Stack Overflow
Stack Overflow

Questions tagged [kimono]

UPDATE: KimonoLabs was acquired by Palantir in early 2016, and no longer supports this product. Kimono is a web-scraping tool by KimonoLabs that turns any data on the web into an API. The user selects data from a web page, and Kimono builds a model of the data. Kimono then provides that data in an API, and revisits the original page periodically to keep the API up-to-date.

Kimono has announced that it will shut down the service on february 29 2016

Kimono is a web-scraping tool by Kimono Labs that turns any data on the web into an API. Using Kimono's browser extension, you define the sites and objects (CSS selectors) you want to crawl. Output formats include JSON, CSV and RSS.

Kimono Labs hosts the crawls and the results. It also supplies API keys and links to the API for a number of commonly used web app frameworks:

  • Curl
  • jQuery
  • Node.js
  • PHP
  • Python 2
  • Python 3
  • Ruby
  • R
  • Go

Crawl scheduling and myriad config options are available. As of the writing of this tag wiki, the Kimono API is in beta.

Further reading

Kimono About

48 questions
4
votes
1 answer

Why is Kimono API responding with a 404?

I am trying to update my kimono API via Google Script in Sheets. There are many urls in the sheet, but I've only shown 2 for this example. I am receiving HTTP error 404. I've checked, and the apikey and id are fine. How can I determine what's…
Łukasz Kozłowski
  • 43
  • 3
2
votes
1 answer

Kimono - Adding GUID to RSS output

I'm using Kimono Labs to scrape data from a web page and create RSS output. Each item includes title, description and unique link. I want to use the feed as a trigger on IFTTT.com, but IFTTT requires that each feed item include a GUID. Is there a…
John Beaudoin
  • 23
  • 2
1
vote
0 answers

How to auto-run crawl on Kimono

I'm using Kimonolabs but I had some problems with the auto crawl. I have seen that Xytrix answered there is a way to start the crawl, but I think that is the same thing if I do it from start's button ... There is a way to do it automatically? I did…
David Herrera García
  • 11
  • 4
1
vote
1 answer

Passing URL to Kimono Desktop

I use KimonoDesktop to do some crawl. Very usefull and ergonomic. But I need to use kimono with my program wrote in NodeJS. I was thinking about call an existing API by using an url. Something like that is explain here. However I need to change the…
flexbrane
  • 11
  • 1
1
vote
0 answers

New to Kimono, having problems editing an API

I'm looking for an easy to use but fast web scraping tool. I recently started experimenting with Kimono after the acquisition of Kimono and transition to a desktp app. I got stuck when I tried to go back and edit and finish my API. I tried to follow…
Joel
  • 11
  • 5
1
vote
1 answer

Kimono Desktop crawl stuck at "Queued"

I'm using Kimono Desktop to crawl a site and posting the data to a Firebase endpoint. Everything is working from beginning to end with the exception of auto-running. When creating or editing the Kimono API with the Chrome extension the desktop app…
George Hinchliffe
  • 11
  • 2
1
vote
1 answer

Kimono desktop source URLs to csv

I have a list of multiple URLs for use with a Kimono desktop API I created, but for the life of me I can't figure out how to make it clear in the data output (csv) what rows of results come from which source URL. Is there a way to pull in the…
saijay
  • 11
  • 2
1
vote
0 answers

Setting limits & offsets with import.io

I'm looking at moving over from kimonolabs to import.io since they're now shutting down soon. I have 2 questions related to import.io and parameters which are allowed when making api requests. 1 - Is it possible to set to set limits for the data…
Tunds
  • 1,804
  • 2
  • 15
  • 30
1
vote
1 answer

Using regular expressions in a css selector

Im scraping a page using Kimono and Ive come across some data that is structured as below. The issue is that all of the data is stored in an element called
some entries only have one of these elements, some have…
sam
  • 9,486
  • 36
  • 109
  • 160
1
vote
2 answers

Kimono XPath for pagination without next>

Don't understand how to paginate for kimono scraping without next> in navigation i.e. for paging structure:
1 2 3
AndriuZ
  • 648
  • 6
  • 26
1
vote
1 answer

How to Create a Web Hook URL through Parse.com?

I have a service (KimonoLabs.com) that I want to link with Parse.com. I need to provide a webhook URL that will push data to Parse.com. How can this be done in Parse.com?
Nathan Schafer
  • 21
  • 2
1
vote
2 answers

Kimono Labs API suddenly stops working

I've created API with Kimono Labs, to generate RSS feed from a website. It is working ok, crawling data every hour, however every several days it just stop working. No errors, nothing. It the crawl history i can see, that previous crawls was…
Andrew Shtern
  • 11
  • 3
1
vote
1 answer

Posting Data with Kimonolabs Webhook

I stuck at the problem, that if I want to post my Kimono Data via Webhook in my Database it gives me a JSON like this: { "name": "",..."results": {"collection1": [{ ...}]} The problem is that these kind of JSON creates one single row in my…
Tobias Dre
  • 31
  • 5
1
vote
2 answers

Kimonolabs - is "Source URLs to crawl from another kimono API" dynamic

I've built two APIs with Kimonlabs. API "A" gets a list of URLs. API "B" gets several values from a web page. I've set the crawl strategy for "B" to "URLs from Source API", and set the API to "A". My question is about whether the list of URLs that…
user5229120
1
vote
0 answers

Kimono Labs regex

Kimono Labs uses this for their basic regex expression: /^()(.*?)()$/. The documentation claims the first bracket holds the text before the beginning of the captured expression, the middle bracket holds the captured expression, and the end bracket…
GBin
  • 31
  • 7
1
2 3 4