Skip to content

Instantly share code, notes, and snippets.

View shiondev's full-sized avatar

Shion Deysarkar shiondev

4 followers · 0 following
View GitHub Profile
@shiondev
shiondev / products_reviewsFlat-CSV-example.csv
Created June 29, 2017 00:49
products_reviewsFlat-CSV-example.csv
We can make this file beautiful and searchable if this error is corrected: Unclosed quoted field in line 2.
id,asins,brand,categories,colors,count,dateAdded,dateUpdated,descriptions,dimension,ean,features,flavors,imageURLs,isbn,keys,manufacturer,manufacturerNumber,merchants,name,prices,quantities,reviews.date,reviews.dateAdded,reviews.dateSeen,reviews.didPurchase,reviews.doRecommend,reviews.id,reviews.numHelpful,reviews.rating,reviews.sourceURLs,reviews.text,reviews.title,reviews.userCity,reviews.userProvince,reviews.username,sizes,skus,sourceURLs,upc,vin,websiteIDs,weight
"AVpiQm_p1cnluZ0-LhKc","B002KI7QZW","SquareTrade","Electronics,Electronics Warranties,Electronics, Electronics Warranties",,,"2015-09-20T22:28:35Z","2016-07-28T12:50:41Z",,,,"[{""key"":""material"",""value"":[""[]""]}]",,"http://ecx.images-amazon.com/images/I/41Z-RA9b3hL._SY300_QL70_.jpg,http://ecx.images-amazon.com/images/I/41Z-RA9b3hL._SS40_.jpg",,"squaretrade2yearelectronicsprotectionplan250300/b002ki7qzw,squaretrade/rdce0299n2b",,"RD-CE0299N2B",,"Squaretrade 2-year Electronics Protection Plan ($250-300)",,,,,,,,,,,,,,,,,,,"http://www.amazon.c
@shiondev
shiondev / product_basicFields-CSV-example.csv
Created May 23, 2017 15:58
product_basicFields-CSV-example.csv
id brand categories manufacturer name sourceURLs
AVpgRL7qLJeJML43LfPj Sparco Envelopes,Fax Paper,Forms,Paper,Stationery,All Paper & Printable Media,Office,Paper & Printable Media,Office Supplies,Paper, Forms & Envelopes,Sparco,Paper & Stationery Sparco Products Sparco Economy 7-inch Thermal Fax Paper (box of 6) https://www.overstock.com/Office-Supplies/Sparco-Economy-7-inch-Thermal-Fax-Paper-Box-of-6/9519127/product.html
AVpgRL7qLJeJML43LfPj Sparco Envelopes,Fax Paper,Forms,Paper,Stationery,All Paper & Printable Media,Office,Paper & Printable Media,Office Supplies,Paper, Forms & Envelopes,Sparco,Paper & Stationery Sparco Products Sparco Economy 7-inch Thermal Fax Paper (box of 6) http://www.walmart.com/ip/Sparco-Products-Fax-Paper-1-2-Core-H-Sensitivity-8-1-2-x98-White/22856854?action=product_interest&action_type=title&item_id=22856854&placement_id=irs-2-m3&strategy=PWBAB&visitor_id&category=&customer_id_enc&config_id=2&parent_item_id=15140199&parent_anchor_item_id=15140199&bucket_id=irsbucketdefault&beac
@shiondev
shiondev / products_pricesflat-CSV-example.csv
Last active April 24, 2017 18:52
products_pricesFlat-CSV-example.csv
We can make this file beautiful and searchable if this error is corrected: Any value after quoted field isn't allowed in line 2.
id,asins,brand,categories,colors,count,dateAdded,dateUpdated,descriptions,dimension,ean,features,flavors,imageURLs,isbn,keys,manufacturer,manufacturerNumber,merchants,name,prices.amountMin,prices.amountMax,prices.availability,prices.color,prices.condition,prices.count,prices.currency,prices.dateAdded,prices.dateSeen,prices.flavor,prices.isSale,prices.merchant,prices.offer,prices.returnPolicy,prices.shipping,prices.size,prices.source,prices.sourceURLs,prices.warranty,quantities,reviews,sizes,skus,sourceURLs,upc,vin,websiteIDs,weight
"AVpfBXYtLJeJML430pLJ",,"Hansa","Toys & Hobbies,Stuffed Animals,Hansa",,,"2015-11-01T04:15:04Z","2015-11-01T04:15:04Z",,,,"[{""key"":""Year"",""value"":[""2004""]},{""key"":""Condition"",""value"":[""New""]}]",,"http://i.ebayimg.com/images/g/EBUAAOSwWnFWBHIe/s-l300.jpg",,"stuffedhansaowl9tallnewwithtag2004/231727014821",,,"[{""dateSeen"":[""2015-10-31T00:00:00Z""],""name"":""Modprims - Ebay.com""}]","Stuffed Hansa Owl 9" Tall New With Tag 2004",12.99,12.99,,,"New",,"USD","2015-11-0
@shiondev
shiondev / products_all-CSV-example.csv
Last active February 3, 2017 19:19
products_all CSV example
We can make this file beautiful and searchable if this error is corrected: Unclosed quoted field in line 2.
id,asins,brand,categories,colors,count,dateAdded,dateUpdated,descriptions.dateSeen,descriptions.sourceURLs,descriptions.value,dimension,ean,features.key,features.value,flavors,websiteID,imageURLs,isbn,keys,manufacturer,manufacturerNumber,merchants.address,merchants.availability,merchants.city,merchants.country,merchants.dateSeen,merchants.name,merchants.phone,merchants.postalCode,merchants.province,name,prices.amountMin,prices.amountMax,prices.availability,prices.color,prices.condition,prices.count,prices.currency,prices.dateAdded,prices.dateSeen,prices.flavor,prices.isSale,prices.merchant,prices.offer,prices.returnPolicy,prices.shipping,prices.size,prices.source,prices.sourceURLs,prices.warranty,reviews.date,reviews.dateAdded,reviews.dateSeen,reviews.didPurchase,reviews.doRecommend,reviews.numHelpful,reviews.rating,reviews.sourceURLs,reviews.text,reviews.title,reviews.userCity,reviews.username,reviews.userProvince,sizes,skus.sourceURLs,skus.value,sourceURLs,upc,vin,weight
"AVnjo8-lD1GB75FR6uL3",,,,,,"2015-08
@shiondev
shiondev / shoe_example.csv
Last active January 16, 2017 16:28
Shoe Example
We can make this file beautiful and searchable if this error is corrected: It looks like row 2 should actually have 71 columns, instead of 7 in line 1.
id,asins,brand,categories,colors,count,dateAdded,dateUpdated,descriptions.dateSeen,descriptions.sourceURLs,descriptions.value,dimension,ean,features.key,features.value,flavors,id,imageURLs,isbn,keys,manufacturer,manufacturerNumber,merchants.address,merchants.availability,merchants.city,merchants.country,merchants.dateSeen,merchants.name,merchants.phone,merchants.postalCode,merchants.province,name,prices.amountMin,prices.amountMax,prices.availability,prices.color,prices.condition,prices.count,prices.currency,prices.dateAdded,prices.dateSeen,prices.flavor,prices.isSale,prices.merchant,prices.offer,prices.returnPolicy,prices.shipping,prices.size,prices.source,prices.sourceURLs,prices.warranty,reviews.date,reviews.dateAdded,reviews.dateSeen,reviews.didPurchase,reviews.doRecommend,reviews.numHelpful,reviews.rating,reviews.sourceURLs,reviews.text,reviews.title,reviews.userCity,reviews.username,reviews.userProvince,sizes,skus.sourceURLs,skus.value,sourceURLs,upc,vin,weight
AVkyrhGsUmTPEltRbV2b,,Incharacter,,,,2016-0
@shiondev
shiondev / datafinit_request_status_completed.json
Last active April 26, 2016 17:26
Datafiniti Request Status Completed
[
{
"id": 37,
"query": "name%3A%22dog%20food%22&20AND%20price%3A%2A",
"dataType": "product",
"accountId": "12345678912345678",
"planId": "free",
"view": "products_all_json",
"async": 0,
"status": "COMPLETED",
@shiondev
shiondev / sample_df_pr.json
Last active August 29, 2015 14:24
Sample Datafiniti Property Data Feed
{
"total": 176456,
"records": [
{
"address": "8524 Crownwood Dr",
"city": "Laredo",
"country": "US",
"dateUpdated": "2015-07-08T11:08:51Z",
"encoding": "utf-8",
"features": [
@shiondev
shiondev / sample_df_bl.json
Created April 30, 2015 21:57
Sample Datafiniti Business List
{
"total": 4977,
"records": [
{
"address": "4021 Vista Park Ct",
"categories": [
"auto dealers",
"van dealers"
],
"city": "Sacramento",
@shiondev
shiondev / sample_df_pp.json
Last active August 29, 2015 14:20
Sample Datafiniti Product Pricing Data Feed
{
"total": 3400,
"records": [
{
"categories": [
"pets",
"dogs",
"dog food"
],
"dateUpdated": "2015-04-01T16:35:47Z",
@shiondev
shiondev / url_filter.js
Created April 30, 2015 04:04
URL filter example
this.parseLinks = function(html, url, headers, status, jQuery) {
var app = this;
var $ = jQuery;
var $html = app.parseHtml(html, $);
var links = [];
// gets all links in the html document
$html.find('a').each(function(i, obj) {
// console.log($(this).attr('href'));
var link = app.makeLink(url, $(this).attr('href'));