WhiteHatBox
Share Page
Following(0)
Partner(s)
buckwildn16

Question about scrape

ReplyThanks 2016/12/08 11:07:42 0 0
I am trying to scrape info from brickseek using the scraper function "scrape some text" I want to scrape the store info, the qty and price. I can do this perfectly fine with the scrape one text and then add it to my table but what I would like to do is do this in one action with the scrape some text command. The problem lies when I try to select control it highlights but no elements pop into the tree therefor when I choose find html there is nothing there. I don't have a good grasp on multilevel scraping if thats what needs done here and I have watched the tutorial but, cant get that to work for this specific page. I know there is a way if someone can give me a little direction.
Aprilcaicai
2016/12/08 21:56:32
We have created a simple module to show you how to scrape multiple texts on this page. And please set the settings on the scrape action like the below photo shows. https://drive.google.com/open?id=0B7CsX9k-imncaW42QWNtcGYzbEk

buckwildn16
2016/12/09 00:51:53
oh247 is me asking for permission to see the file. my other email
Aprilcaicai
2016/12/09 03:00:12
Sorry cannot understand what you mean
buckwildn16
2016/12/09 03:34:09
I thought you meant there was a simple module for download at the link above. I tried using the method listed in the pic above but when I go to level 2 and select the control I want to scrape still nothing happens. Please have a look at http://brickseek.com/target-inventory-checker/?sku=207-29-0180 then enter 46222 in the zipcode field and submit. Then on the page that appears I am trying to scrape the information for the product: Store, qty, and price. The method above is not working for me. I tried for hours to find a solution but the only way I can work it is to scrape the 3 into their own variable then add them to a table. Your method would be much more efficient but I cant get it working. Can you advise?
Aprilcaicai
2016/12/09 05:01:35

We have created a simple module for you, and the value it scraped out has included some html code, please go to edit it by yourself.

/editor/attached/file/20161209/20161209050044_0395.dat

If there is still problem for it, please go to search some video to view first. I think it will be helpful to you.

buckwildn16
2016/12/10 02:00:41

Thanks very much exactly what I needed to get me pointed in the right direction. I am having a bit of trouble with the table loop on a different section of the program though. In addition to using your method I added in routines to strip all of the html from the final table. Worked great left me with 20 or so columns like this:

Canton43670Ford Rd Canton, MI 48187-3101734-454-1133(55.7 Miles),0,0,$N.A.


the 2nd zero represents my SaleableQTY which is what I am working with on this table loop. I made a table loop with an if statement. If FinalTable Equals 0 then

Variable Operate Delete the first row from the table.


Now the problem:

The loop works fine for about 10 rows then it throws a false. I wrote the table to a file so I could verify the position and characters were right here is the results it did not delete:

Canton
43670 Ford Rd
Canton, MI 48187-3101
734-454-1133
(55.7 Miles),0,0,$N.A.
Allen Park
3100 Fairlane Dr
Allen Park, MI 48101-2870
313-768-0064
(56.2 Miles),0,0,$N.A.
Westland
35401 Warren Rd
Westland, MI 48185-6590
734-728-4444
(57.2 Miles),0,0,$N.A.
Dearborn Heights
26650 Ford Rd
Dearborn Heights, MI 48127-2841
313-565-0404
(57.6 Miles),0,0,$N.A.
Dearborn
15901 Ford Rd
Dearborn, MI 48126-2800
313-336-5000
(59.1 Miles),0,0,$N.A.
Livonia
29451 Plymouth Rd
Livonia, MI 48150-2112
734-793-0637
(59.8 Miles),0,0,$N.A.
West Livonia
20100 Haggerty Rd
Livonia, MI 48152-1087
734-953-6620
(63.6 Miles),0,0,$N.A.
Farmington Hills
30020 Grand River Ave
Farmington Hills, MI 48336-4722
248-476-1808
(65.5 Miles),0,0,$N.A.
Novi
27100 Wixom Rd
Novi, MI 48374-1115
248-374-1282
(66.9 Miles),0,0,$N.A.
Jackson
1076 Jackson Xing
Jackson, MI 49202-2039
517-788-3900
(67.5 Miles),0,0,$N.A.

if I create a 2nd if it deletes a few more but still doesnt clear the whole table. Is this a possible bug? Also thanks so much for your time. I own other bot makers and I love this one compared to those. I just wanna get this part fixed cause its a vital part of the bot I am making.

What I am trying to do is find available products and if they are found on row 1 email to op and if they arent found on the 1st row delete the row.

Aprilcaicai
2016/12/11 22:21:59

What you mean is that if this column's value in the red circle is 0, and then deletes this row?
If so you can judge it before you add this row to your Table, if this column's value is 0, and then delete this row directly, so no need to add it to the Table.


<< < 1> >>
VerifyCode
Advanced Option