Web Data Extraction - doesn't work in version 5

[Pyt]

Hello forum!

I have a task that ran perfectly on 4 and 4.5 - extract data from a web table with 10.000 rows, use those data to loop through a creation process in another program to create a pdf file for each row of data.

Now, in the new version it seems that it only handles a fraction of the data ammount. If I limit myself to perhaps 1000 rows, it works fine, but with more than that, it doesn't work anymore.

What can I do to fix this? I need to run through 130.000 users, and like I said, it previous versions it worked with chunks of 10.000 users. Now it doesn't.

Thanks.

Jens Pytlich, Denmark.

[forumsupport]

Hello,

Can you please email us your task at http://www.tethyssolutions.com/support_form.htm so that one of our Technical Support staffs can help you resolve the problem?

In addition, can you please tell us, are you getting an error? If yes, can you please send us screenshot of it so that we can actually see?

It would help us investigate further.

[Pyt]

Task submitted.

I have solved my problem somewhat, by limiting the number of records to 2000 per run.

Now I have another problem - I cannot use a variable in the URL for "Extract Table" - this means that I have to manually change the recordset to the next one, every time the scrips runs. Is it possible to change the URL per script run? All I really need, is the ability the put a variable into the URL for the data extraction. It's possible every where else, just not in this particular URL.

Thanks again,

Jens Pytlich, Denmark

[forumsupport]

Hello,

We have not received your task.

If for next record, the layout of webpage is same then Web recorder will take care of changing parameters in a URL. Extract Table command will take care of dynamic URL in that case.

We have attached a sample task for your reference. This task will browse through all the online samples on Tethys website one by one. Table on webpage has two columns Task number and Task name. In each iteration task will click on respective task name link, will extract the description of that task into excel and will come back to page having list of tasks. In that way task will browse through all the sample tasks.

If you could send us URL of website and steps to automate the task, we would be able to create a specific task for you.

Hope that helps.