E
Excel dweeb
Right now I have a webquery that goes out and gets a page that itself
contains many links to other pages. Then, depending on my user's
choice(s) I have to go out and fetch some 90+ other pages from links
on that first page. This is a very slow process.
What (I think) I need is some way to run some large subset of those 90
webqueries concurrently rather than stepping through them one at a
time from within Excel. Could I write a routine in C# that would take
all of the 90 URLs and send them out in different threads, returning
them to Excel for subsequent processing as they get done? Anybody have
such a routine already? :> And how would I communicate its results
back to an Excel sheet?
It seems clear that my original solution of putting a webquery result
(one of the 90) on a temporary sheet, doing some processing, then
moving on to the next query does not scale well. I'd be better served
to stick the whole result of the query into a variable type String and
doing my processing in memory rather than on a sheet. But, I think to
really speed things up, I need to go the concurrent route.
Am I missing some obvious way to do all this from within Excel? TIA
for any help y'all can provide.
contains many links to other pages. Then, depending on my user's
choice(s) I have to go out and fetch some 90+ other pages from links
on that first page. This is a very slow process.
What (I think) I need is some way to run some large subset of those 90
webqueries concurrently rather than stepping through them one at a
time from within Excel. Could I write a routine in C# that would take
all of the 90 URLs and send them out in different threads, returning
them to Excel for subsequent processing as they get done? Anybody have
such a routine already? :> And how would I communicate its results
back to an Excel sheet?
It seems clear that my original solution of putting a webquery result
(one of the 90) on a temporary sheet, doing some processing, then
moving on to the next query does not scale well. I'd be better served
to stick the whole result of the query into a variable type String and
doing my processing in memory rather than on a sheet. But, I think to
really speed things up, I need to go the concurrent route.
Am I missing some obvious way to do all this from within Excel? TIA
for any help y'all can provide.