Is it possible to run multiple automation apps at the same time from the same automation folder? I'm trying to run multiple apps at the same time to extract data from 40+ tables. I'm running into an issue where it appears the application (v13.2) is locking up and the tables that should take less than 5 min to extract, are taking much longer.
The reason I'm trying to run them parallel is because I need to have the table exports completed in less than 12 hours and having multiple automation apps run parallel seems to be the best option.
Sorry, there's no way to do that. Why is Toad locking up? Is the network connection getting lost to database or something like that? Will solving that problem make this take less than 12 hours?
If you wanted to try to run them in parallel, and you've defined multiple scheduled tasks to run the different apps, you could try opening the items in task scheduler and adding "/VIRTUAL CLEAN" to Toad's parameter list. This will effectively give each instance of Toad its own unique User Files folder in case one of the reasons it's locking up is due to files stepping on each other. However, you'll also need to make sure that each app is defined to export to a common export folder that's not underneath User Files since virtual instances of Toad will automatically try to clean up their user files when finished.
This, however, may not solve your problem. As John mentioned above, the fact it's taking 12 hours may possibly be more related to network, database, or data volume issues; in which case, running in virtual mode may not help much. But, it's definitely worth a try to see if it helps in your environment.
If you can install Toad on a PC with a faster network connection to the database (on the server itself if the DB is running on windows), that should make a big difference if you are exporting a lot of data.
Thank you for the quick responses. The reason it takes about 12 hours is due to the large amount of data I'm exporting from some of the tables. There are a few with 90+ million rows each. If I put all of the extracts in one app it will take over 24 hours to extract all of the data but I need it done in under 12 hours, that's why I set up multiple automation apps in the folder. I haven't set up the scheduler as I'm just trying to get them to run. All of the data from the exports are going to one folder on the network and the Toad installation is on a server. I think there is an issue with running multiple apps at the same time, I just wish there wasn't.
If you schedule them in the Task Scheduler and use the "/VIRTUAL" switch, it should run multiple copies of Toad, each running its own app to export a single table. That should allow you to do what you're looking to do. However, upon a bit further looking, it may be best to not include the "CLEAN" option after the "/VIRTUAL" switch since that will force a clean install and it may be best to make sure all your environment settings and automation settings are intact.
Give that a shot and see if it'll help with what you're trying to do. Also, you may want to try to export them to a local folder first and then copy them to the network after all have finished. That may also help the speed performance.
If Toad appears locked while running....look at the output file. If it is growing, Toad isn't locked. Which export format are you using? (Text or Delimited is fastest).
I definitely agree with John Bowman's point about exporting to a local folder first, then copying the files across the network when done.
I've tried setting them up in the Toad scheduler, which actually creates a Windows Task Scheduler entry. I've tried adding the switch /VIRTUAL but I must be putting it in the wrong place because I'm not seeing these run in parallel. It looks like all but one will stop after a few seconds and the one will continue running.
Where does the switch go? (I've tried googling it but that was zero help).
Thank you for the information. I'm still unable to get this to work. Where does the /VIRTUAL switch go? I've created a Scheduled Item for each of the six Apps that I created. It looks like each one creates a Task in the Windows Task Scheduler. When I run each of them, either in Toad or from Windows, they don't appear to run, which is why I ask about where that switch goes. In the Toad Scheduler Items I put /VIRTUAL in the Parameters field of the Actions tab.
Also, I can see where the task scheduler in Windows starts the task but then in less than a minute it shows that the task completed successfully, which it hadn't.
I just tried it again using Toad 13.2 and it executed successfully. Do you happen to have any system or group policy restrictions which might be preventing you from launching scheduled tasks? Or, can you open Task Scheduler and look to see if Toad is launching in the background? It should appear in the list of "Background Processes" within Windows 10's Task Manager.
Thank you for the information. I was looking at the task scheduler in Toad, and I noticed that the results returned were saying "Incorrect Function". I did a few searches on that and found something regarding the network path that the file should be saved to could be the issue. I have a mapped drive to a network folder and when I just entered the actual network path and not the mapped drive letter, I could see multiple process running. I think that may have been my issue all along. As of right now I have two test processes running in parallel.
