The batch of 8 files all processed within two hours last night. (See the output below.) That's a full 20 minutes ahead of the 4 that ran on Thursday. I chalk the improved performance up to there being less happening on the servers on a Friday night.
Given that level of success, I plan to run the remaining batches starting tonight at 7:00 pm. I'll have it run 8 at a time and give it the full list of remaining commands. It should finish sometime Sunday night or early Monday morning.
My next blog post will explain how I'm doing this, so watch this space.
dispatched: /openils/bin/authority_control_fields.pl --start_id=11 --end_id=21439 1 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=21441 --end_id=43928 2 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=43931 --end_id=65785 3 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=65791 --end_id=86020 4 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=86026 --end_id=102506 5 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=102507 --end_id=119262 6 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=119263 --end_id=136363 7 of 8 running dispatched: /openils/bin/authority_control_fields.pl --start_id=136364 --end_id=152938 8 of 8 running 1 of 8 processed 7 of 8 running 2 of 8 processed 6 of 8 running 3 of 8 processed 5 of 8 running 4 of 8 processed 4 of 8 running 5 of 8 processed 3 of 8 running 6 of 8 processed 2 of 8 running 7 of 8 processed 1 of 8 running 8 of 8 processed 0.01user 0.00system 1:59:44elapsed 0%CPU (0avgtext+0avgdata 14480maxresident)k 752inputs+8outputs (0major+1308minor)pagefaults 0swaps
Oh, wow! I messed up.
ReplyDeleteLooks like I redid the first four files somehow.
I swear I cut them from the original batches list, but guess not.
Still going to run the rest tonight.