Worker either hung or the API didn't close the connection

We probably need to add a hard timeout on the groutine.
Logs:

Apr 22 15:54:19 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251057]:  not found in the config file. Using default.
Apr 22 15:54:19 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251057]: INFO 2024-04-22 15:54:19,088 _client.py:1026 HTTP Request: POST https://merlinite-7b-vllm-openai.apps.fmaas-backend.fmaas.res.ibm.com/v1/chat/completions "HTTP/1.1 200 OK"
Apr 22 15:54:21 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T15:54:21.266Z        INFO        cmd/generate.go:683        Job took 27s to run
Apr 22 15:54:21 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T15:54:21.284Z        INFO        cmd/generate.go:554        Job done        {"job": "182", "pr_number": "730", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin", "out_dir": "/home/fedora/instruct-lab-bot/precheck-pr-730-458892bc2b34c55bbe5e4fb3ae827475a54214b7"}
Apr 22 17:13:33 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:33.046Z        INFO        cmd/generate.go:377        Processing job 183        {"job": "183"}
Apr 22 17:13:33 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:33.207Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 2/5        {"job": "183", "pr_number": "730", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 17:13:35 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:35.354Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 3/5        {"job": "183", "pr_number": "730", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 17:13:37 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:37.503Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 4/5        {"job": "183", "pr_number": "730", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 17:13:39 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:39.597Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 5/5        {"job": "183", "pr_number": "730", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 17:13:43 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T17:13:43.973Z        INFO        cmd/generate.go:878        SDG Post Details: &{POST https://datagen-service-predictor-fmaas-rhods-testing.apps.fmaas-devstage-backend.fmaas.res.ibm.com/skill/datagen HTTP/1.1 1 1 map[Accept:[application/json] Content-Type:[application/json]] {{"created_by":"ae2015","mm_model_id":"mistralai/mixtral-8x7b-instruct-v0-1","num_samples":10,"seed_examples":[{"answer":"(A) To apply for public benefit XYZ, you must provide both your full name and vehicle license plate number\n","context":"To apply for public benefit XYZ, provide the following:\n* Your full name and date of birth\n* Your vehicle license plate number\n","question":"Which of the following is true:\n(A) To apply for public benefit XYZ, you must provide both your full name and vehicle license plate number\n(B) To apply for public benefit XYZ, you must provide either your full name or vehicle license plate number\n"},{"answer":"(A) When requesting IRS help, an employee must provide both name and SSN.\n","context":"Form W-2. If you were an employee, you should receive Form W-2 from your employer. You will need the information from this form to prepare your return. See Form W-2 under Credit for Withholding and Estimated Tax for 2023 in chapter 4. Your employer is required to provide or send Form W-2 to you no later than January 31, 2024. If it is mailed, you should allow adequate time to receive it before contacting your employer. If you still don't get the form by early February, the IRS can help you by requesting the form from your employer. When you request IRS help, be prepared to provide the following information.\n* Your name, address (including ZIP code), and phone number.\n* Your SSN.\n* Your dates of employment.\n* Your employer's name, address (including ZIP code), and phone number.\n","question":"Which of the following is true:\n(A) When requesting IRS help, an employee must provide both name and SSN.\n(B) When requesting IRS help, an employee must provide either name or SSN.\n"},{"answer":"(A) If your address is outside the U.S., you must enter both foreign country name and foreign postal code.\n","context":"Foreign address. If your address is outside the United States or its territories, enter the city name on the appropriate line of your Form 1040 or 1040-SR. Don't enter any other information on that line, but also complete the spaces below that line.\n1. Foreign country name.\n2. Foreign province/state/county.\n3. Foreign postal code.\nDon't abbreviate the country name. Follow the country's practice for entering the postal code and the name of the province, county, or state.\n","question":"Which of the following is true:\n(A) If your address is outside the U.S., you must enter both foreign country name and foreign postal code.\n(B) If your address is outside the U.S., you must enter either foreign country name or foreign postal code.\n"},{"answer":"(A) To transfer the vehicle's title, you must have both your driver's license number and vehicle license plate number.\n","context":"TITLE TRANSFERS\nWhen you buy a vehicle, you need to transfer the vehicle's title to establish yourself as the new legal owner.\nBefore you begin:\n1. Have the California Certificate of Title with you. Make sure the title has been signed by the buyer(s), seller(s), and lienholder (if applicable).\nNote: If you do not have the title, complete an Application for Replacement or Transfer of Title (REG 227).\n2. Have the following:\n* Your driver's license number\n* Vehicle license plate number\n* Vehicle identification number (VIN)\n* Legal owner (or lienholder) name and address\n* Vehicle make, model, and year\n* Purchase date and price\n3. Be able to pay the transfer fee. All transfer fees are the responsibility of the buyer.\n4. Allow 30 days from the day DMV receives your documents to process your title transfer.\n","question":"Which of the following is true:\n(A) To transfer the vehicle's title, you must have both your driver's license number and vehicle license plate number.\n(B) To transfer the vehicle's title, you must have either your driver's license number or vehicle license plate number.\n"},{"answer":"(A) When you arrive at a DMV office, you will need both correct fee(s) for your application and residency document.\n","context":"To apply for an ID, you must complete a Driver License and Identification Card application and pay any fees. For current ID fees, visit www.dmv.ca.gov.\n1.  Before visiting a DMV office:\n* Gather the identity, residency, and SSN documents you need to apply for an ID card.\n* Effective April 2018 DMV will begin offering an online DL and ID application process. Applicants will complete their electronic application before visiting DMV. Be sure to bring your application confirmation with you to your office visit.\n* Make an appointment before visiting a DMV office. Appointments can be made online at www.dmv.ca.gov or by calling 1-800-777-0133. You may also verify payment options available at the DMV office.\n2.  When you arrive at a DMV office, you will need:\n* Correct fee(s) for your application.\n* Original or certified documents(s) establishing identity, birth date, true full name.\n* Original document establishing proof of SSN if applying for a REAL ID Compliant ID.\n* Residency Document.\nThe DMV representative may give you a number and/or direct you to wait. When it is your turn, you will be called to a window to process your application.\n","question":"Which of the following is true:\n(A) When you arrive at a DMV office, you will need both correct fee(s) for your application and residency document.\n(B) When you arrive at a DMV office, you will need either correct fee(s) for your application or residency document.\n"}],"task_description":"Understand when a bullet list of items means that the items are needed jointly rather than separately.\n"}} 0x6c14c0 5587 [] false datagen-service-predictor-fmaas-rhods-testing.apps.fmaas-devstage-backend.fmaas.res.ibm.com map[] map[] <nil> map[]   <nil> <nil> <nil> {{}}}
Apr 22 18:45:05 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: Stopping labbotworker.service - Instruct Lab GitHub Bot Worker...
Apr 22 18:45:05 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: 2024-04-22T18:45:05.300Z        INFO        cmd/generate.go:187        Shutting down
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: labbotworker.service: State 'stop-sigterm' timed out. Aborting.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: labbotworker.service: Killing process 236324 (instruct-lab-bo) with signal SIGABRT.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: SIGABRT: abort
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: PC=0x46f7c1 m=0 sigcode=0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 0 [idle]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.futex()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/sys_linux_amd64.s:557 +0x21 fp=0x7ffd274be410 sp=0x7ffd274be408 pc=0x46f7c1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.futexsleep(0x7ffd274be488?, 0x442456?, 0x7ffd274be488?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/os_linux.go:69 +0x30 fp=0x7ffd274be460 sp=0x7ffd274be410 pc=0x437490
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.notesleep(0x1678d48)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/lock_futex.go:160 +0x87 fp=0x7ffd274be498 sp=0x7ffd274be460 pc=0x410a27
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.mPark(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:1634
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.stoplockedm()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:2775 +0x73 fp=0x7ffd274be4f0 sp=0x7ffd274be498 pc=0x442633
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.schedule()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:3556 +0x3a fp=0x7ffd274be528 sp=0x7ffd274be4f0 pc=0x44447a
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.park_m(0xc0001e1380?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:3740 +0x11f fp=0x7ffd274be570 sp=0x7ffd274be528 pc=0x4449ff
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.mcall()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:458 +0x4e fp=0x7ffd274be588 sp=0x7ffd274be570 pc=0x46b9ae
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 1 [semacquire, 4538 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xc0001873c0?, 0x0?, 0x0?, 0xe0?, 0x41f216?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc0005053a0 sp=0xc000505380 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goparkunlock(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:404
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.semacquire1(0xc00028e008, 0x18?, 0x1, 0x0, 0x2b?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/sema.go:160 +0x218 fp=0xc000505408 sp=0xc0005053a0 pc=0x44ebf8
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: sync.runtime_Semacquire(0xc00029c018?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/sema.go:62 +0x25 fp=0xc000505440 sp=0xc000505408 pc=0x469c05
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: sync.(*WaitGroup).Wait(0xc00007e5a0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/sync/waitgroup.go:116 +0x48 fp=0xc000505468 sp=0xc000505440 pc=0x4797a8
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.glob..func1(0x1671be0, {0xf4989a?, 0x4?, 0xf49756?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:200 +0x765 fp=0xc000505920 sp=0xc000505468 pc=0xd6ec25
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/spf13/cobra.(*Command).execute(0x1671be0, {0xc0002144d0, 0x7, 0x7})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:987 +0xaa3 fp=0xc000505ac0 sp=0xc000505920 pc=0xc36543
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/spf13/cobra.(*Command).ExecuteC(0x1671ec0)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1115 +0x3ff fp=0xc000505b98 sp=0xc000505ac0 pc=0xc36e1f
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/spf13/cobra.(*Command).Execute(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1039
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.Execute()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/root.go:35 +0x1a fp=0xc000505be0 sp=0xc000505b98 pc=0xd7975a
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: main.main()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/main.go:26 +0x22a fp=0xc000505f40 sp=0xc000505be0 pc=0xd7b7ea
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.main()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:267 +0x2bb fp=0xc000505fe0 sp=0xc000505f40 pc=0x43dc3b
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000505fe8 sp=0xc000505fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 2 [force gc (idle), 3 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xa0d11d07af8b6?, 0x0?, 0x0?, 0x0?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000062fa8 sp=0xc000062f88 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goparkunlock(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:404
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.forcegchelper()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:322 +0xb3 fp=0xc000062fe0 sp=0xc000062fa8 pc=0x43df13
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.init.6 in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:310 +0x1a
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 3 [GC sweep wait]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0x1677901?, 0x0?, 0x0?, 0x0?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000063778 sp=0xc000063758 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goparkunlock(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:404
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.bgsweep(0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000637c8 sp=0xc000063778 pc=0x429d1f
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcenable.func1()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:200 +0x25 fp=0xc0000637e0 sp=0xc0000637c8 pc=0x41ee85
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcenable in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:200 +0x66
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 4 [GC scavenge wait]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0x1678200?, 0xe5973?, 0x0?, 0x0?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000063f70 sp=0xc000063f50 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goparkunlock(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:404
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.(*scavengerState).park(0x1678200)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000063fa0 sp=0xc000063f70 pc=0x4275a9
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.bgscavenge(0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000063fc8 sp=0xc000063fa0 pc=0x427b59
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcenable.func2()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:201 +0x25 fp=0xc000063fe0 sp=0xc000063fc8 pc=0x41ee25
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcenable in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:201 +0xa5
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 5 [finalizer wait, 90 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0x0?, 0xc000024108?, 0x0?, 0x0?, 0x1000000010?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000078e20 sp=0xc000078e00 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.runfinq()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mfinal.go:193 +0x107 fp=0xc000078fe0 sp=0xc000078e20 pc=0x41dea7
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.createfing in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mfinal.go:163 +0x3d
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 6 [select, 4538 minutes, locked to thread]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xc0000647a8?, 0x2?, 0x29?, 0xe3?, 0xc0000647a4?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000064638 sp=0xc000064618 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.selectgo(0xc0000647a8, 0xc0000647a0, 0x0?, 0x0, 0x0?, 0x1)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/select.go:327 +0x725 fp=0xc000064758 sp=0xc000064638 pc=0x44dbc5
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.ensureSigM.func1()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000647e0 sp=0xc000064758 pc=0x464cbf
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000647e8 sp=0xc0000647e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.ensureSigM in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/signal_unix.go:997 +0xc8
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 18 [syscall]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.notetsleepg(0xffffffffffffffff?, 0xc00005e728?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/lock_futex.go:236 +0x29 fp=0xc00005e7a0 sp=0xc00005e768 pc=0x410d09
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: os/signal.signal_recv()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/sigqueue.go:152 +0x29 fp=0xc00005e7c0 sp=0xc00005e7a0 pc=0x46a369
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: os/signal.loop()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/os/signal/signal_unix.go:23 +0x13 fp=0xc00005e7e0 sp=0xc00005e7c0 pc=0x6ea833
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00005e7e8 sp=0xc00005e7e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by os/signal.Notify.func1.1 in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/os/signal/signal.go:151 +0x1f
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 34 [chan send, 70 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc0002bde08 sp=0xc0002bdde8 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.chansend(0xc00004b3e0, 0xc0002bdf48, 0x1, 0xc000098280?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/chan.go:259 +0x3a5 fp=0xc0002bde78 sp=0xc0002bde08 pc=0x40ac85
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.chansend1(0xc0004286f0?, 0xc000428708?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/chan.go:145 +0x17 fp=0xc0002bdea8 sp=0xc0002bde78 pc=0x40a8d7
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.glob..func1.2(0x0?, 0xc00004b440)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:178 +0x25f fp=0xc0002bdfc0 sp=0xc0002bdea8 pc=0xd6f3df
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.glob..func1.7()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:181 +0x2b fp=0xc0002bdfe0 sp=0xc0002bdfc0 pc=0xd6f14b
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0002bdfe8 sp=0xc0002bdfe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by github.com/instructlab/instructlab-bot/worker/cmd.glob..func1 in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:159 +0x545
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 36 [select, 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xc0003a7078?, 0x6?, 0xdc?, 0x89?, 0xc0003a6e8c?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc0003a6d10 sp=0xc0003a6cf0 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.selectgo(0xc0003a7078, 0xc0003a6e80, 0xf4fef2?, 0x0, 0xc0003a6f38?, 0x1)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/select.go:327 +0x725 fp=0xc0003a6e30 sp=0xc0003a6d10 pc=0x44dbc5
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*persistConn).roundTrip(0xc000143200, 0xc00029e5c0)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:2652 +0x979 fp=0xc0003a70e8 sp=0xc0003a6e30 pc=0x6d9979
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Transport).roundTrip(0xc0002cb040, 0xc0001bac00)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:604 +0x79a fp=0xc0003a7310 sp=0xc0003a70e8 pc=0x6cdcfa
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Transport).RoundTrip(0x452d2f?, 0x10b2bc0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/roundtrip.go:17 +0x13 fp=0xc0003a7330 sp=0xc0003a7310 pc=0x6c4973
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.send(0xc0001bac00, {0x10b2bc0, 0xc0002cb040}, {0xc000016001?, 0x1751?, 0x0?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/client.go:260 +0x606 fp=0xc0003a7560 sp=0xc0003a7330 pc=0x69a6a6
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Client).send(0xc00044c600, 0xc0001bac00, {0x4783aa?, 0xc0000a2bd0?, 0x0?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/client.go:181 +0x98 fp=0xc0003a75d8 sp=0xc0003a7560 pc=0x699f38
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Client).do(0xc00044c600, 0xc0001bac00)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/client.go:724 +0x912 fp=0xc0003a77e8 sp=0xc0003a75d8 pc=0x69c212
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Client).Do(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/client.go:590
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.(*Worker).datagenSvc(0xc0000a6640, {0xc00004c010, 0x1, 0x1?}, {0xc0004ab6e0, 0x55}, 0x11?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:880 +0x5ff fp=0xc0003a79f8 sp=0xc0003a77e8 pc=0xd7643f
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.(*Worker).processJob(0xc0000a6640)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:530 +0x15e5 fp=0xc0003a7ed0 sp=0xc0003a79f8 pc=0xd72985
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.glob..func1.4(0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:196 +0x172 fp=0xc0003a7fc8 sp=0xc0003a7ed0 pc=0xd6ee72
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: github.com/instructlab/instructlab-bot/worker/cmd.glob..func1.9()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:198 +0x27 fp=0xc0003a7fe0 sp=0xc0003a7fc8 pc=0xd6ecc7
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0003a7fe8 sp=0xc0003a7fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by github.com/instructlab/instructlab-bot/worker/cmd.glob..func1 in goroutine 1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /home/fedora/worker-intruct-lab-bot/instruct-lab-bot/worker/cmd/generate.go:192 +0x755
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 11 [GC worker (idle), 3 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xa0d11d087a7ba?, 0x3?, 0xfc?, 0xca?, 0xc0002967a8?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000296750 sp=0xc000296730 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcBgMarkWorker()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1295 +0xe5 fp=0xc0002967e0 sp=0xc000296750 pc=0x420a05
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0002967e8 sp=0xc0002967e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcBgMarkStartWorkers in goroutine 20
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1219 +0x1c
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 21 [GC worker (idle), 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xa081f6e705537?, 0x3?, 0xf0?, 0xe5?, 0xc0001d6f00?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000297750 sp=0xc000297730 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcBgMarkWorker()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1295 +0xe5 fp=0xc0002977e0 sp=0xc000297750 pc=0x420a05
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0002977e8 sp=0xc0002977e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcBgMarkStartWorkers in goroutine 20
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1219 +0x1c
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 12 [GC worker (idle), 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xa081eef50e121?, 0x3?, 0xcb?, 0x9a?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000064f50 sp=0xc000064f30 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcBgMarkWorker()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1295 +0xe5 fp=0xc000064fe0 sp=0xc000064f50 pc=0x420a05
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000064fe8 sp=0xc000064fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcBgMarkStartWorkers in goroutine 20
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1219 +0x1c
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 13 [GC worker (idle), 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xa081f6e7057a9?, 0x3?, 0xa3?, 0xa9?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc000065750 sp=0xc000065730 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gcBgMarkWorker()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1295 +0xe5 fp=0xc0000657e0 sp=0xc000065750 pc=0x420a05
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000657e8 sp=0xc0000657e0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by runtime.gcBgMarkStartWorkers in goroutine 20
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/mgc.go:1219 +0x1c
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 476 [IO wait, 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0x9abbad317f79a4cf?, 0xb?, 0x0?, 0x0?, 0x9?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc0002be5c8 sp=0xc0002be5a8 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.netpollblock(0x48e218?, 0x408b66?, 0x0?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/netpoll.go:564 +0xf7 fp=0xc0002be600 sp=0xc0002be5c8 pc=0x436857
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: internal/poll.runtime_pollWait(0x7f6d9a2c4960, 0x72)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/netpoll.go:343 +0x85 fp=0xc0002be620 sp=0xc0002be600 pc=0x468385
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: internal/poll.(*pollDesc).wait(0xc000022180?, 0xc00027c000?, 0x0)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0002be648 sp=0xc0002be620 pc=0x512f07
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: internal/poll.(*pollDesc).waitRead(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: internal/poll.(*FD).Read(0xc000022180, {0xc00027c000, 0x1000, 0x1000})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc0002be6e0 sp=0xc0002be648 pc=0x5141fa
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net.(*netFD).Read(0xc000022180, {0xc00027c000?, 0xc00027c724?, 0x71a?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/fd_posix.go:55 +0x25 fp=0xc0002be728 sp=0xc0002be6e0 pc=0x5c1225
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net.(*conn).Read(0xc0000664c0, {0xc00027c000?, 0x0?, 0xc0004048b8?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/net.go:179 +0x45 fp=0xc0002be770 sp=0xc0002be728 pc=0x5d1425
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net.(*TCPConn).Read(0xc0002be808?, {0xc00027c000?, 0xc00039c030?, 0x18?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         <autogenerated>:1 +0x25 fp=0xc0002be7a0 sp=0xc0002be770 pc=0x5e2405
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: crypto/tls.(*atLeastReader).Read(0xc00039c030, {0xc00027c000?, 0xc00039c030?, 0x0?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/crypto/tls/conn.go:805 +0x3b fp=0xc0002be7e8 sp=0xc0002be7a0 pc=0x62041b
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: bytes.(*Buffer).ReadFrom(0xc0004049a8, {0x10b3920, 0xc00039c030})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/bytes/buffer.go:211 +0x98 fp=0xc0002be840 sp=0xc0002be7e8 pc=0x481cb8
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: crypto/tls.(*Conn).readFromUntil(0xc000404700, {0x10b56e0?, 0xc0000664c0}, 0x8e1?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/crypto/tls/conn.go:827 +0xde fp=0xc0002be880 sp=0xc0002be840 pc=0x6205fe
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: crypto/tls.(*Conn).readRecordOrCCS(0xc000404700, 0x0)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/crypto/tls/conn.go:625 +0x250 fp=0xc0002bec20 sp=0xc0002be880 pc=0x61dbd0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: crypto/tls.(*Conn).readRecord(...)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/crypto/tls/conn.go:587
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: crypto/tls.(*Conn).Read(0xc000404700, {0xc000035000, 0x1000, 0xe8c811?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/crypto/tls/conn.go:1369 +0x158 fp=0xc0002bec90 sp=0xc0002bec20 pc=0x623e98
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*persistConn).Read(0xc000143200, {0xc000035000?, 0x40a805?, 0x60?})
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:1954 +0x4a fp=0xc0002becf0 sp=0xc0002bec90 pc=0x6d618a
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: bufio.(*Reader).fill(0xc0003af1a0)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc0002bed28 sp=0xc0002becf0 pc=0x66b563
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: bufio.(*Reader).Peek(0xc0003af1a0, 0x1)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/bufio/bufio.go:151 +0x53 fp=0xc0002bed48 sp=0xc0002bed28 pc=0x66b693
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*persistConn).readLoop(0xc000143200)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:2118 +0x1b9 fp=0xc0002befc8 sp=0xc0002bed48 pc=0x6d6f79
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Transport).dialConn.func5()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:1776 +0x25 fp=0xc0002befe0 sp=0xc0002befc8 pc=0x6d57a5
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0002befe8 sp=0xc0002befe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by net/http.(*Transport).dialConn in goroutine 472
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:1776 +0x169f
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: goroutine 477 [select, 92 minutes]:
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.gopark(0xc0002b9f90?, 0x2?, 0xe0?, 0x9d?, 0xc0002b9f1c?)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/proc.go:398 +0xce fp=0xc0002b9db8 sp=0xc0002b9d98 pc=0x43e08e
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.selectgo(0xc0002b9f90, 0xc0002b9f18, 0xc00029e780?, 0x0, 0xc00044d890?, 0x1)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/select.go:327 +0x725 fp=0xc0002b9ed8 sp=0xc0002b9db8 pc=0x44dbc5
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*persistConn).writeLoop(0xc000143200)
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:2421 +0xe5 fp=0xc0002b9fc8 sp=0xc0002b9ed8 pc=0x6d8945
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: net/http.(*Transport).dialConn.func6()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:1777 +0x25 fp=0xc0002b9fe0 sp=0xc0002b9fc8 pc=0x6d5745
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: runtime.goexit()
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0002b9fe8 sp=0xc0002b9fe0 pc=0x46d9a1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: created by net/http.(*Transport).dialConn in goroutine 472
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]:         /usr/lib/golang/src/net/http/transport.go:1777 +0x16f1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rax    0xca
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rbx    0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rcx    0x46f7c3
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rdx    0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rdi    0x1678d48
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rsi    0x80
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rbp    0x7ffd274be450
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rsp    0x7ffd274be408
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r8     0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r9     0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r10    0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r11    0x286
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r12    0x4448e0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r13    0xc0000647a4
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r14    0x16785e0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: r15    0x1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rip    0x46f7c1
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: rflags 0x286
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: cs     0x33
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: fs     0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[236324]: gs     0x0
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: labbotworker.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: labbotworker.service: Failed with result 'timeout'.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: Stopped labbotworker.service - Instruct Lab GitHub Bot Worker.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: labbotworker.service: Consumed 2min 17.260s CPU time.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal systemd[1]: Started labbotworker.service - Instruct Lab GitHub Bot Worker.
Apr 22 18:45:50 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:50.471Z        INFO        cmd/generate.go:133        Starting generate worker
Apr 22 18:45:51 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:51.474Z        INFO        cmd/generate.go:377        Processing job 185        {"job": "185"}
Apr 22 18:45:51 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:51.623Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 2/5        {"job": "185", "pr_number": "737", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 18:45:53 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:53.697Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 3/5        {"job": "185", "pr_number": "737", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 18:45:55 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:55.766Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 4/5        {"job": "185", "pr_number": "737", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 18:45:57 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:45:57.837Z        INFO        cmd/generate.go:597        Retrying fetching updates, attempt 5/5        {"job": "185", "pr_number": "737", "work_dir": "/home/fedora/instruct-lab-bot", "origin": "origin"}
Apr 22 18:46:02 ip-172-31-13-79.us-east-2.compute.internal instruct-lab-bot-worker[251701]: 2024-04-22T18:46:02.461Z        INFO        cmd/generate.go:330        Running the precheck command: /usr/local/bin/ilab chat --quick-question can you solve the following riddle? Two turkeys in front of the turkey, two turkeys behind the turkey, tell me how many total turkeys? --tls-insecure --endpoint-url https://merlinite-7b-vllm-openai.apps.fmaas-backend.fmaas.res.ibm.com/v1/ --model /shared_model_storage/transformers_cache/models--ibm--merlinite-7b/snapshots/233d12759d5bb9344231dafdb51310ec19d79c0e

Turns out the job was taking a long time (2 hours to run)

actions:
@vishnoianil is adding one.
Add proof of life logging during the job. It's hard to tell if the worker is just waiting on the API call results or dead. We haven't seen anything hang yet but for this scenario it would have been helpful.

This was a result of an SDG job with context taking 2 hours. Worker was fine. Raised context issue with backend.


Check if Portable WinPython works with DS features

On python-vscode-2019.11.50794, experience is still a mixed bag. Do I guess right the awesomeness miletstone shall be "DS: February 2020 Release" ?

It's working rather nicely with latest VSCode-1.48.0, python-vscode-2020.8.101144.
(in latest Winpython64-<IP_ADDRESS>codrc.exe)
Remaining issues are standard issues:

no sound (VSCode security)
%matplotlib widget working so so reliably (typical of %matplotlib widget)


CWL support (resolves #403)

Continued from #404

The CWL test seems to require Docker which is currently not installed on toil-jenkins-slave.

Jenkins, test this please.

Jenkins, test this please.


Bug fix for tidl-j6

Thanks for contributing to TVM!   Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from Reviewers by @ them in the pull request thread.

@trevor-m This PR has a few fixes in TIDL annotation. Please review. Thanks.


Searching with scope "sub" does not include baseDN on Samba 4.7.6

Hi, we've found an issue (on current branch next) with subtree-scoped searches against Samba 4.7.6 LDAP not returning the base DN when they should.
Assuming baseDN = 'CN=Users,DC=ad,DC=example,DC=org' and a DIT with only the Users container (no objects underneath it):

ldapsearch -b "cn=Users,dc=ad,dc=example,dc=org" -s sub '(objectClass=container)' :heavy_check_mark: works - returns exactly 1 entry (the Users container)
client.search(baseDN, { scope: 'base', filter: new EqualityFilter({ attribute: 'objectClass', value: 'container' }) }) :heavy_check_mark: works - returns exactly 1 entry
client.search(baseDN, { scope: 'sub', filter: new EqualityFilter({ attribute: 'objectClass', value: 'container' }) }) :x: does not work - returns exactly 0 entries - this should be impossible!

What is more concerning is that it seems that it behaves differently on Samba 4.11 (not sure why, but probably because of some opaque internal LDB handling changes).
We initially thought it was caused by #602, but even after fixing the race condition and using our fork of the library, the issue remained. The queries looked legit, but we decided to compare the generated BER on the wire with the actual messages sent by ldapsearch.
There's only 1 difference: whitespace in DNs:

ldapsearch sends the DNs as-is, without processing: CN=Users,DC=ad,DC=example,DC=org
ldapjs re-formats DNs like this: cn=Users, dc=ad, dc=example, dc=org - with spaces as separators!

What's strange is that RFC 4514 (String Representation of Distinguished Names) does not seem to imply spaces are valid RDN separators. In fact, the only separator it defines is , (comma, or U+002C).
Why it works with scope: 'base' is beyond me, but when we tested ldapsearch with a re-formatted baseDN with spaces inserted with scope sub, we got the same results as with ldapjs (0 results). This means the spaces really are extraneous.
This looks related to #151 and the defaults it established. I'm really surprised it hasn't caused a bigger number of issues till now.
I wonder about @mcavage's comments in #80  on "old LDAP clients" - this implies that "new LDAP clients" (what about servers?) should handle spaces in DNs gracefully, right? It seems non-obvious to me since I can't find an explanation for this special handling of spaces in the RFCs, though human users could of course imply that whitespaces are insignificant (which they are apparently not, to this Samba instance).
For now, I'll get a fix ready that changes the DN serialization in SearchRequest messages to not use spaces. More generally, it seems like a long-standing mistake to add spaces by default if RFC 4514 does not define them as separators. At this point, a change to the default value produced by DN.toString() will likely break people's systems, though, so this "precision" fix that only targets SearchRequest seems like a more viable option.

I think it's pretty clear that the RFC dictates that parts of the DN path should be separated by , and only , (https://tools.ietf.org/html/rfc4514#section-3). Therefore, I would prefer that we only follow the RFC. Spaces are permitted in the values, though. So take caution to not remove all spaces. Also, leading and trailing spaces must be escaped.

It seems like DN already handles this well:
> require('.').parseDN('CN=Users,DC=example\\ ,DC=org').format({ });
'cn=Users, dc="example ", dc=org'
> require('.').parseDN('CN=Users,DC=example\\ ,DC=org').format({ skipSpace: true });
'cn=Users,dc="example ",dc=org'

For now, I'll apply a targeted fix for SearchEntry. @jsumners what shape is next in? It's going to be a breaking release, right? I wonder if it would be wise to cram a global change of default DN formatting in, such that the lib would follow the RFC.

Upon further reflection, I'm not sure if value quoting is actually allowed or understood. I had assumed it looked OK, but I can't find anything concrete to back this up.

next will be a semver major. I am okay with breakages for spec compliance for sure.
I am likely to just cut next as a final release in the next few days.

Aha! I may have found the root cause for the confusion around spaces and quotes:

RFC 1779, released in 1995, allows <spaced-separator>, which, in their BNF, is optional space, a comma or a semicolon, and another optional space
RFC 2253, from Netscape in 1997, says only the canonical form (comma, no spaces) must be produced, but the old form from LDAPv2 must be understood by implementations for backwards compatibility. Also, it allows quoting string values.
RFC 4514, from 2006, only mentions commas, no spaces around them. Also, no mention of quotes is to be seen anywhere.

Now, the LDAP RFC (4511, "The Protocol", which obsoletes old LDAP standards) only mentions RFC 4514 as the format of DNs to use on the wire.
This means:

LDAPv3-compliant servers should understand both the "original" LDAPv3 syntax with quoting and the new RFC
If we aim to fully adopt the "new" RFC (which 14 years old, so not exactly bleeding-edge), we should fix the package to always generate DNs without quoting and according to the up-to-date ABNF which is, thankfully, simpler than the old formats

For now, I'll just do a targeted fix that addresses the issue at hand (no spaces between commas in SearchRequest) and preserves the previous behaviour w.r.t. quotes/special chars, but it looks like we should review DN handling in general: spacing, quoting and escaping of special characters.

⚠ This issue has been locked due to age. If you have encountered a recent
problem that seems to be covered by this issue, please open a new issue.
Please include a minimal reproducible example
when opening a new issue.


Error loading syntax file groff:yaml line 29: did not find expected key

Description of the problem or steps to reproduce
Put the groff.yaml file in the syntax directory as specified, whenever I open or save a file I get the error in the title. Not really sure how to fix, removing the (empty) line 29 simply moves the error to line 28.
Specifications
Version: 1.4.1
Commit hash: 1856891
OS: Arch Linux
Terminal: Sakura

Fix: Don't copy paste the file. This can introduce syntax breaking spaces into the files. Save them directly instead. My mistake.


Unable to reproduce the results of nuScenes

I used the default settings to train the nuscenes dataset for 20 epochs.
The results:
2020-10-08 10:55:02,123   INFO  ----------------Nuscene detection_cvpr_2019 results-----------------
***car error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.19, 0.15, 0.08, 0.29, 0.25 | 30.23, 36.51, 39.30, 41.76 | mean AP: 0.3694980287568553
***truck error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.41, 0.21, 0.11, 0.31, 0.26 | 4.47, 11.09, 14.46, 15.67 | mean AP: 0.1142404557716026
***construction_vehicle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.84, 0.49, 1.21, 0.09, 0.48 | 0.00, 0.00, 0.09, 0.45 | mean AP: 0.0013674274124315946
***bus error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.50, 0.19, 0.08, 0.55, 0.19 | 4.98, 14.73, 23.86, 25.58 | mean AP: 0.17285901373045104
***trailer error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.79, 0.22, 0.31, 0.30, 0.28 | 0.00, 0.46, 3.95, 5.42 | mean AP: 0.02460108796236435
***barrier error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.64, 0.29, 0.10, nan, nan | 4.13, 15.49, 24.64, 29.96 | mean AP: 0.1855463415027166
***motorcycle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.23, 0.24, 0.47, 0.73, 0.31 | 15.21, 18.29, 18.97, 19.24 | mean AP: 0.17927265983891655
***bicycle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.25, 0.31, 0.70, 0.43, 0.09 | 0.15, 0.29, 0.33, 0.37 | mean AP: 0.002861717324087194
***pedestrian error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.46, 0.29, 1.17, 0.73, 0.32 | 3.10, 5.27, 6.85, 9.13 | mean AP: 0.06090067635335221
***traffic_cone error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.51, 0.37, nan, nan, nan | 1.99, 3.25, 5.03, 8.77 | mean AP: 0.04758176893069175
--------------average performance-------------
trans_err:       0.4805
scale_err:       0.2753
orient_err:      0.4688
vel_err:         0.4271
attr_err:        0.2718
mAP:     0.1159
NDS:     0.3656

Have you modified the codes or configs? I have trained multiple times and your results are not reasonable.

Have you modified the codes or configs? I have trained multiple times and your results are not reasonable.

I downloaded OpenPCDet from github again and tested the provided nuScenes model.
The default configuration is used.
The result is as follows:
mAP: 0.0537
mATE: 0.6625
mASE: 0.6185
mAOE: 0.6631
mAVE: 0.6382
mAAE: 0.5249
NDS: 0.2161
Eval time: 24.8s
Per-class results:
Object Class    AP      ATE     ASE     AOE     AVE     AAE
car     0.299   0.181   0.153   0.084   0.288   0.261
truck   0.057   0.434   0.249   0.203   0.273   0.250
bus     0.089   0.511   0.186   0.357   0.598   0.222
trailer 0.000   1.000   1.000   1.000   1.000   1.000
construction_vehicle    0.000   1.000   1.000   1.000   1.000   1.000
pedestrian      0.000   1.000   1.000   1.000   1.000   1.000
motorcycle      0.091   0.238   0.267   0.512   0.464   0.356
bicycle 0.000   0.261   0.330   0.812   0.482   0.109
traffic_cone    0.000   1.000   1.000   nan     nan     nan
barrier 0.000   1.000   1.000   1.000   nan     nan
2020-10-20 08:26:37,597   INFO  ----------------Nuscene detection_cvpr_2019 results-----------------
***car error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.18, 0.15, 0.08, 0.29, 0.26 | 26.35, 30.23, 31.24, 31.97 | mean AP: 0.29946538313132837
***truck error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.43, 0.25, 0.20, 0.27, 0.25 | 1.74, 4.78, 7.58, 8.83 | mean AP: 0.05732718808144324
***construction_vehicle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
1.00, 1.00, 1.00, 1.00, 1.00 | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
***bus error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.51, 0.19, 0.36, 0.60, 0.22 | 2.00, 7.19, 12.74, 13.79 | mean AP: 0.08929415627377697
***trailer error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
1.00, 1.00, 1.00, 1.00, 1.00 | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
***barrier error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
1.00, 1.00, 1.00, nan, nan | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
***motorcycle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.24, 0.27, 0.51, 0.46, 0.36 | 7.85, 8.97, 9.60, 9.87 | mean AP: 0.09070364497854315
***bicycle error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
0.26, 0.33, 0.81, 0.48, 0.11 | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
***pedestrian error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
1.00, 1.00, 1.00, 1.00, 1.00 | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
***traffic_cone error@trans, scale, orient, vel, attr |<EMAIL_ADDRESS>1.0, 2.0, 4.0
1.00, 1.00, nan, nan, nan | 0.00, 0.00, 0.00, 0.00 | mean AP: 0.0
--------------average performance-------------
trans_err:       0.6625
scale_err:       0.6185
orient_err:      0.6631
vel_err:         0.6382
attr_err:        0.5249
mAP:     0.0537
NDS:     0.2161

Maybe your nuScenes dataset is corrupted / incomplete.
I was able to reproduce the nuScenes numbers (see below).

Maybe your nuScenes dataset is corrupted / incomplete.
I was able to reproduce the nuScenes numbers (see below).

I also used mmdetection3d to test the nuscenes database and got the correct result.
So, this is not a problem with the dataset.

@yeyang1021 Could you get correct numbers with KITTI pretrained models? And what's your version of spconv, pytorch, gcc, cuda?

@yeyang1021 Could you get correct numbers with KITTI pretrained models? And what's your version of spconv, pytorch, gcc, cuda?
I did not use the pre-trained KITTI model, but the test results of the model, which trained by myself are normal.
gcc version 7.5.0
pytorch 1.1
cuda 10.0
spconv 1.0

When does you download your nuscene models?
I have updated the NuScenes models in 2020-08-10 as mentioned in the changelog of README.md.

When does you download your nuscene models?
I have updated the NuScenes models in 2020-08-10 as mentioned in the changelog of README.md.

Thanks for your reply.
Now I can get the correct test result.
I changed the environment.
pytorch 1.3
cuda 10.0
spconv 1.2

Glad to hear it.


Name provider flags are not mentioned

even though the NameChanger sample uses Name Provider flags in this call, as can be used in FltGetFileNameInformation, the docs do not mention them.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e1002d23-2f37-2eaa-f40b-fa5aba120d5a
Version Independent ID: dc26a275-6cfe-1a71-0e80-376276edba0a
Content: FltGetDestinationFileNameInformation function (fltkernel.h) - Windows drivers
Content Source: wdk-ddi-src/content/fltkernel/nf-fltkernel-fltgetdestinationfilenameinformation.md
Product: windows-hardware
Technology: windows-devices
GitHub Login: @lorihollasch
Microsoft Alias: loriwhip

@alfaunits , thanks for reporting this. I've added file name flags and descriptions to FltGetDestinationFileNameInformation.


Could not find object iI

Checklist

[ ] I'm reporting a broken site support issue
[x ] I've verified that I'm running youtube-dl version 2021.12.17
[ x] I've checked that all provided URLs are alive and playable in a browser
[x ] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x ] I've searched the bugtracker for similar bug reports including closed ones
[ x] I've read bugs section in FAQ

Verbose log

(transcriber) root@transcriber:~# youtube-dl --verbose https://youtube.com/watch?v=Dk2QFXMHM88
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://youtube.com/watch?v=Dk2QFXMHM88']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python 3.10.11 (CPython x86_64 64bit) - Linux-5.19.0-46-generic-x86_64-with-glibc2.36 - OpenSSL 1.1.1t  7 Feb 2023 - glibc 2.36
[debug] exe versions: ffmpeg 5.1.1, ffprobe 5.1.1
[debug] Proxy map: {}
[youtube] Dk2QFXMHM88: Downloading webpage
[youtube] Dk2QFXMHM88: Downloading player 8e83803a
ERROR: Signature extraction failed: Traceback (most recent call last):
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1589, in _decrypt_signature
func = self._extract_signature_function(
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1510, in _extract_signature_function
cache_res = res(test_string)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1578, in
return lambda s: initial_function([s])
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 36, in call
return self.func(*args, **kwargs)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 1037, in resf
ret, should_abort = self.interpret_statement(code.replace('\n', ' '), var_stack, allow_recursion - 1)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 441, in interpret_statement
ret, should_return = self.interpret_statement(sub_stmt, local_vars, allow_recursion)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 915, in interpret_statement
return eval_method(), should_return
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 800, in eval_method
self._objects[variable] = self.extract_object(variable)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 952, in extract_object
raise self.Exception('Could not find object ' + objname)
youtube_dl.jsinterp.JSInterpreter.Exception: Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
(caused by Exception('Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1589, in _decrypt_signature
func = self._extract_signature_function(
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1510, in _extract_signature_function
cache_res = res(test_string)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1578, in
return lambda s: initial_function([s])
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 36, in call
return self.func(*args, **kwargs)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 1037, in resf
ret, should_abort = self.interpret_statement(code.replace('\n', ' '), var_stack, allow_recursion - 1)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 441, in interpret_statement
ret, should_return = self.interpret_statement(sub_stmt, local_vars, allow_recursion)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 915, in interpret_statement
return eval_method(), should_return
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 800, in eval_method
self._objects[variable] = self.extract_object(variable)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 952, in extract_object
raise self.Exception('Could not find object ' + objname)
youtube_dl.jsinterp.JSInterpreter.Exception: Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1589, in _decrypt_signature
func = self._extract_signature_function(
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1510, in _extract_signature_function
cache_res = res(test_string)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1578, in
return lambda s: initial_function([s])
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 36, in call
return self.func(*args, **kwargs)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 1037, in resf
ret, should_abort = self.interpret_statement(code.replace('\n', ' '), var_stack, allow_recursion - 1)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 441, in interpret_statement
ret, should_return = self.interpret_statement(sub_stmt, local_vars, allow_recursion)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 915, in interpret_statement
return eval_method(), should_return
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 800, in eval_method
self._objects[variable] = self.extract_object(variable)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 952, in extract_object
raise self.Exception('Could not find object ' + objname)
youtube_dl.jsinterp.JSInterpreter.Exception: Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 825, in wrapper
return func(self, *args, **kwargs)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/YoutubeDL.py", line 846, in __extract_info
ie_result = ie.extract(url)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/common.py", line 535, in extract
ie_result = self._real_extract(url)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 2032, in _real_extract
signature = self._decrypt_signature(sc['s'][0], video_id, player_url)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1599, in _decrypt_signature
raise ExtractorError(
youtube_dl.utils.ExtractorError: Signature extraction failed: Traceback (most recent call last):
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1589, in _decrypt_signature
func = self._extract_signature_function(
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1510, in _extract_signature_function
cache_res = res(test_string)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/extractor/youtube.py", line 1578, in
return lambda s: initial_function([s])
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 36, in call
return self.func(*args, **kwargs)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 1037, in resf
ret, should_abort = self.interpret_statement(code.replace('\n', ' '), var_stack, allow_recursion - 1)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 441, in interpret_statement
ret, should_return = self.interpret_statement(sub_stmt, local_vars, allow_recursion)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 915, in interpret_statement
return eval_method(), should_return
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 800, in eval_method
self._objects[variable] = self.extract_object(variable)
File "/var/miniconda3/envs/transcriber/lib/python3.10/site-packages/youtube_dl/jsinterp.py", line 952, in extract_object
raise self.Exception('Could not find object ' + objname)
youtube_dl.jsinterp.JSInterpreter.Exception: Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
(caused by Exception('Could not find object iI; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.')); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Description

I was using youtube-dl and attempted this video and was presented with a new issue -- The video: https://youtube.com/watch?v=Dk2QFXMHM88
I can play the video and I tried downloading it from the command line as well as in my code and the message is the same. I do not see this issue elsewhere in the issues forum.
Thank you - JM

I can't reproduce this with the master code, or with a recent nightly build:
 ./youtube-dl-20230718 -v -F 'https://youtube.com/watch?v=Dk2QFXMHM88'
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-F', u'https://youtube.com/watch?v=Dk2QFXMHM88']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2023.07.18 [47214e46d] (single file build)
[debug] ** This version was built from the latest master code at https://github.com/ytdl-org/youtube-dl.
[debug] ** For support, visit the main site.
[debug] Python 2.7.18 (CPython i686 32bit) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial - OpenSSL 1.1.1u  30 May 2023 - glibc 2.15
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[youtube] Dk2QFXMHM88: Downloading webpage
[debug] [youtube] Decrypted nsig QaolwXKp7MnaizsPWh => OHgJh6GcgpQTDA
[debug] [youtube] Decrypted nsig wmXojlgp76qQm0xmVw => cITJP9FhgZQUYQ
[info] Available formats for Dk2QFXMHM88:
format code  extension  resolution note
249          webm       audio only tiny   49k , webm_dash container, opus  (48000Hz), 64.69MiB
250          webm       audio only tiny   62k , webm_dash container, opus  (48000Hz), 81.48MiB
251          webm       audio only tiny  119k , webm_dash container, opus  (48000Hz), 155.04MiB
140          m4a        audio only tiny  129k , m4a_dash container, mp4a.40.2 (44100Hz), 168.17MiB
160          mp4        256x144    144p   28k , mp4_dash container, avc1.4d400c, 30fps, video only, 36.56MiB
278          webm       256x144    144p   45k , webm_dash container, vp9, 30fps, video only, 58.83MiB
133          mp4        426x240    240p   52k , mp4_dash container, avc1.4d4015, 30fps, video only, 67.79MiB
242          webm       426x240    240p   69k , webm_dash container, vp9, 30fps, video only, 90.16MiB
134          mp4        640x360    360p   90k , mp4_dash container, avc1.4d401e, 30fps, video only, 117.70MiB
243          webm       640x360    360p  143k , webm_dash container, vp9, 30fps, video only, 186.74MiB
135          mp4        854x480    480p  142k , mp4_dash container, avc1.4d401f, 30fps, video only, 185.16MiB
244          webm       854x480    480p  213k , webm_dash container, vp9, 30fps, video only, 277.02MiB
136          mp4        1280x720   720p  238k , mp4_dash container, avc1.4d401f, 30fps, video only, 309.29MiB
247          webm       1280x720   720p  359k , webm_dash container, vp9, 30fps, video only, 466.68MiB
248          webm       1920x1080  1080p  589k , webm_dash container, vp9, 30fps, video only, 766.27MiB
137          mp4        1920x1080  1080p  680k , mp4_dash container, avc1.640028, 30fps, video only, 884.07MiB
18           mp4        640x360    360p  309k , avc1.42001E, 30fps, mp4a.40.2 (44100Hz), 402.52MiB
22           mp4        1280x720   720p  367k , avc1.64001F, 30fps, mp4a.40.2 (44100Hz) (best)
$

Although the actual crash is different, your diagnostic and line numbers match #32314. Presumably new YT player JS is crashing that version of jsinterp.py in a different way.
Please update your yt-dl code again from the master or from the nightly .tar.gz, or install a nightly build. See #30839.

--force-reinstall may have helped in the first case.


Transaction history

Is there a way to get transaction history (both on-chain and off-chain)? I noticed I spent surprisingly large amount of money when I played with LN, so I'd like to investigate what happened.

Thanks for good input!


TS-4570: Return to TS_HTTP_OS_DNS_HOOK if server address is set.

Using HostDB, Traffic Server will try to connect to all the resolved
IP addresses if the connection fail. However if a plugin sets the
address using some out-of-band knowledge and TSHttpTxnServerAddrSet,
it onlt gets to set the address once.
This change returns the state machine to the OS_DNS_HOOK API callout
so that the plugin can have an opportunity to set a different server
address.

[approve ci]

Ping @SolidWallOfCode @jacksontj @sudheerv @bgaff

FreeBSD build successful! See https://ci.trafficserver.apache.org/job/Github-FreeBSD/342/ for details.

Linux build successful! See https://ci.trafficserver.apache.org/job/Github-Linux/236/ for details.

@SolidWallOfCode Please review.

I think this should be OK. I was concerned about its interaction with transparency but the os_addr_style values are set up to avoid that (e.g. that can be moved to values that prevent checking for transparency again). Is there a provision for unsetting the origin server address, so that a plugin could try an address and if that fails fall back to HostDB?

@SolidWallOfCode I filed TS-4574 to clear the explicit address. However now that I know a bit more about how the DNS resolutions works, the patch there is not really sufficient.
FWIW my current code samples the first DNS address before setting any addresses and restores that if all else fails. For now I'm giving up DNS RR.


Added some getters to handle RGBA as int and RGB / RGBA packed ints.

getRed() Gets the red as an integer. 0-255
getBlue() Gets the blue as an integer. 0-255
getGreen() Gets the green as an integer. 0-255
getAlpha() Gets the alpha as an integer. 0-255
getRGB() Gets the RGB as a packed integer.
getRGBA() Gets the RGBA as a packed integer.

Cool, but the code for RGB construction is not right I believe. It should be (red << 24 | green << 16 | blue << 8 | 255). Alpha is 255 in RGB

Okay, I have changed getRGB to include the alpha component at 255.

What does the calculateDamage method do?

LOL, nice catch. It's just a rough example for showing @lclc98 something. I didn't expect to have to commit again, and forgot to remove the method from the file x)


feat: Bump saucectl runners

Description

Cypress framework version 12.17.4, runner version 10.5.0.
Playwright framework version 1.37.1, runner version 2.21.0 .
TestCafe framework version 3.2.0, runner version 3.1.0.
Motivation and Context

Types of Changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation fix (typos, incorrect content, missing content, etc.)

Hi @lauramthomas , can I get a review for this PR? Thanks!


setconfig()

closes #10

Pull Request Test Coverage Report for Build 41

0 of 5 (0.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-1.5%) to 72.065%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

build/main.js
0
5
0.0%

Totals

Change from base Build 38:
-1.5%

Covered Lines:
307

Relevant Lines:
440

💛  - Coveralls


Snapshots strange behaviour

Hi. I’m trying to set up cross-device saves synchronization and I’m facing strange problem here.
The goal is to check server-side (storage) snapshot for unique device data every time my app is saving or loading and then save processed, up-to-date data to storage.
For example, I’m trying to implement next simple logics:
Device A saves unique ID to snapshot (and creates it).
Device B is trying to load data from snapshot, compares own ID with snapshot’s one and finds out that data is not equal. So that device B writes own ID to snapshot and saves it.
Device B gets up-to-date (own) data on load.
On that moment strange things appear.
Let’s try to load snapshot with device A.
Obtained on open snapshot has data from device B, so that device A is trying to save own ID in its turn.
It commits modified snapshot and gets STATUS_OK.
Device B sees nothing new on load.
Let’s try to load snapshot with device A once again.
Obtained on open snapshot has updated metadata but old (B) content!
Actual data is obtained only in 5-10 minutes.
Is it related to some kind of caching?
What can I do to make it more reliable?
Is it possible to know that snapshot isn’t REALLY applied for certain moment?
I really appreciate any help you can provide.

Thanks for the detailed report.  Do you think you could capture logcat logs of when device "B" is loading and does not get the update and the subsequent loading on "A"?

Sorry for such long response. Finally I've managed to fix it. Seems like this behavior is strongly related to Android account synchronization settings and data usage politics. It was necessary to enable auto synchronization or manually synch AppData/Drive and consider mobile data usage settings for system and Drive application:


All Entries are compulsory to execute Search in Order History Page. (Agent Panel)

Description of the bug
All Entries are compulsory to execute search.
To Reproduce
Steps to reproduce the behavior:

Go to 'https://www.pulseptt.com/agent.html'
Login with valid credential:- 1. User name: john 2. Password: 12345678
Navigate to License Management.
Click Order View order History.
See error.

Expected behavior
Search by Company Name (List with ALL), Agent Name (List with ALL), Order ID (List with ALL) should be implemented. Expiry Date should auto-fill with current date.
Desktop (please complete the following information):
OS: Windows 10
Browser :Version 100.0.4896.60 (Official Build) (64-bit)
Version [0.1.1]

This Bug has not Resolved.


os: TempDir and /var/tmp

On modern Linux /tmp is often mounted as in-memory file system not suitable for large temporary files. Such files or files that should survive a reboot should be stored in /var/tmp. Yet Go does not provide a convenient method to access the latter and most code just use os.TempDir() for temporary files. This leads to bugs like when Docker used /tmp for big temporary image files leading to not-enough-space errors.
So it would be nice to have something like os.PersistentTempDir() that returns /var/tmp on Linux.

I'm not sure whether we want a new function or not, but marking this as Go1.7 to decide.

I don't think /var/tmp would stand for a "permanent" temp directory. The reason why os.TempDir exists is the fragmentation among operating systems where temp files must be written and TempDir is doing fair job and is useful for programs that will be distributed among multiple platforms.
What is the equivalent of persistent temp directory on other platforms? If you are only targeting Linux, why don't you just hardcode /var/tmp?
In any case, TEMPDIR is honored by io.TempDir and ioutil.Tmp* utilities can create directories and files against its value.

I don't think we should blame Go's API for the problem with docker
creating temp. images in tmpfs backed /tmp.
A user facing application should detect free space available if it's
going to create huge temporary files in anywhere, even it's in /var/tmp.
(I'd like if we could add an API to query available free space to the os
package though.)
Go's temp file/dir API respect $TMPDIR, so think it's enough. And
in fact, I've seen systems with $TMPDIR set to /var/tmp and only
applications with hardcoded tmp directory use /tmp.

@minux You are right that one cannot blame Go. In fact after some thinking I think the blame should go to RedHat or whoever first broke the long tradition that /tmp was perfectly OK for big files breaking the existing code. Still, what about changing the default for TempDir to return /var/tmp?

that /tmp was perfectly OK for big files

I can't agree that that was ever the case. And considering the size of my /var partition, you would be more happy with my memory-backed /tmp than my disk-backed /var/tmp.

Still, what about changing the default for TempDir to return /var/tmp?

I would consider this a breaking change. /tmp and /var/tmp are entirely different things. And people certainly wouldn't want large files sticking around because a program failed to clean up behind itself (system crash or similar).
Maybe Docker shouldn't abuse either /tmp nor /var/tmp and look into defining its own path under /var/cache or similar.


Add CI static analysis, address all outstanding warnings

We have now all the static analysis we might ever want!

PMD, Checkstyle and Findbugs for Java code
Detekt for Kotlin
Lint for Android-specific issues

And to make this all possible... SURPRISE CI SWAP!
We're now using CircleCI instead of Travis. Why?

Travis is sloooooow
It took an average of 10 minutes on Travis to get a plain build, and with the static analysis this would've ballooned up to unbearable levels. CircleCI completes a static-analysis build in 1-3 minutes less per build compared to Travis' "naked build" times
CircleCI looks good
Look at that build report page! Nothing else to say ✨
I was curious to use CircleCI
I heard great things about it, and I have to say, while not as flexible/configurable as a Jenkins issue, it's free, fast, flexible enough, and hassle-free. I count that as a win.
You can easily store test reports and build artifacts (including the static analysis report results)
See an example of JUnit test results and of the other reports in a sample build.

Not everything is 100% awesome; in particular, CircleCI only understands the JUnit test reports, but not the other tools', so you still have to fish those out manually. No nice report pages the way Jenkins can generate (yet?). But those are mostly minor things and I feel this is still a big step ahead in the right direction.

Note: this PR is big-ish because it contains a loooot of static analysis fixes, but most of them are very very trivial changes, so it shouldn't be too big. I'm sorry I couldn't keep it smaller, but the build would never be green if I didn't address them all in one go.

@rock3r great! just missing the final on the protected method :)


First implementation of Diff & Patch POC

Pull Request

[x] I have checked for similar PRs.
[x] I have read the contributing guidelines.

Changes

[x] Code
[x] Documentation
[ ] Other:

Description
A PoC implementation of an RDF based diff, delta-exchange, patch process of VEC XML files.

@RainerGanss code beautifing and consolidation still has to be done, but may be you have some comments before this.


Add new filter to check latest showcases and builder tools

I'm currently working on a new feature for users to filter showcases and builder tools by latest projects. I would like to hear your opinion on it.
Currently I'm displaying LAST 10 projects added in the filter. What do you think?

It's awesome to add that in, only thing I'd wonder us are you intending it to be default filter?

It's awesome to add that in, only thing I'd wonder us are you intending it to be default filter?

By default it's showing all of the projects

Cool, only thing I could think of is name (Last va Latest), but either works (esp. as Latest is 6 letters, mught be less consistent visibly)

Cool, only thing I could think of is name (Last va Latest), but either works (esp. as Latest is 6 letters, mught be less consistent visibly)
A bit off imo, unless we come up with better design

Agree, let's leave it as you have it in PR

Awesome @fill-the-fill 👍


added captcha verification in utils/recaptacha.js

Issue: 22
Short description of what this resolves:

added captcha verification in utils/recaptacha.js

Changes proposed in this pull request and/or Screenshots of changes:

added captcha verification in utils/recaptacha.js

Not all changes done.


bug: Deployments action is failing in CI

Bug Report
Deployments is failing
https://github.com/kkrt-labs/kakarot/actions/workflows/deployments.yml
Fix asap

@Eikix if we look at the logs, it seems this is coming from Infura, I guess just make sure that the Infura key is right or has not expired and that should probably fix this.


feat(app): add new icons for sun and moon

Description

Fixes WB-NNNNN
Fixes #NNNN

What does the PR do? Include a concise description of the PR contents.
Testing
How was this PR tested?

Could you try using the addicon script in devtools: https://github.com/wandb/devtools/blob/main/docs/addicon.md
It does things like replace colors with currentColor

I gave this a shot and it am running into some issues. I ran the official installer for poetry, then tried following the rest of the steps but receive errors. When was the last time this was tested?
curl -sSL https://install.python-poetry.org | python3 -
Retrieving Poetry metadata

The latest version (1.8.5) is already installed.

poetry install --no-root
zsh: command not found: poetry

addicon command wasn't found in weave or core. 🤔


Add aim tracker for accelerate

Adds support for Aim
cc @gorarakelyan to make sure it all seems alright with you! I thought about an easy set_context func but since our trackers all work off an abstract base class, seemed easier to just leave it as a kwarg. Let me know if there's something I seem to have missed! (Based this off my no-accelerate training script I wrote)
Accelerator will automatically only log on the main process and initialize the trackers on the main process, hence why there isn't any special "Are we on the main process" things in this PR.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@muellerzr the tracker looks awesome! Is there any example training script, which I can run to test out the integration? Thanks a million!

@gorarakelyan you can follow the directions here for installing the git version of accelerate + configuring it for your system:
https://huggingface.co/docs/accelerate/basic_tutorials/install
And then feel free to run the nlp_example.py script found in the examples directory here: https://github.com/huggingface/accelerate/blob/main/examples/nlp_example.py
Just make sure to also install transformers and datasets first :)

@muellerzr thanks, will test it out soon! 🤗