Application Insights resources

Is there a roadmap for creating App Insights resources via the CLI without resorting to resource create?

For the record, this is how I'm doing it now. But being able to do this in a cleaner way and also having a command to create and retrieve application instrumentation keys would be nice:
	az resource create \
		--resource-group $RESOURCE_GROUP \
		--resource-type "Microsoft.Insights/components" \
		--name $NAMESPACE_PREFIX-appinsights \
		--location $PRIMARY_LOCATION \
		--properties '{"ApplicationId":"facerecognition","Application_Type":"other", "Flow_Type":"Redfield", "Request_Source":"IbizaAIExtension"}'

Thanks for your interest @rcarmo.
cc/ @mayurid @twitchax

Thanks for the command..
The below should help retrieve application instrumentation keys
az resource show -g $RESOURCEGROUPNAME -n $APPLICATION_NAME --resource-type "Microsoft.Insights/components" --query properties.InstrumentationKey

Thanks for the tips, but any ETA on when there will be an az insights cli command?

Does anyone know how to create an API key through the CLI?

This does work. However, when I "connect" the resulting Application Insights to an app service (function app) by using the instrumentation key the Application Map seems not to work. Any ideas on that?

I've looped in the right people at MS to see this thread!

Thank you @markheath, file approach did work for me.

The file approach works just as expected, but if you anybody wants to use the command in PowerShell without writing to a file, the JSON can be escaped adding a \ in the double quotes works, like this:
az resource create --resource-group myresourcegroup --name myappinsights --resource-type Microsoft.Insights/components --location southcentralus --properties '{\"Application_Type\":\"web\"}'
(taking the @kuvinodms code as an example)

@NicoSorrenti thanks - I thought I'd tried that, but I'll give it another go. Would be nice to simplify that.

Closing. PR made from @alexeldeib has taken care of this.
To use it, please run "az extension add -n application-insights", and you will see related commands under monitor app-insights. Once commands are stabilized, we will move them to CLI's core monitor command module


TypeError: 'type' object is not subscriptable

Thanks for your opensource, when I try to run this model, I face the following problem:
File "/mnt/nfs/dev-aigc-0/data1/xiuyuanqin/work/vocos/vocos/modules.py", line 109, in ResBlock1
dilation: tuple[int] = (1, 3, 5),
TypeError: 'type' object is not subscriptable
could you help me with this problem?

I have fixed this problem by up the python verision from 3.8 to 3.9

I have fixed this problem by up the python verision from 3.8 to 3.9
I tried, but it still couldn't

upgrade to python 3.10 or use
from typing import Tuple
Tuple[int]


fix(fetch): fetch client can now override headers with options

Status

READY
Description
fix #1622
The fetch client could not override header with options, so i fixed it.
Before
The fetch client could not override headers with options because headers implement after ...options so headers is always fixed.
return customFetch<Promise<createPetsResponse>>(getCreatePetsUrl(), {
  ...options,
  method: 'POST',
  headers: { 'Content-Type': 'application/json' },
  body: JSON.stringify(createPetsBodyItem),
});

After
headers implement contains ...options?.headers
return customFetch<Promise<createPetsResponse>>(getCreatePetsUrl(), {
  ...options,
  method: 'POST',
  headers: { 'Content-Type': 'application/json', ...options?.headers },
  body: JSON.stringify(createPetsBodyItem),
});

Related PRs
none
Todos

[x] Tests
[x] Documentation
[x] Changelog Entry (unreleased)

Steps to Test or Reproduce
You can check by using sample app.

oh nice, thanks for fixing!


TooManyRedirects: Exceeded 30 redirects

I followed your suggestion on the Server Error issue:

Anyway, the most common reason for a 500 error is the Internet Archive rate-limiting you. My suggestion is to turn the --rate-limit-wait parameter higher! It defaults to 5 seconds; I'd try 30 or even 60.

I tried 30 and this happens:
Microsoft Windows [Version 10.0.18363.1082]
(c) 2019 Microsoft Corporation. All rights reserved.

C:\Users\yewhe\Downloads>archiver --file fest.txt --rate-limit-wait 30
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 48, in mapstar
    return list(map(*args))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\wayback_machine_archiver\archiver.py", line 35, in call_archiver
    r = session.head(request_url, allow_redirects=True)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 553, in head
    return self.request('HEAD', url, **kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 518, in request
    resp = self.send(prep, **send_kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in send
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in <listcomp>
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 137, in resolve_redirects
    raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects, response=resp)
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\yewhe\AppData\Local\Programs\Python\Python38-32\Scripts\archiver.exe\__main__.py", line 7, in <module>
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\wayback_machine_archiver\archiver.py", line 243, in main
    pool.map(partial_call, archive_urls)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 771, in get
    raise self._value
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

Here's the txt file with urls I attempted to archive:
fest.txt

Interesting error! I've never seen this one before.
I would guess it's a single URL from your list that has some weird script redirection, or something else like that. I'll rerun with logging and see what happens.

I haven't been able to reproduce this. Can you use pip to upgrade to the newest version (1.9.0) and run:
archiver --file ./fest.txt --rate-limit-wait 30 --log DEBUG > out.log 2>&1

That's what it would be on Linux, not sure on Windows. The > out.log 2>&1 is just saving the debug and error log to a file, but you can leave those out and copy/paste the output here as well.

It appears to run successfully without errors, but the last entry of the log file says otherwise:
DEBUG:root:Arguments: Namespace(archive_sitemap=False, file='./fest.txt', jobs=1, log_file=None, log_level='DEBUG', rate_limit_in_sec=30, sitemaps=[], urls=[])
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
INFO:root:Parsing sitemaps
INFO:root:Reading urls from file: ./fest.txt
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/wellness
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/hub
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2019-2
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-lineup
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/personnel
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/videos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/photos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/past-shows
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-10th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-saturday-jan-11th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-17th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/marathon-map
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/archive
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/about
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/sponsorship
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/contact
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2018
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/jazz-for-kids
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year
DEBUG:root:Archive URLs: {'https://web.archive.org/save/https://www.winterjazzfest.com/2020-saturday-jan-11th', 'https://web.archive.org/save/https://www.winterjazzfest.com/jazz-for-kids', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-17th', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-10th', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018', 'https://web.archive.org/save/https://www.winterjazzfest.com/contact', 'https://web.archive.org/save/https://www.winterjazzfest.com/past-shows', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2019-2', 'https://web.archive.org/save/https://www.winterjazzfest.com/wellness', 'https://web.archive.org/save/https://www.winterjazzfest.com/hub', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj', 'https://web.archive.org/save/https://www.winterjazzfest.com/personnel', 'https://web.archive.org/save/https://www.winterjazzfest.com/', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest', 'https://web.archive.org/save/https://www.winterjazzfest.com/about', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon', 'https://web.archive.org/save/https://www.winterjazzfest.com/archive', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-lineup', 'https://web.archive.org/save/https://www.winterjazzfest.com/photos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes', 'https://web.archive.org/save/https://www.winterjazzfest.com/sponsorship', 'https://web.archive.org/save/https://www.winterjazzfest.com/marathon-map', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation', 'https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2020'}
ERROR:root:520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 48, in mapstar
    return list(map(*args))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\yewhe\AppData\Local\Programs\Python\Python38-32\Scripts\archiver.exe\__main__.py", line 7, in <module>
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\wayback_machine_archiver\archiver.py", line 243, in main
    pool.map(partial_call, archive_urls)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 771, in get
    raise self._value
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020

Can you make sure you're running 1.9.0? I added more logging that prints the version number, and I don't see it in the above log. 1.9.0 should fix the 520 issue (or at least if they don't show up more than 5 times in a row).

For some reason, after I tried updating, the archiver version is still 1.8.1.

Since you have already installed Archiver, you should be able to run pip with --upgrade, which upgrades an already installed package. Something like pip install --upgrade --user wayback-machine-archiver.

I updated archiver to 1.9.0 and used archiver --file ./fest.txt --rate-limit-wait 30 --log DEBUG. It's been like this for more than 6 hours and it doesn't seem to have finished:
C:\Users\yewhe\Downloads\archiver files>archiver --file ./fest.txt --rate-limit-wait 30 --log DEBUG
DEBUG:root:Archiver Version: 1.9.0
DEBUG:root:Arguments: Namespace(archive_sitemap=False, file='./fest.txt', jobs=1, log_file=None, log_level='DEBUG', rate_limit_in_sec=30, sitemaps=[], urls=[])
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
INFO:root:Parsing sitemaps
INFO:root:Reading urls from file: ./fest.txt
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/wellness
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/hub
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2019-2
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-lineup
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/personnel
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/videos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/photos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/past-shows
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-10th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-saturday-jan-11th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-17th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/marathon-map
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/archive
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/about
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/sponsorship
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/contact
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2018
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/jazz-for-kids
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year
DEBUG:root:Archive URLs: {'https://web.archive.org/save/https://www.winterjazzfest.com/archive', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon', 'https://web.archive.org/save/https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes', 'https://web.archive.org/save/https://www.winterjazzfest.com/', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-17th', 'https://web.archive.org/save/https://www.winterjazzfest.com/past-shows', 'https://web.archive.org/save/https://www.winterjazzfest.com/personnel', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-saturday-jan-11th', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-lineup', 'https://web.archive.org/save/https://www.winterjazzfest.com/sponsorship', 'https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th', 'https://web.archive.org/save/https://www.winterjazzfest.com/contact', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2019-2', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax', 'https://web.archive.org/save/https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation', 'https://web.archive.org/save/https://www.winterjazzfest.com/photos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj', 'https://web.archive.org/save/https://www.winterjazzfest.com/hub', 'https://web.archive.org/save/https://www.winterjazzfest.com/jazz-for-kids', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-10th', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest', 'https://web.archive.org/save/https://www.winterjazzfest.com/about', 'https://web.archive.org/save/https://www.winterjazzfest.com/wellness', 'https://web.archive.org/save/https://www.winterjazzfest.com/marathon-map', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out'}
ERROR:root:520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/
Traceback (most recent call last):
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/

:-/
I haven't been able to reproduce the "Too Many Redirects" issue, and I haven't got a 520 error since updating the retry logic to cover 520s.

I tried again and this time it seems to be a 520 error. Strange.
Microsoft Windows [Version 10.0.18363.1139]
(c) 2019 Microsoft Corporation. All rights reserved.

C:\Users\yewhe\Downloads\archiver files>archiver --file ./fest.txt --rate-limit-wait 30 --log DEBUG
DEBUG:root:Archiver Version: 1.9.0
DEBUG:root:Arguments: Namespace(archive_sitemap=False, file='./fest.txt', jobs=1, log_file=None, log_level='DEBUG', rate_limit_in_sec=30, sitemaps=[], urls=[])
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
DEBUG:requests.packages.urllib3.util.retry:Converted retries value: Retry(total=5, connect=None, read=None, redirect=None, status=None) -> Retry(total=Retry(total=5, connect=None, read=None, redirect=None, status=None), connect=None, read=None, redirect=None, status=None)
INFO:root:Parsing sitemaps
INFO:root:Reading urls from file: ./fest.txt
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/wellness
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/hub
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2019-2
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-lineup
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/personnel
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/videos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/photos-2020
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/past-shows
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-10th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-saturday-jan-11th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/2020-friday-jan-17th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/marathon-map
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/archive
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/about
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/sponsorship
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/contact
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/talks-2018
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/jazz-for-kids
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come
DEBUG:root:Creating archive URL for https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year
DEBUG:root:Archive URLs: {'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/23/thank-you-for-joining-us-at-2020-winter-jazzfest', 'https://web.archive.org/save/https://www.winterjazzfest.com/piedmont-blues-a-search-for-salvation', 'https://web.archive.org/save/https://www.winterjazzfest.com/photos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added', 'https://web.archive.org/save/https://www.winterjazzfest.com/past-shows', 'https://web.archive.org/save/https://www.winterjazzfest.com/about', 'https://web.archive.org/save/https://www.winterjazzfest.com/videos-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-saturday-jan-11th', 'https://web.archive.org/save/https://www.winterjazzfest.com/archive', 'https://web.archive.org/save/https://www.winterjazzfest.com/hub', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/7/just-announced-seu-jorge-at-the-town-hall', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/thx-for-attending-2019-wjf-see-you-next-year', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2019-2', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2020', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/24/tickets-on-sale-friday-1025-at-12-noon-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/artemis-just-added-to-eubanks-evans-experience-allison-miller-boom-tic-boom-at-lpr-on-jan-13th', 'https://web.archive.org/save/https://www.winterjazzfest.com/personnel', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/16/2020-nyc-winter-jazzfest-initial-lineup-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018', 'https://web.archive.org/save/https://www.winterjazzfest.com/', 'https://web.archive.org/save/https://www.winterjazzfest.com/amendola-vs-blades-w/-skerik-mark-guiliana-space-heroes', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/16/wjf-closing-night-show-with-mark-guiliana-beat-music-improvisations-at-nublu-is-sold-out', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/marathon-artist-lineups-by-day-just-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-17th', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-friday-jan-10th', 'https://web.archive.org/save/https://www.winterjazzfest.com/jazz-for-kids', 'https://web.archive.org/save/https://www.winterjazzfest.com/contact', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/2020-wjf-dates-announced-january-9-18-more-details-to-come', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/11/29/revive-yo-feelings-a-musicians-wellness-benefit-with-robert-glasper-terrace-martin-more-just-added-to-jan-11th-manhattan-marathon', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/6/were-proud-to-be-part-of-prs-foundations-international-keychange-program', 'https://web.archive.org/save/https://www.winterjazzfest.com/wellness', 'https://web.archive.org/save/https://www.winterjazzfest.com/marathon-map', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/30/tickets-on-sale-and-new-shows-announced', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/10/31/new-shows-just-announced-tickets-on-sale-friday-nov-1-at-12-pm-et', 'https://web.archive.org/save/https://www.winterjazzfest.com/news/2020/1/2/new-wjf-talks-just-added-gcpax-mygwj-jm475-bj3fd', 'https://web.archive.org/save/https://www.winterjazzfest.com/sponsorship', 'https://web.archive.org/save/https://www.winterjazzfest.com/2020-lineup'}
ERROR:root:520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018
Traceback (most recent call last):
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018
ERROR:root:520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu
Traceback (most recent call last):
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/news/2019/12/13/opening-night-dj-set-just-added-on-jan-8th-gilles-peterson-lefto-and-kassa-overall-at-nublu
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 48, in mapstar
    return list(map(*args))
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\yewhe\AppData\Local\Programs\Python\Python38-32\Scripts\archiver.exe\__main__.py", line 7, in <module>
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 244, in main
    pool.map(partial_call, archive_urls)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 771, in get
    raise self._value
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/https://www.winterjazzfest.com/talks-2018

Also, archiving with an xml sitemap also gives the 'Exceeded 30 redirects' error after about 30-40 minutes:
I converted the xml file to txt file because Github doesn't support xml: ragina.txt
C:\Users\yewhe\Downloads\archiver files>archiver --sitemaps file://ragina.xml --rate-limit-wait 30
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 48, in mapstar
    return list(map(*args))
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 35, in call_archiver
    r = session.head(request_url, allow_redirects=True)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 553, in head
    return self.request('HEAD', url, **kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 518, in request
    resp = self.send(prep, **send_kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in send
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in <listcomp>
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 137, in resolve_redirects
    raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects, response=resp)
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\yewhe\AppData\Local\Programs\Python\Python38-32\Scripts\archiver.exe\__main__.py", line 7, in <module>
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 244, in main
    pool.map(partial_call, archive_urls)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 771, in get
    raise self._value
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

The XML sitemap vs list of URLs shouldn't make a difference, they're both processed offline (and with good test coverage) to the same format internally and then pass through the same logic. I'll give this list a try.
Do you know which URL caused the redirect error?

For the xml one (ragina.txt in my previous comment), no idea. This time it doesn't say which url, unlike the txt one.

BUT this time it did display the problematic link for this file (also converted to txt because Github):
nyman.txt
Microsoft Windows [Version 10.0.18363.1171]
(c) 2019 Microsoft Corporation. All rights reserved.
C:\Users\yewhe\Downloads\archiver files>archiver --sitemaps file://nyman.xml --rate-limit-wait 30
ERROR:root:520 Server Error: UNKNOWN for url: https://web.archive.org/save/http://www.michaelnyman.com/shop/soundtracks
Traceback (most recent call last):
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 38, in call_archiver
    r.raise_for_status()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\models.py", line 928, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 520 Server Error: UNKNOWN for url: https://web.archive.org/save/http://www.michaelnyman.com/shop/soundtracks
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 48, in mapstar
    return list(map(*args))
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 35, in call_archiver
    r = session.head(request_url, allow_redirects=True)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 553, in head
    return self.request('HEAD', url, **kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 518, in request
    resp = self.send(prep, **send_kwargs)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in send
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 661, in <listcomp>
    history = [resp for resp in gen] if allow_redirects else []
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\site-packages\requests\sessions.py", line 137, in resolve_redirects
    raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects, response=resp)
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\yewhe\AppData\Local\Programs\Python\Python38-32\Scripts\archiver.exe\__main__.py", line 7, in <module>
  File "C:\Users\yewhe\AppData\Roaming\Python\Python38\site-packages\wayback_machine_archiver\archiver.py", line 244, in main
    pool.map(partial_call, archive_urls)
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "c:\users\yewhe\appdata\local\programs\python\python38-32\lib\multiprocessing\pool.py", line 771, in get
    raise self._value
requests.exceptions.TooManyRedirects: Exceeded 30 redirects.

@Melonadev I've pushed v1.9.1 which increase the redirect limit from 30 to 100.
I don't expect this to fix the issue (if you have 30, I suspect it is actually an infinite redirect), but I don't know what else to try!

So, interesting that you noticed a failure with a higher wait time...
Normally these infinite redirects are because the site is using a cookie to know that it has already redirected you and stop. I wonder if, for long wait times, the cookie goes invalid and so the loop doesn't break.
I'll see if I can find some time over the holiday to try that out.

This could be an issue with Wayback Machine itself and not your archiver, but I'm not sure.

Something strange that has been occurring for the past few days: Any of my attempts to save pages directly to the Wayback Machine website using its online form returns 'Job failed.'

To be clear, it's not the fault of archiver, but a rather troubling issue with Wayback Machine itself. This occurs on Microsoft Edge 87.0.664.47, which is already up-to-date.
I'll try this on Firefox, and will report back on my findings later.

I too have been having issues, but through my scheduled runs of my script:

https://twitter.com/RaspberryPion/status/1331522966396366849
https://twitter.com/RaspberryPion/status/1330084311110987777
https://twitter.com/RaspberryPion/status/1328634615423123457

🤷  Let me know if you figure anything out!

I already contacted the Internet Archive team about this issue<EMAIL_ADDRESS>

The online form's working now!

Glad to hear it!

I am running in this or similar issue consistently now.  Not able to use the api to save urls.  It was working, but suddenly running into this issue!
Name: waybackpy
Version: 3.0.6
Summary: Python package that interfaces with the Internet Archive's Wayback Machine APIs. Archive pages and retrieve archived pages easily.
Home-page: https://akamhy.github.io/waybackpy/
Author: Akash Mahanty
Author-email<EMAIL_ADDRESS>License: MIT
Location: /home/nat/.local/lib/python3.8/site-packages
Requires: click, requests, urllib3
Required-by:
Note: you may need to restart the kernel to use updated packages.

<ipython-input-4-9a60b9f17f1c> in save_url(save_url)
      2     user_agent = "Mozilla/5.0 (Windows NT 5.1; rv:40.0) Gecko/20100101 Firefox/40.0"
      3     save_api = WaybackMachineSaveAPI(save_url)
----> 4     save_api.save()

~/.local/lib/python3.8/site-packages/waybackpy/save_api.py in save(self)
    208                 self.sleep(tries)
    209
--> 210             self.get_save_request_headers()
    211             self.saved_archive = self.archive_url_parser()
    212

~/.local/lib/python3.8/site-packages/waybackpy/save_api.py in get_save_request_headers(self)
     87         )
     88         session.mount("https://", HTTPAdapter(max_retries=retries))
---> 89         self.response = session.get(self.request_url, headers=self.request_headers)
     90         # requests.response.headers is requests.structures.CaseInsensitiveDict
     91         self.headers = self.response.headers

~/.local/lib/python3.8/site-packages/requests/sessions.py in get(self, url, **kwargs)
    540
    541         kwargs.setdefault('allow_redirects', True)
--> 542         return self.request('GET', url, **kwargs)
    543
    544     def options(self, url, **kwargs):

~/.local/lib/python3.8/site-packages/requests/sessions.py in request(self, method, url, params, data, headers, cookies, files, auth, timeout, allow_redirects, proxies, hooks, stream, verify, cert, json)
    527         }
    528         send_kwargs.update(settings)
--> 529         resp = self.send(prep, **send_kwargs)
    530
    531         return resp

~/.local/lib/python3.8/site-packages/requests/sessions.py in send(self, request, **kwargs)
    665             # Redirect resolving generator.
    666             gen = self.resolve_redirects(r, request, **kwargs)
--> 667             history = [resp for resp in gen]
    668         else:
    669             history = []

~/.local/lib/python3.8/site-packages/requests/sessions.py in <listcomp>(.0)
    665             # Redirect resolving generator.
    666             gen = self.resolve_redirects(r, request, **kwargs)
--> 667             history = [resp for resp in gen]
    668         else:
    669             history = []

~/.local/lib/python3.8/site-packages/requests/sessions.py in resolve_redirects(self, resp, req, stream, timeout, verify, cert, proxies, yield_requests, **adapter_kwargs)
    164
    165             if len(resp.history) >= self.max_redirects:
--> 166                 raise TooManyRedirects('Exceeded {} redirects.'.format(self.max_redirects), response=resp)
    167
    168             # Release the connection back into the pool.

TooManyRedirects: Exceeded 30 redirects.

failed_links


🐛 Bug Report: catalog backend plugin for MsGraph does not ingest users without email

📜 Description
The default user transformer provided by the MsGraph plugin does not ingest users who do not have an email included in their profile, preventing those users from signing in. This is an issue because email is not a mandatory field when creating an user and therefore not all users will have this field defined.
👍 Expected behavior
Consider ingesting users without email into the catalog by using userPrincipalName as the identifier, instead of email by default by changing the default user transformer. Currently, the user transformer returns the user as undefined if the mail field does not exist.

The userPrincipalName parameter is must exist for each user and is unique

👎 Actual Behavior with Screenshots
Users without user.mail field defined do not get ingested into the catalog.
👟 Reproduction steps

Have an user in the Microsoft Org that does not have an email defined
Check in the catalog after ingestion that the user has not been ingested as expected

📃 Provide the context for the Bug.
Note: A PR was created in the community-plugins repo to add a custom transformer but after discussions, we determined it would be best to have this added to the main repo as it may benefit all users.
🖥 Your Environment
No response
👀 Have you spent some time to check if this bug has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
Yes I am willing to submit a PR!

This makes a lot of sense to me, if there's no email then fall back to the userPrincipalName. We would also need to consider how the resolver works in the Azure auth provider as it looks for email to match on:
https://github.com/backstage/backstage/blob/50e74610355b300f68316817f5d90c0d69bbd307/plugins/auth-backend-module-microsoft-provider/src/resolvers.ts#L33-L53
@afscrome @pjungermann @drodil, as users of this provider any thoughts on this?

Sounds like a valid idea though we haven't encountered such situation yet.

How do we feel about using userPrincipalName as the main identifier instead of using it as a fallback with the email so that we don't need to handle 2 cases with the authentication? Is there any reason why email is used in this case?

Hi @JessicaJHee, as email is the current pattern and it seems to be working for many Adopters who use this entity provider it doesn't make sense to introduce a potential breaking change. The email address is often in the profile for the auth provider and is common pattern there to use like this. Having an email address does help power other features in Backstage more generally speaking.
Anecdotally speaking, based on my experience helping people on Discord, I haven't actually run into this issue till you submitted the PR in the Community Plugins repo. Based on that I'm hesitant to change what is working for many already but do feel like this should be supported as the fallback.

I'll +1 not changing the default behavior to use a UPN over email address - it's a breaking change that'll definitely break my current company's install.  I'm also pretty sure it would have impact at my previous company too.
Whilst a UPN may contain an @ symbol and look like an email address, it may well not be an address you can contact that user on.  For example at my current company for example, my UPN is for an internal domain (e.g. name@corp.COMPANY.com), whereas my email address is<EMAIL_ADDRESS> I will not receive any emails sent to my UPN.  I've also often seen UPNs using the Microsoft default domain (i.e. @TENANT.onmicrosoft.com) rather than the company's primary domain.
I don't think it's a good idea to fudge something into a user's spec.mail which you can't send an email address to.  And we definitely should not use UPN if a specific email address has been provided.
Since spec.email is optional on the User entity, I do think it would be reasonable to modify the defaultUserTransformer to not reject users without email addresses completely.  However rather than fall back to UPN, I think we should just leave spec.email (as well as the email annotation) blank.
https://github.com/backstage/backstage/blob/50e74610355b300f68316817f5d90c0d69bbd307/plugins/catalog-backend-module-msgraph/src/microsoftGraph/defaultTransformers.ts#L125
One knock on effect form this change is that the default email based signInResolver won't work for such users.  Using a UPN wouldn't helper here either as the sign in resolver works specifically with the mail provided by Microsoft which is specifically for the user's mail field, not their UPN.  This can be solved by creating a user id based resolver - mapping info.result.fullProfile.id to the graph.microsoft.com/user-id annotation.

@awanlin @afscrome Thank you both for the detailed feedback! I'll go ahead and open up a PR to leave the mail field blank when it does not exist but still allow the user to be added to the catalog. I won't use the userPrincipalName as suggested.

How do we feel about using userPrincipalName as the main identifier instead of using it as a fallback with the email so that we don't need to handle 2 cases with the authentication? Is there any reason why email is used in this case?

I've been implementing Backstage for a customer that has exactly the same use case:
I also had to build my own transformer to make sure that the userPrincipalName is used as a mail address when the mail address is not provided. Because without a mail the user won't be added to the catalog.
There were some accounts that had no mail, because they didn't have a "mailbox" attached. So they told me to use userPrincipalName instead.
As an extra, I also needed users without any relations to not be added to the catalog.
export async function myUserTransformer(
  graphUser: MicrosoftGraph.User,
  userPhoto?: string,
): Promise<UserEntity | undefined> {
  const backstageUser = await defaultUserTransformer(graphUser, userPhoto);

  if (!backstageUser?.spec.profile) {
    logger.info(`This user ${backstageUser?.spec.profile?.displayName} has no profile so will be undefined`);
    return undefined;
  }
  else if(backstageUser?.spec.profile?.email || graphUser.userPrincipalName){
    if (backstageUser?.spec.profile?.email == null && graphUser.userPrincipalName) {
      backstageUser.spec.profile = backstageUser.spec.profile || {};
      backstageUser.spec.profile.email = graphUser.userPrincipalName;
      logger.info(`The user ${backstageUser?.spec.profile?.displayName} has its mail set manually`);
      return backstageUser;
    }
    else {
      return backstageUser;
    }
  }
  return backstageUser;
}


[WIP] Avoid data copy in Writer

Why is this PR needed?
Currently there are 6 data copies during data write process, in CarbonFactDataHandlerColumnar.processDataRows
What changes were proposed in this PR?
This PR avoid all data copy by using DirectByteBuffer
Does this PR introduce any user interface change?

No

Is any new testcase added?

Yes

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/428/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2128/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/435/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2135/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/437/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2137/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2138/

Build Success with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/438/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2162/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/461/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2164/

Build Success with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/463/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/477/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2176/

Build Success with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/497/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2196/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/538/

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2239/

Build Success with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/572/

Build Success with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2277/

I have gone through on a very high level. I need to check out code and review agian.
@jackylk : It will be useful if you can give one flow of all the 5 places where new data was created. I couldn't find 5 places.

@ajantha-bhat
CarbonRowDataWriterProcessorStepImpl.processBatch:
	CarbonRow converted = convertRowWithoutRearrange(row);

TablePage.convertToColumnarAndAddToPages:
	byte[] valueWithLength = addShortLengthToByteArray((byte[]) noDictAndComplex[i]);  // alloc and copy
	noDictDimensionPages[i].putData(rowId, valueWithLength); // safe copy to unsafe

HighCardDictDimensionIndexCodec.encodeIndexStorage:
	byte[][] data = input.getByteArrayPage();  // unsafe copy to safe
	byte[] flattened = ByteUtil.flatten(indexStorage.getDataPage());   // alloc and copy

SnappyCompressor.compressByte:
	Snappy.rawCompress(unCompInput, unCompInput.length); // copy inside, shoud use rawCompress(Object input, int inputOffset, int inputLength, byte[] output, int outputOffset)

Build Failed  with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2304/

Build Failed  with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/597/

Build Success with Spark 2.4.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbon_PR_Builder_2.4.4/601/

Build Success with Spark 2.3.4, Please check CI http://<IP_ADDRESS>:12545/job/ApacheCarbonPRBuilder2.3/2308/

LGTM


Failed to spawn IntelliSense process: -2147418105

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.79.0
OS Version: windows 11 professional 22H2 22621.1778

Steps to Reproduce:

red squiggles occurs.

### Tasks
- [ ] dropdown list selected C/C++

It looks like this is caused by the C++ extension. Please file the issue to the C++ extension repository. Make sure to check their issue reporting template and provide them relevant information such as the extension version you're using. See also our issue reporting guidelines for more information.
Happy Coding!


GC callbacks, a more flexible scaling model, and a getter for GC threshold

For context: https://github.com/saghul/txiki.js/discussions/516 & https://github.com/saghul/txiki.js/pull/520
I implemented a draft of some new core features in quickjs to expose more of an interface for the GC to its runtime. This way it is easier for the application embedding quickjs to control when GC events can run and some related side effects.
This additional control is helpful in the context of systems with some real time requirements.
The extended interface basically consists of:

A getter for the cg threshold to complete its interface.
A flag to fix the threshold, disabling the autoscaling feature which is currently forced.
Callbacks before and after the CG event (not to be run for manually triggered ones). The before callback has a boolean return value to further specify if the event should be allowed or not.

Tests are not provided yet since they might be a bit tricky to write, but if there is consensus on this or some alternative variant I will write some.

Broken PR. I need to reopen it.

Sadly the style is about what you can expect by someone deeply unfamiliar with the codebase and who does not generally work with C :D.
In my defense I was unable to find specific guidelines in the repo, and the naming conventions are not always consistent across the codebase, so every time I had to name a variable it was a bit of a pickle :D
If you have feedback about style (or if there is a clang formatter I missed) it is welcome as well.

Ignore the style for now. It should just look like the surrounding code.
We have no linter alas.

In general, I'm supportive of the approach.
I didn't comment on the style issues since they are not relevant just yet ;-)
@chqrlie thoughts?

Hello @KaruroChori, sorry for the lag, I am focused on some tricky issues ATM, I won't have much time to investigate your approach until next week.

No problem!

I fixed this PR to not duplicate https://github.com/quickjs-ng/quickjs/pull/424 & reworked some of the naming.

It would be great if the GC callbacks are called with runtime pointer so one can trigger any necessary cleanups.
JS_SetGCAfterCallback(runtime->runtime, [](JSRuntime* rt) {
            auto env = (napi_env) JS_GetRuntimeOpaque(rt);
            if (env->gcAfter != nullptr) {
                env->gcAfter->finalizeCallback(env, env->gcAfter->data, env->gcAfter->finalizeHint);
            }
    });

Pre/post GC hooks seem unobjectionable to me. I'd maybe change it to a single hook that's called with enum JSGCEvent { JS_GC_PRE, JS_GC_POST } or something like that.
I'm not entirely sold on this fix_malloc_gc_threshold thing. That should probably be a separate pull request.

Agreed FWIW.

I'm not entirely sold on this fix_malloc_gc_threshold thing. That should probably be a separate pull request.

Ok, once I get back from my vacations I will split this PR :).

Finally back :D.
@bnoordhuis about your suggestion, I noticed that pattern of dispatching is not particularly common in the code base.
Still, I agree it would make the interface cleaner, even more so if other GC-related hooks are needed later on.
I will updating this PR to reflect the consensus reached.

I'd maybe change it to a single hook that's called with enum JSGCEvent { JS_GC_PRE, JS_GC_POST } or something like that.

Do you meant this for registration of the different callbacks, or are you expecting one single callback to handle multiple events at once switching between cases?

I think he meant both.

one single callback to handle multiple events at once switching between cases?

This :arrow_up:
Something along the lines of:
typedef void (*JSGCEventListener)(enum JSGCEvent event, void *arg);
void JS_AddGCEventListener(JSRuntime *rt, JSGCEventListener *l, void *arg);

I like it. It's also flexible in case we need new events later down the line.


Remove deprecated Python39 support from serverless

Description
Remove support to python 39 serverless runtime
AC

[ ] Users should not be able to create new python39 functions
[ ] Users do not loose their existing python39 function - those keep running but cannot be edited unless runtime filed is changed.
[ ] Removed runtime should be part of new release and included in the releasae notes and in the "whats new" announcement for customers

Related
We can do it at 16-10-2024 as it fulfills the deprecation period announced by the notice to customers
Python39 was deprecated with https://github.com/kyma-project/serverless/issues/747

see comment https://github.com/kyma-project/serverless/issues/1205#issuecomment-2435332733


Tapable.plugin is deprecated. Use new API on .hooks instead

Do you want to request a feature or report a bug? Bug

What is the current behavior?

https://travis-ci.org/julmot/form-components/builds/346048668#L4063-L4081
If the current behavior is a bug, please provide the steps to reproduce.
Run the build of this repository which uses these settings. PR: https://github.com/julmot/form-components/pull/9

What is the expected behavior?
It shouldn't fail or provide a meaningful message that helps resolving the issue. The current message looks like an internal error.
Please mention other relevant information such as the browser version, Node.js version, webpack version, and Operating System.
webpack v4
Win10
node v6.11.3

Did you upgrade the extract-text-webpack-plugin to latest version?

Just got the same issue directly after installing webpack
webpack 4.0.0
node 8.9.3
text-webpack-plugin 3.0.2

I think you have to install v4.0.0-alpha.0.
As you can see in the release notes under Code Refactoring: ExtractTextPlugin: update to new plugin system and API's.

Can't imagine that relaying on alpha releases is intended.

using v4.0.0-alpha.0 worked for me

@sokra If using v4.0.0-alpha.0 works (can't confirm), is this the way to go?

I'm no longer using extract-text-webpack-plugin anywhere, is there a way to find out which plugin is generating this warning?

node --trace-depracation

I had the same problem.but resolved it using version 3.11.0

@sokra What's the solution in this regard?

@julmot Try with extract-text-webpack-plugin@next

extract-text-webpack-plugin
npm i -D extract-text-webpack-plugin@next

No Works with extract-text-webpack-plugin v4.0.0-beta.0

Doesn't work for me either, just gives a different error message:
Module build failed: ModuleBuildError: Module build failed: TypeError: Cannot read property 'resolveUrlLoader' of undefined

@julmot Could you please submit an issue for that error?

Hello guys, i've found the way to resolve this problem. You can check my config here, hope it will help you.
http://io.misostack.com/posts/webpack-003/

I'm sure using extract-text-webpack-plugin@next works if you're getting the error from extract-text-webpack, but what if you're not?

extract-text-webpack-plugin@next works for me

@montogeek The issue that occured afterwards seems to be covered in: https://github.com/bholloway/resolve-url-loader/issues/79
@sokra It's annoying that you're ignoring my questions.

In order to use<EMAIL_ADDRESS>you must install<EMAIL_ADDRESS>What you are seeing is not an error but a deprecation notice. If there actually is an error, you could open an issue on ETWP repository.

@ooflorent I assume the reason there are so many people reporting this as an error and not just a notice is that something else is failing silently, and without anywhere else to look people believe this to be the error. I for one cannot get Webpack 4 working, but no error messages.

@Slapbox try to comment plugins and loader step by step

I'm still getting:
DeprecationWarning: Tapable.plugin is deprecated. Use new API on `.hooks` instead
DeprecationWarning: Tapable.apply is deprecated. Call apply on the plugin directly instead

with:
"html-webpack-plugin": "^3.0.4"
"extract-text-webpack-plugin": "^4.0.0-beta.0"

same with or without "extract-text-webpack-plugin": "^4.0.0-beta.0"

Also having same issue:
Running webpack ...

(node:26427) DeprecationWarning: Tapable.plugin is deprecated. Use new API on `.hooks` instead
/var/www/example.com/node_modules/webpack/lib/Chunk.js:460
                throw new Error(
                ^

Error: Chunk.entrypoints: Use Chunks.groupsIterable and filter by instanceof Entrypoint instead
    at Chunk.get (/var/www/example.com/node_modules/webpack/lib/Chunk.js:460:9)
    at /var/www/example.com/node_modules/@symfony/webpack-encore/node_modules/extract-text-webpack-plugin/dist/index.js:176:48
    at Array.forEach (<anonymous>)
    at /var/www/example.com/node_modules/@symfony/webpack-encore/node_modules/extract-text-webpack-plugin/dist/index.js:171:18
    at AsyncSeriesHook.eval [as callAsync] (eval at create (/var/www/example.com/node_modules/webpack/node_modules/tapable/lib/HookCodeFactory.js:24:12), <anonymous>:7:1)
    at AsyncSeriesHook.lazyCompileHook [as _callAsync] (/var/www/example.com/node_modules/webpack/node_modules/tapable/lib/Hook.js:35:21)
    at Compilation.seal (/var/www/example.com/node_modules/webpack/lib/Compilation.js:881:27)
    at hooks.make.callAsync.err (/var/www/example.com/node_modules/webpack/lib/Compiler.js:464:17)
    at _done (eval at create (/var/www/example.com/node_modules/webpack/node_modules/tapable/lib/HookCodeFactory.js:24:12), <anonymous>:9:1)
    at _err1 (eval at create (/var/www/example.com/node_modules/webpack/node_modules/tapable/lib/HookCodeFactory.js:24:12), <anonymous>:32:22)
    at _addModuleChain (/var/www/example.com/node_modules/webpack/lib/Compilation.js:749:12)
    at processModuleDependencies.err (/var/www/example.com/node_modules/webpack/lib/Compilation.js:688:9)
    at _combinedTickCallback (internal/process/next_tick.js:131:7)
    at process._tickCallback (internal/process/next_tick.js:180:9)```

`package.json`:

```user@server:/var/www/example.com# cat package.json
{
    "devDependencies": {
        "@symfony/webpack-encore": "^0.17.0",
        "webpack-cli": "^2.0.10",
        "webpack-notifier": "^1.5.1"
    },
    "license": "UNLICENSED",
    "private": true,
    "scripts": {
        "dev-server": "encore dev-server",
        "dev": "encore dev",
        "watch": "encore dev --watch",
        "build": "encore production"
    },
    "dependencies": {
        "bootstrap-sass": "^3.3.7",
        "extract-text-webpack-plugin": "4.0.0-beta.0",
        "jquery": "^3.3.1",
        "node-sass": "^4.7.2",
        "sass-loader": "^6.0.6",
        "webpack": "^4.0.1"
    }
}```

Also getting `yarn run encore dev` error which is weird:

```error An unexpected error occurred: "Command failed.
Exit code: 1
Command: sh
Arguments: -c /var/www/example.com/node_modules/.bin/encore dev
Directory: /var/www/example.com
Output:
".
info If you think this is a bug, please open a bug report with the information provided in "/var/www/example.com/yarn-error.log".
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.```

I don't have extract-text-webpack-plugin installed but I'm still getting the deprecation warning: yarn list | grep text-web returns nothing

@retorquere Currently multiple plugins use these deprecated APIs. You can use node's --trace-deprecation flag to identify which vendor is involved and open an issue on its repository.

There was already an open issue for it so I've joined that.

Plugin > extract-text-webpack-plugin@next  It helped me

Happens:

https://github.com/jantimon/html-webpack-plugin/issues/874
https://github.com/webpack/webpack-dev-server/issues/1324

Is using .hooks documented somewhere?

I have been facing following issue after updating webpack4. I was thinking it is an issue with "extract-text-webpack-plugin (4.0.0-beta.0)". But to debug I started removing plugins one by one. When remove "webpack-manifest-plugin" things started working. Sometimes other plugins also make "Tapable.plugin" issues
(node:8445) DeprecationWarning: Tapable.plugin is deprecated. Use new API on .hooks instead
Unhandled rejection Error: Chunk.initial was removed. Use canBeInitial/isOnlyInitial()
at Chunk.get initial [as initial] (/home/xxxxxx/Documents/Marketing/form-framework/node_modules/webpack/lib/Chunk.js:72:9)
webpack-manifest-plugin

the --progress flag also prompts the warning

Same as @deanshub. Removing the '--progress' flag got rid of the warning for me:
OLD
    "build": "webpack --progress --bail --env dist -p",     "start": "webpack-dev-server --progress --mode development --watch-content-base --open"
NEW
    "build": "webpack --bail --env dist -p",     "start": "webpack-dev-server --mode development --watch-content-base --open"

resolved by using npm install extract-text-webpack-plugin@next --save-dev

I had the same issue.. So far, my issue was using the uglify plugin..
const path = require('path');
const webpack = require('webpack');
const nodeExternals = require('webpack-node-externals');
const UglifyJsPlugin = require('uglifyjs-webpack-plugin');

module.exports = {
  target: 'node',
  entry: './src/index.js',
  output: {
    filename: 'server.js',
    path: path.resolve(__dirname, 'dist'),
  },
  mode: 'production',
  module: {
    rules: [
      {
        enforce: 'pre',
        test: /\.js?$/,
        exclude: [/node_modules/],
        loader: 'eslint-loader',
      },
      {
        test: /\.js?$/,
        loader: 'babel-loader',
        exclude: [/node_modules/],
        options: {
          presets: [
            ['env', {
              targets: {
                node: "current",
              }
            }]
          ],
          plugins: ['transform-object-rest-spread']
        }
      }
    ]
  },
  plugins: [
    new webpack.LoaderOptionsPlugin({ options: {} }),
  ],
  optimization: {
    minimizer: [
      new UglifyJsPlugin({
        cache: true,
        uglifyOptions: {
          ecma: 8,
        },
      })
    ]
  },
  externals: [nodeExternals()],
};

new config resolved the problem for me...
const path = require('path');
const webpack = require('webpack');
const nodeExternals = require('webpack-node-externals');

module.exports = {
  target: 'node',
  entry: './src/index.js',
  output: {
    filename: 'server.js',
    path: path.resolve(__dirname, 'dist'),
  },
  mode: 'production',
  module: {
    rules: [
      {
        enforce: 'pre',
        test: /\.js?$/,
        exclude: [/node_modules/],
        loader: 'eslint-loader',
      },
      {
        test: /\.js?$/,
        loader: 'babel-loader',
        exclude: [/node_modules/],
        options: {
          presets: [
            ['env', {
              targets: {
                node: "current",
              }
            }]
          ],
          plugins: ['transform-object-rest-spread']
        }
      }
    ]
  },
  plugins: [
    new webpack.LoaderOptionsPlugin({ options: {} }),
  ],
  externals: [nodeExternals()],
};

extract-text-webpack-plugin@next works 👍

@sokra I'm getting this when using compiler.plugin('done' with Webpack v4.1.1

@dtothefp That's expected. In webpack 4 you should use hooks:
compiler.hooks.done.tap("MyPlugin", () => { … })

Same error here. On my side extract-text-webpack-plugin@next isn't helping.

I can confirm that warning with @next
Am 14. März 2018 17:32:21 MEZ schrieb Choppy Thing<EMAIL_ADDRESS>
Same error here. On my side extract-text-webpack-plugin@next isn't
helping.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/webpack/webpack/issues/6568#issuecomment-373087137

--
Mit freundlichen Grüßen
Martin Dünkelmann

Still getting the same issue with next :-(

I have a same error too.
before
  "devDependencies": {
    "css-loader": "^0.28.10",
    "extract-text-webpack-plugin": "^3.0.2",
    "gulp": "^3.8.8",
    "node-sass": "^4.7.2",
    "sass-loader": "^6.0.7",
    "style-loader": "^0.20.3",
    "webpack": "^4.1.1",
    "webpack-cli": "^2.0.12"
  },

after
"devDependencies": {
"css-loader": "^0.28.10",
"extract-text-webpack-plugin": "^4.0.0-beta.0",  // updated by npm i -D extract-text-webpack-plugin@next fnpm i -D extract-text-webpack-plugin@next`
"gulp": "^3.8.8",
"node-sass": "^4.7.2",
"sass-loader": "^6.0.7",
"style-loader": "^0.20.3",
"webpack": "^4.1.1",
"webpack-cli": "^2.0.12"
},
and I've solve it.

"devDependencies": {
"extract-text-webpack-plugin": "^4.0.0-beta.0",
},
Still get the error

For everyone commenting here about using the latest version of X and still having the notices: Please run webpack using node --trace-deprecation ./node_modules/.bin/webpack. This is the only way to identify which package is using deprecated APIs.
If the stack trace shows that extract-text-webpack-plugin is responsible for the notice, please open an issue on its repository.

No configuration file found and no output filename configured via CLI option.
A configuration file could be named 'webpack.config.js' in the current directory.
Use --help to display the CLI options.

@MartinX3 I've submitted a PR (see geowarin/friendly-errors-webpack-plugin#63)

Sorry to say, migrate to Webpack 4 now, sucks!!!

I'm no longer using extract-text-webpack-plugin anywhere
The same notice here

I add the same problem and the deprecation notice is linked to uglifyjs-webpack-plugin.
I checked the version installed via npm:
npm list uglifyjs-webpack-plugin
└─┬<EMAIL_ADDRESS>  └──<EMAIL_ADDRESS>
I wanted to use the why function of yarn and I was surprised to not have the .hook warning anymore and justly:
❯ yarn list uglifyjs-webpack-plugin
└─<EMAIL_ADDRESS>
Seems like npm is not installing the latest dependency for uglifyjs-webpack-plugin, I can't explain why but this seems to be the problem.

@Fenntasy npm/yarn cache clear && npm/yarn install

Well...
npm cache clear
npm ERR! As of npm@5, the npm cache self-heals from corruption issues and data extracted from the cache is guaranteed to be valid. If you want to make sure everything is consistent, use 'npm cache verify' instead.
npm ERR!
npm ERR! If you're sure you want to delete the entire cache, rerun this command with --force.

To be sure, I tried npm cache verify but it does not change anything.
npm cache clear --force did not change anything either (which is somewhat reassuring considered the previous message, it really self heal, it just still has an error).
I even tried upgrading npm to 5.7.1 but it did not change the fact that npm does not want to install the last version of uglifyjs-webpack-plugin

@Fenntasy Delete the node_modules folder and try installing again

I did that between every try ^^'.
I'm not saying that because I have the problem, just pointing to a potential way of discovering the problem or a way out (using yarn).

I have tried all the solutions above and still get the same error. I even went as far as removing all plugins from my config file and got the same error.
When I try to do a node trace to figure out the cause of the problem, I get the error;
ERROR in Entry module not found: Error: Can't resolve './src' in '/home/jioke/lab/altalabs/ui'

What could I possibly be doing wrong?

@kinsomicrote please open an issue to help us diagnose the problem.

For anyone still reading this and struggling with extract-text-webpack-plugin, first off I will say that the @next solution worked for me.
However, it seems that extract-text-webpack-plugin is being replaced with mini-css-extract-plugin for weback4.
See this issue for reference.

Just remember, mini-css-extract-plugin requires webpack >= 4.1

Sean Larkin just said in his blog post about the release of Webpack 4 that it won't support ExtractTextPlugin anymore. CSS files will be simply added to the entry points for bundling (which is way better).

extract-text-webpack-plugin@next works for me

I have used mini-css-extract-plugin but this issue still exist. Are there other libraries will also causes this issue?

Same error with "webpack": "^4.4.1" and "extract-text-webpack-plugin": "^3.0.2".
Fixed with extract-text-webpack-plugin@next (currently extract-text-webpack-plugin@4.0.0-beta.0).

Here is a quick summary for everyone encountering this message.
What is this message?
webpack 4 is using a new plugin system and deprecates the previous APIs. There are 2 new warnings:
DeprecationWarning: Tapable.apply is deprecated. Call apply on the plugin directly instead
DeprecationWarning: Tapable.plugin is deprecated. Use new API on `.hooks` instead

These are warnings. They are outputted to the console to warn our users that they are using an outdated API and should migrate to the newest.
How bad are these warnings?
They are only a textual information, not errors. If you see a DeprecationWarning you can ignore it until you have to update to the next major version of webpack.
How to get rid of them?
Update your webpack dependencies (webpack, loaders, plugins, …). If all your dependencies have done the migration, the warnings should be gone. If they are not and you can help us and the plugin authors to fix this!

Identify who raises the warning by getting the stracktrace:

add process.traceDeprecation = true at the top of your config
or run you node process using the --trace-deprecation flag

The stracktrace will be similar to this:
(node:10213) DeprecationWarning: Tapable.plugin is deprecated. Use new API on `.hooks` instead
    at FriendlyErrorsWebpackPlugin.apply (./node_modules/friendly-errors-webpack-plugin/src/friendly-errors-plugin.js:39:14)
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
         this plugin is using a                                it is defined in
            deprecated API                                       this package

    at webpack (./node_modules/webpack/lib/webpack.js:37:12)
    at processOptions (./node_modules/webpack-cli/bin/webpack.js:436:16)
    at <anonymous>
    at process._tickCallback (internal/process/next_tick.js:160:7)
    at Function.Module.runMain (module.js:703:11)
    at startup (bootstrap_node.js:193:16)
    at bootstrap_node.js:617:3

In the above stacktrace, FriendlyErrorsWebpackPlugin is causing the warning.

Open an issue on the plugin's (or loader's) repository and include the stacktrace so its author could identify what is causing the warning.

If you absolutely want to remove them, you can disable the deprecation notices within your configuration by adding the following statement:
// Ignore all deprecations and hope that nothing will silently break in the future.
process.noDeprecation = true;


is this code tested?

how to edit the configure files?
Is the pool works well?
thanks.

This bug have been fixed in the latest testing branch. Reason is that the miner sent status request before login, which leads to that the server closed the tcp conn with it.

此错误已在最新的测试分支中修复。原因是矿工在登录前发送了状态请求，这导致服务器用它关闭了tcp conn。

历害

此错误已在最新的测试分支中修复。原因是矿工在登录前发送了状态请求，这导致服务器用它关闭了tcp conn。

还是不行，你测试正常吗。我用20台挖了一天了，还是这样

Could you help me upload your pool.log here？ It would help me analysis the bug.

epic-server.log
epic.log

I notice there is no login request. So I think it's the problem on miner config. You can check the readme part in #4 .

晕，我刚发现，没开启，哈哈，感谢感谢


More Improvements (see full info)

Here's what I did and why I did it:

Remove README.md information about why use Wumpfetch - Users already know it's light from the start and from package phobia, no point adding extra unneeded information.
Made gulpfile.js lighter - Made it like the other files
Edit LICENSE - There was an unneeded gap
Index.js modifications -  No longer does it hard code the package name and URL, making life easier for people forking it or using it in business. Also changed request to req to make it lighter!
.gitignore edit - Removed unneeded "/"
WumpRequest.js Improvements - Package name and URL are also no longer hard coded here, renamed consts to decrease file size.

Now under 10kb!
Let me know if anything needs editing

:weary::weary::weary:

+1 weeb

react u weeb


proofgeneral_HEAD: fix

Motivation for this change
As far as I can tell, the current derivation in master is broken, because of those changes:
https://github.com/ProofGeneral/PG/commit/1a18e33658645a81225c56b5d4f4a4b89434d301
https://github.com/ProofGeneral/PG/issues/177
It seems we don't need a patch anymore as a result.

@spacekitteh did you not run into this issue with
https://github.com/NixOS/nixpkgs/pull/25695
?

This PR broke the default proofgeneral package which still references the pg.patch file.  I'm not familiar with proofgeneral versioning, should we make HEAD the default or revert the patch deletion?

@gebner woops, that was a bad oversight on my part!
I think we should probably keep the 4.4 around, in case HEAD ever breaks, it's good to have a more stable fallback no?
At least for now, let's revert the patch deletion. Should I:

revert this commit, then submit a new commit that does the other fixes w/o removing the patch
or
just make a new commit to restore the patch
?

just make a new commit to restore the patch

I think that's the way to go here.


Clarify sorting requirements in documentation

I'm using coverageBed to determine the average read coverage of genomic features (defined in BED files) in BAM files, and I can't get the -sorted option to work. And without the -sorted option, I'm running out of memory for large BAM files (> 1 GB). I'm currently using bedtools 2.25 because groupBy is broken in the latest 2.26 release (https://github.com/arq5x/bedtools2/issues/435).
Since the benefits of sorting are stressed at https://github.com/arq5x/bedtools2#performance and http://bedtools.readthedocs.io/en/latest/content/tools/coverage.html, I'm wondering if the online coverageBed documentation could be made a bit more explicit in how to prepare the input files and how to use -sorted. In particular:

What should the genome file mentioned at http://bedtools.readthedocs.io/en/latest/content/tools/coverage.html look like (-g option; "Specify a genome file the [sic] defines the expected chromosome order in the input files for use with the -sorted option."). Is there a description of the expected file format somewhere?
Could you add instructions to http://bedtools.readthedocs.io/en/latest/content/tools/coverage.html on how to deal with BAM files ? I tried sorting my BAM file with samtools sort unsorted.bam > sorted.bam, and my BED files with sortBed -i unsorted.bed > sorted.bed, but this still gives errors:

Case 1, "A.bed" and "sorted.bam"
Output of samtools view -H sorted.bam:
@HD	VN:1.0	SO:coordinate
@SQ	SN:chrI	LN:230218
@SQ	SN:chrII	LN:813184
@SQ	SN:chrIII	LN:316620
@SQ	SN:chrIV	LN:1531933
@SQ	SN:chrIX	LN:439888
@SQ	SN:chrmt	LN:85779
@SQ	SN:chrV	LN:576874
@SQ	SN:chrVI	LN:270161
@SQ	SN:chrVII	LN:1090940
@SQ	SN:chrVIII	LN:562643
@SQ	SN:chrX	LN:745751
@SQ	SN:chrXI	LN:666816
@SQ	SN:chrXII	LN:1078177
@SQ	SN:chrXIII	LN:924431
@SQ	SN:chrXIV	LN:784333
@SQ	SN:chrXV	LN:1091291
@SQ	SN:chrXVI	LN:948066
...

Output of cut -f 1 A.bed | uniq:
chrI
chrII
chrIII
chrIV
chrV
chrVI
chrVII
chrVIII
chrIX
chrX
chrXI
chrXII
chrXIII
chrXIV
chrXV
chrXVI
chrmt

When I run coverageBed -b sorted.bam -a A.bed -d -sorted for these files, I get:

ERROR: chromomsome [sic] sort ordering for file sorted.bam is inconsistent with other files.

Here it's clear that the BED and BAM files have different orderings. Apparently samtools doesn't seem to reorder chromosomes in a sort (https://github.com/arq5x/bedtools/issues/109#issuecomment-114932058). Is there any way to easily sort chromosomes in BAM files, or is the only solution to sort the BED file to match the BAM file and use a genome file with the -g option, as suggested at https://github.com/arq5x/bedtools/issues/109#issuecomment-114942096?
Case 2, "B.bed" and "sorted.bam"
With a different BED file, with output of cut -f 1 B.bed | uniq:
chrIV
chrX
chrXVI

I get for coverageBed -b sorted.bam -a B.bed -d -sorted:

ERROR: Sort order was unspecified, and file sorted.bam is not sorted lexicographically.
Please re-reun [sic] with the -g option for a genome file.
See documentation for details.

I'm more confused here, since the three chromosomes in the BED file are in the same order as the chromosomes in the BAM file. Is coverageBed thrown off here because the chromosomes in the BED file are a subset of the chromosomes in the BAM file?

Related, is it really necessary to require the same chromosome order in the BED and BAM files when using coverageBed with -sorted? Does matching chromosome orders really bring significant performance gains?
If the requirements could be relaxed so that the chromosomes in input features files of coverageBed don't need to be sorted in the same order, -sorted would be much easier to use.

Sorry for your troubles. Yes, it is absolutely necessary and it really does make a tremendous speed difference. What version are you using? If you can share minimal files, I can also test, as this should work.

If you can share minimal files, I can also test, as this should work.

You mean the second case?
For the first, I guess I should follow the steps you described at https://github.com/arq5x/bedtools/issues/109#issuecomment-114942096 (if this information could be added to http://bedtools.readthedocs.io/en/latest/content/tools/coverage.html, that would be great). Are the chromosome names.txt file and genome file both supposed to be single-column text files?

Yes, the second case. Two column files: first column is chromosome label, second is length. The chrom order in this file specifies the expected order in all data files.

Two column files: first column is chromosome label, second is length. The chrom order in this file specifies the expected order in all data files.

So tab-delimited, then? Is this documented anywhere?

What version are you using?

2.25 (I use groupBy which is broken in 2.26)
My BAM file is 600 MB, but I should be able to create a smaller one. What would be the easiest way to privately share files? I could give you a Dropbox link if there is an email address I can send it to.

http://bedtools.readthedocs.io/en/latest/content/general-usage.html#genome-file-format
groupby works in the repo version, I just haven't had time to finalize all fixes for the next release. Sorry.  Email is aaronquinlan. gmail.


Cannot play songs

Describe your problem here.
I've not been able to play specific songs in psych 0.6.2. Only 3 of them don't work. I'm positive that it's an openfl, flixel or even haxe issue but I'm not sure which libraries to install anymore
openfl/events/SampleDataEvent.hx (line 189)
openfl/media/Sound.hx (line 748)
flixel/system/FlxSound.hx (line 619)
flixel/system/FlxSound.hx (line 482)
PlayState.hx (line 2384)
PlayState.hx (line 3107)
flixel/FlxState.hx (line 203)
flixel/FlxGame.hx (line 752)
flixel/FlxGame.hx (line 682)
flixel/FlxGame.hx (line 556)
openfl/events/EventDispatcher.hx (line 444)
openfl/display/DisplayObject.hx (line 1400)
Uncaught Error: To be consistent with flash the listener function registered to SampleDataEvent has to provide between 2048 and 8192 samples.

Are you modding a build from source or with Lua?
Source
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
Compiled and changed libraries due to other issue

0.6.2 isn't supported anymore

Could I please have a more specific answer? I am aware of this. I just want to be able to fix issues with a previous build

I also ported everything to 0.7.3 just to see if there was a change. None at all, issue still persists

Somehow the issue was a leftover lua file that I had no idea was misbehaving.

Did you edited Playstate or source code ?
Maybe it's due to broken events / functions.
Try import songs JSON to a default engine build maybe it's due to json.
If you have only a "inst.ogg" file try this : open song json and at the end change "needs_vocals : true" with false
yes i'm from gamebanana lol

Did you edited Playstate or source code ?
Maybe it's due to broken events / functions.
Try import songs JSON to a default engine build maybe it's due to json.
If you have only a "inst.ogg" file try this : open song json and at the end change "needsVoices : true" with false
yes i'm from gamebanana lol

Change your openfl version to 9.2.2 and don't change it again.