utils.text.reduce_message_length Not reducing text length

Bug description
I come across this issue.
  File "/Users/azure/Documents/Workspace/Datasci/lib/python3.10/site-packages/metagpt/utils/text.py", line 31, in reduce_message_length
    raise RuntimeError("fail to reduce message length")
RuntimeError: fail to reduce message length

Bug solved method
Digging into the code, I assume utils.text.reduce_message_length() only check if the token is short enough.
If it's too long, it simply raise exception, instead of shorten it.
Following it the code in utils.text.reduce_message_length()
def reduce_message_length(
    msgs: Generator[str, None, None],
    model_name: str,
    system_text: str,
    reserved: int = 0,
) -> str:
    max_token = TOKEN_MAX.get(model_name, 2048) - count_string_tokens(system_text, model_name) - reserved
    for msg in msgs:
        if count_string_tokens(msg, model_name) < max_token or model_name not in TOKEN_MAX:
            return msg

    raise RuntimeError("fail to reduce message length")

LLM type and model name:
System version:MetaGPT 0.7.4
Python version: Python 3.10.13

Is it a feature that is not implemented yet, or I can try to create a PR to fix it

Thank you for your feedback.
The issue isn't caused by reduce_message_length, but rather by incorrect usage of the reserved parameter when using reduce_message_length.
In the v0.6-release branch, the source code looks like this：
prompt = reduce_message_length(gen_msg(), model_name, system_text, CONFIG.max_tokens_rsp)

However, in the v0.7-release branch, the source code looks like this：
prompt = reduce_message_length(gen_msg(), model_name, system_text, 4096)

The reserved parameter is assigned a constant value of 4096, which could result in max_token = TOKEN_MAX.get(model_name, 2048) - count_string_tokens(system_text, model_name) - reserved being constantly less than 0.
You can submit a PR to replace 4096 with config.llm.max_token：

Or, you can wait until I submit a PR to fix this issue in a few days.

Thank you for your feedback. The issue isn't caused by reduce_message_length, but rather by incorrect usage of the reserved parameter when using reduce_message_length. In the v0.6-release branch, the source code looks like this：
prompt = reduce_message_length(gen_msg(), model_name, system_text, CONFIG.max_tokens_rsp)

However, in the v0.7-release branch, the source code looks like this：
prompt = reduce_message_length(gen_msg(), model_name, system_text, 4096)

The reserved parameter is assigned a constant value of 4096, which could result in max_token = TOKEN_MAX.get(model_name, 2048) - count_string_tokens(system_text, model_name) - reserved being constantly less than 0. You can submit a PR to replace 4096 with config.llm.max_token：
Or, you can wait until I submit a PR to fix this issue in a few days.

I get it, reduce_message_length truncate msg instead of compacting it.
Does it make sense to recursively feed msg to refine and compact chain to make it shorter??
Also, why should reserve been set to config.llm.max_token?
Doesn't config.llm.max_token should equals to TOKEN_MAX.get(model_name, 2048) literally？
In this case should I set reserve = 0?

STEP1:  max_token is calculated by token_max - token_of_sys - reserved
max_token = TOKEN_MAX.get(model_name, 2048) - count_string_tokens(system_text, model_name) - reserved

STEP2: msg is compared with max_token, so this max_token represents the max token allowed by llm.
for msg in msgs:
    if count_string_tokens(msg, model_name) < max_token or model_name not in TOKEN_MAX:
        return msg

Therefore, I propose reserved means the token reserved for other use. It has nothing to do with config.llm.max_token(maximum length of the response generated by the LLM)
reduce_message_length is only used by researcher, and after I modified reserve=0, it works.

In metagpt/actions/research.py line: 137
prompt = reduce_message_length(gen_msg(), model_name, system_text, 0)
logger.debug(prompt)
queries = await self._aask(prompt, [system_text])

seems like the reduced result if fed into llm as prompt, so there is not need for extra reserved

max_token = TOKEN_MAX.get(model_name, 2048) - count_string_tokens(system_text, model_name) - reserved

is equal to
available_for_prompt = max_io_size_of_model - system_text_used - preallocated_for_response

"prompt" corresponds to the first parameter, and "system_text" corresponds to the second parameter below：
await self._aask(prompt, [system_text])

I see! token are shared between prompt and completion.
Thanks


[Feature]: set SOC service

What do we want to achieve?
We want to create a new ROS service that allows calling the internal set_soc function.
This feature is needed in order to correct internal deviations in the estimation.
How do we plan to do it?

Define and create new service message
Implement the call
The available range has to be between 0 and 100

How can it be tested?

Set any value and check it changes correctly in the battery data being published

Subtasks
No response

Reviewed and woreking, tested in rbwatcher su-st-230620aa


Translate "Cannot Play Stream Video" into Japanese

Is this all we need to translate into Japanese?
I assume "Stream Video" is just a normal video.

@tomoyuki28jp Thanks. "Stream Video" is video stored in iCloud.

BTW, you might like to translate the "OK" message too.

@chiunam Thanks for your explanation. I just made another pull request: https://github.com/chiunam/CTAssetsPickerController/pull/123

And I think we don't need to translate the "OK" message :)


How to hide content in the parent view when the user goes to a nested state and show it again when the user backs to the parent state?

I’d like to hide some html-content in the parent view when the user goes to child state and show it again when the user backs to parent state.
What is the right way to do that?
I think using root scope and state change events isn’t a good way, is it?

https://gist.github.com/christopherthielen/b3fc0304b737a4bf8ec9


Include elemental-operator related images into rancher security radar

We should provide a list of elemental images. I'd assume this is the same list of images that is used for airgap. We could do something similar to https://github.com/rancher/rancher/releases/download/v2.8.2/rancher-images.txt

Hi @pjbgf,
Just added an elemental-operator-images.txt file listing all images referenced with the chart in current supported releases (v1.3.5, v1.4.2 and v1.4.3). See the latest one as an example https://github.com/rancher/elemental-operator/releases/download/v1.4.3/elemental-operator-images.txt
Does it match what you'd expect and need to run security scans on elemental image releases?

@davidcassany that looks good and inline with what we consume from other projects. Thank you for working on this. :bow:
cc: @rancher/rancher-security


Clarify CAS availability

r? @therealprof
(rust_highfive has picked a reviewer for you, use r? to override)


Build and publish container image for integration tests

Then, Kubernetes distributions will be able to run the tests from Inspektor Gadget with the following commands, without installing kubectl-gadget or recompiling:
wget https://github.com/kinvolk/inspektor-gadget/releases/download/v0.2.0/gadget-integration-tests-job.yaml
kubectl apply -f gadget-integration-tests-job.yaml
kubectl logs -n gadget-test -l job-name=gadget-test

Rebased


fix: substrate Provider does not update correctly after disconnecting wallet

Interbtc UI Pull Request Template
Description
Resolves #963
Current behaviour (updates)
When my wallet gets disconnected, "Destination" selection UI is available.

New behaviour
When my wallet gets disconnected, "Destination" selection UI is unavailable.
Reproducible testing steps:

Connect your wallet.
Disconnect your wallet.
"Destination" selection UI is invisible.

Superseded by #992


Add/keep Python 3.8 support

Hi, I'm interrested in using the project but would need python3.8 support still.
But I've seen that the generated code has dict annotation. while python3.8 only supports Dict.
Would you be ok to still consider python3.8 support ?
Thx.

hi @mat-sop
yes I/we can use python>=3.9 (3.10 actually) to generate that python code still ok with python3.8, thanks effectively to the 1 place you found (had also changed it in my clone).
would you want me to make that patch/PR (though for 1 line I guess you could make it) ?
cheers,

@mat-sop made tentative here: https://github.com/mirumee/ariadne-codegen/pull/188
had to change a bit more than I was expecting. not sure all of them are actually required but so, yes, I used a search/replace at one moment ;)
all tests pass localy on my system at least.


Fix reassembly pages allocation/shrinking

I have noticed, that an application which uses reassembly package will start consuming more and more memory over time. After some profiling, I found out that most of the memory was taken at
https://github.com/google/gopacket/blob/0f680daf16b80a573e90e62cd91ce8e02e72f9a4/reassembly/memory.go#L47
These pages are used by tcp assembly logic for packets which came out of order. After tcp assembly is done with a page, it puts it back to the free list. This list may, at some point, be too big for current traffic rate, therefore we have shrinking logic. tryShrink function shrinks the free slice to some size, and assigns nil to the pointers which pointed to preallocated pages in order to let GC collect those unused pages:
https://github.com/google/gopacket/blob/0f680daf16b80a573e90e62cd91ce8e02e72f9a4/reassembly/memory.go#L73
However, as we saw, those pages are allocated as a slice of pages, which afaik, should be a single memory block. Therefore, in order for GC to collect that memory, all the pages allocated in that memory block should have no pointers to them. So, we may turn up wasting 1023 pages, while using only one page of that memory block.
Proposed fix, is to allocate pages separately, so that they can be collected by GC independently of each other. However, this hits our performance, because allocating pages one by one is slower than allocating them all at once.

Hey, @jandos, just for the record, are you ever calling any of the reassembler Flush* functions?  Without calling those functions ever, you'll definitely grow in size ad infinitum.  With regular use of at least one of the Flush* functions, though, memory use should remain constant.

Hi, yes I do flush/close every N minutes.
The problem happens when traffic rate goes up and down. For example, we hit a peak moment with high traffic rates, we allocate lots of pages to handle out of order packets. Then, rate goes down, we try to shrink, and let GC collect some of our pages, but most probably they will not get collected, because of the issue I described. So, when we hit next peak, we do the same, allocate more pages, since we nil-ed out some of them during shrinking.
This will repeat, and more memory blocks will be used ineffectively, consuming more memory than it should.

Another possible solution could be disabling shrinking free list completely.
This way, memory usage level will get to its maximum during traffic rate peak point, and will not grow any further. It will only grow if we have bigger traffic rate or more out of order packets, but we will not have those "fragmented" memory blocks.
This way we won't loose performance during pages allocation.


extractor for decko.ceskatelevize.cz

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
[x] Searched the bugtracker for similar pull requests

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[ ] Improvement
[x] New extractor
[ ] New feature

Description of your pull request and other information
This extractor adds support for downloading videos from decko.ceskatelevize.cz. While similar in nature to the existing one for iVysilani, this one provides playlists for Decko's series and different MPD manifests for {requestSource:"decko"}.
Unfortunately, I was not able to add a working unit test for the DeckoVideo class (the DeckoPlaylist has a working test). This IE ultimately results in a redirect to a MPD manifest, which is handled by the generic IE. However, the resulting (generic) info_dict lacks the url member, failing the Missing mandatory field assert. I would appreciate any hints on how to overcome this.

Does not work:
PS C:\dev\youtube-dl\master> py -3.6 .\youtube_dl\__main__.py http://decko.ceskatelevize.cz/video/213543116070004 -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['http://decko.ceskatelevize.cz/video/213543116070004', '-v']
[debug] Encodings: locale cp1251, fs utf-8, out utf-8, pref cp1251
[debug] youtube-dl version 2017.04.11
[debug] Git HEAD: e593706
[debug] Python version 3.6.0 - Windows-10-10.0.10240-SP0
[debug] exe versions: ffmpeg N-83622-gdcd3418, ffprobe N-83622-gdcd3418, rtmpdump 2.4
[debug] Proxy map: {}
[DeckoVideo]<PHONE_NUMBER>70004: Downloading JSON metadata
[DeckoVideo]<PHONE_NUMBER>70004: Downloading JSON metadata
Traceback (most recent call last):
  File ".\youtube_dl\__main__.py", line 19, in <module>
    youtube_dl.main()
  File "C:\dev\youtube-dl\master\youtube_dl\__init__.py", line 464, in main
    _real_main(argv)
  File "C:\dev\youtube-dl\master\youtube_dl\__init__.py", line 454, in _real_main
    retcode = ydl.download(all_urls)
  File "C:\dev\youtube-dl\master\youtube_dl\YoutubeDL.py", line 1890, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "C:\dev\youtube-dl\master\youtube_dl\YoutubeDL.py", line 761, in extract_info
    ie_result = ie.extract(url)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\common.py", line 429, in extract
    ie_result = self._real_extract(url)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\decko.py", line 51, in _real_extract
    playlist2 = self._download_json(playlist1.get("url"), video_id)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\common.py", line 662, in _download_json
    encoding=encoding, data=data, headers=headers, query=query)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\common.py", line 630, in _download_webpage
    res = self._download_webpage_handle(url_or_request, video_id, note, errnote, fatal, encoding=encoding, data=data, headers=headers, query=query)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\common.py", line 527, in _download_webpage_handle
    urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query)
  File "C:\dev\youtube-dl\master\youtube_dl\extractor\common.py", line 498, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "C:\dev\youtube-dl\master\youtube_dl\YoutubeDL.py", line 2099, in urlopen
    req = sanitized_Request(req)
  File "C:\dev\youtube-dl\master\youtube_dl\utils.py", line 540, in sanitized_Request
    return compat_urllib_request.Request(sanitize_url(url), *args, **kwargs)
  File "C:\Python\Python36\lib\urllib\request.py", line 329, in __init__
    self.full_url = url
  File "C:\Python\Python36\lib\urllib\request.py", line 355, in full_url
    self._parse()
  File "C:\Python\Python36\lib\urllib\request.py", line 384, in _parse
    raise ValueError("unknown url type: %r" % self.full_url)
ValueError: unknown url type: 'error_region'

Does not work:

Interesting. Works for me:
~/projects/youtube-dl (git:decko) $ python -m youtube_dl http://decko.ceskatelevize.cz/video/213543116070004
[DeckoVideo]<PHONE_NUMBER>70004: Downloading JSON metadata
[DeckoVideo]<PHONE_NUMBER>70004: Downloading JSON metadata
[generic] ?token=7c3956c30a5750a0e4028eb1a9e83a4db43c7e6e&contentType=vod&expiry=1491938151&id=61924494877085121&playerType=dash&quality=web&region=4&skipIpAddressCheck=false&userId=5f6a2c90-e553-4402-893d-619bfb335b73: Requesting header
[redirect] Following redirect to http://<IP_ADDRESS>:80/atip/f5d7b9e37790772e241b314b1f3b0fc8/1491934551668/61924494877085121-pc.mpd
[generic]<PHONE_NUMBER>7085121-pc: Requesting header
WARNING: Falling back on generic information extractor.
[generic]<PHONE_NUMBER>7085121-pc: Downloading webpage
[generic]<PHONE_NUMBER>7085121-pc: Extracting information
[dashsegments] Total fragments: 221
[download] Destination:<PHONE_NUMBER>7085121-pc-61924494877085121-pc.f61924494877085121-pc-1001-1505.mp4
[download]  57.2% of ~183.04MiB at  1.67MiB/s ETA 00:53

So apparently some region-based blacklisting is happening. What is the recommended way of dealing with this?

Okay, screw this one -- re-implemented in https://github.com/rg3/youtube-dl/pull/12719 directly inside the existing CeskaTelevize IE.


fix incorrect variable name in plugin demo

Tiny fix for an incorrect variable name in the readme.

Nice catch @jhrtn, thanks for the PR! 🎉


Estimate scope

14.01.2022 https://jdi-family.atlassian.net/wiki/spaces/JDN/pages/13893818/Project+Timeline

Done.


Feature/repo migration

allow migrating a repo by calling an api, rsync will be used to migrate the project from redmine to lexbox.
still need to do:

[x] block starting migration if there's an inflight request.
closes #240

Alright, I've merged in the work for blocking migration on requests being in progress, it was more complicated than I first thought, but I wrote tests for it and tried it out myself and it seems to work fine. I also hid the migrate button from non admins. I figure if an admin should know better than to click on a button they don't want to click. I'd like to merge this in since it's getting pretty large.


Added configuration for Travis CI

This will make it possible for GitHub to automatically build and test each PR, which helps to avoid potential bugs.
@adelwu, as the owner of the GitHub repo, you'll have to visit https://travis-ci.org/ and turn on integration for our repo.  Basically you'll need to do steps 1-3 from here: https://docs.travis-ci.com/user/tutorial/#to-get-started-with-travis-ci (this PR does steps 4-5).


feature request: differentiate public and private functions

it would be great if aerial could differentiate between public and private functions. When you want a quick overview of a file, looking first at the public functions would really help to get a picture as to what the file is about.
Currently as far as I'm aware, aerial doesn't support this.
In terms of GUI, this could be displayed through a different icon for public/private fields or functions, but maybe it would even make more sense to have different highlight colors of the same icon (so the same function icon, but with a different color depending on whether the function is public or private).
I'm not sure about the implementation though, because SymbolKind doesn't differentiate...
(Edit: I'm interested in this at first for elixir, where the public/private status is trivial to get from tree-sitter: there are two keywords: def and defp)

hmm presumably the solution could be to add a new optional field in aerial.Symbol, scope, that could contain at least public and private (and possibly protected and such). And then the GUI could handle those as it wants.
I'll probably try to work on something like that through the week-end.


"Beep" on every char I type

I'm having a strange issue when using zsh-syntax-highlighting.
It's working, but every time I type a char it fires a 'beep' sound.
When I disable the plugin, the beeps stop.
Any idea what could cause this or how I could debug it?
I'm using MacOS with prezto.

Closing as duplicate. Reopen if it still happens.


fix namespace move-project action

#3456 - this issue is seen specifically when attempting to move a namespace not in a project

Good call re: filtering projects by cluster, but I've moved that into a computed prop so the list of projects stays updated eg, try removing a project then moving a namespace: the removed project will still be in the modal dropdown (you may run into #3175 trying that; it's next on my list)


Use connection string in non-ssl case when proto is not defined in host option

For now inside connection procedure we surprisingly generating connection string in non-ssl mode and in when proto is not specified inside host option but never use it during factual connection which is probably wrong since we do not pass generated string (containing proto) to ldap_connect function.
This PR fixes this behaviour.

Thanks for raising this issue! It brought up a much larger thing. Since the difference between URI-connect and the old one is only in there due to openldap-libraries older that version 2.2 and openldap 2.2 was tagged 11 years ago, we should probably remove this switch completely!

@heiglandrea, WDYT about finishing with it?)


finland elytra

yes

Not an issue, closing.
No issue against Finland (or any country, really), but all the wings were made by the community and not by me.
All wings were used with permission from their creators, and I'm not just gonna search a wing from Google Images and use it.
Copyright exists, after all, and issue #15 shows one example of people misrepresenting their ownership of something.

If you want a Finland wing, you can post your own wing submission as an issue on GitHub!
You must either own the elytra texture, or post a texture of an artist that allows the texture's usage in our mod.
We (the Cafeteria Team) may deny submissions which do not meet the mod's standards.


security error on safari

When a user disables localstorage / cookies in safari window.onerror is invoked with security error.
I'm not sure what the correct thing this module should do though, i'm just opening this issue to see what you think ;)

Hmmm, well we already have try/catch around the localStorage access calls. I wonder if anybody has documented a workaround for this before...

Oh the error is thrown here: https://github.com/visionmedia/debug/blob/master/browser.js#L24 not sure if this happens in other browsers too.

Oh ok. So lets try throwing a try/catch around that part of the code as
well? (Ideally hoisting it out into its own function so that the entire
module doesn't get de-optimized because of the module-level try/catch).
On Tue, Jan 6, 2015 at 11:54 AM, Amir Abu Shareb<EMAIL_ADDRESS>wrote:

Oh the error is thrown here:
https://github.com/visionmedia/debug/blob/master/browser.js#L24 not sure
if this happens in other browsers too.
—
Reply to this email directly or view it on GitHub
https://github.com/visionmedia/debug/issues/167#issuecomment-68923111.


Multi-frame DICOM support

OHIFv3 lacks the support of annotations and measurements on multi-frame DICOM files particularly when we want to persist and load Measurement SRs on multi-frame DICOM files.
There are several issues being resolved in this PR:

Supporting of annotations and measurements on multi-frame files
Saving Measurement SRs on multi-frame DICOM files
Fixed loading of frames of multi-frame DICOM files : it was not loading the last frame ( loading Frame 1 twice, and not loading the last frame) , as you can guess, it was related to indexing of frames. Frame numbers are 1-based, not 0-based.
Fix jumping to the selected measurement/annotation on multi-frame files
Show correct instance id and frame number on the "Measurement Tracking" panel
Fixed a few "React" errors that was causing error logs in the browser console.

External dependencies:
This depends on the changes of dcmjs library:  https://github.com/dcmjs-org/dcmjs/pull/317
The changes has been merged and available on version 0.28.1, therefore updated the package.json for dcmjs library.

@md-prog - a few small changes, then it looks good to me.
@sedghi - this fixes some important issues with multiframe and annotations.  It does not fix volume annotations yet - that is something we still need to discuss how to handle properly.

@sedghi, the issue No.1 mentioned in your last comment is related to dcmjs library's "lack of features" (if not defect).
https://github.com/dcmjs-org/dcmjs/issues/318
Basically, the lines of dcmjs library mentioned in above Github issue, are blocking us to save the annotations made on to the multi-frame file with the correct frame number information.
With this issue resolved, the issue should go. (During my development, I had to temporarily use the locally cloned dcmjs with the temporary fix to the issue.)
No.2 is not a new thing, I think.


Made the normal check up page responsive

Description
made the normaL checkup page mobile responsive
Related Issues

Closes #1002

Type of PR

[x] (Bug Fix)

Screenshots / videos (if applicable)

https://github.com/user-attachments/assets/1a7dea12-8e1c-4ffa-afcc-b99a8c865f42
Checklist

[x] I have gone through the contributing guide
[x] I have updated my branch and synced it with project main branch before making this PR
[x] I have performed a self-review of my code
[x] I have tested the changes thoroughly before submitting this pull request.
[x] I have provided relevant issue numbers, screenshots, and videos after making the changes.
[x] I have commented my code, particularly in hard-to-understand areas.

Additional context:

Please review my pull request @varshith257 @Anjaliavv51

Please interchange change the bottom follow us icons and the sentence

And also decrease the size of navbar

Please interchange change the bottom follow us icons and the sentence

but it is like this only in the main website @Anjaliavv51

@samarsajad for this page pls change as I said , the page has changed by someone I am looking into that

@samarsajad for this page pls change as I said , the page has changed by someone I am looking into that

https://github.com/user-attachments/assets/fc6a4e9a-f6e0-4ea2-b60a-762cef8724c0
made the changes @Anjaliavv51

@varshith257 changes good , it can be merged.


Update zoomus 4.0.36452.0616 - sha256

If there’s a checkbox you can’t complete for any reason, that's okay, just explain in detail why you weren’t able to do so.
After making all changes to the cask:

[ ] brew cask audit --download {{cask_file}} is error-free.
[ ] brew cask style --fix {{cask_file}} reports no offenses.
[ ] The commit message includes the cask’s name and version.

Additionally, if updating a cask:

[ ] If the sha256 changed but the version didn’t,
provide public confirmation by the developer: {{link}}

Additionally, if adding a new cask:

[ ] Named the cask according to the token reference.
[ ] brew cask install {{cask_file}} worked successfully.
[ ] brew cask uninstall {{cask_file}} worked successfully.
[ ] Checked there are no open pull requests for the same cask.
[ ] Checked the cask was not already refused in closed issues.
[ ] Checked the cask is submitted to the correct repo.

VirusTotal seems to provide some concerning information about this update. I might be wrong, but need verification

pkg is signed but seems to have bundled malware.

https://www.virustotal.com/en/file/1a2128812a01dfbbc0b932461daa49a3ca6f7efcbc50b0916f7cabebece4a6d8/analysis/1500328763/

pkgutil --check-signature zoomus--4.0.36452.0616.pkg
Package "zoomus--4.0.36452.0616.pkg":
   Status: signed by a certificate trusted by Mac OS X
   Certificate Chain:
    1. Developer ID Installer: Zoom Video Communications, Inc. (BJ4HAAB9B3)
       SHA1 fingerprint: 0F 67 41 1B BA 55 79 0B 19 01 50 2C 09 E7 41 C2 A7 5C 7C B8
       -----------------------------------------------------------------------------
    2. Developer ID Certification Authority
       SHA1 fingerprint: 3B 16 6C 3B 7D C4 B7 51 C9 FE 2A FA B9 13 56 41 E3 88 E1 86
       -----------------------------------------------------------------------------
    3. Apple Root CA
       SHA1 fingerprint: 61 1E 5B 66 2C 59 3A 08 FF 58 D1 4A E2 24 52 D1 98 DF 6C 60

I've opened a support ticket with upstream.

Note that, either way, this PR is wrong. The actual sha256 is 1a2128812a01dfbbc0b932461daa49a3ca6f7efcbc50b0916f7cabebece4a6d8 (see VirusTotal).
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 (the sha256 in this PR) is the sha256 for an empty string (we even check for it in multiple places in our audit).

Whoops, didn't notice that! I'll open a new PR. Thanks @vitorgalvao!
https://github.com/caskroom/homebrew-cask/pull/36692


Plugin not enabled after installation

Hello,
I installed the following plugin https://github.com/jichu4n/fish-command-timer, installation went fine, plugin file is located at both places ~/.{cache,config}/fisherman/command-timer/fish_command_timer.fish (looks normal to me), it's listed the fishfile (line jichu4n/fish-command-timer exists) but the plugin is not enabled. I have to manually call the fish_command_timer command in the shell or source the file in my fish config file.
Is it normal ? Looking briefly at the source code of fisherman, it seems that after installing a plugin it tries to enable it.
Env :
Arch Linux up-to-date
fish, version 2.6.0
fisherman version 2.13.0 ~/.config/fish/functions/fisher.fish
xfce4-terminal up-to-date (in case it's useful)
Thanks in advance.

Note that the plugin says that it should be manually enabled like I said. My bad if I'm wrong when thinking that fisherman handled this automatically.

@DjebbZ Yep. The problem is, that this is not really a plugin, but a file with some code in it. Ideally, this software would be distributed as a fish "configuration snippet".
From the fish docs:

Configuration snippets in files ending in .fish, in the directories:

$XDG_CONFIG_HOME/fish/conf.d (by default, ~/.config/fish/conf.d/)
$__fish_sysconfdir/conf.d (by default, /etc/fish/conf.d)
/usr/share/fish/vendor_conf.d (set at compile time; by default, $__fish_datadir/conf.d)

Notice that snippets are a "fish-shell thing", not something made up in fishmerman.
If you must use this software, you have a few options:

Contact the author and try to convince him to rewrite that code as a legal fish snippet. Basically, put the code inside a conf.d directory and not ask users to source the file.
Optionally fork that project and follow the steps above to fix it.

@DjebbZ Also check out humanize_duration and see if you can use it instead. 👋

So fast !
I don't have the skills to develop it, I'd rather point the maintainer to this discussion. Thanks a lot !

@DjebbZ Cool. So, the "fishy" way would be to ask users to put that file inside ~/.config/conf.d instead of sourcing the file. This is still not enough for fisherman to pick it up, so if @jichu4n would be so kind to change their repo structure to this:
LICENSE
README.md
conf.d/fish_command_timer.fish

then fisherman would be able to install that as plugin (snippet).

I'm writing this exact Pull Request right now :smile:
Your explanations are very precise, really appreciated.

I'm almost there : I installed my fork locally, but had to open a new shell to see the results. I thought simply running fisher . in my fork would install and enable, seems it just installed it.
I'm asking so that I write proper instructions in the Pull Request. Thanks again !

@DjebbZ Just let me know what else you need from me. 👋

here you go https://github.com/jichu4n/fish-command-timer/pull/15


Find some way to warn people when using wrong barrier dimensions

When tile group dimensions don't match barrier dimensions, the simulation hangs but doesn't throw out any errors. This has happened to many times and can confuse a lot of users. Find a way to compare the two values and throw out at least a warning for it.

Duplicate of #581


Add ::theme

Explanation: ::part and ::theme are defined together in the spec, but it looks like ::part is the only one listed in CanIUse. I think this is somewhat complicated because IIRC, Chrome's initial implementation was of ::part but not ::theme? (Unless someone can correct me?) If that's the case, it makes sense to separately list both.
See:
https://github.com/fergald/docs/blob/master/explainers/css-shadow-parts-1.md
https://developer.mozilla.org/en-US/docs/Web/CSS/::part

Looks like ::theme was removed from the specification and isn't supported in any browser. See here for a bit more information.

Oh! Weird. MDN still links to that explainer. Oh well, thanks!


Add information about publishing views into docs page

Add information about publishing views into docs page
Currently the github readme.md shows how to publish the vendor views, but this information was missing in the docs pages.
this PR set the docs align

Thanks!


Save after refresh?

Is the description for the save parameter correct? What use would a save after a refresh be? Surely refreshing the data means there is nothing to save?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 15ceb029-d6be-0391-c7ae-99f209cf9286
Version Independent ID: d58d7a85-3881-e653-f24e-6da42aa8dc7e
Content: refresh (Client API reference) in model-driven apps - PowerApps
Content Source: powerapps-docs/developer/model-driven-apps/clientapi/reference/formContext-data/refresh.md
Service: powerapps
GitHub Login: @KumarVivek
Microsoft Alias: kvivek

@EHulburd Thanks for the feedback. We have updated the docs with the correct information and pushed to live. Closing the issue.


Cryptographic columnar cipher implemented in Java

I have created a cryptographic columnar cipher used in networking transmission.

I have added identation in Producer Consumer problem along with comments
and also in columnar cipher I have added link for proper explanation and comments added with indentation


about embedkgqa

hi,embedkgqa model = cronkgqa,but which model is the real embedkgqa?

Hello, I'm surprised. What model is model1? The  results are the same as cronkgqa

QA_model_EmbedKGQA_complex is the actual EmbedKGQA model. What do you mean by model1?

QA_model_EmbedKGQA_complex is the actual EmbedKGQA model. What do you mean by model1?

Because I trained embedkgqa and model1 and got the same results, I don't know which model model1 represents

Can you elaborate how you trained those two models? ie the commands used?

Can you elaborate how you trained those two models? ie the commands used?

I used the commands of running code in readme

Are these the exact commands you used?
  In my experiments with the base model (model1) I do not get as good results as CronKGQA. It would be helpful if you could share the exact command you ran

Also can you show what results you got with model1? In my experiments with the base model (model1) I do not get as good results as CronKGQA. It would be helpful if you could share the exact command you ran

yes,I used these commands, but I did't save the results of model1, I can train it again, then I can provide the results to you.Thank you very much for answering my question

hi,I have another question,I trained embedkgqa_complex,but when I to eval it , the following error occurred:
Traceback (most recent call last):
File "./train_qa_model.py", line 551, in
qa_model.load_state_dict(torch.load(filename))
File "/opt/current-env/anaconda3/envs/tf_2.x/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1223, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for QA_model_EmbedKGQA_complex:
Missing key(s) in state_dict: "entity_embedding.weight", "time_embedding.weight".
Unexpected key(s) in state_dict: "tkbc_model.embeddings.0.weight", "tkbc_model.embeddings.1.weight", "tkbc_model.embeddings.2.weight", "entity_time_embedding.weight", "answer_type_embedding.weight", "combine_all_entities_func_forReal.weight", "combine_all_entities_func_forReal.bias", "combine_all_entities_func_forCmplx.weight", "combine_all_entities_func_forCmplx.bias", "linear2.weight", "linear2.bias", "bn2.weight", "bn2.bias", "bn2.running_mean", "bn2.running_var", "bn2.num_batches_tracked".

This is because embedkgqa_complex needs non-temporal complex embeddings. You can train those separately, but we will upload a trained checkpoint soon. It would be great if you could create a separate issue for this

This is because embedkgqa_complex needs non-temporal complex embeddings. You can train those separately, but we will upload a trained checkpoint soon. It would be great if you could create a separate issue for this

ok, thank you


Could not load file or assembly Microsoft.Web.Infrastructure

Similar to issue #92, I'm getting the following error in the Request tab.
Could not load file or assembly 'Microsoft.Web.Infrastructure, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.
This is on a web forms project, on a machine that doesn't have mvc3 installed.
I'm resolving by installing mvc3, but it may be worth considering an alternative mechanism to retrieve the information for this tab.

I got this issue in the IIS cloud.
It works in my local.
What is the problem?


[TeX input] support for Cyrillic

This is closely related to #1120 but could be started without it.
Traditionally, TeX needs macros to support Cyrillic. The standard one seems to be cyracc.def which is used in much production content.

@pkra, when you added this to v2.x.x, were you thinking about the example extension that I went you back in February?  Would we need to add a Cyrillic web font, or rely on system fonts?  Your 1120 links to some potential font sources.

@pkra ping

I think I added this before this milestone moved from "all the things 2.x" to "2.7" (but yes, it must have been inspired from your example).
I don't mind kicking it out or doing whatever you want to do.

I'd prefer not to do it without proper font support.  We could do it with the STI fonts now, but not the MathJax TeX fonts.  If you want me to build a Cyrillic font to include in the MathJax fonts, I can do that.  Probably would not be too hard.

The package you link to seems to have a different transliteration scheme than the one we did from the AMS style.  do we have anyone at AMS who knows about the different packages and could advise us on how to proceed?

Hm. Getting complicated. Do you want to discuss this at the next F2F?

Do you want to discuss this at the next F2F?

Sure.

Maybe this should be a third-party extension in [Contrib]?

Maybe this should be a third-party extension in [Contrib]?

Oh yes, that sounds like a good compromise for now.


Rich Indexing

Semi-Dynamic Index building for Markdown+
Build simple, rich, or hybrid indexes with internal links.
Usage
Both usage cases center around the use of the index extension.
@label@(parent1|parent2|...)

Simple Index
Anywhere in the document add an index marker with no label and a list of terms to be indexed. Terms will be searched for in a case and whitespace insensitive manner. Pipe (|) is used as a delimiter.
@@(Term1|Term2|Another term)

Complex Index Entry
An index marker can be placed anywhere inline.  The label will be used as the lookup term in the index. If parent(s) are listed, the label will be listed as a nested sub-entry under each of the parents. Pipe (|) is used as a delimiter.
@This Term@(Magic)

The label will also be used for the HTML translated anchor by stripping whitespace and converting it to lowercase.
Generating the Index
The rich index snippet, when executed, combines the simple and rich index entries into a single, alphabetized index.
If you have simple and rich entries, rich entries will be folded under the simple entries as follows:
0. Simple entries are created as top-level, un-indented entries.

Child entries are indented under their top-level parent.
If a Rich entry has no parent, it will be inserted as a top-level entry.
If a Rich entry has a parent and that parent does not exist in the top-level entries, the parent will be added as a new top-level entry and the Rich entry will be added as a child of that top-level entry.
If a Rich entry has a parent and the parent exists in the top-level entries, and the Rich entry is not listed as a child of the parent, it will be added as a new child.
If a Rich entry has a parent and the parent exists in the top-level entries, and the Rich entry exists, the child will be updated with an additional page reference to the new Rich entry.

{{index,wide
##### Index

- That ... pg. [1](#page0), [3](#page2)
- there1
  - here ... pg. [3](#here)
  - onehere ... pg. [2](#onehere)
- there2
  - here ... pg. [2](#here)
- there3
  - more ... pg. [3](#more)
- This ... pg. [1](#page0), [3](#page2), [4](#page3)

}}

Known issues.

The snippet is not smart enough to know that it is scanning markup when looking for terms. This could create bad entries.
The simple index lookup assumes page-level anchor links in the format #page## ( e.g. #page1 ) that do not currently exist
The links don't seem to work
The Styling is meh. I mostly emulated the existing Index snippet. We could do some dot padding, etc.

Other notes
I'm not the most efficient JS coder. I'd be very unsurprised if some of this could be condensed.
I'm not married to the @label@(parent) pattern - I wanted to emulate the link markup and @ wasn't occupied as best I was aware.

The simple index lookup assumes page-level anchor links in the format #page## ( e.g. #page1 ) that do not currently exist

Homebrewery does have page-level anchor's on the
 elements, in the form of id="p1". These get used by the TOC snippet.

The simple index lookup assumes page-level anchor links in the format #page## ( e.g. #page1 ) that do not currently exist

Homebrewery does have page-level anchor's on the
 elements, in the form of id="p1". These get used by the TOC snippet.

Oh. Wow. I just learned a new thing. I had no idea that the anchor behavior also applied to any ID'd tag. That's got to have been there for years?!
:exploding_head:

Yes, but due to how rendering works this is funky, Id for headers are not unique between pages, and Partial Page Rendering(PPR, which applies to 50+ pages brews) blocks them altogether. We are working on some fixes for that.

Yes, but due to how rendering works this is funky, Id for headers are not unique between pages, and Partial Page Rendering(PPR, which applies to 50+ pages brews) blocks them altogether. We are working on some fixes for that.

Fair, but as long as the ones for the pages are, it works for this purpose so long as someone doesn't manage to construct a collision between tags.
I considered concatenating the page number with the munged label ( i.e. p1-thisismylabel ) but I didn't see an elegant way to grab that...

If/when #3089 goes live, each Markdown token will be contained inside pageBlock tokens, which will have a pageNumber property, so it will all be accessible from the Markdown Lexer output.

I am unsure what is going wrong with this conflict

There is currently an active conflict between the Variable code and this PR. The variables code is processing the parentheticals if the parenthetical has spaces. I have not been able to determine why - my regex is too weak to understand the version of variables that was implemented.

Test document:
https://homebrewery-pr-3113.herokuapp.com/share/T9i5qU8UxHcK

Just doing a quick look at this now, and I likely will come back to this comment to add more bits later as I find them.  This is a checkbox list not because everything has to be done, but just in case you want to check them as "looked at" as you read it.

[ ] a.  At first I was confused on why it was generating multiple pages in your example brew but now I understand that it's because there are multiple appendices, so it makes more sense.   I don't have an answer for this; but what if this snippet only generated the {{index ...}} portions, with no page breaks between them, and users could sort them out themselves?  Here is what that would look like:  (sidenote:  you have a stray ` on page 1 inside your code fence which is causing bad formatting in the generated index entry.):

[ ] b.  Is it worth considering generating an id for each index, since we are generating stuff anyway?  So you'd get `{{#spell-index,index,wide ...}}?  It would make it easier for users to target it with CSS later.  But maybe not worth the extra clutter.

[ ] c. I think your index styling needs a little more.  It should be a five-column layout at minimum.  And for practicality, I suggest two properties:  column-span: all for headers, and column-fill: balance for the index.  The first one isn't true to the PHB, but with short indices with few entries they will look much better.  And the column-fill works better with balance because the default auto requires either a fixed height or manual column breaks.  Here are my recommendations:

	.index {
		column-count: 5;
		font-size : 0.218cm;

		h1, h2, h3, h4, h5 {
			column-span: all;
		}
   ...

[ ] d. An alternative to (c) is to change the .page/.columnWrapper itself to have 5 columns rather than 2.  Basically drop the {{index }} block wrapper, switch to {{index}} span wrapper and use it like the cover pages where you use :has(.index).  That way you'd have a fixed-height columnWrapper that is set to 5 columns and can use column-fill: auto.  I still recommend column-spanning headers though.  The generator wouldn't wrap each index anymore, but just stamp {{index}} at the top of the page, followed by index, and the CSS something like this:

.page {
	&:has(.index) .columnWrapper {
		column-count: 5;
	    column-fill: auto;
		font-size : 0.218cm;
		...

[ ] e. Rather than ellipsis, should it just be a comma between the entry and the page number (and leaving off pg. entirely)?  That is how the PHB is.
[ ] f. Expanding on (e), the generator currently adds a trailing comma on every entry.  It should likely be doing some sort of join(',') on an array of results rather than just adding a comma to each result?  I haven't looked deep at the actual js yet.

That's enough to chew on for now I think.  I haven't looked at crossreferences yet (the example doc doesn't seem to have them, which is fine for now, but should likely get them before we merge).

I'm going to respond to these individually where I do.

[ ]  a.  At first I was confused on why it was generating multiple pages in your example brew but now I understand that it's because there are multiple appendices, so it makes more sense.

I probably could explain that more clearly.  The section on using optional additional Indices doesn't do a great job of spelling out that they will be rendered distinctly.

I don't have an answer for this; but what if this snippet only generated the {{index ...}} portions, with no page breaks between them, and users could sort them out themselves?

I think that's kind of an "a or b" decision where one value isn't any better or worse than the other as a default.  I think we can push this decision off to be part of deciding the final default styling.

[ ]  b.  Is it worth considering generating an id for each index, since we are generating stuff anyway?  So you'd get `{{#spell-index,index,wide ...}}?  It would make it easier for users to target it with CSS later.  But maybe not worth the extra clutter.

There should be an implicit id generated for the H#. If not, we should add one.

C through E are really just styling thoughts. The styling is incomplete. It is the existing index styling with no tweaks. This tool should be style agnostic beyond the very minimal. Style should go in the theme.

[ ]  f. Expanding on (e), the generator currently adds a trailing comma on every entry.  It should likely be doing some sort of join(',') on an array of results rather than just adding a comma to each result?  I haven't looked deep at the actual js yet.

That isn't doing a join, but there isn't a solid reason for not doing one.

That's enough to chew on for now I think. I haven't looked at crossreferences yet (the example doc doesn't seem to have them, which is fine for now, but should likely get them before we merge).

Are you using https://homebrewery-pr-3113.herokuapp.com/edit/vtI5G0Zl_fan or https://homebrewery-pr-3113.herokuapp.com/edit/PXQAJqD9pVbK Both should have them.


Normalize Report and Dashboard Actions

Is your feature request related to a problem? Please describe.
All the action buttons in reports and dashboards use different components to trigger the action.
Describe the solution you'd like
Normalize to use the same components

Closes #363


Duplicate Quests

What is your Quests version / build number (do not say "latest")?
3.8.6
Describe the problem and how to replicate it. Any console errors to post using Pastebin.com?
Editing a quest results in 2 of the same quests and it makes them un-removeable.

Make a quest
Assign an NPC to the quest.
Edit the quest and save it.
/questsadmin reload
Duplicate is made
If applicable, can you provide an example quest from quests.yml using Pastebin.com?

Thanks for your report. I wasn't able to replicate this issue per se, but did discover that quest IDs would erroneously increment after editing, It seems likely that what you're experiencing is a by-product of this.
That said, please try the following build and let me know whether the problem has been alleviated:
https://ci.codemc.io/job/PikaMug/job/Quests/70/


Gaussian Mixture Model Code in python

I would like to contribute code implementation of Gaussian Mixture Model in python under GSSOC21.

Go ahead @vinc3nati.


Remove handling of "preprocessed" template tags when it is no longer necessary for eslint-plugin-ember compat

It will no longer be necessary when https://github.com/gitKrystan/prettier-plugin-ember-template-tag/issues/149 is shipped. This means we can remove handling of preprocessed template tags altogether.

Fixed by #162


Make settings/controls scrollable

If users have small screens or use scaling, then the settings might be so long that they continue beyond the screen. There is currently no way for the user to access those settings.
It should be relatively easy to implement a scrollbar to allows the user to scroll from the top settings to the bottom settings.

Hey, I'd like to fix this for you

Hey @lewisyng that would be great, thank you :)
Please check out our CONTRIBUTING for more information.

@atjn Just added the scrollbar. Some checks don't seem to start automatically. Let me know if something is missing for that to happen


create cli flags for install_gems

Author Name: Rogier Mars (Rogier Mars)
Original Redmine Issue: 4980, https://dev.opennebula.org/issues/4980
Original Date: 2017-01-12

Hi,
Would it be possible to create flags to set the OS and make the script non-interactive? This would make it easier to run the script from configmanagement like ansible. Now we have to wrap it in expect, and that causes other issues.
For example:
install_gems --os=centos --silent --force
install_gems --os=ubuntu --silent --force

Agree, for now I use this workaround:
sed -i 's/apt-get install/apt-get -y install/g' /usr/share/one/install_gems
echo '0\n' | /usr/share/one/install_gems

Fixed by #4233, install_gems is not interactive anymore.


How do we configure anti forgery when web api and angular 2 application are different website?

Hi, please see my comment here: https://github.com/aspnet/Mvc/issues/5681#issuecomment-272302665


Docs for eas apps tab

:nut_and_bolt: Description: What code changed, and why?

:chains: Related Resources
:+1: Definition of Done
:athletic_shoe: How to Build and Test the Change
:white_check_mark: Checklist

[ ] Tests added/updated?
[ ] Docs added/updated?

:camera: Screenshots, if applicable

should we close https://github.com/chef/automate/issues/1962 since it is being done as part of this already?

https://github.com/chef/automate/pull/2207

@chef/docs-team needs guidance from product and marketing around EAS. Our draft content is in #2207.

Could I get eyes on https://github.com/chef/automate/pull/2207 before we merge it here?

This PR is good to go and ready to merge when applicable.


[🐞] The components that uses server$ doesn't recovery after once be offline even if the network is recovered.

Which component is affected?
Qwik Runtime
Describe the bug
I am trying to make a qwik app that can work even while the network is offline.
I expected the server$ is not working if the network is offline.
But not expected once the network went offline, the app never to be recovered even if the network is recovered again.
https://github.com/QwikDev/qwik/assets/4876/635a91ed-b75a-4688-a649-10d100759327
Relating with https://github.com/QwikDev/qwik/issues/1846
Reproduction
https://github.com/genki/qwik-test/tree/offline_recovery_test
Steps to reproduce
Please git clone the repo above and
pnpm i
pnpm run dev

to visit the page on the browser.
Then,

Click the links "Top" and "Demo" at the footer to check if the navigation is working.
By using the dev tools, change the network status to "offline".
Confirm the navigation would fail to move to the "Top" that is using the server$ and see the errors in the console.
Change the network status to "no throttling" to recover the network.
Click the "Top" link and confirm the navigation is still not working even if the network is online.

System Info
System:
    OS: macOS 14.5
    CPU: (8) arm64 Apple M2
    Memory: 145.81 MB / 24.00 GB
    Shell: 3.6.1 - /opt/homebrew/bin/fish
  Binaries:
    Node: 20.12.1 - /opt/homebrew/opt/node@20/bin/node
    Yarn: 1.22.19 - /opt/homebrew/bin/yarn
    npm: 10.5.0 - /opt/homebrew/opt/node@20/bin/npm
    pnpm: 9.4.0 - ~/Library/pnpm/pnpm
    bun: 1.1.3 - ~/.bun/bin/bun
  Browsers:
    Chrome: 126.0.6478.127
    Safari: 17.5
  npmPackages:
    @builder.io/qwik: file:../../clone/qwik/packages/qwik/dist => 1.5.6-dev20240709001810
    @builder.io/qwik-city: file:../../clone/qwik/packages/qwik-city => 1.5.6
    typescript: 5.1.6 => 5.1.6
    undici: 5.22.1 => 5.22.1
    vite: 4.4.0 => 4.4.0

Additional Information
No response

If you remove the call of server$ from the "Top" page, the navigation is stay working even if go offline and of course after it is back.
Maybe the fail of the dynamic import in the qwikloader crushes something.

Hi, can you simulate this behaviour with an old version like 1.3.2 pls?
Is this appending in preview mode?

@gioboa
In the preview mode, it happened that the "Demo" link getting multiplied per clicking "Top" link while the network is offline.
But the navigation has been recovered after the network is back online.
I will try to test with the qwik-1.3.2

@gioboa
I have tested with the qwik-1.3.2, all behaviours were exactly same.

Thanks for your tests. Can you add the expected behaviour in the description pls?

@gioboa Yes, I added.

The one of the reasons of this issue may be which there's no error handling for this line.
https://github.com/QwikDev/qwik/blob/281de9701ecae0affcf18447985646917a2ef373/packages/qwik-city/runtime/src/server-functions.ts#L388


Add exactextract

now on conda-forge! as of last week!

Locking failing b/c there isn't an ARM build:
https://github.com/conda-forge/exactextract-feedstock?tab=readme-ov-file#current-release-info

sadly I just ran in to that too :/ is there a way to add it to platforms where possible?

is there a way to add it to platforms where possible?

@weiji14 went through this process for another package recently, documented below if someone wants to pursue it!
https://github.com/pangeo-data/pangeo-docker-images/issues/396#issuecomment-2148329950


Disable tab in navbar

Would it be better to disable tab in navbar for current page rather reloading it...?
Currently, if we click on same tab it reloads the page.

@jainaman224 Which tab . Can you please provide steps to reproduce.

Talking about this code.
    {{#if timeList}}

Schedule

      {{/if}}

If we are on same page. It will be better if we add any class to it to disable that 'li' tag. Instead of reloading that page or we can use it as go to top.


MyDashboard page showing multiple console errors when rendering

Sign In
Hit F-12 on the browser
Switch to the console view
Go to the My Dashboard Page

Lots of errors and warnings showing up there. Would be good to fix as many of these as possible.

See https://github.com/TrashMob-eco/TrashMob/pull/1626
@joebeernink  If there are other errors in the page, can you please add a screenshot? There's no other visible warning or error in the console or in the code on my side.


vpp: AF_XDP doesn't compile.

It gives a af_xdp plugins - no working libbpf found - af_xdp plugin disabled warning because the compile check fails.
I don't know why or what it is doing exactly, but I may try to troubleshoot that later.
For now, I haven't had a usecase for it and it seems very new.

-- Found Python3: /nix/store/vvcjl6cdspd1hf4jn8byp2k7801sa2xa-python3-3.10.7-env/bin/python3.10 (found version "3.10.7") found components: Interpreter
/build/source/src/plugins/af_xdp/CMakeLists.txt(14):  vpp_find_path(BPF_INCLUDE_DIR NAMES bpf/xsk.h )
/build/source/src/plugins/af_xdp/CMakeLists.txt(15):  if(NOT BPF_INCLUDE_DIR )
/build/source/src/plugins/af_xdp/CMakeLists.txt(20):  set_property(GLOBAL PROPERTY FIND_LIBRARY_USE_LIB64_PATHS TRUE )
/build/source/src/plugins/af_xdp/CMakeLists.txt(21):  vpp_plugin_find_library(af_xdp BPF_LIB libbpf.a )
-- af_xdp plugin needs libbpf.a library - found at /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/lib/libbpf.a
/build/source/src/plugins/af_xdp/CMakeLists.txt(22):  vpp_plugin_find_library(af_xdp BPF_ELF_LIB elf )
-- af_xdp plugin needs elf library - found at /nix/store/3n4f7bpw8vkb05vmchpbm061k3mfqg0g-libelf-0.8.13/lib/libelf.so
/build/source/src/plugins/af_xdp/CMakeLists.txt(23):  vpp_plugin_find_library(af_xdp BPF_Z_LIB z )
-- af_xdp plugin needs z library - found at /nix/store/91cri48yw4ca4bq46i1p5fa440nv0hyr-zlib-1.2.12/lib/libz.so
/build/source/src/plugins/af_xdp/CMakeLists.txt(24):  if(NOT BPF_LIB OR NOT BPF_ELF_LIB OR NOT BPF_Z_LIB )
/build/source/src/plugins/af_xdp/CMakeLists.txt(29):  set(CMAKE_REQUIRED_FLAGS -fPIC )
/build/source/src/plugins/af_xdp/CMakeLists.txt(30):  set(CMAKE_REQUIRED_INCLUDES /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/include )
/build/source/src/plugins/af_xdp/CMakeLists.txt(31):  set(CMAKE_REQUIRED_LIBRARIES /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/lib/libbpf.a /nix/store/3n4
f7bpw8vkb05vmchpbm061k3mfqg0g-libelf-0.8.13/lib/libelf.so /nix/store/91cri48yw4ca4bq46i1p5fa440nv0hyr-zlib-1.2.12/lib/libz.so )
/build/source/src/plugins/af_xdp/CMakeLists.txt(32):  CHECK_C_SOURCE_COMPILES(                                                                                #include <bpf/xsk.h>
int main(void)
{
    return xsk_socket__create (0, 0, 0, 0, 0, 0, 0);
} BPF_COMPILES_CHECK )
-- Performing Test BPF_COMPILES_CHECK
-- Performing Test BPF_COMPILES_CHECK - Failed
/build/source/src/plugins/af_xdp/CMakeLists.txt(38):  if(NOT BPF_COMPILES_CHECK )
/build/source/src/plugins/af_xdp/CMakeLists.txt(39):  message(WARNING af_xdp plugins - no working libbpf found - af_xdp plugin disabled )
-- af_xdp plugins - no working libbpf found - af_xdp plugin disabled
/build/source/src/plugins/af_xdp/CMakeLists.txt(40):  return()

I tried to compile the CHECK_C_SOURCE_COMPILES source manually:
[nix-shell:/tmp/build-test]$ gcc -o test test.c -I /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/include /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/lib/libbpf.a /nix/store/3n4f7bpw8vkb05vmchpbm061k3mfqg0g-libelf-0.8.13/lib/libelf.so /nix/store/91cri48yw4ca4bq46i1p5fa440nv0hyr-zlib-1.2.12/lib/libz.so
test.c: In function ‘main’:
test.c:4:5: warning: ‘xsk_socket__create’ is deprecated: libbpf v0.7+: AF_XDP support deprecated and moved to libxdp [-Wdeprecated-declarations]
    4 |     return xsk_socket__create (0, 0, 0, 0, 0, 0, 0);
      |     ^~~~~~
In file included from test.c:1:
/nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/include/bpf/xsk.h:310:5: note: declared here
  310 | int xsk_socket__create(struct xsk_socket **xsk,
      |     ^~~~~~~~~~~~~~~~~~
/nix/store/i38w7ashc8bvz4zh1i8gzbb3c5z3l71x-binutils-2.39/bin/ld: /nix/store/c1qvkgpx594g4grsgn4yfvc7j40b87ry-libbpf-0.8.1/lib/libbpf.a(usdt.o): in function `usdt_manager_attach_usdt':
(.text+0xb7b): undefined reference to `gelf_getnote'
collect2: error: ld returned 1 exit status

The deprecation warning makes me itchy, but the problem is that libelf isn't elfutils, and vpp needs elfutils' libelf.

Satz mit X war wohl nix.


Problems with trade offers.

offer.Accept() never return true anymore.
offer.OfferState never get TradeOfferState.TradeOfferStateNeedsConfirmation state. Even if you open in browser there is no message Awaiting mobile confirmation in trade offer. But if you call Bot.AcceptAllMobileTradeConfirmations(); trade will be accepted.
Bot.AcceptAllMobileTradeConfirmations(); don't write to log Confirmed Trade with... if there is a lot of items in offer (for example 100).

Actually all works fine.

offer.Accept() no longer returns a boolean, please see the method prototype
I am not reproing this
I will look into this.

I will look into this. Edit - I don't see that string in the code anywhere...
https://github.com/Jessecar96/SteamBot/blob/8a22079bee029bdf99ab9da9ed68b05b3b0005d2/SteamBot/Bot.cs#L1092


PostgreSQL database as a Prerequisite

Instead of having an integrated deployment of the PostgreSQL instance for the Orchestrator components, we set the existence of this database as a prerequisite.
A reference implementation of a simple deployment is documented for testing purposes only, based on Bitnami charts and validated on OpenShift 4.13+.
@masayag

@masayag given that the DB deployment is already provided by the user, do we still need the initContainters sections in the job-service and -data-index` deployments?
I think we can safely remove them and document that the DB must be available before installing the chart, WDYT?
Also, the whole thing may completely change the day we move to the operator-based deployments of these services.

Also, the whole thing may completely change the day we move to the operator-based deployments of these services.

Exactly, and that day has arrived. I'll first work on including the CRDs, to support the version that includes add-ons installation, next, we'll get rid of the entire job-service and data-index service deployments entirely.


implement Hashable for Nat

I notice The haskell version handles the size of Nats. Are Idris Nats infinite width? I notice you've got an implementation for Int which suggests to me this would be OK but I'd be guessing

Nat is arbitrary precisions, so you will need to do something more complicated, unfortunately I don't know how to do it. Maybe see what haskell's hashing library do?

Ah OK. I wondered if that might be the case. I'll leave this for now then - I'd rather not get into that can of worms


can't run in my pc

Traceback (most recent call last):
  File "main.py", line 168, in
    tf.app.run()
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py", line 48, in run
    _sys.exit(main(_sys.argv[:1] + flags_passthrough))
  File "main.py", line 163, in main
    agent.train(conf.t_train_max)
  File "/home/ddy/workspace/deep-rl-tensorflow/agents/agent.py", line 67, in train
    observation, reward, terminal = self.new_game()
  File "/home/ddy/workspace/deep-rl-tensorflow/environments/environment.py", line 87, in new_random_game
    self.lives = self.env.ale.lives()
AttributeError: 'TimeLimit' object has no attribute 'ale'

the command is :
python main.py --double_q=True --network_output_type=dueling --env_name=Breakout-v0
I have installed scipy opencv tensorflow_1.0 gym[all]

It seems TimeLimit object is a wrapper of AtariEvn,
change line 22 in file environment.py:

self.env = gym.make(env_name).env  # self.env = gym.make(env_name)

and it works


Monitoring - steve blocks monitoring from finishing installation

What kind of request is this (question/bug/enhancement/feature request):
bug
Steps to reproduce (least amount of steps as possible):

run rancher:mater-head 3623201ad single install
add a cluster
enable the cluster monitoring

Result:

both the app cluster-monitoring and monitoring-operator are stuck in installing state

Metrics show on the cluster dashboard, node page, etc, but the Grafana and Prometheus links are broken

Other details that may be helpful:

disabling steve fixes the problem partially: Grafana and Prometheus are accessible, but apps show new errors

Rancher logs:
2020/03/03 20:05:24 [ERROR] AppController p-tjr5h/cluster-monitoring [helm-controller] failed with : failed to install app cluster-monitoring. Error: UPGRADE FAILED: a release named cluster-monitoring is in use, cannot re-use a name that is still in use

Similar issue to https://github.com/rancher/rancher/issues/25742
There are jobs (operator-init-cluster-monitoring/operator-init-monitoring-operator) in downstream cluster that are completed but helm is not recognizing that and fails to remove them and mark app as deployed. Starting to think this has something to do with watchers/informers.
Ex helm logs:
Watching for changes to Job operator-init-cluster-monitoring with timeout of 0s
Add/Modify event for operator-init-cluster-monitoring: ADDED
operator-init-cluster-monitoring: Jobs active: 1, jobs failed: 0, jobs succeeded: 0

You can see the helm/tiller processes for those just hanging:
USER       PID  START   TIME COMMAND
root       735  17:52   0:00 rancher-helm upgrade --install --namespace cattle-prometheus monitoring-operator --timeout 0 --set operator.apiGroup=monitoring.coreos.
root       736  17:52   0:02 rancher-tiller --listen :42962 --probe-listen :58626

root      1231  18:21   0:01 rancher-tiller --listen :60924 --probe-listen :43186
root      1232  18:21   0:00 rancher-helm upgrade --install --namespace cattle-prometheus monitoring-operator --timeout 0 --set operator.resources.limits.memory=500

root      1246  18:21   0:01 rancher-tiller --listen :33356 --probe-listen :35169
root      1252  18:21   0:00 rancher-helm upgrade --install --namespace cattle-prometheus cluster-monitoring --timeout 0 --set exporter-kube-etcd.enabled=true,prome

When I try to do a manual status on the cluster-monitoring install it works but says pending, however when I do one of the monitoring-operator (HELM_HOST=:42962 rancher-helm status monitoring-operator) I get this error from tiller:  [storage/driver] 2020/03/09 18:35:50 query: failed to query with labels: the server is currently unable to handle the request (get configmaps)
The following errors have shown up in logs, not directly around the install but at diff times, potentially unrelated:

retrywatcher.go:129 Watch failed: the server is currently unable to handle the request (get jobs.batch)
reflector.go:326] github.com/rancher/steve/pkg/clustercache/controller.go:184: watch of *v1.PartialObjectMetadata ended with: too old resource version:

the fix is validated on master-head c34bdc2bb
the steps are the same. Monitoring is working as expected.


Added graph team funsettings set solving #817

Take 2!  This PR adds the graph team funsettings set command resolving issue #817
Cleaned up commits, removing changes to package and shrinkwrap files.  Rebuilt and retested.

Coverage remained the same at 100.0% when pulling f13143e083858f6774aed3789e41a39d4c029085 on arnieraju:feature/817-team-funsettings-set into 8a81ecdcf004ff502a3083b4efc27d46387d0cf6 on pnp:dev.

Nice! Thank you @arnieraju, we'll have a look shortly!

Merged manually. Thank you! 👏


newFiles

@Raj-tonystark46 Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

No thanks


Backport "HBASE-26817 Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIX" to branch-2.4

Signed-off-by: Duo Zhang<EMAIL_ADDRESS>

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m  6s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ branch-2.4 Compile Tests _

+1 :green_heart:
mvninstall
2m 24s
branch-2.4 passed

+1 :green_heart:
compile
2m 11s
branch-2.4 passed

+1 :green_heart:
checkstyle
0m 39s
branch-2.4 passed

+1 :green_heart:
spotbugs
1m 18s
branch-2.4 passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
2m  7s
the patch passed

+1 :green_heart:
compile
2m 11s
the patch passed

+1 :green_heart:
javac
2m 11s
the patch passed

+1 :green_heart:
checkstyle
0m 38s
the patch passed

+1 :green_heart:
whitespace
0m  1s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
10m  7s
Patch does not cause any errors with Hadoop 2.10.0 or 3.1.2 3.2.1.

+1 :green_heart:
spotbugs
1m 19s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 10s
The patch does not generate ASF License warnings.

28m 51s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4197/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/4197

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile

uname
Linux 781d44eb8d83 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2.4 / 1fca21722b

Default Java
AdoptOpenJDK-1.8.0_282-b08

Max. process+thread count
60 (vs. ulimit of 12500)

modules
C: hbase-server U: hbase-server

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4197/1/console

versions
git=2.17.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.


test-branch/execute-job/wrong-comment-on-pr/20907a22-1f2f-41c2-b98a-dbe4bbcaa48d

PR for testing 7d5bdb8ada5f7073de9a4619caaff8f4477264c3

comment 1


Stale element reference: element is not attached to the page document

12:16:00.101 INFO - Executing: [find element: By.xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']])
12:16:00.115 INFO - Done: [find element: By.xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]
12:16:00.125 INFO - Executing: [implicit wait: 1000])
12:16:00.127 INFO - Done: [implicit wait: 1000]
12:16:00.132 INFO - Executing: [click: 54 [[ChromeDriver: chrome on XP (4ff171e97d5b794417dfd920aa033cb6)] -> xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]])
12:16:00.206 INFO - Done: [click: 54 [[ChromeDriver: chrome on XP (4ff171e97d5b794417dfd920aa033cb6)] -> xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]]
12:16:00.215 INFO - Executing: [is displayed: 54 [[ChromeDriver: chrome on XP (4ff171e97d5b794417dfd920aa033cb6)] -> xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]])
12:16:00.226 INFO - Done: [is displayed: 54 [[ChromeDriver: chrome on XP (4ff171e97d5b794417dfd920aa033cb6)] -> xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]]
12:16:02.237 INFO - Executing: [click: 54 [[ChromeDriver: chrome on XP (4ff171e97d5b794417dfd920aa033cb6)] -> xpath: //div[contains(@id, 'ext-comp-') and contains(@style, 'display: block') and contains(@style, 'visibility: visible')]//div[contains(@class, 'x-window-footer')]//button[text()='OK']]])
12:16:02.713 WARN - Exception thrown
org.openqa.selenium.StaleElementReferenceException: stale element reference: element is not attached to the page document
(Session info: chrome=54.0.2840.99)
(Driver info: chromedriver=2.25.426923 (0390b88869384d6eb0d5d09729679f934aab9eed),platform=Windows NT 10.0.10586 x86_64) (WARNING: The server did not provide any stacktrace information)
What is the reason that an exception is thrown?
This exception is thrown in all test cases provided within Bobcat AEM JUnit archetype.
You can see from the logs the Bobcat tries to click "OK" dialog button two times, what is the reason of this behavior?

Hi Anton, could you provide java stacktrace from the moment of failure?

Please see error-log.txt.
By the end of the tests execution it says me that test result is OK,
but the existence of this exceptions has put into question this result.

We will look at this, thanks

Hey Anton,
Unfortunately our integration tests don't show any problems with the mentioned archetype. You should bear in mind that AEM 6.1 is the preferred version to run example tests, could you let us now on what AEM version you are trying to execute these tests?


Adding a shell script to execute jasmine-node's own spec files

I created this simple script to run jasmine-node's own specs under the scripts directory. This is the file I use locally when I work on jasmine-node and I think this would be helpful to others.
It's very easy to switch between the default and --verbose mode by passing in the "--verbose" argument.
I also updated the documentation with "development" notes.

merged thanks


MacOS build error in CI

Hi there,
Just trying to have a little play with this.
Thanks!
Alex

If you check in my gut repos, I fixed this ci issue in godot-steam-api.
Though probably you want to not use this repo? It’s for Godot 3.x. Godot 4 uses a new systems to talk with c++

Thanks!


Fix crashes in case of absent openGL

checks context nullity at entry of a NanoVG function where it's forgotten
on openGL context initialization after the first one, the function pointers would not be checked for null, resulting in crash

I don't particularly like the way the needsInit check is before every function, but I cannot think of anything else that would not require 2 different macros.
So applying this now, thanks!


Make Conjure Water not place water in the Nether, and work with cauldrons and waterloggable blocks

Fixes Conjure Water to not place water in the Nether
Allows Conjure Water to fill cauldrons
Allows Conjure Water to waterlog blocks

Based on Hex Casting's Place Fluid spell implementation

Ohh this can even insert into fluid containers I see. That has great potential. Thanks for the contribution! (This counts as a bugfix so I can still publish it right?)


Fix datatable retrieval issue with latest gherkin

In regards to issue #36, using yarn and applying the temporary workaround mentioned here (which will hopefully be merged soon), everything works as expected, but apparently, the new gherkin version has a slightly different step structure, and the datatable retrieval breaks. This PR fixes it and still maintains compatibility with the previous version.

Hey @Lukas-Kullmann, could you have a look?

Hey @dbuggerx,
I will have a look. Unfortunately, I am not in the office this week, so you will have to wait till next week for this to be merged.

Ok, no problem. Thanks!

Hey @Lukas-Kullmann, would you know when you could have a look at this?

Hey,
I'm so sorry, I kind of forgot about this. I'll be back in office on Tuesday and I have set a reminder to do it first thing in the morning then.

Thanks a lot man!

Hey @Dbuggerx,
I published v2.3.3 with your changes. :)

Thanks!


ForkingPickler can't pickle

Hi,
I was trying out the pycro-manager with democamera config in microanager-gamma (14May nightly build) in a jupyter notebook with the following codes as documented.
from pycromanager import Acquisition, multi_d_acquisition_events

with Acquisition(directory=r'C:\Users\biswajitpradha\Reseach\analysis\PycroManager\data', name='acquisition_name') as acq:
    events = multi_d_acquisition_events(
                                    num_time_points=4, time_interval_s=0,
                                    channel_group='channel', channels=['DAPI', 'FITC'],
                                    z_start=0, z_end=6, z_step=0.4,
                                    order='tcz')

But it showed an error:
AttributeError: Can't pickle local object 'Acquisition.__init__.<locals>.event_sending_fn'

full error pic:

Do you know what's going wrong here?
Thanks, Biswajit

Appears to be something specific to python launching new processes on Windows. I just pushed a new version that may fix this. Upgrade to version 0.0.3 with pip install pycromanager --upgrade and give it a try

Hi @henrypinkard ,
Thanks for the hard work on this! Same issue here. I just tried to install version 0.0.3 and it isn't found. pip install reports that only 0.0.1 and 0.0.2 are available.
Looking forward to trying the package out on a couple of our rigs,
Doug

Whoops, look like I somehow forgot to push. Its up now. Let me know how it goes

This code,
from pycromanager import Acquisition, multi_d_acquisition_events

with Acquisition(directory=r'C://testing//data', name='acquisition_name') as acq:
    events = multi_d_acquisition_events(
                                    num_time_points=4, time_interval_s=0,
                                    channel_group='channel', channels=['DAPI', 'FITC'],
                                    z_start=0, z_end=6, z_step=0.4,
                                    order='tcz')

used with version 0.0.3 now gives the following error:
TypeError: no default __reduce__ due to non-trivial __cinit__
full error picture:

looks like this is a quirk with how windows handles multiple processes. For the time being, you can fix this by putting your whole script in a block with:
if __name__ == '__main__':
     with Acquisition...

I'm going to keep playing around to see if I can find a more durable solution

I guess the above is the best solution possible due to how multiprocessing is implemented on windows. This should be fixed by #18, and I just pushed version 0.2.0 to pip that has these changes.
You'll need to get the next MM nightly build after this PR merges (https://github.com/micro-manager/micro-manager/pull/805).
Closing for now since I think this is fixed. Open a new one if you run into something else


rust: Channel and Schema structs have IDs

Changelog

adds id members to the crate::Channel and crate::Schema structs.
refactored and separated Writer::add_channel into two methods, Writer::add_schema and Writer::add_channel.

Docs
In docstrings, please review if not clear.
Description
When a message reader recieves schema and channel information, the schema and channel IDs in the MCAP are hidden from them.  This PR adds those so that readers can observe ID information.
Additionally, this PR updates the Writer interface in these ways:

The add_channel(Channel) method is replaced with add_channel(schema_id, topic, message_encoding, metadata). This was done because the Channel struct now contains a channel ID, and to continue to use it would force the user to come up with their own channel ID before calling this function.
An add_schema(...) method is added to register schemas ahead of channels. This is needed to allow the caller to register a new schema without coming up with an ID in advance.
The existing write(Message) method is kept, but instead of automatically assigning new IDs for the message channel and schema, it uses the IDs passed in. This means that when writing functions that transform MCAP data, the IDs from the input can be kept in the output.

BeforeAfter

cc. @mrkline


unable to scrap help

Can i get some help.
Had to make some tweaks to get it to even download. But now it is downloading and after a while the browser closes exactly at the same spot every time it is downloading the Model S manual it gets to section 12 and just closes the Brower, opens back up and I authenticate again but it starts at the very beginning of the manual. It does not pickup from section 12.
Any help is appreciated?
***Changes to the requirements document
beautifulsoup4==4.10.0
certifi==2020.11.8
chardet==3.0.4
future==0.18.2
idna==2.10
lxml==4.8.0
Pillow==9.1.1
pywin32-ctypes==0.2.0
requests==2.25.1
soupsieve==2.2.1
urllib3==1.26.2
zipp==3.4.0

Starting from scratch again this time I didn't want to make any changes to your instructions.
Getting to step 6 this is the error I get, the way I got around this was changing the pillow version in the file previously but i'll instead wait to see what you recommend.
C:\Users\testUser\AppData\Local\Temp\pip-install-cbvxvd_h\pillow_2f4e64ae17c34c2e9b0782862e6affb1\setup.py:46: RuntimeWarning: Pillow 8.3.1 does not support Python 3.10 and does not provide prebuilt Windows binaries. We do not recommend building from source on Windows.
lambda: warnings.warn(
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> Pillow
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
WARNING: You are using pip version 22.0.4; however, version 22.1.1 is available.
You should consider upgrading via the 'C:\Users\testUser\AppData\Local\Programs\Python\Python310\python.exe -m pip install --upgrade pip' command.

I changed the requirements to pillow=9.1.1 than i get this following error which was another issue i had to resolve. Can't for the life of me remember what i did but I'm about to research it again and see how to get around it.
  error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.32.31326\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2
  *********************************************************************************
  Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?
  *********************************************************************************
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> lxml
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

Even after updating pip / modules  it seems that the script runs for a bit then encounters the following:
Seems to never finish getting the HTML files. never makes it to the Images.
Traceback (most recent call last):   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 262, in <module>     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 255, in run     driver.get_html()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 146, in get_html     self.restart_scrape()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 43, in restart_scrape     run()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 251, in run     driver.get_index()   File "C:\Users\zero\Desktop\TeslaServiceManualScraper-master\scrape.py", line 52, in get_index     window1 = driver.window_handles[1] IndexError: list index out of range

How did you get to that point, I'm having a hell of a time

selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"#form-submit-continue"}
(Session info: chrome=102.0.5005.63)
Not sure how to get around this to begin downloading. Any suggestions?

selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":"#form-submit-continue"} (Session info: chrome=102.0.5005.63)
Not sure how to get around this to begin downloading. Any suggestions?

Assuming you are using windows,   how did you install the PIP modules?   using the install -r requirements.txt didnt work so I installed them all manually.   in windows the python commands are  py -m pip install  nameofmodule
you can check what you have installed by using py -m pip list
I didnt do anything crazy.  I have the current ver of python installed on windows 11.  I just downloaded the zip, extracted , installed modules   cd' to the directory and ran the scrape.py.

I was able to actually get it to download but i had to not only modify the requirements but make changes to the secrets.py file. it is downloading now but the problem is the browser closes and restarts and once i put in the credentials it starts at the very top and does not continue from where it left off. quite irritating.

I don't know why the browser closes at all in the first place after it gets to like section 12 of the manual than it just restarts from the top.
hopefully the developer can chime in on both our problems, and I'm on windows 10

Can i get some help.
Had to make some tweaks to get it to even download. But now it is downloading and after a while the browser closes. Opens back up and I authenticate again but it starts at the very beginning of the manual.
***Changes to the requirements document
beautifulsoup4==4.10.0
certifi==2020.11.8
chardet==3.0.4
future==0.18.2
idna==2.10
lxml==4.8.0
Pillow==9.1.1
pywin32-ctypes==0.2.0
requests==2.25.1
soupsieve==2.2.1
urllib3==1.26.2
zipp==3.4.0
***Change to scrips for Windows users
This was the only way I could get the scraper to start otherwise it was throwing other errors related to the commands commented.
import time
TODO: Input your tesla account details
tesla_account_email = "email"
tesla_account_password = "pass"
login_delay = 15
def tesla_login(driver):
driver.get("https://tesla.com/teslaaccount")
driver.find_element_by_css_selector("#form-input-identity").send_keys(tesla_account_email)
time.sleep(10 + login_delay)
driver.find_element_by_css_selector("#form-submit-continue").click()
time.sleep(10 + login_delay)
driver.find_element_by_css_selector("#form-input-credential").send_keys(tesla_account_password)
time.sleep(10 + login_delay)
driver.find_element_by_css_selector("#form-submit-continue").click()
return driver

Also it does not download any of the images only the pages so far. I recall it downloads the pages first than images but the CMD prompt is a little misleading
example below it shows:
visited: 79
upcoming: 892
images: 252
visited: 80
upcoming: 891
images: 255
visited: 81
upcoming: 890
images: 256

There seems to be a few issues here, but there was definitely a bug.  The browser should restart, it is preemptively stopping Tesla from booting users out, but the bug is that it wasn't saving before the restart kicks in, so it restarts from the top.  Sorry about that, that's a breaking bug right there!
Unfortunately for the modules, I'm not sure I can help.  Selenium and chromedriver are notorious for having all sorts of gotchas.  I really didn't want to use Selenium but it was the quickest way to get this running for me.  I didn't think a ton of people would be using it, I just thought it was fun to share.  In retrospect, Selenium is no fun.

I think decoderring22 isnt using the latest version of your app.  I went to yesterdays version and received the same bug he did with the selenium.common.exception.
so @decodering22  pull the latest zip after @AnsonLai  fixes the resume bug on restart.  that should resolve your issue.

I  downloaded the latest as i only started to play with this today. I'm pretty sure it is the latest that has this bug. Unless you are saying to pull the latest after @AnsonLai fixes the bug than yes that is my plan.
@AnsonLai thanks for the confirmation it is supposed to close and restart. That is reassuring. As far as saving i can definitely see in the folder it has harvested all the HTML files up to the point before it restarts, none of the images are saved however. Do you have any ideas why it would not restart from the previous place? I'm not a developer but dangerous enough to break things and test things out. I spent so much on this i'm determined to get it to work and will share the file with you guys once I can confirm it works and downloads everything.
Thanks again for your effort. Figure get it now before Tesla stops people from downloading it.

  The model 3 manual seems to link to a few pages that the user doesn't have access to.
I created a tolerance threshold just now and pushed that out.  But you can skip it entirely, comment out lines 130 and 131 in scrape.py and I think you're in the home stretch!

Awesome let me try that right now. thanks

Well now this is interesting commenting out 130 and 131  results in this error, after it authenticates it goes to the you do not  have access page like it always does but instead of opening the service manual it closes the browser and give this error below:
File "C:\Users\testuser\Desktop\TeslaServiceManualScraper-master\scrape.py", line 137, in get_html
source = re.sub(mpulse_tracker, '', source)
UnboundLocalError: local variable 'source' referenced before assignment

Are you sure you're commenting out the right lines?  You need to leave this intact:
source = self.driver.find_element_by_css_selector("html").get_attribute('outerHTML')
Comment out these two lines:
if not check_source_validity(source):
self.restart_scrape()

I put 130 and 131 back in but changed 133 to 100 from 10 and it went into a loop on can't access this page so i killed the browser.
I'm going to call it a night and check your comment tomorrow to give it another go. It is at the end of the manual before it start to download pictures so almost there.

Let me try it again now with just 130 and 134 commented out instead.

Doesn't like that, i believe your intent is to also comment out 132 & 133 as well correct just leaving 130 alone, which is now running waiting to see if it loops again
C:\Users\AF-NUC\Desktop\TeslaServiceManualScraper-master>python scrape.py
File "C:\Users\testuser\Desktop\TeslaServiceManualScraper-master\scrape.py", line 132
error_count += 1
IndentationError: unexpected indent

It is now going into the Unable to access File loop going to kill the browser so i don't get the VPN IP or account banned. Something is definitely not right as it gets near the end of the model S manual.
I can share the "docs" folder it is only 180MB, not sure if you run the script you will see exactly what I'm experiencing.
Let me know your thoughts, ill try again tomorrow.   None of the service manuals have 1800+ pages, and you're seeing that you visited 900 and still have another 900 to go.  I suspect in an earlier version of scrape.py, the URLs weren't being added to the visited list somehow.  You should start again by deleting dict.pickle and the data folder.  You should probably use the latest version of scrape.py as well.


NPE from plugin

I only see it in my logs once, and I don't remember anything odd happening at that time--I was traveling toward Taverley at the time according to my logs--but I did have it happen to me on May 29th. (3 days ago)
2022-05-29 15:11:34 [Client] WARN  n.runelite.client.eventbus.EventBus - Uncaught exception in event subscriber
java.lang.NullPointerException: null
	at net.runelite.api.coords.WorldPoint.fromLocalInstance(WorldPoint.java:217)
	at net.runelite.api.coords.WorldPoint.fromLocalInstance(WorldPoint.java:175)
	at com.Crowdsourcing.scenery.CrowdsourcingScenery.addObjectThisTick(CrowdsourcingScenery.java:81)
	at com.Crowdsourcing.scenery.CrowdsourcingScenery.onWallObjectSpawned(CrowdsourcingScenery.java:98)
	at net.runelite.client.eventbus.EventBus$Subscriber.invoke(EventBus.java:70)
	at net.runelite.client.eventbus.EventBus.post(EventBus.java:223)
	at net.runelite.client.callback.Hooks.post(Hooks.java:169)
	at gn.sw(gn.java:38111)
	at gm.r(gm.java:239)
	at po.f(po.java:1065)
	at hj.hj(hj.java:7958)
	at bn.hp(bn.java:7910)
	at client.ft(client.java:3271)
	at client.ag(client.java:1054)
	at aj.h(aj.java:368)
	at aj.run(aj.java:347)
	at java.base/java.lang.Thread.run(Thread.java:829)

Since opening this, I've started to see this error many more times in my logs.

I'll take a look at this tomorrow, thanks for raising it

Looks like this is because we call WorldPoint.fromLocalInstance(client, local) without guaranteeing that the LocalPoint local is non-null in the scenery crowdsourcing. The method that creates the local point (LocalPoint.fromWorld) seems to do some sort of plane comparison and if the current plane does not match the given world point's plane, it will return null instead of a coord.
I'm not entirely sure how this happens in the first place. Maybe rendering some object on a lower plane? I'll have to try a bit more to repro it. In other instances we just return when the local point is null, but if there's a better approach or if there's a legit edgecase we would miss by skipping (for ex do objs spawn on lower planes if you can see them?) that might not be good enough.

You should be able to return when the point is null. I wish I knew where this was being caused so it could be reproduced for testing, but I don't know offhand where this was caused.

FYI I'm still seeing this today in a variety of places in the game. If you were to set a conditional breakpoint on the point being null before passing it into fromLocalInstance() you might be able to figure out what triggers this. It's creating plenty of log lines in my logs though.


Fix all deprecation warnings

I've fixed all deprecation warnings from all versions of Django supported by taggit, while maintaining backwards compatibility with all currently supported versions, and with all tests passing.
This involved adding some helpers for the recently renamed field.rel.to/field.remote_field.model, and changing the use of add_lazy_relation to lazy_related_operation on Django 1.9.
SQL names are quoted using the correct function now, fixing #380 and #383.
on_delete=models.CASCADE has been added to all ForeignKeys where it was missing, including in tests and migrations. This is backwards compatible with current code and projects, as on_delete=models.CASCADE was the assumed default previously.
Warnings due to different versions of unittest bundled through different version of Django have been sorted out, as has a warning from Django for Python 3.3, 3.4.
Finally, DeprecationWarnings are now show in test output. As there are no more deprecation warnings, the test output is still useable as it is before, without being polluted with lots of DeprecationWarning noise.

I fixed the backwards conditional that you spotted, properly silencing the DeprecationWarning from Django in those versions of Python.

Sorry for the delay! Thanks a bunch, your contributions are greatly appreciated :sparkles:


Legacy GPU support

Any chance of legacy GPU support - ATI FirePro M7820?
Blender 2.8 works ok, Blender 3.3.1 wont display grid and background, objects not displayed correctly.

Debug files:
Note: when starting with blender_debug_gpu_glitchworkaround.cmd, grid, background and cube display correctly.
https://www.dropbox.com/sh/aj0xpbi7gd260s3/AABoLkCzMZIl8wfdsdxNeW14a?dl=0

After trying several blender versions (2.8.x - 2.9.x) from blender organisation, and versions 3.x.x from your github release page, blender has display problems or crashes on my system. Funny thing is that newer driver version has more problems than the older one. It's time for a hardware refresh...
Conclusion is that it's not worth anyone's time to bother with legacy hardware support, more so since Microsoft stopped windows 7 support.
I want to thank you for your time and work on blender support for windows 7.

I've checked the Blender system requirements (https://www.blender.org/download/requirements/). It says that Terrascale 2 GPUs have been deprecated since version 2.91, probably one of the reasons for this was the buggy driver situation that you encountered.
The idea behind this project is not to support older hardware, but to allow those that prefer Windows 7 to use Blender on supported hardware.
If a change in Blender breaks hardware on Windows 7 as was the case with issues #18 and #19 i will revert the change. For this issue this is not the case, fixing it would require workarounds for driver bugs, which as you said is not worth it.