Bug: PermissionError causes ValueError: invalid literal for int() with base 10: ''

I have an ipfs share that is read only.
However if I try to create a file in this read only share, it gives an unexpected error in console.
The PermissionError: [Errno 1] Operation not permitted: '/ipfs' is perfectly normal, however the second error, ValueError: invalid literal for int() with base 10: '' seems to be bug?
Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/error_printer.py", line 52, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_resolver.py", line 213, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_server.py", line 126, in __call__
    app_iter = provider.custom_request_handler(environ, start_response, method)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 1525, in custom_request_handler
    return default_handler(environ, start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_server.py", line 345, in do_PROPFIND
    reslist = res.get_descendants(depth=environ["HTTP_DEPTH"], add_self=True)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 461, in get_descendants
    for child in self.get_member_list():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 419, in get_member_list
    for name in self.get_member_names():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/fs_dav_provider.py", line 218, in get_member_names
    for name in os.listdir(self._file_path):
PermissionError: [Errno 1] Operation not permitted: '/ipfs'

ValueError("invalid literal for int() with base 10: ''")
Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/wsgi.py", line 145, in respond
    for chunk in filter(None, response):
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/wsgidav_app.py", line 563, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/debug_filter.py", line 157, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/error_printer.py", line 52, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_resolver.py", line 213, in __call__
    for v in app_iter:
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_server.py", line 126, in __call__
    app_iter = provider.custom_request_handler(environ, start_response, method)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 1525, in custom_request_handler
    return default_handler(environ, start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/request_server.py", line 345, in do_PROPFIND
    reslist = res.get_descendants(depth=environ["HTTP_DEPTH"], add_self=True)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 461, in get_descendants
    for child in self.get_member_list():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 419, in get_member_list
    for name in self.get_member_names():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/fs_dav_provider.py", line 218, in get_member_names
    for name in os.listdir(self._file_path):
PermissionError: [Errno 1] Operation not permitted: '/ipfs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/server.py", line 1277, in communicate
    req.respond()
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/server.py", line 1073, in respond
    self.server.gateway(self).respond()
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/wsgi.py", line 151, in respond
    self.req.ensure_headers_sent()
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/server.py", line 1120, in ensure_headers_sent
    self.send_headers()
  File "/home/phill/.local/lib/python3.8/site-packages/cheroot/server.py", line 1138, in send_headers
    status = int(self.status[:3])
ValueError: invalid literal for int() with base 10: ''

I couldn't reproduce it here with
Running WsgiDAV/3.0.4 Cheroot/8.4.2 Python/3.7.7

I can mock an exception, but I don't get the ValueError: invalid literal for int() with base 10: '' error in send_headers
Could you add some more info?

I was mistaken that creating a file is the trigger, it's a little more complicated than what I first thought.
The upshot is this:
/ipfs/ is a filesystem that follows these rules:

The file system is mounted read-write but any write operations will result in a permission error
The next sub-level in the path must be a CID hash e.g. /ipfs/QmVFrvcv6ZapvBsLUuUKEKegKpGG1ojKz8xva6HC9DVfJN
This is a virtual file system, as such it has no children until a valid (matching rule # 2) child is requested, as such ls /ipfs results in a permission error

As you see in the attached log in the gist, the windows client trying to access /AutoRun.inf  at the base of the share which translates to /ipfs/AutoRun.inf  on this linux host throws a permission error because it violates rule # 2
Also sometimes the windows client attempts to list the root of the share / translating to /ipfs violating rule # 3
This is the expected behaviour. What is unexpected is the secondary header error that's (sometimes) triggered following the permission error.
I can't seem to reproduce this secondary error in the logs this time.
Config & logs are here: https://gist.github.com/phillmac/926080a445caa6af93001fe7730922fc
/ipfs and /ipns are read-write fuse mounted filesystems as per findmnt  and mounted by the same user wsgidav is running under :
├─/ipfs                               /dev/fuse                         fuse        rw,nosuid,nodev,relatime,user_id=1000,group_id=1000
└─/ipns                               /dev/fuse                         fuse        rw,nosuid,nodev,relatime,user_id=1000,group_id=1000

Hopefully this should help to nail down the lifecycle of the bug a bit better, if you need more details, let me know :D

Managed to get a clean trace with debug enabled, showing the full error.
wsgidav-error2.log

Confirmed it with a browser... trying to open the root of the /ipfs share triggers the bug 100% of the time

Thanks for providing the details.
It seems to be related to the processing in the error_printer middleware.
It could use some refactoring, but you can try this setting as a workaround:
error_printer:
    catch_all: true

(Which should be default btw. Did you explicitly set it to false before?)

Nope. I grabbed a copy of the example config as a template, set up my shares and left everything else alone.

I updated the sample. Does setting true help in your case?

Yup, that seems to at least mitigate the problem, I get a clean 500 error and the stack trace now looks something like this:
23:31:33.931 - <139958434023168> wsgidav.error_printer       ERROR   : Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/error_printer.py", line 51, in __call__
    app_iter = self.next_app(environ, sub_app_start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/http_authenticator.py", line 223, in __call__
    return self.next_app(environ, start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dir_browser/_dir_browser.py", line 110, in __call__
    context = self._get_context(environ, dav_res)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dir_browser/_dir_browser.py", line 182, in _get_context
    childList = dav_res.get_descendants(depth="1", add_self=False)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 461, in get_descendants
    for child in self.get_member_list():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 419, in get_member_list
    for name in self.get_member_names():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/fs_dav_provider.py", line 218, in get_member_names
    for name in os.listdir(self._file_path):
PermissionError: [Errno 1] Operation not permitted: '/ipfs'

23:31:33.932 - <139958434023168> wsgidav.error_printer       ERROR   : Caught HTTPRequestException(HTTP_INTERNAL_ERROR)
Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/error_printer.py", line 51, in __call__
    app_iter = self.next_app(environ, sub_app_start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/http_authenticator.py", line 223, in __call__
    return self.next_app(environ, start_response)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dir_browser/_dir_browser.py", line 110, in __call__
    context = self._get_context(environ, dav_res)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dir_browser/_dir_browser.py", line 182, in _get_context
    childList = dav_res.get_descendants(depth="1", add_self=False)
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 461, in get_descendants
    for child in self.get_member_list():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/dav_provider.py", line 419, in get_member_list
    for name in self.get_member_names():
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/fs_dav_provider.py", line 218, in get_member_names
    for name in os.listdir(self._file_path):
PermissionError: [Errno 1] Operation not permitted: '/ipfs'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/phill/.local/lib/python3.8/site-packages/wsgidav/error_printer.py", line 88, in __call__
    raise as_DAVError(e)
wsgidav.dav_error.DAVError: DAVError(500 Internal Server Error: An internal server error occurred
    Source exception: '[Errno 1] Operation not permitted: '/ipfs'')

23:31:33.932 - <139958434023168> wsgidav.error_printer       ERROR   : e.src_exception:
[Errno 1] Operation not permitted: '/ipfs'

Closing this bug for now, but improved the error handling in the middleware stack should be addressed in the next major release.
Especially the error_printer could need a review.


ARM M1 Mac - Porting SSE2 instructions to NEON

Has anybody had success building for ARM, apple M1 in particular, and replacing the SSE2 instructions with NEON.
I tried using this library but was not fully successful. https://github.com/DLTcollab/sse2neon

I would recommend the library SIMDe (simd everywhere) https://github.com/simd-everywhere/simde
I have used it in the past - it can translate pretty much any unsupported vector instruction either to a native supported equivalent or the closest most performant emulation.
I will be using this approach to compile the CineForm sdk on the NVIDIA Jetson platform (64-bit ARM)

TechSmith has created a fork to build CineForm for ARM64 Macs with sse2neon: https://github.com/TechSmith/cineform-sdk. It uses their own version of sse2neon to implement few missing functions. I built their fork on my MacBook Air with Apple Silicon and I was able to run TestCFHD.


Upgrade to 2.4.1 on Windows Failed from 2.3.2

I started at 2.3.2 and have about a weeks' worth of data.  Trying to upgrade to 2.4.1, I get the following error:
level=error ts=2018-09-19T15:50:57.3030419Z caller=main.go:617 err="opening storage failed: open e:\prometheus-data\wal\00000146: The system cannot find the file specified."
This is strange because while it is right, the file isn't there, there is a "E:\prometheus-data\wal\000146" file... so it seems like maybe its looking for too many zeros?
For fun, I did try just naming the 000146 file to 00000146 and got this error:
level=error ts=2018-09-19T15:52:34.7769161Z caller=main.go:617 err="opening storage failed: read WAL: repair corrupted WAL: cannot handle error"
I am able to revert everything back to 2.3.2 and everything seems to work fine.

I also just quickly tried to do the same upgrade on a new storage target to make sure I didn't have some weird corruption... I ran 2.3.2 for a few minutes to get some data, stopped it, replaced all the 2.3.2 files with 2.4.1 files and got the same result.

FYI, this is resolved for me with 2.4.2

Thanks! Closing!


Allow inner to view and update json provided by outer

I'm trying to determine whether SES is suitable to allow running scripts provided by third-party users that control their individual Objects in a WebXR app.
Essentially, the "host" application has a 3D Scene (using ThreeJS) which calls an update function each frame (~60fps) to update Objects in the Scene. Some of these Objects are run by third-party scripts. Each time the update function runs we would want to call the third-party script with just the data for their Object and allow them to view and modify it as they see fit.
My current understanding of SES is that I would need to evaluate the Scene's Object every frame to make it safe and then call the third party script with the safe version. My concern in doing this is that running evaluate on many Objects, many times per second is probably not going to be performant.
Am i potentially missing something here that would allow this to work without constant evaluation? Eg:
// adding an object to the scene run by a third-party script
function addObject(properties, scriptSrc) {
  const object = new SceneObject(properties)
  object.script = s.evaluate(scriptSrc)
  scene.add(object)
}

// called ~60 times per second
function update() {
  scene.objects.forEach(object => {
    // call the evaluated third-party script
    // passes in the object properties and allows the script to modify as they see fit
    object.script.update(object.properties)
  })
}

@ashconnell, sorry for the delay in answering. We are finalizing a new SES which is simpler and more performant.
Overall, evaluation is not the only way to safely put code in contact with each other. I will try to understand your use case:

You can evaluate and therefore isolate each third-party script in its own Compartment.
In your example, your evaluation returns a function (s.evaluate(scriptSrc)) and you just need to call that function later on, and you don't need to re-evaluate afterwards.
Once the code has been evaluated, it basically executes at native speed.
It looks like you have the perfect case, the scripts are pure transformational libraries (they only rely on input and outputs). If your input arguments to the functions are primitives, or if you prevent their mutability with harden(), and if you are careful with the return values (no live references) then you are very close to complete isolation.

I hope this helps. Feel free to ask for more details. I will keep this open.

Thank you @ashconnell. Please reopen if you have any follow-up questions!


General "default" git practice docs.

URL of RTD document: https://civicactions-handbook.readthedocs.io/en/git/

We used to provide some basic .gitconfig like the first 24 lines of https://github.com/openprivacy/dotfen/blob/master/home/.gitconfig - should we consider this (or does it exist somewhere else)?

We used to provide some basic .gitconfig like the first 24 lines of https://github.com/openprivacy/dotfen/blob/master/home/.gitconfig - should we consider this (or does it exist somewhere else)?

@openprivacy I am adding a much more conservative version of this in the next push. Git defaults have improved a lot and I feel much of this config is not needed anymore. I think helper is best left on a per-system config (ssh-agent should time out anyway, and timing out just git doesn't actually help). autosetuprebase means that git pull will rebase, which is fine if you expect that, but pretty unfriendly for developers not expecting that (especially if there is a conflict). I think whitespace and autocrlf can be better handled on a per-project basis by .gitattributes files, but I left autocrlf in as the default is still best set on an OS basis. I don't think merge.log adds anything if you are only doing fast-forward. push.default now has simple as the default.


Test Link.__delattr__ and Chain.__delattr__

These functions had been added by #2657. But they lack unit tests.

Probably this is solved by #3406

Thank you for notifying me. I close this issue.


Add unicode support

https://github.com/myfreeweb/httpotion/issues/65
Sorry for the messy history.. only 1 line was actually changed. Unicode responses were not getting decoded properly and this seems to fix it.

Hey, thanks for noticing that.
Could you add a test case that covers that change? Also, the commit history could be squashed and rebased with current master.

Okay thanks for the heads up on rebasing! That's done and added a test that seems to work, though not sure if it's in the right spot.


[MINOR][SQL] Remove unused an error class and query error methods

What changes were proposed in this pull request?
In the PR, I propose to remove the unused error class CANNOT_INFER_DATE and some unused methods/parameters from QueryExecutionErrors and QueryCompilationErrors.
Why are the changes needed?
To improve code maintainability.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
By existing tests, GA.

@panbingkun @LuciferYang @itholic @cloud-fan @srielau Could you review this PR, please.

Merging to master. Thank you, @itholic for review.

late LGTM


hot reload benchmarks 2-3x regressed in recent engine roll(with dart roll)

With https://github.com/flutter/flutter/commit/2e24351fb1a329cbf279cd87e1b647898e609262
hot_mode_dev_cycle_win__benchmark 2203ms(used to be 739ms) hotReloadFlutterReassembleMilliseconds
hot_mode_dev_cycle_linux__benchmark 2219ms(used to be 819ms) hotReloadFlutterReassembleMilliseconds
hot_mode_dev_cycle_linux__benchmark 2609ms(used to be 1299ms) hotReloadMillisecondsToFrame
Could be time-accounting issue since we also see 2x speed up in hotRestartMillisecondsToFrame 2397ms(used to be 5070ms)

Closing in favour of #17888 which came later, but is better-tagged.


Black screen when opening a project in the web version [3.5.rc6]

Godot version
v3.5.rc6.official.f05cecdc4
System information
Windows 10, OpenGL ES 3.0 Renderer: WebKit WebGL, NVIDIA GeForce GTX 1660 Driver Version: 497.29
Issue description
Edge version: 103.0.1264.49 (Offizielles Build) (64-Bit)
(Also happens in Chrome)
I disabled all my edge extensions.
Edge shows me some errors:

Steps to reproduce
Open the web version of the 3.5.rc6 Godot version.
Start the editor, create a new project and open it.
After a few seconds the editor should become black.
(This also happend to me when i open an existing project)
Minimal reproduction project
_No response
_

This was supposed to be fixed by #62531 but apparently there's still some case not handled @Faless.

Fixed by ad5fdcc0f3d8c0715429f2d533f577748b477f01.

I've uploaded a fixed build for 3.5 RC 6, it should be fine now. (You might need a hard refresh to make sure you get the new version built from 861e15554398c98630b905c8f2273477bdba5f99.)


Usage with custom dataset

Hi,
Thanks for the amazing work, one of the best papers and repos I could find on this topic. I want to use this code with my custom dataset, which is very similar to Geolife, i.e. it has userID, timestamp, latitude(in degrees) and longitude(in degrees), and want to forecast the trajectories for future. Any guidance on how can I achieve this?

Hi,
you would have to modify the dataloader to take into account the changes to the dataset.
practically you would have to modify row 47 to 52 in the baselineutils.py
raw_data = pd.read_csv(os.path.join(full_dt_folder, dt), delimiter=delim,
                                         names=["frame", "ped", "x", "y"],usecols=[0,1,2,3],na_values="?")

raw_data.sort_values(by=['frame','ped'], inplace=True)

inp,out,info=get_strided_data_clust(raw_data,gt,horizon,1)

As first try to see I would do some preprocessing on the data
1)pick a coordinate as a reference point and zero all the other values wrt to the reference point, and try to map the point in x,y coordinates.
2)Also I would make sure that the timestamps sampled at a regular interval. If they aren't your best bet would be to try and do some interpolation in order to get data taken at regular timestamp.
Once you do that you should be able to try just changing the column names in row 47.


⚠ Jenkins Plugins Artifactory has degraded performance

In 8d4f5c1, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1154 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 257fc70 after 13 minutes.


Support ibis deferred expression API

https://ibis-project.org/how-to/analytics/chain_expressions

Fixed in https://github.com/vast-data/vastdb_sdk/commit/ea3e6407cb4e3ad49211dfb67034e75415c0830e


Number TextField Backspace not working

When a textField is set to type number, the backspace key doesn't work. Delete key still works

[x] This is a v1.4 issue.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Expected Behavior
Backspace should work the same way as with string textField
Current Behavior
Backspace does nothing
import get from "lodash-es/get";
function addRowsCountOnChange(event: Object) {
    try {
        if (!this) {
            return;
        }

        this.setState({
            isBySetState: true,
            addRowsCount: get(event, "target.value", "")
        });
}

<TextField value={addRowsCount} onChange={addRowsCountOnChange.bind(this)}
type="number" margin="normal" style={{width: 44}}/>

Your Environment

Tech
Version

Material-UI
v1.4

React
v16.3

browser
Chrome

How about this? https://codesandbox.io/s/j24wkv5zoy

@rexkenley Providing a live reproduction example would help a lot. It's not the first time we receive feedback like this one. People assume it's coming from Material-UI, while in fact, it's just how the native <input type="number" /> behaves. I'm closing for now.

This codesandbox.io template may be a good starting point. Thank you!

mbrookes
Thanks for pointing out codesandbox, it's AWESOMESAUCE.
oliviertassinari
I modified the code to be more like mine and backspace DOES work.
https://codesandbox.io/s/0xj7n8yy5w
I am using TextField in a ms dynamics 365 web resource. If I remove the type="number", the backspace DOES work, but it will accept non numeric.
Is it possible that something may have "corrupted" the keypress event of TextField?

@rexkenley Can you confirm that the second input is also behaving incorrectly? https://codesandbox.io/s/9zzyzrl964

@rexkenley Oh, so you are saying it's working on the codesanbox but it's not working on your environment? It's this is the case, you have to look somewhere else :/.

oliviertassinari
That's correct. I am going to try using the regular input tag and see what happens when I get back to the office.
Thanks! I will let you know the results.

oliviertassinari
It is defnitely something with Microsoft cm365. I added a plain html page and it won't accept the backspace key. Thanks for your help guys.
daveyJS3.grid


Error while installing hyperion

[x] I confirm that this is an issue rather than a question.

Bug report

Steps to reproduce
What is expected?
What is actually happening?
System

Without a few lines of text from where you installed Hyperion, into which target directory, which OS etc. no one will be able to help you.

Hi,
IMHO this is related to NSIS installer, see https://github.com/hyperion-project/hyperion.ng/blob/94850d890a152ce999289bb5b5ec3d44899abbd2/cmake/nsis/template/NSIS.template.in#L223
It has a length limit of 1024 chars. Your current Windows PATH environment variable is too long for the installer.
See https://github.com/SWI-Prolog/swipl-devel/issues/450
and https://github.com/PointCloudLibrary/pcl/issues/5001
Simple solution is to add it manually. As i don't use Windows i can't tell you what to add, maybe @Paulchen-Panther can help out.
wbr

Not a Hyperion issue


add architecture specific dependency fields support

Currently, the RPC interface doesn't support architecture specific fields. It merges them in the generic arrays instead. See FS#48796.
Partial support for arch specific dependencies has been implemented with a temporary workaround in 6e3cb3b933b2f37b67a8173ff5d461ad8058f12c. This will however work only if the 32 bits (make)dependencies use the naming prefix lib32- on on the x86_64 arch, and the regular name on the i686 arch. Most user cases should be covered by this hack, but probably not all (I'm still looking for a test case where this hack actually fails).
It is possible to implement another temporary hack by reading and parsing the .SRCINFO files to retrieve the correct information. This indeed bypasses the RPC interface, and is implemented by bauerbill and pkgbuilder. This would however require to substantially change the current design as PKGBUILD cloning is done after dependency resolution, and this is something I'm not going to do. I will instead wait for the proper fix to be implemented in the RPC. Once this is done, correct arch specific support will be trivial to add and the existing hack can be removed.
See also wiki discussion and https://github.com/AladW/aurutils/issues/80.

I'm still looking for a test case where this hack actually fails

I hope this is the same issue:
Before building openrct2-git on a 32-bit-machine, pacaur fails at resolving dependencies… with no results found for gcc-multilib which isn't available for 32-bit-systems.
The dependency is declared for 64-bit makedepends_x86_64=('gcc-multilib') so it should affect 32-bit.

Yes, this is the same issue and a situation where the simplistic hack above fails. Unfortunately, handling this package requires FS#48796 to be fixed first as explained above.

I've expanded the current hack to handle gcc-multilib as it's always needed with lib32 packages on 64 bit arch anyway (see 4d36c53779d9a83480e351ba62589cc4d11aa6dc).

Note: Arch is phasing out i686 support. No further work is therefore needed, and the current hack could be removed in November 2017.

@rmarquis You got it wrong I think. Official i686 support in the repo from current devs is what is going out.
i686 will probably stay, the ideal goal being to have it built in an automated manner by the end of the year. But what is sure, is that support for multiple architectures will stay in all the tools.
That being said, I’m not asking you to spend any of your time on this issue until at least the future of i686 is established. ;)

True, the official support is ending. We'll see if a viable community effort happens.

This is superseded by #720, closing now.


test: Update verifyAccessToken bulk export test

Issue #, if available:
Description of changes:

Update parameter used for verifyAccessToken bulk export test
Update documentation with picture captions and more details

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

LGTM, should we review the updated results again on Monday to be sure?

Yes! Let's do that.


Plex MPV Shim

Project description
This project aims to allow casting of content from a Plex server to MPV, with minimal dependencies to prevent the project from becoming unmaintained.
Plex Media Player is slated to become unmaintained, so a good replacement is in order.
Metadata

homepage URL: https://github.com/iwalton3/plex-mpv-shim
source URL: https://github.com/iwalton3/plex-mpv-shim
license: none visible
platforms: Unix

I attempted the following derivation:
{ config, pkgs, ... }:
let
  plex-mpv-rev = "6ecc912a4f41586719c3430870db4004022a30a7";
  plex-mpv-shim = pkgs.python3Packages.buildPythonApplication rec {
    pname = "plex-mpv-shim";
    version = "0.1-${plex-mpv-rev}";
    name = "${pname}-${version}";
    src = pkgs.fetchFromGitHub {
      owner = "iwalton3";
      repo = "plex-mpv-shim";
      rev = plex-mpv-rev;
      sha256 = "1kh4p91sf7yxdrkrwfhd2wj5xzkssixxpb3y89c9ybf6wdr00lpz";
    };
    propagatedBuildInputs = with pkgs.python3Packages; [ mpv requests ];
  };
in {
  environment.systemPackages = [ plex-mpv-shim ];
}

Unfortunately it fails with the following error:
Processing ./Plex_MPV_Shim-0.2-py3-none-any.whl
Requirement already satisfied: requests in /nix/store/qssdbbm50hxjsd59ivbx5ml0iahb49wd-python3.7-requests-2.21.0/lib/python3.7/site-packages (from Plex-MPV-Shim==0.2) (2.21.0)
Collecting python-mpv (from Plex-MPV-Shim==0.2)
  Could not find a version that satisfies the requirement python-mpv (from Plex-MPV-Shim==0.2) (from versions: )
No matching distribution found for python-mpv (from Plex-MPV-Shim==0.2)
builder for '/nix/store/6mf4skgqq8zvgdl2k4affssj5sx6xigc-plex-mpv-shim-0.1-6ecc912a4f41586719c3430870db4004022a30a7.drv' failed with exit code 1

Assistance requested.

This requires mpv 0.2 but nixpkg only has 0.1.

This is closed by #77884


👥 Update FastAPI People

👥 Update FastAPI People

📝 Docs preview for commit 151d260076fa6bd2cc9ad02c5d187f4260e2cec7 at: https://fea13028.fastapitiangolo.pages.dev


pornhub.com - Specifically report "Video is not available in your country" when it is opportune instead of "Unable to extract title"

Checklist

[X] I'm reporting a site feature request
[X] I've verified that I'm running youtube-dl version 2020.05.08
[X] I've searched the bugtracker for similar site feature requests including closed ones

Description

Specifically report "Video is not available in your country" when it is opportune instead of "Unable to extract title".
Output:
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.pornhub.com/view_video.php?viewkey=ph5dffec575cfff']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2020.05.08
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.18362
[debug] exe versions: none
[debug] Proxy map: {}
[PornHub] ph5dffec575cfff: Downloading pc webpage
ERROR: Unable to extract title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\YoutubeDL.py", line 797, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\extractor\common.py", line 530, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\extractor\pornhub.py", line 206, in _real_extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\extractor\common.py", line 1014, in _html_search_regex
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\extractor\common.py", line 1005, in _search_regex
youtube_dl.utils.RegexNotFoundError: Unable to extract title; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Use vpn or proxy,

Thanks, I know but here I'm just asking to have a more correct error message.

This should be working now, but the test video is 404 (and we would have needed to know which countries were allowed/blocked). Please open a new issue if not.


Mac OS runner

Challenges:

Must pay for at least 24 hours of usage of a dedicated host for each test (sponsorship?)
Instance can take 15-40 minutes to start (keeping some runners warm is a must?)
EC2 Image Builder doesn't support Mac OS X (packer?)

We're started spiking a MacOS runner here at $WORK. I'd love to collaborate on it!
I don't think a MacOS instance works well in the ephemeral model. Stopping an instance causes the underlying dedicated host to be scrubbed which takes an hour or more to finish.
As for provisioning, we've used a userdata script; no packer.

Oh wow you can't even run multiple instances on the same dedicated host.

We're started spiking a MacOS runner here at $WORK. I'd love to collaborate on it!

That sounds great. Let's set something up. Email me at<EMAIL_ADDRESS>

It might finally be time https://aws.amazon.com/about-aws/whats-new/2024/08/aws-codebuild-mac-builds


Webhooks to refresh URLs after publish

Currently we have a low cached time set on both posts/index and posts/{slug} so that when you go to it, next will look in the background and refetch the content.
Say a new post is published, you then go to the post, you're going to see the old post until you refresh.
If we were to have a webhook that pinged the URL, then when a user went to check it out they'd already get the fresh copy.
And then in future versions of Next, will be all set to implement the following:

Up next, we will be working on a supplemental RFC to address two additional incremental static generation capabilities:

Re-generating and invalidating multiple pages at once (like your blog index and a certain blog post)
Re-generating by listening to events (like CMS webhooks), ahead of user traffic

We've moved towards GraphCDN as a caching layer for many projects, and include the ability to flush graphcdn's cache upon publishing a post. That is being tracked in https://github.com/patronage/bubs-next/issues/143. Can we close this one out?

Yeah, we don't need this any more.


BLE on HMD Global Nokia 7 Plus

Hi team,
So I was just having a play with this using my Nokia 7 Plus (which has ANT+ built in, even though its not listed on the this is Ant website directory), and this works.  It picks up my old garmin strap, and my elite zumo.  Top job!
Now, the question I have is that can the BLE devices it creates, be used within an app running on the same device as the bridge is running on?  Or do you have to run the bridge on a separate device to where you want to consume the the simulated devices?
My use case is running the RGT app on my phone, whilst using the bridge app to generate the signal from my heart strap to the RGT app.  The RGT app already see's my trainer as it has BLE and ANT, just need to get my old school strap linked in.  I have also tried the Ghostracer app to see if it can see the BLE sensor either, but no dice.
Good work!!!

Thanks @leaskovski
Glad that it works for you. I'll add the Nokia 7 plus into the README.
I had the same question earlier. It looks like the bluetooth hardware can do BLE advertising (what this app does) and connect to other BLE devices at the same time (may really depends on what bluetooth hardware an Android device has). However the same device can not receive the BLE advertising from itself. So the answer is no, it cannot.
Out of curiosity I've tried myself to advertise ANT+ heart rate sensor with this app, and on the same phone Strava app can't see the BLE heart rate sensor created by this app.

Thanks @leaskovski
Glad that it works for you. I'll add the Nokia 7 plus into the README.
I had the same question earlier. It looks like the bluetooth hardware can do BLE advertising (what this app does) and connect to other BLE devices at the same time (may really depends on what bluetooth hardware an Android device has). However the same device can not receive the BLE advertising from itself. So the answer is no, it cannot.
Out of curiosity I've tried myself to advertise ANT+ heart rate sensor with this app, and on the same phone Strava app can't see the BLE heart rate sensor created by this app.

Hmm ok, thats a shame.  So I have an old Nexus 5, and the ANT+ enabler software that is available on the Play store.  It took some effort to get it working again to enable ANT+ on it, but I managed to get it working.  I tried the software, and it can pick up my heart strap and show me my heart rate, which is good, but none of my BLE sensor apps are showing it up, so my guess is the BLE side isn't working properly for it.  The nexus 5 is running Android 6.0.1.

Hmm ok, thats a shame.  So I have an old Nexus 5, and the ANT+ enabler software that is available on the Play store.  It took some effort to get it working again to enable ANT+ on it, but I managed to get it working.  I tried the software, and it can pick up my heart strap and show me my heart rate, which is good, but none of my BLE sensor apps are showing it up, so my guess is the BLE side isn't working properly for it.  The nexus 5 is running Android 6.0.1.

I never know Nexus 5 has ANT+ support.
For this app to work, the phone has to support BLE advertising. A quick search gives me this:
https://stackoverflow.com/questions/26441785/does-bluetoothleadvertiser-work-on-a-nexus-5-with-android-5-0
Looks like Nexus 5 doesn't support BLE advertising unfortunately. However maybe there are some third party work that also enables this feature?

I never know Nexus 5 has ANT+ support.
For this app to work, the phone has to support BLE advertising. A quick search gives me this:
https://stackoverflow.com/questions/26441785/does-bluetoothleadvertiser-work-on-a-nexus-5-with-android-5-0
Looks like Nexus 5 doesn't support BLE advertising unfortunately. However maybe there are some third party work that also enables this feature?

@starryalley hmm, ok, so I thought I would try the app on the Nokia 7 plus properly, and it doesn't show up in the Zwift app or RGT, so it looks like it might not have advertising either.  Is there anyway to find out be it via logcat or some other method?

@starryalley hmm, ok, so I thought I would try the app on the Nokia 7 plus properly, and it doesn't show up in the Zwift app or RGT, so it looks like it might not have advertising either.  Is there anyway to find out be it via logcat or some other method?

If you can check logs about this app through logcat, you can see if BLE advertiser is present:
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L451
If advertiser is there, check if the BLE advertising really started:
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L537
If there is any errors there, please paste it here if possible. Thanks.

If you can check logs about this app through logcat, you can see if BLE advertiser is present:
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L451
If advertiser is there, check if the BLE advertising really started:
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L537
If there is any errors there, please paste it here if possible. Thanks.

I used the "Logcat Reader" app (https://play.google.com/store/apps/details?id=com.dp.logcatapp&hl=en_GB&gl=US) to filter out for cscservice.  It came up with the following on startup...
[01-11 22:40:45.666 1557:4654 W/ActivityManager]
Scheduling restart of crashed service idv.markkuo.cscblebridge/.CSCService in 1000ms

[01-11 22:43:02.018 28689:28689 D/CSCService]
Service started

[01-11 22:43:02.018 28689:28689 D/CSCService]
requesting ANT+ access

[01-11 22:43:02.301 28689:28689 D/CSCService]
Bluetooth enabled...starting services

[01-11 22:43:02.325 28689:28689 D/CSCService]
CSCP enabled!

[01-11 22:43:02.330 28689:28709 I/CSCService]
onServiceAdded(): status:0, service:android.bluetooth.BluetoothGattService@abd7590

[01-11 22:43:02.333 28689:28689 D/CSCService]
HR enabled!

[01-11 22:43:02.333 28689:28689 D/CSCService]
Enumerating (1) BT services

[01-11 22:43:02.333 28689:28689 D/CSCService]
Services registered: 00001816-0000-1000-8000-00805f9b34fb

[01-11 22:43:02.334 28689:28689 D/CSCService]
Service onStartCommand

[01-11 22:43:02.334 28689:28709 I/CSCService]
onServiceAdded(): status:0, service:android.bluetooth.BluetoothGattService@9dd1e89

[01-11 22:43:02.377 28689:28689 W/CSCService]
LE Advertise Failed: 1

[01-11 22:43:02.377 28689:28689 V/CSCService]
No subscribers registered

[01-11 22:43:02.377 28689:28689 V/CSCService]
Updating UI: speed:0.0, cadence:0, hr 0, speed_ts:0, cadence_ts:0, 0

I used the "Logcat Reader" app (https://play.google.com/store/apps/details?id=com.dp.logcatapp&hl=en_GB&gl=US) to filter out for cscservice.  It came up with the following on startup...
[01-11 22:40:45.666 1557:4654 W/ActivityManager]
Scheduling restart of crashed service idv.markkuo.cscblebridge/.CSCService in 1000ms

[01-11 22:43:02.018 28689:28689 D/CSCService]
Service started

[01-11 22:43:02.018 28689:28689 D/CSCService]
requesting ANT+ access

[01-11 22:43:02.301 28689:28689 D/CSCService]
Bluetooth enabled...starting services

[01-11 22:43:02.325 28689:28689 D/CSCService]
CSCP enabled!

[01-11 22:43:02.330 28689:28709 I/CSCService]
onServiceAdded(): status:0, service:android.bluetooth.BluetoothGattService@abd7590

[01-11 22:43:02.333 28689:28689 D/CSCService]
HR enabled!

[01-11 22:43:02.333 28689:28689 D/CSCService]
Enumerating (1) BT services

[01-11 22:43:02.333 28689:28689 D/CSCService]
Services registered: 00001816-0000-1000-8000-00805f9b34fb

[01-11 22:43:02.334 28689:28689 D/CSCService]
Service onStartCommand

[01-11 22:43:02.334 28689:28709 I/CSCService]
onServiceAdded(): status:0, service:android.bluetooth.BluetoothGattService@9dd1e89

[01-11 22:43:02.377 28689:28689 W/CSCService]
LE Advertise Failed: 1

[01-11 22:43:02.377 28689:28689 V/CSCService]
No subscribers registered

[01-11 22:43:02.377 28689:28689 V/CSCService]
Updating UI: speed:0.0, cadence:0, hr 0, speed_ts:0, cadence_ts:0, 0

I've updated the title to reflect that this is actually to do with device support.
BTW, I also confirmed that the Nexus 5 doesn't register the advertiser properly, it produces the same error you mentioned.

I've updated the title to reflect that this is actually to do with device support.
BTW, I also confirmed that the Nexus 5 doesn't register the advertiser properly, it produces the same error you mentioned.

LE Advertise Failed: 1

1 means ADVERTISE_FAILED_DATA_TOO_LARGE.
Not sure why this happens on this specific device. Maybe the hardware support is a bit different. If you can, can you try remove this line: and compile/run again?
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L464
If it still doesn't work, maybe try removing line 463 as well.
Just to be clear, do you mean that on Nokia 7 Plus you can't use this app successfully, even once?
Thanks.

LE Advertise Failed: 1

1 means ADVERTISE_FAILED_DATA_TOO_LARGE.
Not sure why this happens on this specific device. Maybe the hardware support is a bit different. If you can, can you try remove this line: and compile/run again?
https://github.com/starryalley/CSC_BLE_Bridge/blob/35b1006aa3497556c49e19055439c54cde7d0435/app/src/main/java/idv/markkuo/cscblebridge/CSCService.java#L464
If it still doesn't work, maybe try removing line 463 as well.
Just to be clear, do you mean that on Nokia 7 Plus you can't use this app successfully, even once?
Thanks.

Sorry, probably set line 463/464 to false instead of true to reduce the AdvertiseData length. I'm not sure what is the default value (include or exclude) so removing those 2 lines may not actually exclude those data.

Sorry, probably set line 463/464 to false instead of true to reduce the AdvertiseData length. I'm not sure what is the default value (include or exclude) so removing those 2 lines may not actually exclude those data.

Will give it a try in the morning. Thanks
Yeah, I thought that as the HR was being read from my strap that it would broadcast fine. I guess I was wrong... To eager for it to think it was working. Classic Dev! Sorry!

Will give it a try in the morning. Thanks
Yeah, I thought that as the HR was being read from my strap that it would broadcast fine. I guess I was wrong... To eager for it to think it was working. Classic Dev! Sorry!

Not managed to try this yet, though whilst I was on calls today, I did manage to get the Nexus 5 working!!!  So by installing CyanogenMod 13 on the Nexus 5 (after reading this thread on getting BLE advertising working, https://forum.xda-developers.com/t/how-to-get-kevo-on-nexus-5-5-0-1-or-5-1-or-cm12-5-0-2-or-5-1-1.3041092/post-65950497), I was able to use that ROM and Ant+ Enabler (https://play.google.com/store/apps/details?id=com.z2software.antplus), and have sucessfully used the app to do a session on RGT Cycling this evening...  so result!  I now have a ANT+ to BLE bridge device that I can use.
Will hopefully check the Nokia 7 Plus tomorrow.

Not managed to try this yet, though whilst I was on calls today, I did manage to get the Nexus 5 working!!!  So by installing CyanogenMod 13 on the Nexus 5 (after reading this thread on getting BLE advertising working, https://forum.xda-developers.com/t/how-to-get-kevo-on-nexus-5-5-0-1-or-5-1-or-cm12-5-0-2-or-5-1-1.3041092/post-65950497), I was able to use that ROM and Ant+ Enabler (https://play.google.com/store/apps/details?id=com.z2software.antplus), and have sucessfully used the app to do a session on RGT Cycling this evening...  so result!  I now have a ANT+ to BLE bridge device that I can use.
Will hopefully check the Nokia 7 Plus tomorrow.

So I made the code change and rebuilt. Tried it, and it doesn't look like it is having an issue now, but it isn't showing the HR sensor up in zwift or the ghostracer app, both of which support BLE sensors.
Filtered logcat attached....
https://pastebin.com/J6bSMrMB

So I made the code change and rebuilt. Tried it, and it doesn't look like it is having an issue now, but it isn't showing the HR sensor up in zwift or the ghostracer app, both of which support BLE sensors.
Filtered logcat attached....
https://pastebin.com/J6bSMrMB

So it looks like some BLE hardware can have trouble keeping the advertise data within 31 bytes so I will probably exclude the power level by default as it will add some extra bytes there.
If you have time, probably try to include device name:
.setIncludeDeviceName(true)
and exclude power level
.setIncludeTxPowerLevel(false)
Not sure what went wrong as I can't see anything wrong in the log.

So it looks like some BLE hardware can have trouble keeping the advertise data within 31 bytes so I will probably exclude the power level by default as it will add some extra bytes there.
If you have time, probably try to include device name:
.setIncludeDeviceName(true)
and exclude power level
.setIncludeTxPowerLevel(false)
Not sure what went wrong as I can't see anything wrong in the log.

@starryalley so it does work.  I set every back in the code, and this time I thought about what you said and looked at the device name of my phone.  It was large, so I changed it to "N7", and it all worked fine, so you probably need to mention something in the readme about device names.  What should be the limit on them?  Looks like there might be a bug in the Android SDK that doesn't truncate the name or something?

@starryalley so it does work.  I set every back in the code, and this time I thought about what you said and looked at the device name of my phone.  It was large, so I changed it to "N7", and it all worked fine, so you probably need to mention something in the readme about device names.  What should be the limit on them?  Looks like there might be a bug in the Android SDK that doesn't truncate the name or something?

Thanks for this info @leaskovski
As for the name being too long, see the second answer: https://stackoverflow.com/questions/36845422/is-there-any-way-to-change-the-device-name-in-advertisedata-in-android-ble
Looks like there is another way to avoid this. Feel free to submit a PR if you have time to test/try.

Thanks for this info @leaskovski
As for the name being too long, see the second answer: https://stackoverflow.com/questions/36845422/is-there-any-way-to-change-the-device-name-in-advertisedata-in-android-ble
Looks like there is another way to avoid this. Feel free to submit a PR if you have time to test/try.


Permit invocation without configuration file, for promoting ad hoc operations

About
The idea of this patch is to make it possible to invoke grafana-import without needing to use a configuration file, in order to promote ad hoc use. We hope it will be received well.
Usage
Instead of defining Grafana connectivity settings within the configuration file, the program now also supports defining it through the command line argument --grafana_url, and the environment variable GRAFANA_URL, in the same way like grafana-client is doing it.
Details
In this spirit, this feature expands into quite the opposite direction what the program was originally conceived for, using a configuration file which can store multiple Grafana connection profiles. We think the program can well be used for both use cases, so this patch relaxes the must-have constraint about having a configuration file.
Trivia
This is a stacked PR, based on GH-8. It can be reviewed independently, but please do not merge prematurely.
References

GH-7

The feature is a good idea.
I build the tool from the grafana-snapshoot "core" program that was using a config file too... a quick and dirty implementation so I didn't even think about it!
But it ise a good idea.


Link to the official twitter docs:

https://developer.twitter.com/en/docs/twitter-api/v1/accounts-and-users/follow-search-get-users/api-reference/post-friendships-create
https://developer.twitter.com/en/docs/twitter-api/v1/accounts-and-users/follow-search-get-users/api-reference/post-friendships-destroy

LGTM, thank you for your contribution!
(I guess you could add a test but this could make the test account flagged as a spam so let's ignore it right @alkihis ?)


[Text] Style not displayed

Hi! Looooooove this plugin. Thank you so much for supporting it. One problem my team has is the plugin doesn't list each layer's Style attribute (such as text style). Is there any way to display that in export HTML specs?
For instance, I use Apple iOS libraries all the time. I'd like my developer to use iOS standard elements like a normal Header:

But Sketch Measure doesn't reveal the text layer style, so the developer may just create a custom version (not knowing it's actually just a simple iOS standard header).

If Measure could display the layer style attribute, that would be suuuuuper helpful. And then we may not have to manage separate documentation labeling what elements are standard and non standard.
In this case it could say:
STYLE: Apple iOS UI/Headline/1 Default/1 Light/1 Label Color/1 Left Aligned
Like this:

Then my engineering team would know that they just have to drop in a standard element vs creating a custom one.
Thank you so much!

can confirm

@surfingsquibb and @qimmiq which version of the Sketch Measure plugin are you running?
I just updated to Sketch 58 this morning to test this out for you and this is what I see using the branch maintained by @ellunium found here https://github.com/ellunium/sketch-measure-latest
I ran through both symbols with embedded text styles and direct test styles sourced from linked library (per examples below)

grab a link library symbol (menu - verify style in sketch 58 shows on right

Export using ellunium version of the Sketch Measure plugin - verify style name appears in export

repeat using Text Style > select library > select style - export again- verify style name appears in Sketch

Export using ellunium version of the Sketch Measure plugin - verify style name appears in export

If the above shows correctly what you are wanting to see and if you are not using the  @ellunium branch from here https://github.com/ellunium/sketch-measure-latest I'd suggest trying that.... hope this helps...


Dropout / unsupervised training implementation ?

Hello, 👋
First thank you for the very good quality of your code and the support you gave to issues / PR.
For a research projet, I am fine-tuning models on a contrastive objective. I intend to use your unsupervised method.
Looking at the code of SimCSE, I noticed that in the forward pass all sequences $x$ and $x^+$ are passed through the same batch. But doing so will apply the same dropout mask to all of them.
My workaround is to perform two forward passes through the BERT encoder, but I still wondered, did you do the same or maybe am I missing something ?

hello, i have the same confusion as you.
In the forward pass all sequences and are passed through the same batch. May it mean sentences pair get the same hidden states. Looking froward to your reply. Thank you.


Disable / enable UI functionality based on user permissions

For example: when a logged-in user doesn't have write access to a repo, the settings section should not show the form to edit tags, description, etc.

Closed by #198.


windowed mode

hey there. is there a way to make it so Cupscale GUI starts in windowed mode (not maximized) ? I've looked in Cupscale Settings and found nothing to change this behavior. Whenever I first open Cupscale, it opens up maximized. I can get it out of the maximized mode after opening it, but I would prefer if it didn't start maximized - or if there was a setting to choose between starting in a smaller windowed mode or maximized... but I didn't find a setting for this. Thanks for making this tool btw. I started using it very recently and really like it overall

Will be in next update
https://github.com/n00mkrad/cupscale/commit/1cf361efecc385148698dfb027f016a87cee597e


Only a few FFZ emotes available

I'm using the latest Cursefore release (which isn't very recent) and it seems like there are only a few global FFZ emotes that display and show up in the menu (at least that's what I think they are).
I noticed a few issues here on the repo that seem to be related to API usage so my hypothesis is that the stable CT release is using an unsupported API for BTTV and Twitch emotes, but I can't confirm or deny it by using a version built from master since the link to your Jenkins is broken.
Would Github CI maybe work for this repo? (for people like me who don't want to grab the entire JDK just for building one mod)
If not, is there an ETA for a new version?
Thanks for developing this mod, and thanks in advance if you reply.

Well, I tried setting up Travis but it turns out that it discards build artifacts by default.
Since I couldn't get the Travis CLI tool to recognize my repo in order to set up Github releases I just gave up and built it in WSL.
I haven't tried it yet but here's the build if anyone's interested:
ChatTweaks_1.12.2-5.1.0.zip

With the version I built from the 1.12.2 branch I now get proper BTTV emotes for the channel I selected (xQcOW) but still no global Twitch emotes or channel FFZ emotes.
Oh well, at least that's something.

Since emote APIs continuously have breaking changes, I doubt most emotes of the 1.12.2 version will work for much longer in general. I'll update to the latest APIs once I get to the 1.15.2 port, but unfortunately there won't be any backports to earlier versions.

With the coming 1.16 port, emotes should become much more stable and in most cases no longer randomly stop working based on external factors thanks to #67.
Closing this one to get a clearer view of open issues.


ssl verification failure with berks on ChefDK 1.1.16

Description
Certificate verify failed error running berks vendor.
OpenSSL::SSL::SSLError: SSL_connect returned=1 errno=0 state=error: certificate verify failed
ChefDK Version
Chef Development Kit Version: 1.1.16
chef-client version: 12.17.44
delivery version: master (83358fb62c0f711c70ad5a81030a6cae4017f103)
berks version: 5.2.0
kitchen version: 1.14.2

Platform Version
Microsoft Windows 7 Enterprise
6.1.7601 Service Pack 1 Build 7601
Replication Case

Clone https://github.com/Nordstrom/chefdk_bootstrap.git
Cd into chefdk_bootstrap.
berks vendor

OBSERVE ERROR

Set SSL_CERT_FILE variable

> $env:SSL_CERT_FILE C:\opscode\chefdk\embedded\ssl\certs\cacert.pem

...repeat...

OBSERVE ERROR

Use OpenSSL to verify connection (its reading the SSL_CERT_FILE attribute correctly)

c:\opscode\chefdk\embedded\bin\openssl.exe s_client -showcerts -connect supermarket.chef.io:443
Loading 'screen' into random state - done
CONNECTED(00000178)
depth=2 C = US, O = DigiCert Inc, OU = www.digicert.com, CN = DigiCert Global Ro
ot CA
verify return:1
depth=1 C = US, O = DigiCert Inc, CN = DigiCert SHA2 Secure Server CA
verify return:1
depth=0 C = US, ST = Washington, L = Seattle, O = "Chef Software, Inc", CN = *.c
hef.io
verify return:1

yay, but still sadness with berks

Stacktrace
Fetching 'chefdk_bootstrap' from source at .
Fetching 'win_proxy' from source at test/fixtures/cookbooks/win_proxy
Fetching cookbook index from https://supermarket.chef.io...
Installing atom (0.2.0)
Installing apt (5.0.0)
E, [2016-12-21T12:35:15.534524 #6600] ERROR -- : Actor crashed!
OpenSSL::SSL::SSLError: SSL_connect returned=1 errno=0 state=error: certificate
verify failed
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/net/http.rb:933:in `connect_no
nblock'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/net/http.rb:933:in `connect'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/net/http.rb:863:in `do_start'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/net/http.rb:852:in `start'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:319:in `open_http'

        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:737:in `buffer_ope
n'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:212:in `block in o
pen_loop'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:210:in `catch'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:210:in `open_loop'

        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:151:in `open_uri'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:717:in `open'
        C:/opscode/chefdk/embedded/lib/ruby/2.3.0/open-uri.rb:35:in `open'
        C:/opscode/chefdk/embedded/lib/ruby/gems/2.3.0/gems/berkshelf-5.2.0/lib/

NOTE: CHEFDK BUGS ONLY
This issue tracker is for the code contained within this repo -- chefdk.

Server issues
Chef-client issues
Cookbook Issues (see the https://github.com/chef-cookbooks repos or search Supermarket or GitHub/Google)

There has been significant effort on Berkshelf to line it up with using trusted_certs and playing nicer with the DK so I'm reasonably confident this issue has been mitigated via this work. This is definitely was definitely a berks bug at one point but this can be closed. If you still have issues please open a new issue with modern versions of ChefDK/berks.


Documentation in paper-radio-group, spelling mistake

i have attached the screenshot please fix it.

This issue tracker is for the core Polymer library, not elements built with it. We'll move this to the appropriate tracker for the element.


Fix reviewers.yml

Description
reviewers.yml isn't recognizing transifex-integration as a username. Let's use the glob of messages.xx files instead.
Release notes
The title of the pull request will be used as the default release notes description. If more detail is needed to communicate to partners the scope of the PR's changes, use this release notes section.
Checklist
General

[x] Added the correct label: < feature | bug | dependencies | infrastructure | ignore-for-release >
[ ] Created tests which fail without the change (if possible)

Test out manually

[ ] Extended the README / documentation, if necessary

Not neccessary

User visible changes
None.
New Features
None.
Issue(s) this completes
Relates to #4891

Auto Request Review fails here because it's technically requesting a review from the author. This won't be a problem in the future.


Content-Digest header format doesn't comply with RFC 9530

I believe the content-digest component is not compliant with the RFC 9530.

uppercase hashing algorithm name (SHA-512) when it should be lowercase (sha-512)
missing colons : around the base64 value.

Example from the RFC (minus line-wrapping)

Content-Digest: sha-512=:YMAam51Jz/jOATT6/zvHrLVgOYTGFy1d6GJiOHTohq4yP+pgk4vf2aCsyRZOtw8MjkM7iw7yZ/WkppmM44T3qg==:

Versus what NSign would send

Content-Digest: SHA-512=YMAam51Jz/jOATT6/zvHrLVgOYTGFy1d6GJiOHTohq4yP+pgk4vf2aCsyRZOtw8MjkM7iw7yZ/WkppmM44T3qg==

Thanks for bringing this to my attention, @nha . You're absolutely right, I missed this after the release of RFC 9421 in February. I'll be working on a fix for this - stay tuned.

Release v1.1.0 should address this.
Please re-open if you feel this is still an issue.


Issue 100 too much logging

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/109/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/110/Test PASSed.

@mrdavidlaing, let's try this version. It should fix log growth problem, at least.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/111/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/112/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/113/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/114/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/115/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/116/Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
http://jenkins.meta.logsearch.io/job/shared.releases.logsearchshipper-PRs/117/Test PASSed.

@mrdavidlaing, done. But my experience says this isn't a good idea.

@fandrei - thanks; and point noted.
I'll get it rolled out today for some real world testing


Fixes comparer across runs in the KiotaLock

Closes https://github.com/microsoft/kiota/issues/4916

Thanks for fixing that. We might have the same issue with workspace comparisons.

Update the PR to capture scenarios on the Workspace side as well.


kind: 0.2.4 -> 0.2.5

PR https://github.com/NixOS/nixpkgs/pull/354666 originally updated the package but was closed due to a merge conflict.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

nixpkgs-review result
Generated using nixpkgs-review.


More details for bundle watch

Hi again !
I'm looking for more information how to setup the watcher.
So, I have 2 questions
This is my bundle.config.js
module.exports = {
    bundle: {
        c411: {
            scripts: [
                'resources/js/common/utils.js',
                'resources/js/common/userMenu.js',
                'resources/js/common/headerFooter.js',
                'resources/js/common.js'
            ],
            styles: [
                'resources/css/bootstrap.css',
                'resources/css/common.css'
            ],
            options: {
                rev: false
            }
        }
    }
};

I have another task for generation CSS from SCSS (before run bundle) using gulp-sass
gulp.task('styles', function() {
    return gulp.src(sassSources)
        .pipe(plumber())
        .pipe(sourcemaps.init())
        .pipe(sass.sync())
        .pipe(autoprefixer())
        .pipe(gulp.dest('resources/css'));
});
gulp.task('bundle', ['styles'], function() {
    return gulp.src('./bundle.config.js')
    .pipe(bundle())
    .pipe(gulp.dest('resources/static'));
});

So, first question, is this the right way?
And the second one how to watch for changes without regenerating all assets over and over?
Let me know if you need more info!
Thanks!

@venelinn Firstly, you can use gulp-bundle-assets to run your sass compilation so that you can create your entire css bundle in one go. See the custom-transforms example on how to do this.
Secondly, you can use the built in gbundle.watch to only re-build the bundles that changed. See this example for details.
Let me know if that doesn't answer your questions.

Hi @chmontgomery,
gbundle is not  a part of library, is it ? it means that i have to copy all dependencies to get it work.


mark embedInNavigationController() as open not public

I want to use custom UINavigationController and it's not possible now cause embedInNavigationController() marked as public and not open. So I can not override it. Could you update this?

Hi @Speakus ,
thanks for pointing that out.
This has been implemented in #102
Cheers!


Sketch: a third take on defaulting values

This still fails round-trip tests.  Ideas there?

What is blocking us on making progress of this PR beside rebase?

I think this was blocked on a couple fuzzer-related things:

how to determine that a round-tripped object is the same after default values have been set
how to ensure the conversion and/or defaulting logic in the round-trip process behaves correctly for randomly generated objects

Alternatives for (1) are to apply defaults before round-tripping or to only diff selected fields, as we plan to do in config, such as by keeping track of which fields the fuzzer populates.
I think the only sane thing to do for (2) is to ensure that we round-trip only valid objects. This means they must have defaults applied and must pass validation.

A solution to 1 is to use the Semantic.DeepEqual I added the other day, or make a separate one that specifically ignores defaults (probably a good idea anyway).
The conversion routines don't have to do correct things on random input, but they must NOT crash. Fuzz testing should continue to be used to verify this property even if we have to do something more fancy to verify the round-trip property. There should be two tests here, not the one we have right now.

Main blocker is a person. To work on it.
On Jan 12, 2015 5:33 PM, "Daniel Smith"<EMAIL_ADDRESS>wrote:

A solution to 1 is to use the Semantic.DeepEqual I added the other day, or
make a separate one that specifically ignores defaults (probably a good
idea anyway).
The conversion routines don't have to do correct things on random input,
but they must NOT crash. Fuzz testing should continue to be used to verify
this property even if we have to do something more fancy to verify the
round-trip property. There should be two tests here, not the one we have
right now.
--
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/pull/2587#issuecomment-69680771
.

#3854 has been merged. This is obsolete.


Ensure shim can build when exec'ing on scratch.

Signed-off-by: Erik Sipsma<EMAIL_ADDRESS>Fixes: https://github.com/dagger/dagger/issues/3393
The problem wasn't actually with pushing the image, it was just that we use the dockerfile frontend to build the shim and when we did an exec on top of a non-platformed llb state (i.e. scratch) the platform got serialized as a string into "unknown" which upset the frontend.
Test case I added looks a little different than the one in the original issue but it fails w/ the same error if the fix is not present. I added pushing to the test case anyways too just to be safe.

Oh I forgot about this after I went on vacation, thanks for the approvals @marcosnils @vito !


Unable to get the full error message when using useFetch() or $fetch

Environment
Stackblitz
Working directory: /home/projects/nuxt-starter-t11enq
Nuxt project info:
------------------------------
- Operating System: Linux
- Node Version:     v18.18.0
- Nuxt Version:     3.10.1
- CLI Version:      3.10.1
- Nitro Version:    2.8.1
- Package Manager<EMAIL_ADDRESS>- Builder:          -
- User Config:      devtools, imports
- Runtime Modules:  -
- Build Modules:    -
------------------------------

Reproduction
https://stackblitz.com/edit/nuxt-starter-5g2kqi?file=app.vue
Describe the bug
I have a server api route that throws an error if something goes wrong. The error includes custom fields like validation, code etc. that the 3rd party backend actually sends back in the HTTP response. My Nuxt server api route contacts that 3rd party backend API and receives the HTTP response. But when I try to use useFetch() or $fetch from my Vue components then I am unable to access all these error fields.
In the real world this would be an Apollo GraphQL request that would throw the error in the server api route that I then need to be able to access in the Vue component but the FetchError simply does not seem to include all that information from the original error / http response.
My server api throws this error:
export default defineEventHandler(() => {
    const isRequestValid = false

    if (isRequestValid) {
        return {
            users: [{ id: 1, username: 'John Doe' }]
        }
    } else {
        throw {
            name: 'Users',
            cause: 'Could not load users',
            code: 'USERS_LOAD_ERROR',
            guiltyDeveloper: 'John Doe',
            validation: {
                username: 'Username is required',
            }
        }
    }
})

And then in my Vue component I try to access this error but I do not see the full error object:
<template>

    data:
{{ data }}

    error:
{{ error }}

</template>

The most that I see is this:
{
    "_data": {
        "url": "/api/users",
        "statusCode": 500,
        "statusMessage": "",
        "message": "Error",
        "stack": "
at createError (./node_modules/.pnpm/h3@1.10.1/node_modules/h3/dist/index.mjs:79:15)\nat Server.toNodeHandle (./node_modules/.pnpm/h3@1.10.1/node_modules/h3/dist/index.mjs:1909:21)\nat process.processTicksAndRejections (node:internal/process/task_queues:95:5)
"
    }
}

No matter what I do, I am unable to access the full raw HTTP response. Where is my validation field? Or where is the guiltyDeveloper field and code and cause?
Additional context
No response
Logs
No response

You ideally should use createError when throwing in event handlers.
 throw createError({
      statusCode: 422,
      data: {
        name: 'Users',
        cause: 'Could not load users',
        code: 'USERS_LOAD_ERROR',
        guiltyDeveloper: 'John Doe',
        validation: {
          username: 'Username is required',
        },
      },
    });

You ideally should use createError when throwing in event handlers.
 throw createError({
      statusCode: 422,
      data: {
        name: 'Users',
        cause: 'Could not load users',
        code: 'USERS_LOAD_ERROR',
        guiltyDeveloper: 'John Doe',
        validation: {
          username: 'Username is required',
        },
      },
    });

Thank you @manniL that worked! I don't recall this being mentioned in the docs anywhere. So the trick is to add a data property in createError().

This is covered here ☺


Some az-cli base commands are not available

My az-cli version:
{
  "azure-cli": "2.31.0",
  "azure-cli-core": "2.31.0",
  "azure-cli-telemetry": "1.0.6",
  "extensions": {}
}

I have a docker image used by our automation system, with az-cli being installed in this image. When I run this image interactively (on my laptop), I get the full set of az-cli commands:
...
Here are the base commands:

    account             : Manage Azure subscription information.
    acr                 : Manage private registries with Azure Container Registries.
    ad                  : Manage Azure Active Directory Graph entities needed for Role Based Access
                         Control.
    advisor             : Manage Azure Advisor.
    afd                 : Manage Azure Front Door.
    aks                 : Manage Azure Kubernetes Services.
    ams                 : Manage Azure Media Services resources.
    apim                : Manage Azure API Management services.
    appconfig           : Manage App Configurations.
    appservice          : Manage App Service plans.
    aro                 : Manage Azure Red Hat OpenShift clusters.
    backup              : Manage Azure Backups.
    batch               : Manage Azure Batch.
    bicep               : Bicep CLI command group.
    billing             : Manage Azure Billing.
    bot                 : Manage Microsoft Azure Bot Service.
    cache               : Commands to manage CLI objects cached using the `--defer` argument.
    capacity            : Manage capacity.
    cdn                 : Manage Azure Content Delivery Networks (CDNs).
    cloud               : Manage registered Azure clouds.
    cognitiveservices   : Manage Azure Cognitive Services accounts.
    config              : Manage Azure CLI configuration.
    configure           : Manage Azure CLI configuration. This command is interactive.
    consumption         : Manage consumption of Azure resources.
    container           : Manage Azure Container Instances.
    cosmosdb            : Manage Azure Cosmos DB database accounts.
    databoxedge         : Support data box edge device and management.
    deployment          : Manage Azure Resource Manager template deployment at subscription scope.
    deployment-scripts  : Manage deployment scripts at subscription or resource group scope.
    deploymentmanager   : Create and manage rollouts for your service.
    disk                : Manage Azure Managed Disks.
    disk-access         : Manage disk access resources.
    disk-encryption-set : Disk Encryption Set resource.
    dla                 : Manage Data Lake Analytics accounts, jobs, and catalogs.
    dls                 : Manage Data Lake Store accounts and filesystems.
    dms                 : Manage Azure Data Migration Service (DMS) instances.
    eventgrid           : Manage Azure Event Grid topics, domains, domain topics, system topics
                         partner topics, event subscriptions, system topic event subscriptions and
                         partner topic event subscriptions.
    eventhubs           : Manage Azure Event Hubs namespaces, eventhubs, consumergroups and geo
                         recovery configurations - Alias.
    extension           : Manage and update CLI extensions.
    feature             : Manage resource provider features.
    feedback            : Send feedback to the Azure CLI Team.
    find                : I'm an AI robot, my advice is based on our Azure documentation as well as
                         the usage patterns of Azure CLI and Azure ARM users. Using me improves
                         Azure products and documentation.
    functionapp         : Manage function apps. To install the Azure Functions Core tools see
                         https://github.com/Azure/azure-functions-core-tools.
    group               : Manage resource groups and template deployments.
    hdinsight           : Manage HDInsight resources.
    identity            : Managed Service Identities.
    image               : Manage custom virtual machine images.
    interactive         : Start interactive mode. Installs the Interactive extension if not
                         installed already.
    iot                 : Manage Internet of Things (IoT) assets.
    keyvault            : Manage KeyVault keys, secrets, and certificates.
    kusto               : Manage Azure Kusto resources.
    lab                 : Manage Azure DevTest Labs.
    local-context       : Manage Local Context.
    lock                : Manage Azure locks.
    logicapp            : Manage logic apps.
    login               : Log in to Azure.
    logout              : Log out to remove access to Azure subscriptions.
    managed-cassandra   : Azure Managed Cassandra.
    managedapp          : Manage template solutions provided and maintained by Independent Software
                         Vendors (ISVs).
    managedservices     : Manage the registration assignments and definitions in Azure.
    maps                : Manage Azure Maps.
    mariadb             : Manage Azure Database for MariaDB servers.
    monitor             : Manage the Azure Monitor Service.
    mysql               : Manage Azure Database for MySQL servers.
    netappfiles         : Manage Azure NetApp Files (ANF) Resources.
    network             : Manage Azure Network resources.
    policy              : Manage resource policies.
    postgres            : Manage Azure Database for PostgreSQL servers.
    ppg                 : Manage Proximity Placement Groups.
    provider            : Manage resource providers.
    redis               : Manage dedicated Redis caches for your Azure applications.
    relay               : Manage Azure Relay Service namespaces, WCF relays, hybrid connections, and
                         rules.
    reservations        : Manage Azure Reservations.
    resource            : Manage Azure resources.
    rest                : Invoke a custom request.
    role                : Manage user roles for access control with Azure Active Directory and
                         service principals.
    search              : Manage Azure Search services, admin keys and query keys.
    security            : Manage your security posture with Azure Security Center.
    servicebus          : Manage Azure Service Bus namespaces, queues, topics, subscriptions, rules
                         and geo-disaster recovery configuration alias.
    sf                  : Manage and administer Azure Service Fabric clusters.
    sig                 : Manage shared image gallery.
    signalr             : Manage Azure SignalR Service.
    snapshot            : Manage point-in-time copies of managed disks, native blobs, or other
                         snapshots.
    sql                 : Manage Azure SQL Databases and Data Warehouses.
    sshkey              : Manage ssh public key with vm.
    staticwebapp        : Manage static apps.
    storage             : Manage Azure Cloud Storage resources.
    synapse             : Manage and operate Synapse Workspace, Spark Pool, SQL Pool.
    tag                 : Tag Management on a resource.
    term                : Manage marketplace agreement with marketplaceordering.
    ts                  : Manage template specs at subscription or resource group scope.
    upgrade             : Upgrade Azure CLI and extensions.
    version             : Show the versions of Azure CLI modules and extensions in JSON format by
                         default or format configured by --output.
    vm                  : Manage Linux or Windows virtual machines.
    vmss                : Manage groupings of virtual machines in an Azure Virtual Machine Scale Set
                         (VMSS).
    webapp              : Manage web apps.

But when this image is run by our pipeline, I can't use some of these commands - some of them aren't showing here:
Here are the base commands:

    account             : Manage Azure subscription information.
    acr                 : Manage private registries with Azure Container Registries.
    ad                  : Manage Azure Active Directory Graph entities needed for Role Based Access
                         Control.
    advisor             : Manage Azure Advisor.
    aks                 : Manage Azure Kubernetes Services.
    appconfig           : Manage App Configurations.
    appservice          : Manage App Service plans.
    bicep               : Bicep CLI command group.
    cache               : Commands to manage CLI objects cached using the `--defer` argument.
    cloud               : Manage registered Azure clouds.
    config              : Manage Azure CLI configuration.
    configure           : Manage Azure CLI configuration. This command is interactive.
    databoxedge         : Support data box edge device and management.
    deployment          : Manage Azure Resource Manager template deployment at subscription scope.
    deployment-scripts  : Manage deployment scripts at subscription or resource group scope.
    disk                : Manage Azure Managed Disks.
    disk-access         : Manage disk access resources.
    disk-encryption-set : Disk Encryption Set resource.
    eventhubs           : Manage Azure Event Hubs namespaces, eventhubs, consumergroups and geo
                         recovery configurations - Alias.
    extension           : Manage and update CLI extensions.
    feature             : Manage resource provider features.
    feedback            : Send feedback to the Azure CLI Team.
    find                : I'm an AI robot, my advice is based on our Azure documentation as well as
                         the usage patterns of Azure CLI and Azure ARM users. Using me improves
                         Azure products and documentation.
    functionapp         : Manage function apps. To install the Azure Functions Core tools see
                         https://github.com/Azure/azure-functions-core-tools.
    group               : Manage resource groups and template deployments.
    hdinsight           : Manage HDInsight resources.
    image               : Manage custom virtual machine images.
    interactive         : Start interactive mode. Installs the Interactive extension if not
                         installed already.
    iot                 : Manage Internet of Things (IoT) assets.
    keyvault            : Manage KeyVault keys, secrets, and certificates.
    local-context       : Manage Local Context.
    lock                : Manage Azure locks.
    logicapp            : Manage logic apps.
    login               : Log in to Azure.
    logout              : Log out to remove access to Azure subscriptions.
    managedapp          : Manage template solutions provided and maintained by Independent Software
                         Vendors (ISVs).
    network             : Manage Azure Network resources.
    policy              : Manage resource policies.
    ppg                 : Manage Proximity Placement Groups.
    provider            : Manage resource providers.
    resource            : Manage Azure resources.
    rest                : Invoke a custom request.
    role                : Manage user roles for access control with Azure Active Directory and
                         service principals.
    security            : Manage your security posture with Azure Security Center.
    sig                 : Manage shared image gallery.
    snapshot            : Manage point-in-time copies of managed disks, native blobs, or other
                         snapshots.
    sshkey              : Manage ssh public key with vm.
    staticwebapp        : Manage static apps.
    storage             : Manage Azure Cloud Storage resources.
    synapse             : Manage and operate Synapse Workspace, Spark Pool, SQL Pool.
    tag                 : Tag Management on a resource.
    term                : Manage marketplace agreement with marketplaceordering.
    upgrade             : Upgrade Azure CLI and extensions.
    version             : Show the versions of Azure CLI modules and extensions in JSON format by
                         default or format configured by --output.
    vm                  : Manage Linux or Windows virtual machines.
    vmss                : Manage groupings of virtual machines in an Azure Virtual Machine Scale Set
                         (VMSS).
    webapp              : Manage web apps.

Namely the command I want to use is cosmosdb.
I have checked the path below for the installed modules and they're all present, including cosmosdb:
$ ls /usr/lib64/az/lib/python3.6/site-packages/azure/cli/command_modules
__init__.py  ams         backup      cdn                consumption        dla        extension    iot              maps                 network         redis         search            signalr  util
__pycache__  apim        batch       cloud              container          dls        feedback     keyvault         marketplaceordering  policyinsights  relay         security          sql      vm
acr          appconfig   batchai     cognitiveservices  cosmosdb           dms        find         kusto            monitor              privatedns      reservations  servicebus        sqlvm
acs          appservice  billing     config             databoxedge        eventgrid  hdinsight    lab              natgateway           profile         resource      serviceconnector  storage
advisor      aro         botservice  configure          deploymentmanager  eventhubs  interactive  managedservices  netappfiles          rdbms           role          servicefabric     synapse

The ~/.azure/commandIndex.json file contains the full list of modules when I run the image interactively, but only limited set of modules when run in our pipeline. Manual removal and re-creation of this file doesn't help.
{"version": "2.31.0", "cloudProfile": "2020-09-01-hybrid", "commandIndex": {"acr": ["azure.cli.command_modules.acr"], "acs": ["azure.cli.command_modules.acs"], "aks": ["azure.cli.command_modules.acs"], "openshift": ["azure.cli.command_modules.acs"], "advisor": ["azure.cli.command_modules.advisor"], "appconfig": ["azure.cli.command_modules.appconfig"], "webapp": ["azure.cli.command_modules.appservice", "azure.cli.command_modules.serviceconnector"], "functionapp": ["azure.cli.command_modules.appservice"], "appservice": ["azure.cli.command_modules.appservice"], "staticwebapp": ["azure.cli.command_modules.appservice"], "logicapp": ["azure.cli.command_modules.appservice"], "cloud": ["azure.cli.command_modules.cloud"], "config": ["azure.cli.command_modules.config"], "configure": ["azure.cli.command_modules.configure"], "cache": ["azure.cli.command_modules.configure"], "local-context": ["azure.cli.command_modules.configure"], "databoxedge": ["azure.cli.command_modules.databoxedge"], "eventhubs": ["azure.cli.command_modules.eventhubs"], "extension": ["azure.cli.command_modules.extension"], "feedback": ["azure.cli.command_modules.feedback"], "find": ["azure.cli.command_modules.find"], "hdinsight": ["azure.cli.command_modules.hdinsight"], "interactive": ["azure.cli.command_modules.interactive"], "iot": ["azure.cli.command_modules.iot"], "keyvault": ["azure.cli.command_modules.keyvault"], "term": ["azure.cli.command_modules.marketplaceordering"], "network": ["azure.cli.command_modules.network", "azure.cli.command_modules.privatedns"], "login": ["azure.cli.command_modules.profile"], "logout": ["azure.cli.command_modules.profile"], "self-test": ["azure.cli.command_modules.profile"], "account": ["azure.cli.command_modules.profile", "azure.cli.command_modules.resource"], "group": ["azure.cli.command_modules.resource"], "resource": ["azure.cli.command_modules.resource"], "provider": ["azure.cli.command_modules.resource"], "feature": ["azure.cli.command_modules.resource"], "tag": ["azure.cli.command_modules.resource"], "deployment": ["azure.cli.command_modules.resource"], "deployment-scripts": ["azure.cli.command_modules.resource"], "policy": ["azure.cli.command_modules.resource"], "lock": ["azure.cli.command_modules.resource"], "managedapp": ["azure.cli.command_modules.resource"], "bicep": ["azure.cli.command_modules.resource"], "role": ["azure.cli.command_modules.role"], "ad": ["azure.cli.command_modules.role"], "security": ["azure.cli.command_modules.security"], "storage": ["azure.cli.command_modules.storage"], "synapse": ["azure.cli.command_modules.synapse"], "rest": ["azure.cli.command_modules.util"], "version": ["azure.cli.command_modules.util"], "upgrade": ["azure.cli.command_modules.util"], "demo": ["azure.cli.command_modules.util"], "disk": ["azure.cli.command_modules.vm"], "disk-encryption-set": ["azure.cli.command_modules.vm"], "disk-access": ["azure.cli.command_modules.vm"], "image": ["azure.cli.command_modules.vm"], "snapshot": ["azure.cli.command_modules.vm"], "vm": ["azure.cli.command_modules.vm"], "vmss": ["azure.cli.command_modules.vm"], "sig": ["azure.cli.command_modules.vm"], "ppg": ["azure.cli.command_modules.vm"], "sshkey": ["azure.cli.command_modules.vm"]}}

I can't find any documented configuration or way to load these modules.

@jiasli for awareness

This is because you are using 2020-09-01-hybrid profile which only supports limited command set.
You may switch to latest profile by running
az cloud set --name AzureCloud --profile latest

@thrubovc Thanks for reaching out to us and reporting this issue. Could you please follow the above suggestion and let us know if that helps ?

Thanks for your response. It doesn't answer why then with the same profile I am able to use those commands in one scenario but not the other. Also, looking at the az cloud set documentation, the latest parameter the --profile flag accepts seems to be 2020-09-01-hybrid which is the profile I'm using.
I'll give it a try though and confirm if it fixes my problem.

@thrubovc Thanks for your reply. Please share the update once you get a chance.

setting the profile to latest has solved my issue!
But I'd like to go back to my previous question - the az profile documentation accepts the 2020-09-01-hybrid profile as the newest configurable profile, followed by latest, which I would expect to be pointing to that. My fear is that if we set our pipeline to use the latest profile, then somewhere down the road, Azure will introduce some API changes that will cause our code not to work anymore.
Is there some backwards-compatibility guaranteed, or undocumented profile version which recognizes the cosmosdb command but isn't latest?

It doesn't answer why then with the same profile I am able to use those commands in one scenario but not the other.

This couldn't be. I am 99.9% percent sure you are using different profiles. 🙂
Hybrid profiles such as 2020-09-01-hybrid are only designed for Azure Stack. If you use public Azure, you should always use latest.

Is there some backwards-compatibility guaranteed?

We don't make breaking changes frequently. If we do make one in breaking change windows (we will provide more info regarding breaking change windows), we will explicitly call that out in the release notes: https://learn.microsoft.com/en-us/cli/azure/release-notes-azure-cli
We will also announce breaking changes beforehand at https://learn.microsoft.com/en-us/cli/azure/upcoming-breaking-changes

or undocumented profile version which recognizes the cosmosdb command but isn't latest?

Nope. All profiles are documented in the help message:
> az cloud set -h

Command
    az cloud set : Set the active cloud.

Arguments
    --name -n [Required] : Name of a registered cloud.
    --profile            : Profile to use for this cloud.  Allowed values: 2017-03-09-profile,
                           2018-03-01-hybrid, 2019-03-01-hybrid, 2020-09-01-hybrid, latest.

thanks, that's all I needed to hear!
all the best!