Problem with scraper

Before creating an issue, first upgrade cfscrape with pip install -U cfscrape and see if you're still experiencing the problem.
Version number
Run pip show cfscrape and paste the output below:
Name: cfscrape
Version: 2.0.5
Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information.
Home-page: https://github.com/Anorov/cloudflare-scrape
Author: Anorov
Author-email<EMAIL_ADDRESS>License: UNKNOWN
Location: /home/zeinab/.local/lib/python2.7/site-packages
Requires: requests
Required-by:
You are using pip version 18.0, however version 19.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Code snippet experiencing the issue
import cfscrape
scraper = cfscrape.create_scraper()  # returns a CloudflareScraper instance
Or: scraper = cfscrape.CloudflareScraper()  # CloudflareScraper inherits from requests.Session
print scraper.get("https://forum.bitcoin.com/ico-announcements-f120/").content  # => "..."
Complete exception and traceback
(If the problem doesn't involve an exception being raised, leave this blank)
Traceback (most recent call last):
File "scrape.py", line 6, in
print scraper.get("https://forum.bitcoin.com/ico-announcements-f120/").content  # => "..."
File "/home/zeinab/.local/lib/python2.7/site-packages/requests/sessions.py", line 525, in get
return self.request('GET', url, **kwargs)
File "/home/zeinab/.local/lib/python2.7/site-packages/cfscrape/init.py", line 132, in request
resp = self.solve_cf_challenge(resp, **kwargs)
File "/home/zeinab/.local/lib/python2.7/site-packages/cfscrape/init.py", line 185, in solve_cf_challenge
answer, delay = self.solve_challenge(body, domain)
File "/home/zeinab/.local/lib/python2.7/site-packages/cfscrape/init.py", line 284, in solve_challenge
["node", "-e", js], stdin=subprocess.PIPE, stderr=subprocess.PIPE
File "/usr/lib/python2.7/subprocess.py", line 567, in check_output
process = Popen(stdout=PIPE, *popenargs, **kwargs)
File "/usr/lib/python2.7/subprocess.py", line 711, in init
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child
raise child_exception
OSError: [Errno 13] Permission denied
URL of the Cloudflare-protected page
[https://forum.bitcoin.com/ico-announcements-f120/]
URL of Pastebin/Gist with HTML source of protected page
[view-source:https://forum.bitcoin.com/ico-announcements-f120/]

Hi @zakhavan,
Unfortunately this is an OS related permission error that has nothing to do with cfscrape or even Python.
I would make sure that you have proper file permissions in place that allow Python to read and execute "node".

Thank you for your reply. Do you know how I can fix it?

You're welcome.
I don't use Windows so I can't tell you exactly how to fix it off the top of my head but it shouldn't be hard to fix. All you really have to do is correct the permissions on the Node.js executable. Finding that executable file and changing those permissions is where you might struggle.
Just google it. I don't recommend running cfscrape as an administrator but here is a random StackOverflow Question & Answer: https://stackoverflow.com/questions/36434764/permissionerror-errno-13-permission-denied
If you can't figure this out. Ask on https://stackoverflow.com
I'm guessing that this has been asked many,many,many times so please take the time to research the problem properly. It is a file permissions problem.
I hope you get it working soon! :smiley:

I'm using linux. Thank you very much for the links. I will look into them.

@zakhavan
I'm giving you a few pointers as a courtesy but I can't help any further.
Start cmd.exe as an Administrator.  You should be able to do that by searching for cmd.exe from the start menu and right clicking to spawn the content menu which has a "Run as Administrator" option.
Find the executable: where.exe node*
Give users full control over the file: icacls "PATH" /grant Users:F <-- Replace PATH with the path found.

@zakhavan
Oh... Duhh... Okay chmod a+x $(which node)

Thank you so much.


Exception when i try to get a variables type (note exception comes when i write type)

Description
What steps will reproduce the problem?

Python 3.7.7 (default, May  6 2020, 11:45:54) [MSC v.1916 64 bit (AMD64)]
Type "copyright", "credits" or "license" for more information.
IPython 7.2.0 -- An enhanced Interactive Python.
a = 1
[SpyderKernelApp] ERROR | Exception in message handler:
Traceback (most recent call last):
File "C:\Users\ander\anaconda3\lib\site-packages\ipykernel\kernelbase.py", line 268, in dispatch_shell
yield gen.maybe_future(handler(stream, idents, msg))
File "C:\Users\ander\anaconda3\lib\site-packages\tornado\gen.py", line 735, in run
value = future.result()
File "C:\Users\ander\anaconda3\lib\site-packages\tornado\gen.py", line 209, in wrapper
yielded = next(result)
File "C:\Users\ander\anaconda3\lib\site-packages\ipykernel\kernelbase.py", line 604, in inspect_request
content.get('detail_level', 0),
File "C:\Users\ander\anaconda3\lib\site-packages\ipykernel\ipkernel.py", line 423, in do_inspect
detail_level=detail_level
File "C:\Users\ander\AppData\Roaming\Python\Python37\site-packages\IPython\core\interactiveshell.py", line 1765, in object_inspect_mime
detail_level=detail_level
File "C:\Users\ander\AppData\Roaming\Python\Python37\site-packages\IPython\core\oinspect.py", line 600, in _get_info
info = self._info(obj, oname=oname, info=info, detail_level=detail_level)
File "C:\Users\ander\AppData\Roaming\Python\Python37\site-packages\IPython\core\oinspect.py", line 863, in _info
names = [sub.name for sub in obj.subclasses()]
TypeError: descriptor 'subclasses' of 'type' object needs an argument
type(a)
Out[2]: int
Versions

Spyder version: 4.1.4
Python version: 3.7.7
Qt version: 5.9.6
PyQt5 version: 5.9.2
Operating System: Windows 10

Dependencies

# Mandatory:
atomicwrites >=1.2.0           :  1.4.0 (OK)
chardet >=2.0.0                :  3.0.4 (OK)
cloudpickle >=0.5.0            :  1.5.0 (OK)
diff_match_patch >=20181111    :  20200713 (OK)
intervaltree                   :  None (OK)
IPython >=4.0                  :  7.2.0 (OK)
jedi =0.17.1                   :  0.17.1 (OK)
nbconvert >=4.0                :  5.6.1 (OK)
numpydoc >=0.6.0               :  1.1.0 (OK)
paramiko >=2.4.0               :  2.7.1 (OK)
parso =0.7.0                   :  0.7.0 (OK)
pexpect >=4.4.0                :  4.8.0 (OK)
pickleshare >=0.4              :  0.7.5 (OK)
psutil >=5.3                   :  5.7.0 (OK)
pygments >=2.0                 :  2.6.1 (OK)
pylint >=1.0                   :  2.5.3 (OK)
pyls >=0.34.0;<1.0.0           :  0.34.1 (OK)
qdarkstyle >=2.8               :  2.8.1 (OK)
qtawesome >=0.5.7              :  0.7.2 (OK)
qtconsole >=4.6.0              :  4.7.5 (OK)
qtpy >=1.5.0                   :  1.9.0 (OK)
rtree >=0.8.3                  :  0.9.4 (OK)
sphinx >=0.6.6                 :  3.1.2 (OK)
spyder_kernels >=1.9.2;<1.10.0 :  1.9.2 (OK)
watchdog                       :  None (OK)
zmq >=17                       :  19.0.1 (OK)

# Optional:
cython >=0.21                  :  0.29.21 (OK)
matplotlib >=2.0.0             :  3.0.2 (OK)
numpy >=1.7                    :  1.17.0 (OK)
pandas >=0.13.1                :  1.0.5 (OK)
scipy >=0.17.0                 :  1.5.0 (OK)
sympy >=0.7.3                  :  1.6.1 (OK)

# Spyder plugins:
spyder_notebook                :  0.3.0 (OK)
spyder_terminal                :  0.4.1 (OK)
spyder_unittest                :  0.4.1 (OK)

It's after i have assigned the value to variable "a" that I start to write "type(a)" and then the exception occurs.

Hey @efo42, thanks for reporting. It seems you installed some packages with pip, which is causing this issue. To fix it, please remove this directory
C:\Users\ander\AppData\Roaming\Python\

and try again.

Hi thanks for the answer and that fixed the problem
Best Regards
Anders
On Thu, Aug 13, 2020 at 5:35 PM Carlos Cordoba<EMAIL_ADDRESS>wrote:

Hey @efo42 https://github.com/efo42, thanks for reporting. It seems you
installed some packages with pip, which is causing this issue. To fix it,
please remove this directory
C:\Users\ander\AppData\Roaming\Python\
and try again.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/spyder-ide/spyder/issues/13525#issuecomment-673549502,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AKT2KLN3UJPXBQFFQG3S2ZLSAQB4PANCNFSM4P6AZM3Q
.

Great to know! Happy Spydering @efo42!


[cli] Improve Tests

Currently

Tests currently test the local files rather than the the build folder which means that the tests can pass while running npx create-expo-stack@latest can be broken.
Running tests is slow and/or trips up with bun
Tests do not have full coverage
Tests don't even pass locally

What this is
We need to be able to ensure that every single iteration of configurations and flags works as expected, at any point in time but particularly upon any change made to the cli.
The way to confirm that each iteration works is to ensure that:

Project set up succeeds, which is to say that

The appropriate cli json object is created
The appropriate command is generated to rerun the command, if desired by the user
Project initialization succeeds
Initializing git succeeds (flag)
Base assets are copied
Installation of dependencies succeeds with the specified package manager (flag)
Code formatting completes

All of the elements on each screen are present, laid out properly, with the proper styles applied (android & ios)
Navigating throughout the application should function as expected such that clicking on a button will lead you to the appropriate page and clicking some other button will return you to the previous page (android & ios)

Conditions

Tests should run on the build folder rather than the the local folder to prevent tests passing locally while breaking in production (eg npx create-expo-stack@latest)
If they are to be run locally, they can't take too long (more than 2 min is too much)
Tests should not run on commit
A PR pertaining to the cli should not be able to be merged without tests passing
Going through the CLI interactively, all iterations work
Going through non-interactive mode, all iterations work

What this is not

Tests for the landing page
Tests for the docs

Closing as this is a feature rather than a bug, we now track features in Discord and Linear. https://discord.com/channels/1173879003191459860/1173881828172636160/1249160239773646868


Outline double-click usability issues

Issue Type: Bug
Clicking on an entry in the outline causes the view to scroll to center that entry. This makes it difficult to double-click and jump to an item since the view moves between clicks.
So, to go to an entry you have to:

single-click on the item
move your mouse to the new location after it scrolls
double-click to jump

I think the intended behavior is to scroll to make the current item visible when moving through the source file. Scrolling after clicking on an item in the view is unnecessary since it's inherently visible in that case.
Ideally the view should only scroll if the new highlight is not already visible, but if that's difficult it might also make sense to just avoid scrolling when triggered by a click in the outline view.
VS Code version: Code 1.28.2 (7f3ce96ff4729c91352ae6def877e59c561f4850, 2018-10-17T00:18:43.347Z)
OS version: Darwin x64 17.7.0

The problem is that the tree has no function like revealInCenterIfOutsideViewport and therefore we always reveal in the center (middle).

@jrieken You can use getRelativeTop to figure out if an item is visible. Then, you can use reveal to reveal it wherever.


Why direction: 'ltr' changes to 'rtl'?

I use Material-UI and Jss. For rtl support I use jss-rtl. My problem is that sometimes I want some part of ui to be left-to-right (i.e. email input box) in this case I set the direction of the input to ltr but the jss-rtl convert it to 'rtl' so I have to opt out of it by flip: false as follow:
emailInput: {
  flip: false,
  direction: 'ltr',
}

I workaround it this way, but I want to know what is the use case of this conversion? I thought that it might be a bug.

All the conversions are performed by the (rtl-css-js)[https://github.com/kentcdodds/rtl-css-js] library. So if there is a bizarre use-case for this kind of conversion, you should ask for it there. This library is only a wrapper for that one.


broken release 2.0.2 - call undefined function

release 2.0.2 is broken because of undefined function call of getStatus in ResponseParser.php
https://github.com/amzn/login-and-pay-with-amazon-sdk-php/pull/28

Thanks for the information! This has been resolved with the latest commit.


Adding attributes in anchor tag.

How to add attributes like target="_blank" in anchor tag??

This package does not work with html.


I18n updates

TaskViewDetailsImp.. should the change include "high", "medium" and "low"?

@manstis not sure what you mean exactly. High, medium and low are in the constants file already, used by another screen/presenter.

Petr is right... sorry on phone and unable to comment on lines :-(

that makes sense :) thanks guys.

done :)

Any chance you can squash the commits?

finally ;)

+1 to merge.


RANGER-2284: Fixed build using docker

https://www.apache.org/dist/maven/maven-3/ no longer has version 3.5.3
For more details, see https://issues.apache.org/jira/browse/RANGER-2284

@necosta Apache Ranger currently isn't setup to use pull requests to take in the changes for commit. All source commits require a JIRA ticket (which you have done already!) and a review board submission. Please review the details about the process to contribute.
Thanks for submitting the patch!

hello apache rangers
my ranger version is 0.7.1
I got a problem after I sync users/groups from ldap
in my hive-plugin
I got a problem when I  Grant authority on groups
It does not seem to work

Fixed by https://github.com/apache/ranger/commit/b517a47f1d696b3ee6345203db7fb5415c35160c


CommandLine Task added a debug line that breaks builds

Required Information
Entering this information will route you directly to the right team and expedite traction.
Question, Bug, or Feature?
Type: Bug
Enter Task Name:  CommandLine
list here (V# not needed):
https://github.com/Microsoft/azure-pipelines-tasks/tree/master/Tasks
Environment

Server - Azure Pipelines or TFS on-premises?

Azure Pipeline (office.vsts.com)

Agent - Hosted or Private:

Private
Issue Description
We were using this:
node -e "process.stdout.write('##vso[task.setvariable variable=target_branch]refs/heads/master'.replace('refs/heads/','refs/remotes/origin/'))"

to write a target branch variable (which should EXIST really), but the commandline task update just broke our builds because it inserted:
"##vso[task.debug]Exit code: 0" at the end of that variable.
Feel free to contact me internally inside MSFT communication channels (kchau)

Hi @kenotron is this issue still actual for you? I just tried running the task using your code and got the correct result.

Hi @kenotron, is the issue still relevant for you?

Feel free to reopen this issue if it still happens to you.


missing pricing of r5/r5d/z1d

The pricing url may be truly deprecated?

Check out: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/index.json

The details page is over 350MB... https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonEC2/current/index.json

@jkleckner unfortunately we don't use the pricing API but instead we scrape the data from many sources, such as HTML tables or JSON data used for rendering the AWS documentation, because the pricing API is relatively new and we didn't yet convert the scraping code to use it.
Unfortunately AWS often fails to update all of these data sources when launching new instance types, so we have data gaps until the documentation is eventually updated.
Feel free to contact AWS via support case or Twitter and ask them to update the documentation for these instance types. Have a look at the scraping script to identify which is the source we're missing. I recently did this for the c5d instance types that currently lack the virtualization information.
Alternatively, we would gladly consider a PR which changes our code to use the pricing API at least for the fields we can get from it.

Hello @cristim, it seems AWS updated the pricing for r5 and r5d instance types on their usual pricing page: https://aws.amazon.com/ec2/pricing/on-demand/
Last scraping was done on 2018-08-02 17:47:34 UTC, and I don't know when it was updated, so maybe it will be automatically fixed in the next scraping.

@rafaelalmeida try to build it locally and see if the page is generated correctly. If this is the case, just ask @powdahound to rebuild the main ec2instances.info website.

@cristim Just tried that - now the r5 instances don't even show in the table (in the production site, they show, but pricing is listed as "unavailable").

That looks like a chance for you to become a project contributor 😀
Try hacking the scrape.py script until it looks good locally and then create a PR.

is there a reason not to use the pricing API?

No particular reason,it just wasn't available earlier when the scraping logic was written, and nobody bothered to migrate to it once it was available.

I,m  working on replacing the price scraping logic with a small wrapper around https://github.com/lyft/awspricing, looking good so far.

Closing this in favor of #367


Requirement name not detected when installing from local git repo, despite specification

Pipenv fails with pip9.exceptions.InstallationError: Could not detect requirement name when installing from local git repo, despite specifying the name with #egg=
Pipenv installed via pip. Also tested on Pipenv master.
$ python -m pipenv.help output
Pipenv version: '2018.05.18'
Pipenv location: '/usr/local/lib/python3.6/site-packages/pipenv'
Python location: '/usr/local/opt/python/bin/python3.6'
Other Python installations in PATH:

2.6: /usr/bin/python2.6

2.6: /usr/bin/python2.6

2.7: /usr/local/bin/python2.7

2.7: /usr/local/bin/python2.7

2.7: /usr/local/bin/python2.7

2.7: /usr/bin/python2.7

3.6: /usr/local/bin/python3.6m

3.6: /usr/local/bin/python3.6

3.6: /usr/local/bin/python3.6

2.7.15: /usr/local/bin/python

2.7.15: /usr/local/bin/python

2.7.10: /usr/bin/python

2.7.15: /usr/local/bin/python2

2.7.15: /usr/local/bin/python2

3.6.5: /usr/local/bin/python3

3.6.5: /usr/local/bin/python3

PEP 508 Information:
{'implementation_name': 'cpython',
 'implementation_version': '3.6.5',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '14.5.0',
 'platform_system': 'Darwin',
 'platform_version': 'Darwin Kernel Version 14.5.0: Sun Jun  4 21:40:08 PDT '
                     '2017; root:xnu-2782.70.3~1/RELEASE_X86_64',
 'python_full_version': '3.6.5',
 'python_version': '3.6',
 'sys_platform': 'darwin'}

System environment variables:

XDG_CONFIG_HOME
LANG
XPC_FLAGS
DISPLAY
TERM_SESSION_ID
COMMAND_MODE
EDITOR
COLORTERM
__CF_USER_TEXT_ENCODING
ITERM_SESSION_ID
NPM_CONFIG_USERCONFIG
SSH_AUTH_SOCK
HOMEBREW_CASK_OPTS
USER
PWD
HOME
TERM_PROGRAM
TERM_PROGRAM_VERSION
Apple_PubSub_Socket_Render
ITERM_PROFILE
TMPDIR
XPC_SERVICE_NAME
TERM
SHELL
SECURITYSESSIONID
SHLVL
COLORFGBG
NPM_CONFIG_CACHE
XDG_CACHE_HOME
LOGNAME
XDG_RUNTIME_DIR
NPM_CONFIG_TMP
XDG_DATA_HOME
PATH
_
PYTHONDONTWRITEBYTECODE
PIP_PYTHON_PATH

Pipenv–specific environment variables:
Debug–specific environment variables:

PATH: /Users/azhou/bin:/usr/local/opt/gettext/bin:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/opt/X11/bin:/usr/local/share/dotnet:/Library/TeX/texbin:/Applications/Wireshark.app/Contents/MacOS
SHELL: /usr/local/bin/bash
EDITOR: vim
LANG: en_US.UTF-8
PWD: /Users/azhou/Documents/workspace/test/test-project

Contents of Pipfile ('/Users/azhou/Documents/workspace/test/test-project/Pipfile'):
[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
six = {path = "git+file:///Users/azhou/Documents/workspace/test/six/.git", editable = true}

[dev-packages]

[requires]
python_version = "3.6"

Contents of Pipfile.lock ('/Users/azhou/Documents/workspace/test/test-project/Pipfile.lock'):
{
    "_meta": {
        "hash": {
            "sha256": "415dfdcb118dd9bdfef17671cb7dcd78dbd69b6ae7d4f39e8b44e71d60ca72e7"
        },
        "pipfile-spec": 6,
        "requires": {
            "python_version": "3.6"
        },
        "sources": [
            {
                "name": "pypi",
                "url": "https://pypi.org/simple",
                "verify_ssl": true
            }
        ]
    },
    "default": {},
    "develop": {}
}

Expected result
Package installs from local git branch successfully.
Actual result
pipenv install fails with pip9.exceptions.InstallationError.
Tested with six. --verbose log at https://gist.github.com/0az/8215fb5a578f47446ff5b1e813a2762b due to length.
Installing -e git+file:///Users/azhou/Documents/workspace/test/six/.git#egg=six…
Obtaining six from git+file:///Users/azhou/Documents/workspace/test/six/.git#egg=six
  Updating /Users/azhou/.local/share/virtualenvs/test-project-kYOvgE9a/src/six clone
Installing collected packages: six
  Found existing installation: six 1.11.0
    Uninstalling six-1.11.0:
      Successfully uninstalled six-1.11.0
  Running setup.py develop for six
Successfully installed six

Adding -e git+file:///Users/azhou/Documents/workspace/test/six/.git#egg=six to Pipfile's [packages]…
Pipfile.lock (ca72e7) out of date, updating to (1ab3f3)…
Locking [dev-packages] dependencies…
Locking [packages] dependencies…
penv/utils.py", line 332, in actually_resolve_reps
    dep[len('-e '):]
  File "/usr/local/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 144, in from_editable
    editable_req, default_vcs)
  File "/usr/local/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 1197, in parse_editable
    "Could not detect requirement name, please specify one with #egg="
pip9.exceptions.InstallationError: Could not detect requirement name, please specify one with #egg=
…

Steps to replicate

Clone a python package (six) into a local repo ($sixdir)
Create empty Pipenv with pipenv install
Install six using pipenv install -e git+file://$sixdir/.git#egg=six

a git repository is not a valid requirement, your requirement needs to point at a directory with a setup.py in it

Also—the error message has been improved in master (will be released in the next version). I’m hitting another bug right now with #egg=, and can’t confirm if the user experience is improved there.

@tealalchemy
I tested it with the benjaminp/six repo, which does have a setup.py. I should probably make that clear.

I believe this is under investigation.


Make nox -s dev run like nox -s dev --verbose

Description
Make nox -s dev run like nox -s dev --verbose to so that all commands run is shown.
Fixes # (issue)
Type of change
Please add a line in the relevant section of CHANGELOG.md to document the change (include PR #) - note reverse order of PR #s. If necessary, also add to the list of breaking changes.

[ ] New feature (non-breaking change which adds functionality)
[ ] Optimization (back-end change that speeds up the code)
[ ] Bug fix (non-breaking change which fixes an issue)

Key checklist:

[ ] No style issues: $ pre-commit run (see CONTRIBUTING.md for how to set this up to run automatically when committing locally, in just two lines of code)
[ ] All tests pass: $ python run-tests.py --all
[ ] The documentation builds: $ python run-tests.py --doctest

You can run unit and doctests together at once, using $ python run-tests.py --quick.
Further checks:

[ ] Code is commented, particularly in hard-to-understand areas
[ ] Tests added that prove fix is effective or that feature works

The --verbose flag allows developers to see what packages are installed by pip in the environments, which is especially useful for the unit, examples, and the docs environments. Is there a way to increase the verbosity for all nox environments by default?

The --verbose flag allows developers to see what packages are installed by pip in the environments, which is especially useful for the unit, examples, and the docs environments. Is there a way to increase the verbosity for all nox environments by default?

There doesn't seem to be having much info available about increasing the verbosity level by default atm.
I could find this much according to the docs :

Controlling commands verbosity
By default, Nox will only show output of commands that fail, or, when the commands get passed silent=False. By passing --verbose to Nox, all output of all commands run is shown, regardless of the silent argument.

Apparantly I tried doing this & some other things as well
nox.options.verbose = True

But it did't make any effect on verbosity.

I checked the other command-line arguments if we can add any more, I think we should also document the --install-only command since it allows the creation of an environment but only installs the dependencies, to keep it ready for later use—this could be useful for the unit and docs environments

Yes, I had added it here


btc testnet sign string is not fees

Describe the bug
android to btc testnet sign success
bug the sign string decode find fees is null
this is my code

this is my sign str:
010000000101722abb6bec2ba97e5946074d9e810d6d5e5adbc81862d2ed090c0f9f9731fd010000006a47304402207d6ff7cfd32c776ab68b487c4be61246248c16bbee649f37ceeb1c48d8fe0d2e022070e9923f0001f6c49dd93013ddecaafb5cb879ff1a69110ccc45b2ac2aac6c07012103c56fe7723ce7ff86ee1815c1087568fe0b6e9228a307a7eb9544f61e0bebac77000000000201000000000000001976a914404e85dd9939fcf30b414979f497ed99c210d54888ac1d788900000000001976a9147be12c4d3370e71eed92b89b56868d4903830cdf88ac00000000
this is my decode info:

To Reproduce
Steps to reproduce the behavior:
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

@hewigovens

im do it
i look my swift code find uxto'txid need .reversed() funcation


[Feature]: Is it possible to automatically ignore dts files inside a folder in bundleless mode?

Version
System:
    OS: Linux 6.1 Ubuntu 20.04.6 LTS (Focal Fossa)
    CPU: (4) x64 AMD EPYC
    Memory: 6.56 GB / 8.01 GB
    Container: Yes
    Shell: 5.0.17 - /bin/bash
  npmPackages:
    @rslib/core: ^0.2.2 => 0.2.2

Details
I think dts files should be ignored by default when building a bundle library? Although this can be achieved by configuring entry as src/**/!(*.d.ts). If don't config this, dts file will be transformed to an empty js file.

Reproduce link
https://codesandbox.io/p/github/wood3n/rslib-test/master?embed=1&file=%2Frslib.config.ts
Reproduce Steps
run pnpm run build

Thanks for report, it's a reasonable feature request, we should ignore .d.ts in this way.


use System.Text.Json as the Json serializer

I really like this project.
We are starting to use this in a new .Net 6-based Azure functions project.
I noticed that NewtonSoft.Json was used for the serialization.
Would it be possible to move to using System.Text.Json?
I'm happy to do the work, if that would help.
Thanks,
Sean.

We are currently stuck with NewtonSoft.Json as that is what the underlying official .NET SDK for Cosmos DB uses. I believe that there is an effort to allow for a bring your own serializer option coming, but I do not know when.

Ok, makes sense.
The hacks seem a bit nasty.
Let’s close this and I’ll re-open when v4 comes out.
Thanks,
Sean.
From: David Pine @.>
Sent: 04 May 2022 18:32
To: IEvangelist/azure-cosmos-dotnet-repository @.>
Cc: Sean Farrow @.>; Author @.>
Subject: Re: [IEvangelist/azure-cosmos-dotnet-repository] use System.Text.Json as the Json serializer (Issue #273)
We are currently stuck with NewtonSoft.Json as that is what the underlying official .NET SDK for Cosmos DB uses. I believe that there is an effort to allow for a bring your own serializer option coming, but I do not know when.
—
Reply to this email directly, view it on GitHubhttps://github.com/IEvangelist/azure-cosmos-dotnet-repository/issues/273#issuecomment-1117618881, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AALDK7T3LGJJXOEUXS3IBR3VIKYBXANCNFSM5VCUTT3Q.
You are receiving this because you authored the thread.Message ID: @.***>

You can use a different serializer now (unsure when it became available) by inheriting from CosmosSerializer
public class CosmosSystemTextJsonSerializer : CosmosSerializer
{
    public override T FromStream<T>(Stream stream)
    {
        return stream.FromJson<T>() ?? default!;
    }

    public override Stream ToStream<T>(T input)
    {
        return input.ToJsonStream();
    }
}

and then referencing in CosmosClientOptions:
new CosmosClientOptions
{
    Serializer = new CosmosSystemTextJsonSerializer()
}

The System.Text.Json serializer option works great!
The only thing is... while setting the serializer on the CosmosClientOptions, the AddInMemoryCosmosRepository() is still using Json.NET.
This leads to different serializing behaviour in e.g. writing tests and running the application.

That's an excellent observation. Would any of you be interested in working on addressing this issue?

@IEvangelist  yes, what's the timescale for the next release?

I can also work on it. There is also another challenge, in combination with Serializer instead of SerializerOptions and Casing Strategy.

No, immediate release timescale. Take your time, and this is much appreciated. Thank you.

I'm running into this issue. When using custom CosmosSerializer the naming convention for type property of the underlying query doesn't get applied. Is there any solution?

Hi @sven5 - Sorry you're experiencing issues.

I'm running into this issue. When using custom CosmosSerializer the naming convention for type property of the underlying query doesn't get applied. Is there any solution?
to be more precise, the query gets generated with Type instead of type ((NOT IS_DEFINED(root[\"Type\"])) OR (root[\"Type\"] = \"Product\")))"

What does your repository configuration look like? Are you using something like:
"RepositoryOptions": {
  "CosmosConnectionString": "<CosmosDB-ConnectionString>",
  "DatabaseId": "<CosmosDB-DatabaseName>",
  "ContainerId": "<CosmosDB-ContainerName>",
  "SerializationOptions": {
    "PropertyNamingPolicy": "CamelCase"
  }
}

Notice the SerializationOptions section. Also, what version are you on?

This is something I plan to look at in a couple of weeks—probably by the end of October.
From: David Pine @.>
Sent: Friday, September 29, 2023 7:13 PM
To: IEvangelist/azure-cosmos-dotnet-repository @.>
Cc: Sean Farrow @.>; Assign @.>
Subject: Re: [IEvangelist/azure-cosmos-dotnet-repository] use System.Text.Json as the Json serializer (Issue #273)
Hi @sven5https://github.com/sven5 - Sorry you're experiencing issues.
I'm running into this issue. When using custom CosmosSerializer the naming convention for type property of the underlying query doesn't get applied. Is there any solution?
to be more precise, the query gets generated with Type instead of type ((NOT IS_DEFINED(root["Type"])) OR (root["Type"] = "Product")))"
What does your repository configuration look like? Are you using something like:
"RepositoryOptions": {
"CosmosConnectionString": "",
"DatabaseId": "",
"ContainerId": "",
"SerializationOptions": {
"PropertyNamingPolicy": "CamelCase"

}
}
Notice the SerializationOptions section. Also, what version are you on?
—
Reply to this email directly, view it on GitHubhttps://github.com/IEvangelist/azure-cosmos-dotnet-repository/issues/273#issuecomment-1741303909, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AALDK7WH4F2R7C4MOYXLWW3X44FRRANCNFSM5VCUTT3Q.
You are receiving this because you were assigned.Message ID: @.***>

I just made an update, see 0788386c1d47cd1ac3e90a6d6ac6e3559db2c63f. This added an implicit operator for the RepositorySerializationOptions that maps to the CosmosLinqSerializerOptions. I now flow that through all the GetItemLinqQueryable calls. That might be the fix.

@IEvangelist that would be great. 👍

This issue is out of scope, since we can't control the serializer (yet). If that changes in the future, we can revaluate this... but for now, let's close this. And @sven5 - see https://github.com/IEvangelist/azure-cosmos-dotnet-repository/releases/tag/7.1.0.

@IEvangelist Thanks for you update. Now it's working perfectly.

@IEvangelist  just one question, do you know when the CosmosDB team is planning to step over to System.Text.Json?   Is there even any schedule?


superbench mpi job should use the proper Ethernet interface

Several superbench tests (e.g. nccltests, ib-traffic ) use openmpi to launch the tests in multiple nodes. Some node type is designed to have multiple ethernet interfaces (e.g. azure2, eth0, docker0, ib0, ib1 etc). The working IPv4 ethernet interface is not the default 'eth0' (e.g. azure2).
While a user can manually check its node type and figure out which ethernet type to use for the MPI (e.g. --mca btl_tcp_if_include azure2 --mca oob_tcp_if_include azure2), it is not generic across diff node types.
Expected: because superbench launches the MPI command, superbench should detect the proper ethernet interface to use. And add it to the openmpi command line.
The following is one way to find this interface using bash. It will be much simpler to use python to do this.
get_eth_interfaces() {
IPV4List=$(ip -4 -f inet a |grep mtu|awk '{print $2}' | sed ':a; N; $!ba; s/\n//g')
for ifname in $(ls /sys/class/net); do
if [[ -f /sys/class/net/$ifname/type && $(cat /sys/class/net/$ifname/type) -eq 1 &&  ! -f /sys/class/net/$ifname/bridge ]]; then
isIPV4=$(echo ${IPV4List} | grep "$ifname:" | wc -l)
isDocker=$(echo $ifname | grep docker | wc -l)
if [[ "${isIPV4}" == "1" && "${isDocker}" == "0" ]]; then
echo $ifname
fi
fi
done
}

When there're multiple Ethernet interfaces available, there won't be "default", OMPI will automatically detect the usable interface using its routability algorithm. The detection is complex and it still cannot cover some cases which require user to specify btl_tcp_if_include and btl_tcp_if_exclude explicitly.
You can pass through such parameters in config yaml:
modes:
- name: mpi
  mca:
    btl_tcp_if_include: azure2

For the proposed get_eth_interfaces detection, it cannot cover some scenarios as well and may not be better than current OMPI's detection. Here're two cases:

"MPI job that spans public and private networks" that OMPI cannot cover, consider the following two nodes
|    Node A     |     |    Node B     |
|               |     |               |
|     eth0      |     |     eth0      |    # public network, cannot route
| <IP_ADDRESS> |     | <IP_ADDRESS> |
|               |     |               |
|     eth1      |     |     eth1      |    # private network, can route
| <IP_ADDRESS> |     | <IP_ADDRESS> |

eth0 is only used to access Internet and they cannot route to each other, while eth1 of two nodes are connected the same switch in private. You detection method would think both of them are usable (ipv4, with ip, no bridge, not docker), it's hard to choose the correct one without extra knowledge for cluster networking.

When all ethernet interfaces (azure2 and eth0 in your case) are disabled or unavailable, IPoIB can also be used for mpi, for example, changing to btl_tcp_if_include ib0 should also work in your environment. The get_eth_interfaces detection would also exclude suitable interfaces.

will use one by setting the config file


194 as developers we need to refactor our code so we have different repositories for teh different domain models

Just to see if test works, dont have playwright installed

We need test cases to be accepted


Incorrect diffs are displayed for newly created files

Hey, first let me thank you for your hard work on this project – much appreciated.
I think the behaviour of the diff editor is incorrect for newly created files. See details below.
monaco-editor version: 0.10.1
Browser: Chromium via electron 1.7.9
OS: macOS Sierra 10.12.6
Steps or JS usage snippet reproducing the issue:
const editor = monaco.editor.createDiffEditor(someContainer, someOptions);
const modifiedModel = monaco.editor.createModel('teeeeest', 'javascript');
const originalModel = monaco.editor.createModel(null, 'javascript');
editor.setModel({ original: originalModel, modified: modifiedModel });

The diff displayed will show an empty line being deleted and a new line teeeeest being inserted. It should only display the new line being inserted – there is no empty line being deleted.

I generally agree, but this is caused by ... convention.
Not only in the Monaco Editor, but in most editors, empty files are considered to consist of one line, with precisely one valid cursor position (1;1). Otherwise, there would be no chance to edit them and insert something...
The side-by-side diff editor is implemented by using two editors. By default the left-hand-side editor is read only, but the diff editor can be instantiated with an option to make both sides editable. It would then be very difficult to edit the left-hand-side (if it would contain no line).
Sorry for the weird explanation, probably not what you were expecting... :)

Thanks @alexandrudima.
This convention makes sense for creating / editing files. However, the convention for diffs when a file is created is definitely for the "before" side of the diff to be no content (as opposed to one empty line).
I can understand if this is not something you want to support though, given that this is primarily an editor and secondarily a diff viewer. It's just a shame for this pretty standard diff'ing scenario not to be covered.

Thanks for the acknowledgement @alexandrudima – I'm guessing this means you don't plan to support the diff behaviour I'm after, but just to be clear could you confirm please?

I also need the feature mentioned in this issue, is it available in version 0.21.2? @alexdima
I have read the issue #1652 and used originalEditor.setHiddenAreas([new monaco.Range(1,1,5,1)]), but it didn’t work.

We closed this issue because we don't plan to address it in the foreseeable future. If you disagree and feel that this issue is crucial: we are happy to listen and to reconsider.
If you wonder what we are up to, please see our roadmap and issue reporting guidelines.
Thanks for your understanding, and happy coding!

You might have more luck requesting this feature for VS Code - if we see a real need for VS Code, monaco editor will have the feature too.


Asm.js revert backend optimization

Reverts an optimization done in #1806.
We can't calculate const math in asm.js and wasm the same way we do for normal javascript.
The following case is erroneous.
// flags: -maic:1
var asmHeap = new ArrayBuffer(1 << 20);
var m = function (stdlib, foreign, heap) {
  'use asm';
  function f(d0, i1) {
    d0 = +d0;
    i1 = i1 | 0;
    return 248749990 /<PHONE_NUMBER> | 0;
  }
  return f;
}({}, {}, asmHeap);
print(m());
print(m());
// Expected Output:
// 0
// 0
// Actual Output:
// 0
// -248749990

I am adding this work item in the wasm todo list to revisit this at a later time.
Most likely most operators can do it the same way as javascript, but it needs deeper investigation to find and deal with the special cases.

This change is

@MikeHolman Can you review this please ?

Ah I guess it gets considered as -1?

lgtm

Yes, these path probably don't check the IRType to do unsigned math.
Also there are cases where we have to trap (wasm) or return 0 (asm.js)


Roll Flutter Engine from d5a0510e0391 to 70c9202fedd4 (1 revision)

https://github.com/flutter/engine/compare/d5a0510e0391...70c9202fedd4
2022-09-21<EMAIL_ADDRESS>Revert "[Impeller] SDF text rendering " (flutter/engine#36330)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


[2.4.x] mpm_event: Fix accounting of active/total processes on ungraceful restart

Children processes terminated by ap_{reclaim,relieve}_child_processes() were
were not un-accounted for total_daemons and active_daemons, which was done in
server_main_loop() only. This led to perform_idle_server_maintenance() thinking
it was over the limit of children processes and never create new ones.
Have this accounting right in event_note_child_{started,stopped}() which is
called both at runtime and reload time.

server/mpm/event/event.c(struct event_retained_data):
Rename field max_daemons_limit to max_daemon_used to better describe what
it's about and to align with AP_MPMQ_MAX_DAEMON_USED.

server/mpm/event/event.c(event_note_child_stopped):
Renamed from event_note_child_killed() to clarify that it's not only called
when a child is killed (i.e. on restart) but whenever a child has stopped.

server/mpm/event/event.c(event_note_child_stopped):
Move decrementing {active,total}_daemons and marking child's threads as
SERVER_DEAD from server_main_loop() so that it's done both at runtime and
reload time. Log the current number/state of daemons at APLOG_DEBUG level
for each child stopped.

server/mpm/event/event.c(event_note_child_started):
Move incrementing {active,total}_daemons from make_child() for symmetry,
given that make_child() calls event_note_child_started(). Log the current
number/state of daemons at APLOG_DEBUG level for each child started.

server/mpm/event/event.c(perform_idle_server_maintenance):
Fix possible miscounting of retained->max_daemon_used accross the multiple
calls to perform_idle_server_maintenance() if ListenCoresBucketsRatio > 0.
Pass an int *max_daemon_used which starts at zero and is bumped consistently
for all the buckets, while retained->max_daemon_used is updated only after
all the buckets have been maintained.

server/mpm/event/event.c(perform_idle_server_maintenance):
Use event_note_child_stopped() to handle exited children processes.

Fixes: BZ 66004
git-svn-id: https://svn.apache.org/repos/asf/httpd/httpd/trunk@1899777 13f79535-47bb-0310-9956-ffa450edef68

Backported to 2.4.x (r1901199 / 138691a51ced29d2717b98784080bc50e9a0610a)


Request: link to the video

Please add a link to the video in the readme.

Will add when available


Fix a few memory leaks and erroneous logic in nczarr_test/testfilter_misc

I was just checking to see if the build warnings were meaningful. I feel like some of them are.
This was was "straightforward" to cleanup, but I never saw symptoms of of its "wrongness".

This test is derived from nc_test4/testfilter_misc.c. So we need to propagate
these changes to that file also.

Got it.

@hmaarrfk Thanks!


[ISSUE #2192] Simplify and optimize integrated test

About #2192 .

[X] integrated test of grpc plugin
[X] integrated test of motan plugin
[X] integrated test of sofa plugin
[X] integrated test of spring cloud plugin
[X] integrated test of dubbo plugin

Codecov Report

Merging #2193 (b0c2c82) into master (dac22f5) will increase coverage by 0.09%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #2193      +/-   ##
============================================
+ Coverage     60.76%   60.86%   +0.09%
- Complexity     4081     4086       +5
============================================
  Files           607      607
  Lines         18099    18099
  Branches       1734     1734
============================================
+ Hits          10998    11016      +18
+ Misses         6204     6186      -18
  Partials        897      897

Impacted Files
Coverage Δ

...shenyu/sync/data/consul/ConsulSyncDataService.java
67.79% <0.00%> (+1.69%)
:arrow_up:

...enyu/client/tars/TarsServiceBeanPostProcessor.java
50.00% <0.00%> (+13.23%)
:arrow_up:

...ache/shenyu/client/tars/common/dto/TarsRpcExt.java
30.76% <0.00%> (+30.76%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dac22f5...b0c2c82. Read the comment docs.


Clickable fields

Make case sensitive and regular expression text in Text filter and all headers of columns
as link (or better - make all cell in layout table clickable) to control their state, to avoid clicking to pixels (checkboxes/down arrow, respectively).

Making case sensitive and regular expression text clickable in the Text filter was fixed by af1cc19c6db0f55a7226bfaa527eb0cdb244cd76
I'm against making the cells in the layout table clickable with the current editing mechanism - I often need to copy cell values, and I want to be able to do this without opening up an Edit pop-up.
I'm not sure about the column headings. Being able to copy these is sometimes useful, but I don't do it so often as copying cell values.
Any other views? @ettorerizza ?

@ettorerizza any views on making the column headings more generally clickable? I'm against for the reasons I state above, but if you disagree then it would be good to have a discussion. Otherwise I'll close this

Oops, sorry, I did not see the previous mention. No, it's clearly not something that I think is useful, personally. I very often select the name of a column to copy it. A completely clickable column name seems to have many disadvantages for very little advantages.

Agreed

Make case sensitive and regular expression text in Text filter DONE
Make all headers of columns or all cell in layout table clickable WON'T DO

This would cause problems in the UI where people want to simply copy text rather than interact with controls.
If an alternative approach to making clicking on column/cell controls easier can be suggested it will definitely be considered - please do this in a new issue if you have any suggestions

@ostephens well, with current human-computer interaction via mouse, there are 3+ buttons now, and some folks COULD use the middle mouse in various ways, but that that's like 1000 support issues waiting to be written for us to triage :)  We'll keep our plans to simple 1 button processing for now and the future UI work.


Include git-describe --long information in all generated files

It would be good if when you generated files like the sky130A.tech file, you included the current git revision. The best way to do this is with git-describe --long.

You should also probably include --dirty and --broken too.

@mithro : The last thing I did along these lines was to add annotated tags. . . where in my process should I do this?  Before/after setting the tag?

@mithro :  Oh, I see what you mean.  I currently set "version" in the techfile to the datestamp (e.g., "20200508") but it could just as easily be set to the result of "git describe --long".
When you say "files like the sky130A.tech file", do you have other files in mind?

Any file which this repo creates.

@mithro :  Okay, done (for sky130A.tech).

Closing this issue, which was implemented a while ago (but more recently, took this a step further by keeping an information file in the installation with the commits of every repository used by open_pdks to compile the final installed PDK).


Feature Request: useContextMenu

So you can have floating ui menus that appear when you context click.

The Context Menu demo shows how to build one of these.
The library doesn't offer hooks like useContextMenu, useCombobox, useSelect etc., not because I don't think they're good ideas, but because I wanted to make it feasible to build any type of component even if the library doesn't support it yet.  So things like useListNavigation, useTypeahead, and useRole are the common primitives used by all of these to build them.
That said, there are areas of improvement here — for example, there could be a hook that handles the virtual element positioning more easily, which also includes things like following the cursor on mousemove and not just click for context menus.

I opened an issue to add a hook for point-based virtual element usage: https://github.com/floating-ui/floating-ui/issues/2150


Project collaborators roles has no impact on admin site

Qfield cloud new user has access to nothing in the admin site even after assigning a role to a user, the checkbox Staff Status allows to have an empty interface.

The project roles as described in this link are only applied in Qfieldsync plugin level.
I have managed to create a new users group to display projects and people menus in the admin site, but I have to keep the Django group roles and Project roles in sync manually.
Qfield Cloud : v 0.26.3
docker setup

The roles that you have cited and the roles that are in Django admin are two separate things. Please read https://docs.djangoproject.com/en/5.0/topics/auth/default/ .


Add encoding decoding input output

A bit like here https://cairo-utils-web.vercel.app/ on top of the page we want a front-end where we can encode and decode a domain easily !

add favicon to the doc


not working on live server

hello, I have deployed my project on live server. But after clicking checkout its throwing below error :
TypeError
DGvai\Nagad\NagadGenerator::generatePaymentRequest(): Return value must be of type array, null returned

Your IP address should be whitelisted to run this on live


finetune (lora) with bridge_orig not work

When I put the downloaded bridge data following the instruction in ./openvla/BridgeData/bridge_data/1.0.0/datas.
Then run finetune.py, it occurs error in this function : vla_dataset = RLDSDataset().
The error is:
Did you mean: bridge_orig -> bridge ?
No builder could be found in the directory: /mnt/nfs2/xx/code/openvla/BridgeData for the builder: bridge_orig.
No registered data_dirs were found in:
- /mnt/nfs2/xx/code/openvla/BridgeData
.
And I don't find bridge_orig in "tensorflow_datasets.core.registered.DatasetNotFoundError: Dataset bridge_orig not found.
Available datasets:
- abstract_reasoning
- accentdb"
Anyone can help?  Thanks a lot

@AnonymousUser360 I had the same problem. I have replaced bridge_orig with bridge everywhere in the code and it started working.

@AnonymousUser360 I had the same problem. I have replaced bridge_orig with bridge everywhere in the code and it started working.

Thanks, I also find it, especially should keep the dataset name consistent with the downloaded dataset json file.

hi, I would like to know which folders should I change bridge to bridge_orig, and whether I should also change similar 'bridge_oxe' to 'bridge_orig_oxe'.
Thank you very much!


feat: allow to manually inject span context to carrier

Issue
https://gravitee.atlassian.net/browse/ARCHI-431
Description
This PR adds method on Tracer to manually inject span context into any carrier.
Additional context

Gravitee.io Automatic Deployment
🚀 A prerelease version of this package has been published on Gravitee's private artifactory, you can:

use it directly by updating your project with version: 7.0.0-archi-431-handle-context-propagation-SNAPSHOT
download it from Artifactory here

:tada: This PR is included in version 7.0.0-alpha.2 :tada:
The release is available on:

7.0.0-alpha.2
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 7.0.0 :tada:
The release is available on:

7.0.0
GitHub release

Your semantic-release bot :package::rocket:


Stream improvements

Have a general question about streams. Currently nanolets and core NanoHTTPD expect InputStream to be returned.
Why don't expose OutputStream into the serve method? This is particulary useful for templating engines:

velocity: template.merge(context, outputwriter)
freemarker: template.process(model, outputwriter)

Currently I have to fully process template into the byte array and return as ByteArrayInputStream. This gives unnecessary memory footprint.

In v3.0.0 you'll be able to get your hands on the streams directly. The reason you shouldn't is because it's very easy to derail a whole client connection with the simplest of mistakes, and therefore the streams won't be exactly visible, but if you don't mind casting to a different interface (which is used to hide away the streams from less experienced users that shouldn't touch them) you can definitely do whatever you want, although that is only meant to allow for more advanced protocols to do their own thing.
Still there's a problem with this. Your response must be an InputStream because the server must first write the headers for your response and only then the response body (by copying your response into the OutputStream). If you were to write directly to the stream you would, as mentioned above, derail the whole protocol :(

100% agree.

I also have a templating engine which suffers from not being able to write directly to a stream. basically the entire response is serialized in memory and then copied again instead of it directly appending to the output.
Maybe a java.io.Writer interface via a callback, should not derail the protocol too much? Somethink like:
public static Response newStreamedResponse(IStatus status, String mimeType, Consumer<Writer> callback) {
   ... write headers
   callback.accept(appendWriter(outputStream)); // let the user stream the content directly
   ...
}

the writer provided to the callback would simply append to the outputstream in the right place, and the callback function could stream its output directly into it.
Do you have any advice, in the meantime, to make this faster?

It's not how you can write to the stream, it's that you can write to the stream. HTTP is a well defined protocol, if you start dropping bytes on the stream out of place then there will be errors. We could go full PHP (aka going full retard) and force the headers to be dumped into the stream as soon as you attempt to write, but honestly the only good example you can get out of PHP is how not to do things, plus I don't feel like going through another layer of buffers so I can define the Content-Length just to let a user mess with the stream... it looks like a terrible idea from any angle I look at it from.
The current way I got this implemented in v3 testing is with an interface pair called IConnection and IConnectionIO where the later extends the former AND also exposes input and output streams.
The HTTP "session" is gone, and you now have a new Request object per request, from which you can get a long-lived Connection object that encapsulates the client socket. This is the new standard way to access client data (IP and so on, things that don't change per request). The Connection class actually implements IConnectionIO but is expected everywhere as an implementation of IConnection so if you want to access the streams you must explicitly cast it to the IO interface (and know it exists in the first place) so that newbies don't just stumble upon the methods and break everything. I might or not actually end up renaming IConnectionIO to IHerebySolemnyPromiseNotToBugTheDevsWhenIBreakShitBecauseITouchedTheStreams just to really bring home the fact that if I do let people touch the streams they will inevitably tear the protocol apart and open a million issues with really cryptic errors, and so I will hide that functionality as much as I can while restricting it the least possible amount so that only truly advanced users that want to build absolutely wicked shit like SSE or HTTP/2 support find and mess with it.
So, just to recap, the streams will never ever be there as a funky way to write your data, but to enable people to implement sub-protocols easily. I need to have some balance there because the more powerful and/or low-level features I leave laying around the more and more issues I will find in the tracker. Android support is a nightmare already and the E_BROKEN_PIPE error haunts my dreams, I don't think I need to add any more nightmare fuel to that already raging fire. With a bigger and more organized team we could probably work something out, as a very busy solo dev no way.

Wow, such a passionate comment. Relax, streams provided in servlets since the day one: https://docs.oracle.com/javaee/6/api/javax/servlet/ServletResponse.html#getOutputStream()
Yes, you can’t shoot in your leg more easily. Scared? Do not use.


logitech g915 'G'/macro keys fail to update

Information

ratbagd version (ratbagd --version): 0.15
Distribution: gentoo (compiled from scratch to confirm)
Kernel version (ex. uname -srmo): 5.11.3

Device info (if applicable):
$ ratbagctl <device> info
raging-hutia - Logitech G915 WIRELESS RGB MECHANICAL GAMING KEYBOARD
             Model: usb:046d:c33e:0
 Number of Buttons: 8
    Number of Leds: 2
Number of Profiles: 3
Profile 0: (active)
  Name: n/a
  Report Rate: 1000Hz
  Button: 0 is mapped to 'button 15'
  Button: 1 is mapped to macro '↕F2'
  Button: 2 is mapped to macro '↕F3'
  Button: 3 is mapped to macro '↕F4'
  Button: 4 is mapped to macro '↕RESERVED'
  Button: 5 is mapped to macro '↓CALC'
  Button: 6 is mapped to 'unknown'
  Button: 7 is mapped to 'unknown'
  LED: 0, depth: rgb, mode: off
  LED: 1, depth: rgb, mode: on, color: 3de2db
Profile 1: (disabled)
Profile 2: (disabled)

Per the profile above, button 5- 'g5' is mapped to keycode 'calc' (140).  This is what ratbag currently thinks my profile is, having attempted to set that keycode via:
random_host /usr/share/libratbag # ratbagctl raging-hutia button 5 action set macro '+KEY_CALC'
random_host /usr/share/libratbag # echo $?
0

Ratbagctl reports success, but ratbagd disagrees- specifically, there is a failure to commit the macro back.  Relevant log snippet from --verbose=raw follows:
ratbag error: hidpp20: failed to update button (-22)
ratbagd error: error committing device (-1000)

The full ratbagd ---verbose=raw &> log is attached as a log.
ratbagd.log
My observation thus far is that none of the macro/button configuration updating is functional for a logitech g915; the LED controls do work however.
If there is any further logs or traces you'd like for a quick dive, let me know.
Barring that, if the above doesn't have an obvious answer- if you have pointers for what I should trace myself as potential causes, please let me know.  Barring that, any pointers where to start tracing in the code- since I know nothing about HID- let me know.

/CC @FFY00 listed as current owner for this device; if that's inaccurate, pardon.


Include nodejs and gomodule updaters

Add 2 new modules to update the ebuilds
Along the way I have improved the logic of uploading to git
The digest is now generated automatically
I have changed so that updates can be multiple.
There are ebuilds that have both gomod and nodejs to process
I have added parameter control in the json file
It would be necessary to adjust the current updates so that they use the content of the main process, tell me if you see it correct and I will prepare it

Regarding distribution archives for Go and Node.js, where are you putting these? It almost seems like livecheck should handle the uploading of these to somewhere. GitHub releases API would be an example place. But it should be sort of generic.

Regarding distribution archives for Go and Node.js, where are you putting these? It almost seems like livecheck should handle the uploading of these to somewhere. GitHub releases API would be an example place. But it should be sort of generic.
The reason I ask is because I currently have my own way of dealing with Node.js packages without having to make tarballs and for Go packages I still use the old EGO_SUM method. It is easier than trying to maintain the tarballs at the moment.

Yes, I will prepare that in a new pull request, because now I am doing it manually in my overlay
Now, if the compressed file is small, I left it in git
https://github.com/inode64/inode64-overlay/tree/main/dist
, and if not, I upload it to my web server
That's why I had thought about creating a hook to be able to perform these tasks automatically.
It was to avoid adding too much in the same pull request

Do you see this code correctly? Do I have to modify something else?

There is a bug in this branch and in master. Ebuilds that have SHAs to update but not a different date according to Git have their ebuilds appear in the root of the project:
~/overlay $ ls -la *.ebuild
-rw-r--r-- 1 root root 682 2024-11-20 03:58:23 pymatting-1.1.12_p20241110-r1.ebuild
-rw-r--r-- 1 root root 468 2024-11-20 03:58:13 spirv-cross-20241113-r1.ebuild
-rw-r--r-- 1 root root 608 2024-11-20 03:58:29 vapoursynth-fsrcnn-ncnn-vulkan-20241112-r1.ebuild

The deletion of the old ebuild works but where the ebuild outputs is definitely wrong.
They should be in the category/package_name directory.
This is a scenario where there is a new commit in the same day or the SHA was incorrect.
2024-11-20 04:05:58.230 | DEBUG    | livecheck.main:get_props:101 - search_dir=/var/db/repos/tatsh
2024-11-20 04:05:58.260 | DEBUG    | livecheck.main:get_props:151 - Parsed path: /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/c9dad37dad64346afdff925fb409e6c6005b719a.tar.gz
2024-11-20 04:05:58.260 | DEBUG    | livecheck.main:main:423 - Fetching https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom
2024-11-20 04:05:58.260 | DEBUG    | livecheck.main:main:431 - Adding Accept header for XML
2024-11-20 04:05:58.634 | DEBUG    | livecheck.main:do_main:292 - Using RE: "<id>tag:github.com,2008:Grit::Commit/([0-9a-f]{40})[0-9a-f]*</id>"
2024-11-20 04:05:58.634 | DEBUG    | livecheck.main:do_main:303 - Result count: 5
2024-11-20 04:05:58.634 | DEBUG    | livecheck.main:do_main:306 - re.findall() -> "0a721959116f6f86dbd13bda70a5fd6a883938f4"
2024-11-20 04:05:58.635 | DEBUG    | livecheck.main:do_main:323 - Attempted to fix top_hash date but it failed. Ignoring this error.
2024-11-20 04:05:58.635 | DEBUG    | livecheck.main:do_main:324 - top_hash = 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-20 04:05:58.635 | DEBUG    | livecheck.main:do_main:325 - Comparing current ebuild version c9dad37dad64346afdff925fb409e6c6005b719a with live version 0a721959116f6f86dbd13bda70a5fd6a883938f4
/var/db/repos/tatsh/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild -> vapoursynth-fsrcnn-ncnn-vulkan-20241112-r1.ebuild

The line showing the rename shows the bad target path.

Ok, nothing else I can do, I'll check it and solve it.

Solve error when the hosts.yml file does not exist and without a manifest file for livechecks
Add more types of variables to obtain the old sha
Remove variable prefixes in do_main, no longer used
If the ebuild matches, use a new revision -r(+1)
Unify the code to show the new ebuilds
Moves the process of obtaining the regex within do_main, there may be code that does not use regex (jetbrains, pecl, sf, etc.) and thus eliminates the need to download the url
Fix previous issues with packages

2024-11-24 13:26:02.764 | INFO     | Processing dev-python/pymatting version 1.1.12_p20240409
dev-python/pymatting: 1.1.12_p20240409 (a073421a31afd0d53b7ff387ad2b361645b446be) -> 20241110 (afd2dec073cb08b8119300feec18c179a9d436f3)
2024-11-24 13:25:37.823 | INFO     | Processing media-video/vapoursynth-fsrcnn-ncnn-vulkan version 20200229
media-video/vapoursynth-fsrcnn-ncnn-vulkan: 20200229 (c9dad37dad64346afdff925fb409e6c6005b719a) -> 20241112 (0a721959116f6f86dbd13bda70a5fd6a883938f4)
2024-11-24 13:25:15.202 | INFO     | Processing dev-util/spirv-cross version 20240910
dev-util/spirv-cross: 20240910 (f84c1fbe3cbb69fa99e9115f658e52df0e95f1bf) -> 20241113 (9040e0d25dc545a6d725276bdbd0362791c81f14)

I have checked with my repository and with the tatsh-overlay

The bug I mentioned is still there.
2024-11-24 07:51:56.061 | DEBUG    | livecheck.main:get_props:101 - search_dir=/var/db/repos/tatsh
DEBUG:asyncio:Using selector: EpollSelector
DEBUG:livecheck.utils.portage:Checking: /var/db/repos/tatsh == /var/db/repos/tatsh ?
2024-11-24 07:51:56.066 | DEBUG    | livecheck.main:get_props:151 - Parsed path: /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/c9dad37dad64346afdff925fb409e6c6005b719a.tar.gz
2024-11-24 07:51:56.066 | DEBUG    | livecheck.main:main:423 - Fetching https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom
2024-11-24 07:51:56.066 | DEBUG    | livecheck.main:main:431 - Adding Accept header for XML
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): github.com:443
DEBUG:urllib3.connectionpool:https://github.com:443 "GET /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom HTTP/11" 200 4191
2024-11-24 07:51:56.278 | DEBUG    | livecheck.main:do_main:292 - Using RE: "<id>tag:github.com,2008:Grit::Commit/([0-9a-f]{40})[0-9a-f]*</id>"
2024-11-24 07:51:56.278 | DEBUG    | livecheck.main:do_main:303 - Result count: 5
2024-11-24 07:51:56.278 | DEBUG    | livecheck.main:do_main:306 - re.findall() -> "0a721959116f6f86dbd13bda70a5fd6a883938f4"
2024-11-24 07:51:56.279 | DEBUG    | livecheck.main:do_main:323 - Attempted to fix top_hash date but it failed. Ignoring this error.
2024-11-24 07:51:56.279 | DEBUG    | livecheck.main:do_main:324 - top_hash = 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-24 07:51:56.280 | DEBUG    | livecheck.main:do_main:325 - Comparing current ebuild version c9dad37dad64346afdff925fb409e6c6005b719a with live version 0a721959116f6f86dbd13bda70a5fd6a883938f4
/var/db/repos/tatsh/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild -> vapoursynth-fsrcnn-ncnn-vulkan-20241112-r1.ebuild

Please try to re-create this by creating the same ebuild as what is in my repository in your own repository or you can clone my repository (but it has to be in installed repositories).
https://github.com/Tatsh/tatsh-overlay/blob/master/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild
In your repo for testing:
mkdir -p media-video/vapoursynth-fsrcnn-ncnn-vulkan
wget 'https://raw.githubusercontent.com/Tatsh/tatsh-overlay/refs/heads/master/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild' -O media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild'
ebuild media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild manifest

# Run this branch of livecheck
livecheck -d -a vapoursynth-fsrcnn-ncnn-vulkan

# This should not output a file
ls *.ebuild

Please share the log.

$ python -m livecheck -W /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/ -p -d -a
!!! Found 2 make.conf files, using both '/etc/make.conf' and '/etc/portage/make.conf'
2024-11-24 14:06:40.536 | INFO     | livecheck.main:main:544 - search_dir=/usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan repo_root=/usr/portage/local/tatsh-overlay repo_name=tatsh-overlay
DEBUG:asyncio:Using selector: EpollSelector
2024-11-24 14:06:40.539 | INFO     | livecheck.main:get_props:109 - Found 1 ebuilds
2024-11-24 14:06:40.539 | INFO     | livecheck.main:get_props:129 - Processing media-video/vapoursynth-fsrcnn-ncnn-vulkan version 20200229
2024-11-24 14:06:40.539 | DEBUG    | livecheck.main:get_props:165 - Parsed path: /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/c9dad37dad64346afdff925fb409e6c6005b719a.tar.gz
2024-11-24 14:06:40.540 | DEBUG    | livecheck.main:do_main:318 - Fetching https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom
2024-11-24 14:06:40.540 | DEBUG    | livecheck.main:do_main:326 - Adding Accept header for XML
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): github.com:443
DEBUG:urllib3.connectionpool:https://github.com:443 "GET /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom HTTP/11" 200 4191
2024-11-24 14:06:40.867 | DEBUG    | livecheck.main:do_main:338 - Using RE: "tag:github.com,2008:Grit::Commit/([0-9a-f]{40})[0-9a-f]*"
2024-11-24 14:06:40.868 | DEBUG    | livecheck.main:do_main:350 - Result count: 5
2024-11-24 14:06:40.868 | DEBUG    | livecheck.main:do_main:354 - re.findall() -> "0a721959116f6f86dbd13bda70a5fd6a883938f4"
2024-11-24 14:06:40.868 | DEBUG    | livecheck.main:do_main:364 - Use updated date 20241112 for commit 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-24 14:06:40.869 | DEBUG    | livecheck.main:do_main:379 - Attempted to fix top_hash date but it failed. Ignoring this error.
2024-11-24 14:06:40.869 | DEBUG    | livecheck.main:do_main:380 - top_hash = 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-24 14:06:40.869 | DEBUG    | livecheck.main:do_main:388 - Comparing current ebuild version c9dad37dad64346afdff925fb409e6c6005b719a with live version 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-24 14:06:40.869 | DEBUG    | livecheck.main:do_main:393 - Updating ebuild /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20200229.ebuild to /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild
media-video/vapoursynth-fsrcnn-ncnn-vulkan: 20200229 (c9dad37dad64346afdff925fb409e6c6005b719a) -> 20241112 (0a721959116f6f86dbd13bda70a5fd6a883938f4)
/usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20200229.ebuild -> /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild
>>> Downloading 'http://distfiles.gentoo.org/distfiles/04/vapoursynth-fsrcnn-ncnn-vulkan-20241112.tar.gz'
--2024-11-24 14:06:40--  http://distfiles.gentoo.org/distfiles/04/vapoursynth-fsrcnn-ncnn-vulkan-20241112.tar.gz
Resolving distfiles.gentoo.org (distfiles.gentoo.org)... <IP_ADDRESS>, <IP_ADDRESS>, 2a02:6ea0:c300::17, ...
Connecting to distfiles.gentoo.org (distfiles.gentoo.org)|<IP_ADDRESS>|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2024-11-24 14:06:41 ERROR 404: Not Found.

>>> Downloading 'https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/0a721959116f6f86dbd13bda70a5fd6a883938f4.tar.gz'
--2024-11-24 14:06:41--  https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/0a721959116f6f86dbd13bda70a5fd6a883938f4.tar.gz
Resolving github.com (github.com)... <IP_ADDRESS>
Connecting to github.com (github.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://codeload.github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/tar.gz/0a721959116f6f86dbd13bda70a5fd6a883938f4 [following]
--2024-11-24 14:06:42--  https://codeload.github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/tar.gz/0a721959116f6f86dbd13bda70a5fd6a883938f4
Resolving codeload.github.com (codeload.github.com)... <IP_ADDRESS>
Connecting to codeload.github.com (codeload.github.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/x-gzip]
Saving to: ‘/usr/portage/distfiles/vapoursynth-fsrcnn-ncnn-vulkan-20241112.tar.gz.__download__’

/usr/portage/distfiles/vapoursynth-fsrcnn-ncnn-vulkan-20241112.tar.gz.     [ <=>                                                                                ]  79,69K  --.-KB/s    in 0,08s

2024-11-24 14:06:42 (1010 KB/s) - ‘/usr/portage/distfiles/vapoursynth-fsrcnn-ncnn-vulkan-20241112.tar.gz.__download__’ saved [81607]

>>> Creating Manifest for /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan

$ ls /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/
Manifest  files  metadata.xml  vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild

tatsh.log
Include log

I have seen a problem, then I will upload the correction, after making the adjustments and tests

Clean up your copy of my overlay and try this and send output:
python -m livecheck -W /usr/portage/local/tatsh-overlay/ -p -d -a vapoursynth-fsrcnn-ncnn-vulkan
ls /usr/portage/local/tatsh-overlay/*.ebuild

Ignore the issue with -r1 files being placed in the root of the repo. That issue exists even in the last release. https://github.com/Tatsh/livecheck/issues/244

Please either redo this PR or fix your branch so it does not need a merge. The project was renamed from portage-livecheck to livecheck.

now it seems to work
tonight I will redo the pull request

2024-11-25 07:13:47.382 | INFO     | livecheck.main:get_props:109 - Found 1 ebuilds
2024-11-25 07:13:47.383 | INFO     | livecheck.main:get_props:129 - Processing media-video/vapoursynth-fsrcnn-ncnn-vulkan version 20241112
2024-11-25 07:13:47.383 | DEBUG    | livecheck.main:get_props:165 - Parsed path: /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/archive/c9dad37dad64346afdff925fb409e6c6005b719a.tar.gz
2024-11-25 07:13:47.383 | DEBUG    | livecheck.main:do_main:324 - Fetching https://github.com/Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom
2024-11-25 07:13:47.383 | DEBUG    | livecheck.main:do_main:332 - Adding Accept header for XML
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): github.com:443
DEBUG:urllib3.connectionpool:https://github.com:443 "GET /Sg4Dylan/vapoursynth-fsrcnn-ncnn-vulkan/commits/master.atom HTTP/11" 200 4191
2024-11-25 07:13:47.669 | DEBUG    | livecheck.main:do_main:344 - Using RE: "tag:github.com,2008:Grit::Commit/([0-9a-f]{40})[0-9a-f]*"
2024-11-25 07:13:47.669 | DEBUG    | livecheck.main:do_main:356 - Result count: 5
2024-11-25 07:13:47.669 | DEBUG    | livecheck.main:do_main:360 - re.findall() -> "0a721959116f6f86dbd13bda70a5fd6a883938f4"
2024-11-25 07:13:47.669 | DEBUG    | livecheck.main:do_main:370 - Use updated date 20241112 for commit 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-25 07:13:47.670 | DEBUG    | livecheck.main:do_main:385 - Attempted to fix top_hash date but it failed. Ignoring this error.
2024-11-25 07:13:47.670 | DEBUG    | livecheck.main:do_main:386 - top_hash = 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-25 07:13:47.670 | DEBUG    | livecheck.main:do_main:394 - Comparing current ebuild version c9dad37dad64346afdff925fb409e6c6005b719a with live version 0a721959116f6f86dbd13bda70a5fd6a883938f4
2024-11-25 07:13:47.670 | DEBUG    | livecheck.main:do_main:400 - Updating ebuild /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild to /usr/portage/local/tatsh-overlay/media-video/vapoursynth-fsrcnn-ncnn-vulkan/vapoursynth-fsrcnn-ncnn-vulkan-20241112.ebuild
media-video/vapoursynth-fsrcnn-ncnn-vulkan: 20241112 (c9dad37dad64346afdff925fb409e6c6005b719a) -> 20241112-r1 (0a721959116f6f86dbd13bda70a5fd6a883938f4)

Continue in #241


CtxRequestIDLogger is a bad name

https://github.com/nullbio/abcweb/blob/67901e361869af4197c8b1d6494d4a391207289f/templates/middleware/middleware.go.tmpl#L7
It's a value for lookup. I propose CtxLogLookup.

Sure, I'll change it. Thanks.


tray icon menu renders under taskbar

Opening and closing windows 11 tray quick settings then opening menu on own tray app renders the menu under the taskbar. Not able to close it unless right clicking on it then left clicking off it.

I can't seem to reproduce, can you explain in more detail how to reproduce?

After some testing, this seems to be an issue with Windows instead of anything app/crate related. However, here are the steps to reproduce:

Using the tao example, cargo run to start the application
App icon should display inside the hidden tray icon menu (if enabled)
Right clicking on the app icon should display the menu normally
Navigate to system taskbar settings. Settings > Personalization > Taskbar
Open "Other system tray icons" and toggle on personal application to show outside the hidden tray icon menu
App icon should display outside the hidden tray icon menu
Right clicking on the app icon should display the menu normally
Open the windows tray quick settings by left clicking on either the wifi or volume icon
Close the quick settings by left clicking on the icons again or outside the menu
Right clicking on app icon should display the menu under the taskbar (unintended behavior)

Notes:
Right clicking anywhere besides any app's tray icon after closing the system quick settings menu then opening app menu does not cause unintended behavior.
Same steps can be taken with winit example.
Other apps with a menu have the same unintended behavior.

alright, thank you for investigating further, since this is something the OS should handle, gonna close this issue

Just want to add in an easier reproduce steps for future readers

right click a tray icon (e.g. WLAN)
hover the mouse on a task bar window icon (e.g. Chrome)


No implementation for adding Vectors ??

I have initialized Vector2 using .init() ;
I tried adding it to another Vector2 using + ;
This results in an error.
I have used Raylib before with rust and it has Vector2 + Vector2 implemented.
Is it not implemented for ZIG because it is impossible or by design?
Or am I missing something?
P.S. currently because of this I resorted to manually adding Vector2.x + Vector2.x and Vector2.y + Vector2.y.
P.S.S. Also rust raylib has a lot of useful methods for Vector2 implemented aka .dot product, .lerp, and so on.
Are these not implemented also in zig raylib? Or did I miss something?

Zig doesn't allow operator overloading. The functions for Vector operations are there, just not yet integrated as member functions. You can call as you would normally in C.

Ok I understand.
By "not yet integrated" do you mean that this is possible in future? I mean for the Vector struct to have vector methods as so on.


Messages never load

Whatever I try, they never load.. on ANY stream/topic.
I tried:

refreshing the app
restarting my phone
reinstalling the app

I'm on andriod (Samsung S9+).
App version v27.200.

I also noticed that a bunch of other screens are empty too and never load...

Hi @EmilyRosina, thanks for the report!
To help diagnose the issue, would you be interested in testing if the problem seems to be specific to that organization? I'm curious if you see the same symptom when connected to a different org, such as the Zulip Development Community.

Also, I'm curious: after you uninstalled and reinstalled the app, do you remember if the app made you log in again? (If so, you would have entered your org URL, then entered a password or used a third-party auth provider, like "Sign in with Google".)
We're aware that (as odd as it sounds), uninstalling an app sometimes doesn't clear all its data: https://stackoverflow.com/questions/33169618/an-android-app-remembers-its-data-after-uninstall-and-reinstall
If you were already logged in after reinstalling the app, then some data wasn't cleared when you uninstalled it. I'd be interested to know if clearing the cache or the app data helps with this issue. You should find a "Clear data" button and a "Clear cache" button in Zulip's App info -> Storage. (I'd try "Clear cache" first, as I expect "Clear data" will log you out of your Zulip account in the app.)
Please let me know if I can make any of this clearer; I wrote this in a bit of a rush but definitely want to diagnose and fix the issue. 🙂

Hi @chrisbobbe
Also some additional info about my org, I can access it perfectly well via the Linux app and also in the web app via the browser. So it's just my phone app that's the issue.
I tried all of what you said:

Clear cache still have the problem
Clear data still have the problem
Join the Zulip Development Community org, using my Github account and access via the browser for now I am facing a never-ending loader there now :weary:
So gonna guess that didn't work either :sweat:
I have also tried refreshing the page, clearing LS/SS and closing opening my browser (Chrome) as well.. nada is helping.. so i'm a bit stuck on that point too now :sweat_smile:

Errors i'm getting in the console for point 3.

Unknown user_id in get_by_user_id: 26065
(anonymous) @ blueslip.ts:34

jQuery.Deferred exception: Cannot read properties of undefined (reading 'date_joined') TypeError: Cannot read properties of undefined (reading 'date_joined')
    at Ae (https://chat.zulip.org/static/webpack-bundles/app.77c4554afb274c5ea0d8.js:2:82850)
    at https://chat.zulip.org/static/webpack-bundles/app.77c4554afb274c5ea0d8.js:2:105098
    at Module.I (https://chat.zulip.org/static/webpack-bundles/app.77c4554afb274c5ea0d8.js:2:53861)
    at HTMLDocument.<anonymous> (https://chat.zulip.org/static/webpack-bundles/app.77c4554afb274c5ea0d8.js:2:105055)
    at c (https://chat.zulip.org/static/webpack-bundles/251.f67b7a0206a58740f79e.js:2:142627)
    at l (https://chat.zulip.org/static/webpack-bundles/251.f67b7a0206a58740f79e.js:2:142929) undefined

Uncaught TypeError: Cannot read properties of undefined (reading 'date_joined')
    at Ae (ui_init.js:589:44)
    at ui_init.js:721:9
    at Module.I (blueslip.ts:239:17)
    at HTMLDocument.<anonymous> (ui_init.js:720:14)
    at c (jquery.js:3830:29)
    at l (jquery.js:3898:12)

Update Ah - tried an incognito tab and it loaded :rocket:

I am trying to login just via my google account directly, but still facing a similar neverending loader problem. I think I might chalk it upto Google being messed up a bit atm.. will try again tomorrow.

Oh no! I'm sorry you've been so unlucky with these bugs.
We hope to have a fix for the chat.zulip.org bug out this evening. PR zulip/zulip#24415 was recently merged to mitigate a recent regression, and I expect it'll be deployed later this evening, after which you can try chat.zulip.org in the web app again.

Hey @chrisbobbe I have a slightly irritating update :sweat_smile:
My phone ran out of battery yesterday... and when I charged it and loaded it up... I could see the messages again. I have no rhyme nor reason that goes anyway to help explaining this :grimacing: But - good news is that I can indeed see messages again.
I guess maybe my phone needed a full power off instead of a restart :woman_shrugging: no idea.. but that's my best guess.

Ah! 😅 Thanks for the update, and I'm glad it's working again! I'll close this for now, but if you see the same symptom again, please let us know and we'll re-open.


Update project directory structure

Codecov Report

Merging #133 (99be3f0) into master (5fd3faa) will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master    #133   +/-   ##
======================================
  Coverage    84.8%   84.8%
======================================
  Files          13      13
  Lines         759     759
======================================
  Hits          644     644
  Misses        115     115

Impacted Files
Coverage Δ

Sources/Shuffle/SwipeCard/CardAnimator.swift

...le/SwipeCardStack/CardStackTransformProvider.swift

...ces/Shuffle/SwipeCardStack/CardStackAnimator.swift

...uffle/SwipeCardStack/CardStackLayoutProvider.swift

Sources/Shuffle/SwipeCard/SwipeCard.swift

...ources/Shuffle/SwipeCardStack/SwipeCardStack.swift

Sources/Shuffle/SwipeCard/SwipeView.swift

Sources/Shuffle/SwipeCard/CardLayoutProvider.swift

...Shuffle/SwipeCardStack/CardStackStateManager.swift

...rces/Shuffle/SwipeCard/CardTransformProvider.swift

... and 16 more


dynamicLabel types

related to this bug: https://github.com/pqina/vue-filepond/issues/150#issue-607740776


test; introduce npm run tdd:debug

To run the unit test in headful mode.
I had to search a little how to do it, because of the issue : https://github.com/vitest-dev/vitest/issues/5055, to use the --no-browser.headless command line. Maybe we will adapt the command once the issue is fixed.

Thanks @mrednic-1A  and @quentinderoubaix  :)


Sidebar settings

I noticed that there was no functionality to open or close the explorer by default.
To address this, I implemented a feature that allows users to choose whether the explorer is extended or folded by default, through the settings.
Please let me know if it suits to you.
(By default, it's still opened)

Contributions are no longer manually activated; instead, I restore the state of the sidebar after the contributions have been added.

Last commit is to prevent this case

Thank for the fixes @Nomehh. A new version will be available on npm in few minutes

<EMAIL_ADDRESS>


Add table oci_oci_container_instances_container_instance

References
Recently introduced service OCI Container Instances
OCI Docs: https://docs.oracle.com/en-us/iaas/Content/container-instances/home.htm
Terraform Resource: https://registry.terraform.io/providers/oracle/oci/latest/docs/data-sources/container_instances_container_instances
Go SDK<EMAIL_ADDRESS>

I am working to provide the solution for this issue on this branch: https://github.com/lucasjellema/steampipe-plugin-oci/tree/add-table-oci_container_instances_container_instance . Most relevant columns are already supported.

Creating the test has not been successful because of an error in OCI APIs with Terraforming oci_container_instances_container_instance. I have created a support request to have the error looked into.

Hey @lucasjellema, did the above issue gets resolved? Can you now proceed with the table? If the table works fine, you can raise a PR(Table +Doc) without the Terraform test. We can work on the terraform test later. Please don't hesitate to let us know if there is anything we can do to help you further.


Update to go 1.15.8

go1.15.8 (released 2021/02/04) includes fixes to the compiler, linker, runtime,
the go command, and the net/http package. See the Go 1.15.8 milestone on the
issue tracker for details.
https://github.com/golang/go/issues?q=milestone%3AGo1.15.8+label%3ACherryPickApproved
full diff: https://github.com/golang/go/compare/go1.15.7...go1.15.8

LGTM

Do we want to fix the release/1.4 branch too?

If it's on 1.15, then we should backport yes

it's on 1.15.4 i believe

oh! I think I tried cherry-picking yesterday, but it wasn't clean; probably not worth the time to try making it clean, and easier to just to a find/replace in the branch; let me open a PR

opened https://github.com/containerd/containerd/pull/5010 for 1.4


Avoid hitting database at every call to the auth strategy

Which could be a good way to avoid hitting the database at every validation call? In the real example you  @nelsonic validate the token against elasticsearch every time. it would be great to cache it. I have thought to use a cache level like Memcached or Redis. What do you think about?

Hi @mazzy89 we aren't ignoring you.
We already have an example using Redis: https://github.com/ideaq/hapi-auth-jwt2/blob/master/example/real_world_example_using_redis_on_heroku.js
Thanks confirming that its not very easy to find...! :wink:

Hi Nelson,
I have already thought to use Redis as a cache layer. I'm asking you if there are other ways to avoid hitting the database for validate the token. What about caching the token at the server side?
Salvatore Mazzarino

Il giorno 19/mag/2015, alle ore 21:34, Nelson<EMAIL_ADDRESS>ha scritto:
Hi @mazzy89 we aren't ignoring you.
We already have an example using Redis: https://github.com/ideaq/hapi-auth-jwt2/blob/master/example/real_world_example_using_redis_on_heroku.js
Thanks confirming that its not very easy to find...!
—
Reply to this email directly or view it on GitHub.

ah...! sorry I did not understand the first time.
Yes, you can cache the tokens on the node layer/server, however this would defeat the "stateless" objective of the server/cluster (making an extra step to scale horizontally).

Let us know what you decide to do for caching! :+1:

Actually I was thinking to use cookie to store token but how could this fit in the case of API consumed by mobile devices?

Good question. APIs accessed by Native apps can still send headers.
But it would be a cross-domain cookie...
http://www.ibuildings.com/blog/2013/03/secure-your-rest-api-oauth2-implicit-grant
The token approach is easier.


Block on receiving from SSL socket

This fixes a bug where not receiving any bytes immediately from an SSL socket would be considered a socket error and the connection would be closed. This changes the code to block and wait for bytes from the SSL socket.
To test, I used the example DummyClient script in the tutorial and pointed it to "wss://echo.websocket.org". Without this change, the example script closes the connection without receiving any messages. With the change, the expected behavior occurs.

No tests broken, thanks you!
It would have been nice to have a test about it, maybe you can?

Sure, no problem. See PR #213


100ms delay between pointermove events in Android webviews?

Describe the bug
I noticed that gestures in Android webviews felt laggy, so after some debugging, I found the root cause: pointermove events have a ~100ms delay between them whereas it should be a ~17ms delay. This isn't directly caused by @use-gesture, but it probably affects a lot of @use-gesture users, so just bringing attention to the issue.
In Android Chrome, when starting a drag gesture, the timeline looks something like:
0ms: pointerdown
3ms: pointermove
10ms: pointermove
27ms: pointermove
44ms: pointermove

In Android webviews, it's something like:
0ms: pointerdown
3ms: pointermove
100ms: pointermove
117ms: pointermove
134ms: pointermove

In each screenshot, I hovered over the first pointermove, then each subsequent pointermove are yellow blocks.
Here's a Codesandbox demo to test the delay: https://codesandbox.io/p/sandbox/clever-shape-8ppngt?file=%2Findex.html%3A1%2C1-17%2C10. You can send the link to yourself via Messenger, which opens it in a webview. I'm getting up to 110ms delay within the Messenger webview (avg around 50ms), and consistently 16-17ms within a browser.
Is this an issue the team is aware of? Is there a possible fix using JS/CSS or do we need to hope the Android folks fix it?
Information:

Use Gesture version: v10.3.1
Device: Pixel 8
OS: Android 14
Browser: Android webview

Checklist:

[x] I've read the documentation.
[x] If this is an issue with drag, I've tried setting touch-action: none to the draggable element.

Chromium team is triaging this: https://issues.chromium.org/issues/333624618


Underscore in field name

What is the reason for using underscore in fieldname?
> Meeting.new.attributes
=> {"_id"=>BSON::ObjectId('549d746563616c2168060000'), "_meeting_quality"=>:hd, "_status"=>:inactive}

Actually we get another attribute that differ one we created

Asking the same question! +1

+1

+1

To be honest - I can't 100% remember my motivations for doing this. If I had to guess - it was probably to indicate that the field shouldn't be directly access, except through the getters and setters - following on from a few other (similar) gems that do similar things.
@xpepermint What are your thoughts on strings vs. symbols? I felt like symbols would be a better choice here, given that the values are immutable, but curious to hear why you feel these should be strings.

@thetron Huh, I don't remember exactly why but I think I was looking at rails enum function which works on strings.

There's 5+ forks only to remove the underscore. +1 for me hehe.

Thanks everyone again for your feedback here. I've merged in #12, which added a configuration option to customise the prefix. At some point in the future we might switch the default to be an empty string, but I wanted to make it easy for existing and future users to continue using the gem on the path to v1.0.0, and support for mongoid 5.
:cake:


Support SSO with Firefox accounts (#3337)

Fixes #3337
Tested on API 16, but due to TLS limitation, SSO is not allowed on API16

Hello,
I tested the arm64 build from buildkite on my Samsung Galaxy S10+. I was able to login to the Mozilla modular server with SSO. It works perfectly! Thank you!

Thanks!


Voicenote: Cleanup after upload

When sending a voicenote we want to clean up the temp file as soon as possible. As upload happens asynchronously in tdlib, how could we know when uploading has finished to delete the temp ogg file?
Bonus question, how can this be done for any other attachment/content/input message?
Thanks BR Florian

Do you use inputFileGenerated to upload the file while it is created?

No, currently we point to inputFileLocal.

Then switching to inputFileGenerated will rid you from managing temporary file lifetime.
Otherwise, the file can be deleted only after the message is successfully (or unsuccessfully) sent. But then the file will need to be redownloaded from the server.

Ok so is there any description of hw to use it? Our first test seems to be unsuccessful :)

https://github.com/tdlib/td/issues/126

Ok so I could "fake" generation if the file exists already, and on receiving start immediately finish it? And then receive stop and it can be deleted?

You may be asked to regenerate the file any time, so immediate deletion sometimes isn't appropriate.
Why do you need to delete the file if it existed previously? If it didn't exist, then you can create it directly in the location specified in the update updateFileGenerationStart. After that file lifetime is managed by TDLib.

Well its a voice note recording, so user presses record on the UI, and we need to start to buffer the audio data somewhere. Or how would that be solved.

You can buffer it to the file pointed by TDLib and even upload the file while it is still recorded. Just use the method uploadFile with inputFileGenerated.

So, to be sure to have understand everything correctly:

the user presses the button to record a voice note
we send a sendMessage with input_message_content containing

{
  "@type": "inputMessageVoiceNote",
  "voice_note": {
    "@type": "inputFileGenerated",
    "original_path": ".ogg",
    "conversion": "record_voice"
  }
}

we wait for updateFileGenerationStart and read the field destination_path
only then we can actually start recording the voice note in the file pointed by destination_path
when the users finishes to record the voice note we can send a finishFileGeneration with the same generation_id as the one received in updateFileGenerationStart

if the users discards the voice note we send a finishFileGeneration with something written in the error field and we should receive a updateFileGenerationStop

Question: is updateFileGenerationStart guaranteed to arrive immediately after the sendMessage with inputFileGenerated? If not we may want to start the voice note recording immediately when the users presses on the button, record the file in a location outside tdlib's file system and move the file later on when the update is received. In that case, should we put the file real path in original_path inside inputFileGenerated? That way the file gets moved by tdlib when we send finishFileGeneration, right?

updateFileGenerationStart guaranteed to arrive immediately after the sendMessage with inputFileGenerated?

Yes.
Instead of sendMessage you can call uploadFile and use sendMessage only if the user didn't cancel recording.
If you want to upload the file during recording, you can use setFileGenerationProgress.

@levlam we went for the easier route with sendMessage but it also seems to work quite well. 2 remarks:

It should be written somewhere that tdlib creates the target file for the generation in advance
Also original_path must be unique, otherwise tdlib reuses the first file ever sent and not even asks for a generation

@Flohack74

TDLib creates the target file to ensure that the target path is unique.
In fact, the conversion and not original_path needs to be unique if the result file needs to be different.


[WIP] Introduce a rax example

This is an attempt to run rax inside Next.js
Currently, it's not rendering anything in the client.
But it won't throw any errors :)

Based on their inaccurate benchmarks, I don't think it's worthwhile. That said, I'd like to make sure we can customize what server-render require is executed, like we discussed. Unless we webpack the server path and the module name is aliased / translated.

@rauchg I'm on it. I am working on it for preact.


RTL support on input is weird

I would suggest making the inputClear invisible instead of gone:

Shouldn't the cursor be coming from the right?
On Fri, Oct 26, 2018, 5:51 PM Bernardo Ferrari<EMAIL_ADDRESS>wrote:

I would suggest making the inputClear invisible instead of gone:
[image: 20181026_132008 2018-10-26 13_50_58]
https://user-images.githubusercontent.com/351125/47580794-3078ae00-d926-11e8-918b-dab5292ba0d3.gif
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/SdkSearch/issues/137, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEES_ySdLyfTtG7Fz3QKeefNHhiwTOks5uoz2YgaJpZM4X8mdM
.

I don't understand RTL languages, but if you want the cursor to come from the right (as with the hint and everything), just need to add a:
android:textAlignment="viewStart"

Cursor does come from right for me

I am testing with "force RTL" setting on, a user complained on my app.

I think that only changes the layout direction but not the locale
direction. I can play with it next week.
On Fri, Oct 26, 2018, 6:16 PM Bernardo Ferrari<EMAIL_ADDRESS>wrote:

I am testing with "force RTL" setting on, a user complained on my app.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/SdkSearch/issues/137#issuecomment-433480254,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEY3qIHd1dj7uwtlvapJYlniDiPprks5uo0NjgaJpZM4X8mdM
.


dbus: re-listen dbus signals on name owner changed

When a name owner changes, signal filter should be re-aligned to the new names.
Fixes:

https://bug.rokid-inc.com/zentaopms/www/index.php?m=bug&f=view&bugID=18496
https://bug.rokid-inc.com/zentaopms/www/index.php?m=bug&f=view&bugID=18579

References:

https://dbus.freedesktop.org/doc/dbus-java/api/org/freedesktop/DBus.NameOwnerChanged.html

Checklist

[x] npm test passes

Thanks for this fix and merged :)