mlxbf-bootimages: init at 4.0.2-12679

Description of changes
Add mlxbf-bootimages which are required to build Nvidia BlueField bootstreams. Because licensing is unclear, they are marked as unfree for now.
Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux (via binfmt)
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

 Could this have failed because of either the platform or because its unfree?

Result of nixpkgs-review pr 233387 run on aarch64-linux 1

1 package failed to build:

mlxbf-bootimages

After observing, the fun thing is that not only did I mess up the URL but they also yanked the 4.0.2 release. So now we're at 4.0.3.

Result of nixpkgs-review pr 233387 run on x86_64-linux 1

After observing, the fun thing is that not only did I mess up the URL but they also yanked the 4.0.2 release. So now we're at 4.0.3.

The power of content addressability


Can we display some information in the chart?

Hi : )
This lib is so cool and I really love it.
I have one question, can we add some information, like label name, value into the chart (like ArtyChartyPie)?
I can't find the corresponding API in the readme.
Thanks!

Hi,
thanks for your comment and apologies for replying so late. Because the charts are shown on mobile displays with little space, I thought it is best to not use labels and just have points clickable and then in the click callback we tell you the point that has been clicked and you can decide how to display that value to the user.
I do not oppose using labels however. Could you make a simple sketch or annotated screenshot or something like that how you think the labels could be displayed and I'll try to add that feature. Thanks

I thought about this a bit more. Do you want labels for points, such as

or more like a legend:
?


Cannot read property 'typeMaps' of undefined

Hello !
I'm trying to use ember-devtools on my ember app.
I've added  this line to my package.json
"ember-devtools": "^4.0.0"
When I'm going to go on my app, I have the following error on my console
Cannot read property 'typeMaps' of undefined
on line 16 of ember-devtools.js, this line :
this.typeMaps = this.store.typeMaps;
It seems like the store isn't initialized or found.
I tried to use ember-devtools on another project, the embercli-todos project and ember-devtools worked perfectly.
I tried to search where does this error on my app come from but I unfortunately didn't found.
Have you ever met this error ? Have you any idea what i'm doing wrong ?
Here some other datas you could have need :
ember-cli version : 1.13.1
ember-devtools version : 4.0.0
ember-data version : 1.0.0-beta.19.2
Thx for your answer.

What version of ember?

I'm on the 1.13.1

I'm closing it cause it's nearly 2 years old


Move CI to Git Actions

https://badetitou.github.io/misc/pharo/2020/11/30/Testing-pharo-with-github-actions/

I'm going to look at @Ducasse 's prior art

I'm going to look at @Ducasse 's prior art


Manual clone step does not work

Component
server, agent
Describe the bug
With previous next versions of Woodpecker the manual clone step worked fine but with next-44b54db475 it does not  work anymore.
.woodpecker.yml:
clone:
  git:
    image: woodpeckerci/plugin-git
    settings:
      depth: 50

steps:
  build-main:
    image: ubuntu
    commands:
      - echo Build main
      - cat README.md

results in failure in the git step:
+ git init -b main
Initialized empty Git repository in /woodpecker/src/github.com/<removed>
+ git remote add origin https://github.com/<removed>
+ git fetch --no-tags --depth=1 --filter=tree:0 origin +refs/heads/main:
fatal: could not read Username for 'https://github.com': No such device or address
exit status 128

A .woodpecker.yml without a manual clone step works fine:
steps:
  build-main:
    image: ubuntu
    commands:
      - echo Build main
      - cat README.md

System Info
{"source":"https://github.com/woodpecker-ci/woodpecker","version":"next-44b54db4"}

Additional context
No response
Validations

[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Checked that the bug isn't fixed in the next version already [https://woodpecker-ci.org/faq#which-version-of-woodpecker-should-i-use]
[X] Check that this is a concrete bug. For Q&A join our Discord Chat Server or the Matrix room.

#1837

Ok I see. When I switch off "Only inject netrc credentials into trusted containers" then the manual clone step works.

jep a dublicate of #1837 ...


No module named json_schema_generator

I am new in python. I don't know how to solve this.
I am trying to execute the following command
python jsonschema_generator.py record example_movie.json schema_movie.json_schema
But I am getting the following error.
Traceback (most recent call last):
File "jsonschema_generator.py", line 9, in
import json_schema_generator
ImportError: No module named json_schema_generator
I executed the above command after navigating in bin folder. Please help me out

If you didn't, you should be able to work around this by passing in PYTHONPATH, e.g. from repo root: PYTHONPATH=. python3 bin/jsonschema_generator.py [...]


triangle only? any voxel support?

Hi DupontCai,
Pyoctree currently only supports 3D tris. I could add voxel support if I thought it would be beneficial to a number of users.
I would need to know more about your use case i.e. are you wanting to use it for medical imaging boxes or something else? And what features would it need?
Cheers,
Michael


Unable to install dynomitedb from apt

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys FB3291D9
sudo add-apt-repository "deb https://apt.dynomitedb.com/ trusty main"
sudo apt-get update
it is stopping at this point as it is unable to talk with dynamite apt.
Please resolve this issue fastly.

@akbarahmed can you comment please?
@sairam546 we usually do not use this process in production, we build our own debians and install them.

@sairam546 The .deb build and the packages on the apt repo were very out of date. As a result, we took the apt repo down.
We're now pointing everyone to the Netflix repo: https://github.com/Netflix/dynomite
I have updated the README on https://github.com/DynomiteDB/DynomiteDB.github.io and will update it on the other repos, website etc.

It is easy for beginners to install using apt. Can you enable that back with some versioning or with some different URL.

Right now we do not have in our timeline as an OSS project to publish a debian. We may consider it later based on the need. There was an effort in the past https://github.com/Netflix/dynomite/issues/367 and as an OSS project, it would be great to get more people involved.

@sairam546 Currently, we do not plan to address it as project maintainers given the fact that at Netflix we build our own Debians. We would love though to support you or anybody else who plans to help with publishing Debian package.


fps locked to 60FPS,FPS locked to 50?

Please help me!

I want to locked to 50FPS

Is V Sync enabled? You can try removing BGFX_RESET_VSYNC from bgfx::reset's reset flags. That'll unlock it from 60fps, providing that your graphics drivers aren't also forcing vsync on your app
I'm not sure how or why you would lock it to 50fps though...

thank you very much.


String Index Out of Bounds Exception Crash

[crash-2024-08-02_23.31.10-client.txt] (https://github.com/user-attachments/files/16477969/crash-2024-08-02_23.31.10-client.txt)

can i see what you did to the configs? also, delete them to see if doing so fixes the crash

I have done nothing to the configs. I will delete them now and retry.

Okay. That crash was resolved, but I have a new one now.
crash-2024-08-03_00.12.48-client.txt

try removing prehistoric fauna to see if it resolves the crash


title

Hey there :wave: Just wanted to let you know that your app on Streamlit Cloud deployed from this repo has gone over its resource limits. Access to the app is temporarily limited. Visit the app to see more details and possible solutions.

Hi @Joiner12, thank you for reporting this issue with the LLM app. The app has been rebooted and is no longer in an error state. 🎈


Add Container Id to IClient so clients can be differentiated in the op stream

Add the container's session id to the the client information, which will be part the the join message, and allowing identifying clients that are reconnecting, rather than net new connections within the op stream
related #3627 and #3605

How about proper description in PR, and if you have one - reference to issue? :)

closing this for now. we should evaluate if it make sense to add this to the quorum/audience at some point


Problems getting started with gulp shell task

Hi,
I am having some issues getting started using the gulp shell task as per the examples. I have installed angular-jsdoc and jsdoc locally and am trying the following task configuration:
gulp.task('docs', shell.task([
  'node_modules/angular-jsdoc/node_modules/jsdoc/jsdoc.js  '+
  '-c node_modules/angular-jsdoc/common/conf.json '+   // config file
  '-t node_modules/angular-jsdoc/default '+   // template file
  '-d build/docs '+                           // output directory
  //'./README.md ' +                            // to include README.md as index contents
  '-r src/client/app'                 // source code directory
  //'-u tutorials'                              // tutorials directory
]));

This returns me
'node_modules' is not recognized as an internal or external command,
operable program or batch file.

I then tried adding node just before the first line of the command:
gulp.task('docs', shell.task([
  'node node_modules/angular-jsdoc/node_modules/jsdoc/jsdoc.js  '+
....

And get:
[08:52:14] Using gulpfile ~\Documents\GitHub\interact\gulpfile.js
[08:52:14] Starting 'docs'...
module.js:338
    throw err;
          ^
Error: Cannot find module 'jsdoc/env'
    at Function.Module._resolveFilename (module.js:336:15)
    at Requizzle.requizzle (C:\Users\rparker\Documents\GitHub\interact\node_modu
les\angular-jsdoc\node_modules\jsdoc\node_modules\requizzle\lib\requizzle.js:87:
22)

I am unsure what to try next, can you please assist?
Thanks

Please try sh node node_modules/angular-jsdoc/node_modules/jsdoc/jsdoc.js or jsdoc command in Windows environmnet


[bug]  rh-stat has an accessibility issue with gray backgrounds

Describe the bug
The rh-stat component has an accessibility issue with gray backgrounds (specifically #3C3F42) where the red font is not legible from the gray background.
Which Component?
rh-stat
Steps to reproduce

Pull down the RHDS project
Build the project and start the dev server
Change one of the demo backgrounds in rh-stat to #3C3F42

Expected behaviour
The text needs to pass the accessibility tests for gray backgrounds
Screenshots
No response
Element HTML
No response
Operating System (OS)
macOS
Browser
Chrome
More browser information
No response
Additional Info
No response

@brianferry Here are the design fixes we are proposing.
https://xd.adobe.com/view/bf14fb6e-fd1e-4869-98ee-14deeb2428b3-ea47/

@coreyvickery @marionnegp
I have added demos so that you can take a look at what the options would look like for the demo.  These demos are both overriding the font color for all dark background rh-stat elements.
Link: https://deploy-preview-444--red-hat-design-system.netlify.app/components/statistic/
The first one uses #FDDBDB which I got from https://red-hat-design-tokens.netlify.app/ which is the token $rh-color-brand-red-lightest.
The second uses #D2D2D2 outlined in the UX doc which has the token $rh-color-text-secondary-on-dark

@brianferry
On #3c3f42 backgrounds:

[ ] Stat should be white
[ ] Body text should be #d2d2d2

Then we're done.

@brianferry Let's make everything white for dark theme including the icon, title, stat, and body text. Can you please update the demo page to reflect this?

@coreyvickery @marionnegp - The demos have now been updated to have a #fff font everywhere.

@brianferry Can we close this or do we need to update the documentation page or somewhere else?

@coreyvickery - Sorry, should've closed this before, if we need to add it to the docs we can open a separate issue for that.  Thanks!


support Typescript class

TS uses classes as JS uses function as constructor.
Here is the propose regex:
class\s+REPLACE(\s+extends\s+[_$a-zA-Z\xA0-\uFFFF][_$a-zA-Z0-9\xA0-\uFFFF]*|)\s+{
This should cater for scenarios:

class Replace {}
class Replace extends Base {
export class Replace {}
export class Replace extends Base  {}

Haven't had a chance to test this out yet, but thanks for this! I'll try it out soon.

Tips: (and working with TypeScriptReact :D )
functions:
(private|protected|public)? (static)? \s+ REPLACE \s* (
interfaces:
interface\s+REPLACE\s*{

@avernus88 is that specific to TypeScriptReact?

It works with both:
'TypeScript':
regExp: ///
# class
class\s+REPLACE(\s+extends\s+[$a-zA-Z\xA0-\uFFFF][$a-zA-Z0-9\xA0-\uFFFF]|)\s+{
# or
|
# matches 'function REPLACE('
function \s+ REPLACE \s (
# or
|
# matches 'REPLACE = function (' or 'REPLACE: function ('
REPLACE \s* (=|:) \s* function \s* (
|
# function:
(private|protected|public)? (static)? \s+ REPLACE \s* (
# interface:
|
interface\s+REPLACE\s*{
///
isTabBased: false
'TypeScriptReact':
  regExp: ///
    # class
    class\s+REPLACE(\s+extends\s+[_$a-zA-Z\xA0-\uFFFF][_$a-zA-Z0-9\xA0-\uFFFF]*|)\s+{
      # or
      |
    # matches 'function REPLACE('
    function \s+ REPLACE \s* \(
      # or
      |
    # matches 'REPLACE = function (' or 'REPLACE: function ('
    REPLACE \s* (=|:) \s* function \s* \(
     |
    # function:
    (private|protected|public)? (static)? \s+ REPLACE \s* \(
    # interface:
     |
    interface\s+REPLACE\s*{
  ///
  isTabBased: false

Hey @avernus88, just so I'm 100% clear on the change, do you mind making a pull request? Feel free to add some test files and everything, and I'll merge it in and release it if it looks good. Thanks for your help!

This is amazing guys. Works flawlessly. Thanks so much. Going to release it shortly.


add context to errors

We should change from anyhow to eyre, since it generates prettier reports. We also should add context to our errors. See this Zulip thread for more information.

Update: #51 moved us over to eyre, but we still need to add context. I think the thing to do is to use wrap_err to add interesting context. Here is an example from the docs:
use eyre::{WrapErr, Result};

fn main() -> Result<()> {
    ...
    it.detach().wrap_err("Failed to detach the important thing")?;

    let content = std::fs::read(path)
        .wrap_err_with(|| format!("Failed to read instrs from {}", path))?;
    ...
}

Perhaps @yaahc or @foresterre knows, though -- are there any procedural macros that will let you do a "wrap err" automatically on the result coming out from a given function? That might make a nice extension to fehler, actually (which we are using). e.g., it'd be really cool if you could do #[throws(context = "opening file {name}")] or whatever and have that work (leveraging the move towards nicer format strings that let you reference variables). I'd like it even more if there were some trivial way to capture the arguments without having to name them. I remember @yoshuawuyts working on something like this?
(Basically I'm thinking of tracing's instrument...but for errors...)

I'm not aware of the existence of such a macro. I've always manually added context to results.

Yea, I don't know of a macro like this, I tend to just use tracing-error and #[instrument] with eyre but having a way to easily add an error to the chain of errors sounds like a great idea. I should make a proc macro for this for eyre.


error: rate: Wait(n=1) would exceed context deadline

Seems to be related to: https://github.com/harmony-one/harmony/issues/3978
Multisig cannot retrieve sig owners from RPC and hence no action can be performed.

absolutely nothing we can do on the frontend I presume right?


Bugfix/still rt is failing oh my bad

Fix two three bugs, only related with tests almost only for test fix except small error handling of riak_cs_console:resolve_sibling/2 function. Two Three commits fix two three different bugs respectively, independently.

@borshop merge


Consistent bridging for NSErrors at the language boundary

This is a great direction to investigate, and we definitely need to make progress here.  However, the proposal acknowledges that we really need to resolve more fundamental questions about the bridging story.  Also, the improvements suggested are largely additive, so we can do them at any time.
As such, it is best to defer discussion of this area until this Fall for consideration in a post Swift 3.0 release.  Thank you for writing this up!

Thanks for looking at my proposal. I would like to point out that although it is largely additive, it is not completely so; a small amount of code would be broken, including anything that was explicitly constructing NSError objects and passing them to APIs that expect ErrorProtocols. Also, all of the explicit casts of Swift errors to NSError would need to be removed. I do believe that the benefits would greatly outweigh the costs here, so if source compatibility is a major concern post-3.0, it may be better to look at this (and the associated bridging issues) sooner rather than later. If small code-breaking changes are still kosher post-3.0, however, then this is no problem, and I will resubmit the proposal in the fall, adjusted to fit whatever decisions are made regarding the bridging behavior. I assume the time to do that would be shortly after 3.0 is released?
Thanks,
Charles

I understand your concern, but the reality is that this is a very large design effort.  I'm pretty confident that we can roll out the benefit of this with either no source breakage, or opt-in breakage that can be staged over time.  As plans for releases beyond Swift 3 are developed, we'll come up with a specific strategy.  This isn't the only proposal in this situation.


support --label for p8 output

When 1.p8 has no __label__ section, 2.p8 will not have one either:
shrinko8 1.p8 2.p8 --label label.png
Workaround: shrinko8 1.p8 temp.p8.png && shrinko8 temp.p8.png 2.p8

Thanks for reporting.
I may've added --label & --title a bit too hastily
What do you think about me changing it so that:

--label can only be used with images that use proper pico8 colors.
--title does not wrap. (instead, I'll allow passing --title twice - once for each line)
A new argument (perhaps semi-undocumented), --cart-template, can be used to replace the default template.png with whatever arbitrary image you like. (Since pico8 doesn't seem to care and some people exploited that to create custom-looking carts)

Done.

It might also be neat if you could pass any arbitrary cart (e.g. a .p8 text file) to --label to copy the same label

While --label still expects a 128x128 image, I did add --merge some_cart.p8 label to allow merge the label (or other sections) into the main input cart.


werkzeug.serving.DechunkedInput.read returns more than what was asked for

I believe this is a bug in werkzeug 1.0.1 and not Flask because the error is produced by request.stream.read(), which is a werkzeug.serving.DechunkedInput instance. Please let me know if this actually belongs to Flask, and I will report it there instead. Note that I have used Flask in these examples for simplicity and because this is where I first found the issue.
With Python 3.9 on Windows 10, given the following Flask app (pip install flask==1.1.2) as server.py:
from flask import Flask, request

SIZE = 320000
app = Flask('bug')

@app.route('/bug', methods=['POST'])
def bug():
    chunk = request.stream.read(SIZE)
    if len(chunk) > SIZE:
        raise ValueError(f'bug in {type(request.stream)}; read({SIZE}) returned {len(chunk)} bytes')

    return 'ok'

if __name__ == "__main__":
    app.run()

And the following client.py file (pip install aiohttp==3.7.3):
import asyncio
import aiohttp

URL = 'http://localhost:5000/bug'
EXTRA = 44
CHUNK = 4000
DELAY = 0.125

async def req():
    yield bytes(EXTRA)
    while True:
        yield bytes(CHUNK)
        await asyncio.sleep(DELAY)

async def main():
    async with aiohttp.ClientSession() as session:
        async with session.post(URL, data=req()) as resp:
            async for line in resp.content:
                print(line)

asyncio.run(main())

Running python server.py followed by python client.py in another terminal will eventually lead to the following error:
[2021-01-27 16:20:20,419] ERROR in app: Exception on /bug [POST]
Traceback (most recent call last):
  File "C:\Python39\lib\site-packages\flask\app.py", line 2447, in wsgi_app
    response = self.full_dispatch_request()
  File "C:\Python39\lib\site-packages\flask\app.py", line 1952, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "C:\Python39\lib\site-packages\flask\app.py", line 1821, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "C:\Python39\lib\site-packages\flask\_compat.py", line 39, in reraise
    raise value
  File "C:\Python39\lib\site-packages\flask\app.py", line 1950, in full_dispatch_request
    rv = self.dispatch_request()
  File "C:\Python39\lib\site-packages\flask\app.py", line 1936, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "C:\server.py", line 10, in bug
    raise ValueError(f'bug in {type(request.stream)}; read({SIZE}) returned {len(chunk)} bytes')
ValueError: bug in <class 'werkzeug.serving.DechunkedInput'>; read(320000) returned 320044 bytes

I expected read to never return more than size, but it did. According to PEP 3333 - Input and Error Streams, read is defined on the input stream with as follows (strong emphasis mine):

The semantics of each method are as documented in the Python Library Reference, except for these notes as listed in the table above:

The server is not required to read past the client's specified Content-Length, and should simulate an end-of-file condition if the application attempts to read past that point. The application should not attempt to read more data than is specified by the CONTENT_LENGTH variable.

And the Python Library Reference for io.RawIOBase.read reads:

Read up to size bytes from the object and return them. As a convenience, if size is unspecified or -1, all bytes until EOF are returned. Otherwise, only one system call is ever made. Fewer than size bytes may be returned if the operating system call returns fewer than size bytes.
If 0 bytes are returned, and size was not 0, this indicates end of file. If the object is in non-blocking mode and no bytes are available, None is returned.
The default implementation defers to readall() and readinto().

Note that it says "Read up to size", and not "Read at least size". Werkzeug behaviours seem to not behave as the documentation says it should, which I think is a bug.
Because the default read implementation delegates to readinto, the buggy implementation is likely here, although I have not investigated further:
https://github.com/pallets/werkzeug/blob/68b7cbda036ae4f299f777180b7fd7a00e6b128b/src/werkzeug/serving.py#L105

In fact, I don't understand why the implementation tries to fill the entirity of buf, based on the following condition:
while not self._done and read < len(buf):

This method is not readall! It's simply read! It should not try to fill buf in its entirity. It should read as much as it can once (in "one system call") and then return. It should only block to perform that first read. It should not repeatedly block to fill buf.

In fact, I don't understand why the implementation tries to fill the entirity of buf, based on the following condition:
while not self._done and read < len(buf):

This method is not readall! It's simply read! It should not try to fill buf in its entirity. It should read as much as it can once (in "one system call") and then return. It should only block to perform that first read. It should not repeatedly block to fill buf.

Is this actually causing an issue? DechunkedInput is only used by the development server in order to provide basic chunked encoding support. It also doesn't appear to be something we can control, as read is provided by io.RawIOBase. All we know is that read has given us a buffer to read some amount into, the size is not provided to us. readinto is allowed to read however much it wants to populate the buffer, it's RawIOBase.read that needs to maintain that buffer and only return the request amount. This seems like a bug in RawIOBase.read.

Is this actually causing an issue? DechunkedInput is only used by the development server in order to provide basic chunked encoding support. It also doesn't appear to be something we can control, as read is provided by io.RawIOBase. All we know is that read has given us a buffer to read some amount into, the size is not provided to us. readinto is allowed to read however much it wants to populate the buffer, it's RawIOBase.read that needs to maintain that buffer and only return the request amount. This seems like a bug in RawIOBase.read.

Is this actually causing an issue

Yes, in my code I have a ring buffer which I want to fill as much as possible without writing so much that I start losing data. Because read returns more than what can fit in my ring buffer, I lose the first few bytes.

the size is not provided to us

I don't have a lot of domain knowledge here, but isn't the size is len(buf)?

readinto is allowed to read however much it wants to populate the buffer

This is debatable. PEP 3333 says it should behave like read, and read says that, if a size is provided, it will only perform a single system call. Yet, by reading that much more, is violating this aspect.

it's RawIOBase.read that needs to maintain that buffer and only return the requested amount

How is it supposed to do that, if it needs to create a buffer which it can pass to readinto and then return that buffer (thus losing control of that buffer it created)?

This seems like a bug in RawIOBase.read

It might be, although it seems strange that it's (seemingly) creating a buffer larger than requested?

Is this actually causing an issue

Yes, in my code I have a ring buffer which I want to fill as much as possible without writing so much that I start losing data. Because read returns more than what can fit in my ring buffer, I lose the first few bytes.

the size is not provided to us

I don't have a lot of domain knowledge here, but isn't the size is len(buf)?

readinto is allowed to read however much it wants to populate the buffer

This is debatable. PEP 3333 says it should behave like read, and read says that, if a size is provided, it will only perform a single system call. Yet, by reading that much more, is violating this aspect.

it's RawIOBase.read that needs to maintain that buffer and only return the requested amount

How is it supposed to do that, if it needs to create a buffer which it can pass to readinto and then return that buffer (thus losing control of that buffer it created)?

This seems like a bug in RawIOBase.read

It might be, although it seems strange that it's (seemingly) creating a buffer larger than requested?

With the information I have, I'm calling this a bug in RawIOBase.read.

With the information I have, I'm calling this a bug in RawIOBase.read.

RawIOBase.read is implemented as follows (unless I'm looking at the wrong thing):
    b = PyByteArray_FromStringAndSize(NULL, n);
    if (b == NULL)
        return NULL;

    res = PyObject_CallMethodObjArgs(self, _PyIO_str_readinto, b, NULL);
    if (res == NULL || res == Py_None) {
        Py_DECREF(b);
        return res;
    }

I very much doubt PyByteArray_FromStringAndSize is allocating more than it should.
        alloc = size + 1;
        new->ob_bytes = PyObject_Malloc(alloc);

RawIOBase.read is implemented as follows (unless I'm looking at the wrong thing):
    b = PyByteArray_FromStringAndSize(NULL, n);
    if (b == NULL)
        return NULL;

    res = PyObject_CallMethodObjArgs(self, _PyIO_str_readinto, b, NULL);
    if (res == NULL || res == Py_None) {
        Py_DECREF(b);
        return res;
    }

I very much doubt PyByteArray_FromStringAndSize is allocating more than it should.
        alloc = size + 1;
        new->ob_bytes = PyObject_Malloc(alloc);

We only know the size of the buffer, that's the only thing we can use to know how much to read.

We only know the size of the buffer, that's the only thing we can use to know how much to read.

The following server.py code exhibits the same behaviour:
from flask import Flask, request

SIZE = 320000
app = Flask('bug')

@app.route('/bug', methods=['POST'])
def bug():
    chunk = bytearray(SIZE)
    n = request.stream.readinto(chunk)
    if n > SIZE:
        raise ValueError(f'bug in {type(request.stream)}; read({SIZE}) returned {n} bytes')

    return 'ok'

if __name__ == "__main__":
    app.run()

No read in sight, only readinto which werkzeug controls.

The following server.py code exhibits the same behaviour:
from flask import Flask, request

SIZE = 320000
app = Flask('bug')

@app.route('/bug', methods=['POST'])
def bug():
    chunk = bytearray(SIZE)
    n = request.stream.readinto(chunk)
    if n > SIZE:
        raise ValueError(f'bug in {type(request.stream)}; read({SIZE}) returned {n} bytes')

    return 'ok'

if __name__ == "__main__":
    app.run()

No read in sight, only readinto which werkzeug controls.

Again, the problem is readinto is reading beyond the size of the provided buf.

Again, the problem is readinto is reading beyond the size of the provided buf.

Great, thanks for reducing this to a minimal reproducible example. Happy to consider a PR since it seems like you're the most knowledgeable about this right now. I'm unlikely to have time to address this before 2.0 otherwise.
A bytearray can grow beyond its pre-allocated size, the same as if no size was given. Seems there's an issue with how we're tracking the size we've read compared to the size of the buffer. That seems like a good place to start.

Great, thanks for reducing this to a minimal reproducible example. Happy to consider a PR since it seems like you're the most knowledgeable about this right now. I'm unlikely to have time to address this before 2.0 otherwise.
A bytearray can grow beyond its pre-allocated size, the same as if no size was given. Seems there's an issue with how we're tracking the size we've read compared to the size of the buffer. That seems like a good place to start.

It appears SIZE = 800, EXTRA = 44 and CHUNK = 400 is enough to trigger this issue ( 844 > 800). I used the following code to see what aiohttp was sending:
import socket
s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
s.bind(('localhost', 5000))
s.listen(1)
c, _ = s.accept()

buffer = b''
while len(buffer) < 4096:
    buffer += c.recv(4096)

print(buffer.decode())

...and adjusted client.py to send E for extra and C for chunk to more easily distinguish the two parts. This is what the socket, and thus flask receives, which werkzeug deals with:
POST /bug HTTP/1.1
Host: localhost:5000
Accept: */*
Accept-Encoding: gzip, deflate
User-Agent: Python/3.9 aiohttp/3.7.3
Content-Type: application/octet-stream
Transfer-Encoding: chunked

2c
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
(...infinite other 190 CCCC...)

This should make for a good testcase.

It appears SIZE = 800, EXTRA = 44 and CHUNK = 400 is enough to trigger this issue ( 844 > 800). I used the following code to see what aiohttp was sending:
import socket
s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
s.bind(('localhost', 5000))
s.listen(1)
c, _ = s.accept()

buffer = b''
while len(buffer) < 4096:
    buffer += c.recv(4096)

print(buffer.decode())

...and adjusted client.py to send E for extra and C for chunk to more easily distinguish the two parts. This is what the socket, and thus flask receives, which werkzeug deals with:
POST /bug HTTP/1.1
Host: localhost:5000
Accept: */*
Accept-Encoding: gzip, deflate
User-Agent: Python/3.9 aiohttp/3.7.3
Content-Type: application/octet-stream
Transfer-Encoding: chunked

2c
EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
190
CCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCCC
(...infinite other 190 CCCC...)

This should make for a good testcase.

I'd like to work on this.


problem running hector mapping in rviz

anyone out there is able to help me counter my current problem of using hector mapping? apprently the surround data does not save according. do i need to attach another hardware or is there any coding i missed out?

I will close it , if you still have question, please comment, i will reopen it and try to help you.


Ignore files generated by JetBrains IDEs

@swift-ci please smoke test

I think this is an obviously correct change, so I'm merging it.


WIP: Results api

Issue: #493

[x ] Tick here to confirm that you have run RunCodeFormatter.ps1

Description:
Based on multiple follow-up conversations, I've re-factored the results API. It now makes no assumptions on the message format, i.e. CSV, JSON, or contents of it, and simply outputs the file contents.
Calling it is substantially "nicer" as well (for a loose definition of nice):
var fileStoreStore = new Nether.Analytics.Results.FileResultsStore(path);
Console.WriteLine(fileStoreStore.For("dau").Latest().AsText());

It does assume some naming convention to the result file, specifically, it assumes something like this:
dau_20170605T1530_name.csv where the first part denotes the name of the job, the second one is the ISO output of the timestamp, and it can optionally be followed by any other description, like a name for the run.
This assumption is there because the job name (in For("dau")) translates directly into the filename search pattern.
Test:
The easiest way to test is to put a random file to a random folder, and name it according to the above convention. When running the test analytics client, specify the folder as the root. The contents of the file should be displayed on the screen.

For discussion
Have a look at the below example and the way you've named the parameters (ignore the spelling error). Especially the second line:
var fileStoreStore = new Nether.Analytics.Results.FileResultsStore(path);
Console.WriteLine(fileStoreStore.For("dau").Latest().AsText());

If I where to read only the second line, I wouldn't really understand what I'm doing:

I'm working with a fileStore object
For("dau") ?!?! (for what, in a fileStore)
Asking for Latest() (latest files? isn't that just a dir?)
Getting the latest files as text

Ok, I get it, because I know what we are trying to do, and perhaps I'm a little bit provocative as well and going to the extremes. What I'm trying to figure out is just, what would be the best naming conventions and patterns to get to the results that I'm looking for?
In English I would write (excuse my poor English)

"Get the latest results for the DAU job as text"

Fluent API
var results = new FileStorageJobResultsProvider(path);
Console.WriteLine(results.Get().Latest().ForJob("dau").AsText());

"Normal" API
var results = new FileStorageJobResultsProvider(path);
Console.WriteLine(results.GetLatestAsText("dau");

"Open the latest result for the DAU job as a stream"

Fluent API
var results = newFileStorageJobResultsProvider(path);
using (var stream = results.Open().Latest().ForJob("dau"))
{
    // Consume result stream here
}

"Normal" API
var results = newFileStorageJobResultsProvider(path);
using (var stream = results.OpenLatest("dau"))
{
    // Consume result stream here
}

"Get the result for for the DAU job from 26th of August, 2014"

Fluent API
var results = new FileStorageJobResultsProvider(path);
Console.WriteLine(results.Get().From(new DateTime(2014, 08, 26)).ForJob("dau").AsText());

"Normal" API
var results = new FileStorageJobResultsProvider(path);
Console.WriteLine(results.GetAsText("dau", new DateTime(2014, 08, 26)));

If we do go the fluent API route, we should make sure it feels very natural to write and read and provide additional value compared to "Normal" API design. Remember that most other APIs in Nether aren't using fluent APIs, so we should be very cautious unless we want to make a bigger re-write of everything.

@krist00fer thanks for the comment on the fluent API. I sort of agree with you, but also, feel a small change can go a long way here - assuming we do decide to keep the fluent API in any case.
resultsProvider.ForJob("dau").GetLatest().AsText();
resultsProvider.ForJob("dau").Between(startDateTime, endDateTime).AsStream();
...

I don't necessary see the value in saying .Get(), or .Open() only to then have to add .AsText() if you called .Get(). Also, if we add something later, we can still say .As<Type>(). Did I miss something?

Closing this PR for now, since no work has been done for a long time. Let's open it as soon as work continues


Classg multi kind

Summary by CodeRabbit

New Features

Enhanced installation instructions and usage information for setting up the environment with new methods.
Added support for concurrent class generation requests, allowing users to specify multiple kinds at once.

Bug Fixes

Improved clarity on shell completion setup in documentation.

Documentation

Expanded help description for command options, including examples for user guidance.
Overall structure and clarity of README have been improved for better accessibility.

Chores

Updated dependency version to allow for new features and improvements.

/verified

/verified

/verified


Game with nos

🚀 Feature
You are given an array arr[], you have to re-construct an array arr[].
The values in arr[] are obtained by doing Xor of consecutive elements in the array.
Have you read the Contributing Guidelines on Pull Requests?
yes
Motivation
Want to add code in cp in c++
Pitch
As a GSSoC'21 .

/assign


Files with non-unicode characters sometimes break

Ideally these characters aren't making it to this point in the build process, but regardless, there needs to be some sort of error handling for when the program finds one of these "bad" characters.

This remains an issue, but I'm removing it from the 1.0.0 release milestone because theoretically, these characters won't be present in the emails by this point in the build process.
Also I'm in charge here. I decide what goes into v1.0.


Are deleted files listed when I call getItems(folderId) for the folder?

If yes, what is a way to separate deleted files from not deleted? I have found field "deleted" in Item class but can't find any description of it.

Thank you for reaching out and for your patience. This SDK is being officially deprecated. See #172 for more information


Purchase error code "E_UNKNOWN" with message: "Cannot connect to iTunes"

Version of react-native-iap: 5.0.1
Version of react-native: 0.63.2
Platforms you faced the error : IOS 12.4.8
Tested environment: Iphone 6 Plus (real device)
Steps to reproduce the behavior
All my code is same as the example. Test with my sandbox account.

Have you tried initConnection()?

i am running into same issue.
tried:

use verified sandbox user
use non-verified sandbox user ( E-Mail not verified )
no sandbox user set and logging in within purchase process ( with either verified or non-verified user )

also using initConnection() which returns true in logs.
i can fetch the list of products and subscriptions from account, but neither requestPurchase nor requestSubscription
public async requestPurchase(sku: string) {
    console.warn('requestPurchase ', sku)
    const init = await RNIap.initConnection()
    console.log('InAppPurchase -> requestPurchase -> init', init)
    try {
      return await RNIap.requestPurchase(sku, false)
    } catch (err) {
      console.warn(err.code, err.message)
    }
  }

public async requestSubscription(sku: string) {
    console.log('InAppPurchase -> requestSubscription')
    const init = await RNIap.initConnection()
    console.log('InAppPurchase -> requestSubscription -> init', init)
    try {
      return await RNIap.requestSubscription(sku)
    } catch (err) {
      console.warn(err.code, err.message)
    }
  }

Do you have a purchaseUpdatedListener with finishTransaction? @patrick-tresp

Hey thanks for fast repy @traingethermarc ,
i do run this when componentDidMount
RNIap.initConnection().then(() => {
      console.log('InAppPurchase -> initializePurchaseListener -> RNIap.initConnection().then()')
      // we make sure that "ghost" pending payment are removed
      // (ghost = failed pending payment that are still marked as pending in Google's native Vending module cache)
      RNIap.flushFailedPurchasesCachedAsPendingAndroid()
        .catch(() => {
          // exception can happen here if:
          // - there are pending purchases that are still pending (we can't consume a pending purchase)
          // in any case, you might not want to do anything special with the error
        })
        .then(() => {
          console.log('InAppPurchase -> RNIap.flushFailedPurchasesCachedAsPendingAndroid -> then')
         purchaseUpdateSubscription = purchaseUpdatedListener(
            (purchase: InAppPurchase | SubscriptionPurchase | ProductPurchase) => {
              console.log('GLOBAL purchaseUpdatedListener', JSON.stringify(purchase))
                  })
            },
          )
          console.log(
            'InAppPurchase -> initializePurchaseListener -> InAppPurchase.getInstance().purchaseUpdateSubscription',
            purchaseUpdateSubscription,
          )

          purchaseErrorSubscription = purchaseErrorListener(
            (error: PurchaseError) => {
              console.warn('purchase ErrorListener', error)
            },
          )
        })
    })

But only purchaseErrorListener is returning an Error, purchaseUpdatedListener has not returned anything so far.

const getProductsIAP = useCallback(async () => {
  await clearProductsIOS();
  await clearTransactionIOS();

 try {
   const result = await initConnection();
   const products = await getProducts(itemSkus);
   props.setProducts(products);
   console.log('result', result);
 } catch (err) {
   console.warn(err.code, err.message);
 }

  purchaseUpdateSubscription = purchaseUpdatedListener(
    async (purchase) => {
      const receipt = purchase.transactionReceipt;
      console.log('purchaseUpdatedListener');
      if (receipt) {
        try {
          await processNewPurchase(purchase); //your backend call
        } catch (ackErr) {
           console.log('ackErr', ackErr);
        }
      } else {
        console.log('purchaseUpdatedListener error: receipt');
      }
    },
  );

  purchaseErrorSubscription = purchaseErrorListener(
    (error: PurchaseError) => {
      console.log('purchaseErrorListener', error);
      console.log(JSON.stringify(error));
    },
  );
}, []);

I am using hooks but this could be easily converted to componentDidMount.

I had the same problem - I assume you test on a real device which is not updated to IOS 14 already? If this is the case update it to IOS 14 or upload the project to TestFlight.

I have various devices on different OS versions and I have this problem on each one of them. I've contacted Apple in regards to this and we're still following up the case, however, without any solid conclusions. I do not believe it is a problem with the package, it must be something on the Apple's side. I've tried everything people are mentioning on this thread and in other threads that have reported a similar problem. The In App Purchase dialog is just inconsistent on showing up and until now, I cannot find a valid reason for it because the outcome are always different. Sometimes I get an E_UNKNOWN error, other times I get zero feedback, sometimes the pop up shows after 10 mins of waiting and other times it just works... I've tried with sandbox users, non sandbox users, I've had the same different outcomes for the same user and device and not even an error or a conclusive/insightful log is shown. This is just frustrating to debug because you can't find pretty much anything... Well, if you guys have any sort of advice or insight, I'm listening ... In the meantime, if I have some news from Apple, I'll keep you posted...

Yes the package is definitely kind of buggy sometimes... :( hopefully they will fix it someday, because there is no real alternative out there. Only can give you the tipps with IOS 14, TestFlight and a "proper" use of the API (which is hard, because there is no real implementation, which is working 100% - as far as I can tell after maaaaaany hours of working with it and by reading different issues here...)

@traingethermarc
as promised:

after installing iOS 14 on Device
after installing XCode 12.1 ( otherwise device was always lost )

I get a successful payment in sandbox with purchase response containing

productId,
transactionDate,
transactionId and
transactionReceipt

Thanks so much, i would have still be looking into code and try to debug.

Are you guys able to call finishTransaction on the IOS side? And I have the same issue, its likely the apple side issue and IOS 14 does resolve it which I can confirm

@traingethermarc thanks to your guide I  upgraded my device to IOS 14 and it worked. But can I ask you one more question. I try to log the object from transactionReceipt method and it show me a very long encrypted string. It's very different from the payload I receive on Android which is a clearly JSON object. So how can I know a purchase in IOS is successful ?

Yes @binhchili in order to verify the receipt you have to send it to your backend. You can use 'node-apple-receipt-verify' and once you validated it you can see the product which was purchased. Then you can store it in your database and send a "success" to your client in order to finishTransaction.

Hey @traingethermarc, don't we need to manually call finish transaction on IOS side? I have validated my receipt from apple side through my server, but I am unable to finish the transaction by calling finishtransaction, it is returning undefined.

I am sending "success" back from server and once the client recieves it:  await finishTransaction(purchase);  finishTransaction is working for both android and iOS.

then(async (data) => {
        console.log(data);
        props.setProcessing(false);
        if (data.ack === 'success') {
          console.log('finished');
          await finishTransaction(purchase);
        //  props.setActivePlan({ planId: productId });
      }

@traingethermarc I just log out the purchase object while testing on Android and find that there are 2 fields: purchaseState and purchaseStateAndroid.  purchaseState return 0 while purchaseStateAndroid  return 1. Can you explain the difference between 2 field ?

@traingethermarc I just log out the purchase object while testing on Android and find that there are 2 fields: purchaseState and purchaseStateAndroid. purchaseState return 0 while purchaseStateAndroid  return 1. Can you explain the difference between 2 field ?

Please open a new thread for a new discussion. Love to see all your kindness tough.
Actually, please check once again since react-native-iap should not return purchaseState and only purchaseStateAndroid.


forms translations are copied to the old laravel ( < 9) lang directory

Package
filament/forms
Package Version
v2.10.12
Laravel Version
v9.0.0
Livewire Version
v2.10.1
PHP Version
PHP 8.1.2
Bug description
Issue
php artisan vendor:publish --tag=forms-translations
Copied Directory [/vendor/filament/forms/resources/lang] To [/resources/lang/vendor/forms]
Solution
Should copy to [/lang/vendor/forms]
Steps to reproduce
No response
Relevant log output
No response

@petermaas This is related to the PackageServiceProvider that we use provided by https://github.com/spatie/laravel-package-tools.


Asset URL incompatibility with iOS client when running server on Windows

When running expo-updates-server natively on Windows asset URLs get a path with some backslashes like /api/assets?asset=updates\1.0.0\1675941667/assets/62c0135163427c652ae397f327f85010&runtimeVersion=1.0.0&platform=ios.
NSURL in iOS does not like this, which results in asset URLs becoming nil and the update failing "due to missing asset URL".
I solved this for myself by moving to WSL for expo-updates-server, but figured maybe some path normalization could be in order?

I ended up making a change to that function to URL encode any backslash (windows path). I agree that it could be handled better though. This isn't the first time I had been bitten by different string handling in URLs between iOS and Android either.
export async function getAssetMetadataAsync(arg: GetAssetMetadataArg) {
  const assetFilePath = `${arg.updateBundlePath}/${arg.filePath}`;
  const asset = await fs.readFile(path.resolve(assetFilePath), null);

  // On Windows, the path can include backslashes doubled up, which causes iOS to not work.
  // Android continues to work. This will simply replace '\\' with URL encoded '\'
  const assetFilePathClean = assetFilePath.replace(/\\/g, '%5C');

  const assetHash = getBase64URLEncoding(createHash(asset, 'sha256', 'base64'));
  const key = createHash(asset, 'md5', 'hex');
  const keyExtensionSuffix = arg.isLaunchAsset ? 'bundle' : arg.ext;
  const contentType = arg.isLaunchAsset ? 'application/javascript' : mime.getType(arg.ext);

  return {
    hash: assetHash,
    key,
    fileExtension: `.${keyExtensionSuffix}`,
    contentType,
    url: `${process.env.BASE_URL}?asset=${assetFilePathClean}&runtimeVersion=${arg.runtimeVersion}&platform=${arg.platform}`,
  };
}


Add handling for double precision input fields when reading _FillValue

Several GCHP input files contain double precision variables with the _FillValue attribute. Recent versions of MAPL read the _FillValue to handle cases where it differs from MAPL_UNDEF but the model crashes unless the input is single precision. The problem is the object function get_var_attr_real32 does not have handling for double precision. See here and here.
I implemented an update to handle double precision input which is now working. I am getting negative concentrations in my model run but that is a separate issue (one of our scale factor files has _FillValue=1 and many missing values when it should simply contain 1s for the data).
Here is the fix I implemented, along with an expansion of the error message to include filename. I can make a PR with this or you can implement the equivalent however you'd like.
      real(REAL64) :: tmpd(1)
      character(len=ESMF_MAXSTR) :: fname
      ...
      fname = get_file_name(this,_RC)
      type is(real(kind=REAL32))
         tmp = attr_val
         attr_real32 = tmp(1)
      type is(real(kind=REAL64))
         tmpd = attr_val
         attr_real32 = REAL(tmpd(1))
      class default
         _ASSERT(.false.,'unsupport subclass for units (attribute named '//attr_name//' in '//var_name//' in '//fname)
      end select

@lizziel If this change works for you, then by all means please submit a PR against develop.   Let us know if you need an earlier MAPL patched with a hotfix.     (@weiyuan-jiang I'm letting you manage the ticket as it is mostly a pfio extension.)

Will do. I won't need a patch since I've already put this in our version.


error in starting enroot container for gromacs:2020.2 on v100 cards

Getting below mentioned error for : enroot start --rw gromacs:2020.2
nvidia-container-cli: mount error: stat failed: /dev/nvidia-modeset: no such file or directory
[ERROR] /home/apps/centos7/enroot/3.2.0/etc/enroot/hooks.d/98-nvidia.sh exited with return code 1
Checked with the solution provided at : https://github.com/NVIDIA/enroot/issues/15
Setting NVIDIA_DRIVER_CAPABILITIES=utility  gives another error
ERROR Failed to verify GPU driver: GPU driver verification failed: Failed to parse host GPU driver version Malformed version:
FATAL Please double check that GPU passthrough is enabled: --nv (Singularity), --gpus all (Docker)
GPU Info : Name :  Tesla V100   Driver Version: 450.51.05    CUDA Version: 11.0

Looks like a problem with the entrypoint of the image, you can use --rc to bypass it in the meantime.
@AdamSimpson any idea what's going on?

Did you manage to solve the issue?

Did you manage to solve the issue?

Issue still persist.

Issue still persist.

It looks like you're missing the compute capability in the workaround. Can you please set NVIDIA_DRIVER_CAPABILITIES=utility,compute and try again?
This issue has been resolved internally and will be present in the next gromacs NGC release, thanks for reporting.

It looks like you're missing the compute capability in the workaround. Can you please set NVIDIA_DRIVER_CAPABILITIES=utility,compute and try again?
This issue has been resolved internally and will be present in the next gromacs NGC release, thanks for reporting.


Can't get DP min/max using smartnoise

Seeing ValueError: We don't know how to rewrite aggregate function: MAX ( length )
, which seems like a problem

Duplicate of #31 , closing


fixup updateDependency for bundle, now open assets in bundle will firstly lookup assets in bundle, then lookup in root directory.

Hello, Your OpenSourceProject is very useful for me, This is awesome, I want to make some pull request to fix error logic or error handle in project. thanks.

I agree that this is a good addition, however there are a few problems/inconsistencies with the code (and assetsmanager's code as well) so I cleaned it up and have pushed a commit to do this.


Hide dots on daemon startup when loglevel != info

When the deamon starts up with log level set to INFO it will show something
like this:
INFO[0000] Loading containers: start.
................................................................
INFO[0000] Loading containers: done.

where the dots represent containers in the system.
When you run with log level set to "error" it will still show the dots
w/o the "Loading..." lines before and after which looks really odd.
This PR will fix it so that the dots are only shown IFF the "Loading..."
lines are also shown
Signed-off-by: Doug Davis<EMAIL_ADDRESS>

Ping @jfrazell

weird why do we even have the dots, LGTM

dots!  :)


BaseContainer missing Clear method

Hey,
I think BaseContainer.js misses Clear() method, that's why after() method leads to the following error while running the tests : "
"after all" hook:
TypeError: botiumContext.container.Clear is not a function
"

Thanks, this was a typographic error in the source code, the method is named "Clean", not "Clear". New npm<EMAIL_ADDRESS>is available.


Update Create-AzSStorageDashboard.ps1

Add support of Az module

@GeorgeH-MS  pls get the appropriate approval and get this merged.  The PR needs to get in to az branch as well

@NeilBird @XiangyuKuangMSFT could you help to review this pull request?

Functionally it is solid, just tested it, but why not just create a separate one for Az and separate for AzureRM (which should be gone very soon anyway) instead of forcing to run the alias command? Though if that is how you would like to to work - it works :-)

Agree with @cblackuk  here. Can you pls update the az branch for Az powershell usage? This file does not exist in az branch

Agree with @cblackuk here. Can you pls update the az branch for Az powershell usage? This file does not exist in az branch

The pull request https://github.com/Azure/AzureStack-Tools/pull/628 has been created to Az branch. Pls help to check

@NeilBird @XiangyuKuangMSFT  can one of you pls approve this PR?

@bganapa and @GeorgeH-MS
I do not have permissions to Merge PRs into this Repo.

Thanks @NeilBird for the review and approval!


FLIR Fix

Removed FLIR rendering invisible entities.
Since we aren't close to doing the 'heat signature strength' that is put in the comments at the top, at the very least things that shouldn't be rendered are fixed here. alot of wire contraptions will appreciate this i imagine.

Could you add it to the other if statement instead of making a new if statement

Done.

ACTUALLY done this time, gaining github experience once update at a time lmao

Thx


Vertical Scroll Working

Hi , i have resolve the issue in which there is no vertical scroll.  if you want any changes please recommend . and also merge this PR .

The issue was solved by someone else a few minutes ago you put the pr. Good luck for the other issues!

Actually i had solved issue for product page images scroll.

This is how it look .
Should i resend PR  or this issue is resolved already


Avoid potential data corruption by allowing decryption by default

In our app we have methods that read encrypted attributes from one record and save them in another record.
# first_name is encrypted
user = User.find(id)
other_user = User.find(other_id)
other_user.first_name = user.first_name
other_user.save!

My worry is that someone does this in a (production) console without running decrypt! first potentially corrupting other_user (which will now have the encrypted version of first_name encrypted again and saved instead of first_name).
How do you avoid this?
Potential solution could be to make encryption optional (we mainly use console1984 for the logging and auditing so we could turn it off).
Another solution could be to not decrypt console output but to still make any other output decrypted (maybe also make this a configuration option).

If you are not encrypting anything on your models then you won't have this problem.
The encryption behavior comes from Rails' own ActiveRecord::Encryption module, the decrypt! method it's there not only to decrypt any encrypted field but also to mark any following command after its execution as a Sensitive Access rather than a Protected Access.


Add option for saving player data regularly while players are online

In addition to how it is currently where data is only saved on logout.

My suggestion for this would be saving online player's data on WorldSaveEvent, this way the world data (Chests) and player data (Inventories) are never out of sync when a server suddenly crashes.

I just wanted to up that implementation... it's dangerous for me to migrate because of that

I just wanted to up that implementation... it's dangerous for me to migrate because of that

Well, this is something that'd only affect if your servers were prone to crashing - it's not a hugely scary thing to not have this. It's a nice little bit of assurance, though.

Crashes do not happens a lot (i would say 1-2 times a month on my side) and it's generaly not a so big issue, but when they do, if players lose custom items that takes month of farming to get... then it gets problematic.


Add features and fixes

Added features :

Show length and add length filter
Show Raw source code
Crawl all subdomains

Fixes :

Fix linkfinder (relative path, js in js, output ..)
Fix subdomains
Fix href output
Fix case sensitive for Duplicate
delay all requests

Looks good to me 🎉


Documentation for JSDOM use minimified version that causes issues.

Hi,
In the Deno documentation for JSDOM ( https://docs.deno.com/runtime/manual/advanced/jsx_dom/jsdom ).
The provided exemple use a minified version of JSDOM :
{
  "jsdom": "https://esm.sh/jsdom"
}

However, this causes the following issue :
import { JSDOM } from "https://esm.sh/jsdom";

const {window} = new JSDOM(
  `<!DOCTYPE html>
  <html lang="en">
    <body>
    </body>
  </html>`,
)!;

if( window.HTMLElement.name !== "HTMLElement")
    throw "Bad name!";

if( window.HTMLElement.prototype.constructor.name !== "HTMLElement")
    throw "Bad name!";

cf https://github.com/jsdom/jsdom/issues/3683
Using import { JSDOM } from "npm:jsdom"; solves this issue.
Cordially,

The page for LinkeDOM may have the same issue ( https://docs.deno.com/runtime/manual/advanced/jsx_dom/linkedom ).


Support cancun version flag

Component
Forge
Describe the feature you would like
Foundry is updated to use the latest revm (https://github.com/foundry-rs/foundry/issues/5565) which has tstore/tload support, however can't be run because there is no cancun flag.
Requesting an early cancun flag to be able to run an 1153 enabled environment.
Additional context
No response

on it

hmm, the --evm-version arg mirrors solc's available versions
https://github.com/ethereum/solidity/blob/develop/liblangutil/EVMVersion.h#L74
I'm hesitant to add it as an additional variant of the solc::EvmVersion enum (which mirrors solc's versions) since this would end up as invalid version.
However the evm_version setting clearly states that it's for the evm:
https://github.com/foundry-rs/foundry/blob/0f530f2ae63342b136ad65e1c7d3b3231b939a6b/crates/config/src/lib.rs#L170-L172
not sure what the correct behaviour for --evm-version cancun should be, compile with shanghai and configure evm as cancun?

A temporary cancun flag would work if that's easiest! Meanwhile I did speak with @hrkrshnn who said they can work on making sure evm_version = cancun applies... so if you'd prefer waiting on that I understand too. I am however working off the transient-store branch of solidity though so I'd imagine it would only work there at least until we're closer to cancun

Thanks! Compiling with custom solc binary just fine but running into OpcodeNotFound errors. Working off this branch and if you want to reproduce you can run forge test --mt testSwapFailsWithTooLargeFee -vvv.

@mattsse Dug into it and solidity and revm are using different hex values. solidity vs revm. The spec is 0x5c/0x5d so I will talk to solc team!

EIP was updated here https://github.com/ethereum/EIPs/pull/7074

EIP was updated here ethereum/EIPs#7074

yep! chatting w/solc team.

any updates here? Is there anything @xBalbinus and i could look at to help get this thru more quickly?

I don't think it's natively supported by recent 0.8.23?
so still requires custom solidity branch

@laudiacay you can use https://github.com/hrkrshnn/tstore-template temporarily; the solc change will only make it to a proper release after the hardfork.

Friendly reminder. cancun is already added to solc @mattsse
https://github.com/ethereum/solidity/blob/develop/liblangutil/EVMVersion.h#L90C1-L90C41

This issue should be closed, 0.8.25 uses cancun by default
cc @DaniPopes / @mds1


need a warning/hint for using the same type parameter on both sides of a typedef

This is a common pitfall as people try to migrate typedefs to the new syntax:
typedef F<T> = void Function<T extends A>(T builder);

Note that it's using <T> on both sides. That's equivalent to:
typedef F<T1> = void Function<T2 extends A>(T2 builder);

It's almost certainly not what the user intended. It leads to a lot of confusion when they get type errors about generic function subtyping. The user's intent in this case was:
typedef F<T extends A> = void Function(T builder);

CC @leafpetersen -- thoughts on priority? I've seen a few folks trip over this. (We also may want to update other docs like the language tour to explain this feature.)

Also filed as a linter request here: https://github.com/dart-lang/linter/issues/1027 .  Not sure which is most appropriate.

I think it should be a lint. It isn't wrong to use the same name in both places (as in, the spec allows it), but some users will want the extra checking.


README file is misleading about requirements

I've seen a couple of these issues coming up already today.  People are trying to get the version of Alamofire that is Swift 3 ready.  So they are following the installation instructions in the README, which currently says to use v3.5, and they end up with a lot of build errors.  Part of the issue seems to be that earlier in the README, Swift 3.0+ is listed as a requirement.
It would probably help to note in the README that v3.5 is only supported up to Swift 2.3 to help with the confusion.

@WERUreo, we're updating the documentation now. Please stop commenting on various issues about it. We're fully aware that the documentation does not "exactly" reflect the current state of the unreleased master branch.

I apologize for seeming a bit overzealous.  I honestly wasn't trying to be difficult.  Obviously, all the contributors on Alamofire are doing fantastic work.  I didn't mean any offense to you or the other contributors.  I just wanted to try and help the community out.  Thank you for all the great work you do on Alamofire.

No worries @WERUreo...we've had a long past few days and have been updating docs tirelessly. Unfortunately you bore the brunt of my frustration of users jumping on master without understanding what the current state of it is. My apologies.


Results don't seem as good as the paper from a user.

I wasn't up for editing their demo to load safetensors to pick out a better finetune, so this is with the SD1.5 ckpt. I ran a couple other sets of these, and none seem to be as well composited together compared to the papers results. These all do have the refiner used on them, but the originals still have the same artifacts.

Hello, and thank you for showing interest in our work.
For instance generation involving parts or subparts, they are expected to be contained within the bounds of the instance box. Could you please ensure the part/subpart boxes are positioned within the instance box before generating again? It's been observed that placing subpart or part boxes in uncommon locations might compromise the quality of instance generation.
As for generating human images, the base model utilized in this repository, Stable Diffusion, faces challenges in this area. We believe that adopting a more sophisticated base model, one that's optimized/tuned for human generation, could significantly enhance outcomes.
Thank you!


Register highlights

Added registers like dil, sil, r10b etc

Have you contacted the maintainer of the file?

No response to comment, therefore closing.


NoSuchBeanDefinitionException: No qualifying bean of type 'org.springframework.core.env.ConfigurableEnvironment' available

Occasionally this error starts showing up in my console:
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'org.springframework.cloud.netflix.eureka.EurekaClientAutoConfiguration': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'org.springframework.core.env.ConfigurableEnvironment' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {}

Spring Boot 2.0.4
Spring Cloud 2.0.1

Duplicates #3140

How to solve it？

You must have not added @Service annotation.

I hava a same question.How to solve it?


Add track name when encoding MIDI

Each MIDI tack can have its own name, the change in this PR encodes the tack name if Track.name is present.

I had the same issue as Travis CI and was not able to make it run. Therefore, I used npm and adapt package.json, of course I did not include it in the commit.

I'm not sure what ES2015 features MIDIConvert uses, or which are in Node.  It's possible Babel can be completely removed from the CI flow.
If not, you can use the resolutions key in package.json to specify a version.

See also #42

Codecov Report

Merging #41 into master will increase coverage by 0.09%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master      #41      +/-   ##
==========================================
+ Coverage   82.79%   82.89%   +0.09%
==========================================
  Files          10       10
  Lines         343      345       +2
  Branches       61       62       +1
==========================================
+ Hits          284      286       +2
  Misses         59       59

Impacted Files
Coverage Δ

src/Midi.js
74.5% <100%> (+0.5%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6860638...cdcd72b. Read the comment docs.


OnFileActivityFinishedEvent not raised!

Hello Taliesin.
When i copied a folder in watchedFolder,sometimes OnFileActivityFinishedEvent raised,sometimes not!So i can't know when a folder was copiey completely.And i can't got this folder name from FinishedEventArgs.
Hope to solve it.Thanks.

I made a test. a static var fCount was defined, when  OnFileFinishedChanging Event raised,fCount ++.
The test result is:when files count == fCount, the  event was triggered completely.
and somtimes fCount is smaller than  the files count in the folder.
`        static void OnFileFinishedChangingEvent(object sender, FileFinishedChangingEventArgs e)
{
        lock (Lock)
        {
            Count = Count + 1;
            Console.WriteLine("OnFileFinishedChangingEvent:");
            Console.WriteLine("  FilePath = {0}", e.FilePath);
            Console.WriteLine("  ChangeType = {0}", Enum.GetName(typeof(FileEventType), e.ChangeType));
            Console.WriteLine(Count.ToString());
            Console.WriteLine();
        }
    }

`


AttributeError while parsing StructureSpecificData

Hi,
I downloaded xml file with data from Fusion Registry that we use in our company for development purposes. I tried to open it with read_sdmx function as follows:
from pandasdmx import read_sdmx
sdmx = read_sdmx('/home/wolkiewicz/fruit.xml')

What I've got was AttributeError, here is the traceback and some printed content:
2020-12-16 15:14:45,834 pandasdmx.reader.sdmxml - WARNING: sdmxml.Reader got no dsd=… argument for StructureSpecificData

--- SS without DSD ---
[True]

--- DataSetClass ---
[<class 'pandasdmx.model.StructureSpecificDataSet'>]

--- <class 'pandasdmx.message.DataMessage'> ---
[<pandasdmx.DataMessage>
  <Header>
    extracted: '2020-12-16T14:14:09'
    id: 'IREF280407'
    prepared: '2020-12-16T14:14:09+00:00'
    reporting_begin: '2017-01-01T00:00:00'
    reporting_end: '2019-01-01T00:00:00'
    receiver: <Agency ANONYMOUS>
    sender: <Agency GCC_STAT>
    source:
    test: False
  dataflow: <DataflowDefinition (missing id)>
  observation_dimension: <Dimension TIME_PERIOD>]

--- <class 'pandasdmx.model.DataStructureDefinition'> ---
[<DataStructureDefinition SDMX:FRUIT_RAW(1.0)>, <DataStructureDefinition SDMX:FRUIT_RAW(1.0)>]

--- SDMX_FRUIT_RAW_1_0 ---
[<DataStructureDefinition SDMX:FRUIT_RAW(1.0)>]

--- DataSet ---
[StructureSpecificDataSet(annotations=[], action=None, attrib=DictLike(), valid_from=None, structured_by=<DataStructureDefinition SDMX:FRUIT_RAW(1.0)>, obs=[], series=DictLike(), group=DictLike())]

<Obs xmlns:ss="http://www.sdmx.org/resources/sdmxml/schemas/v2_1/data/structurespecific" xmlns:footer="http://www.sdmx.org/resources/sdmxml/schemas/v2_1/message/footer" xmlns:ns1="urn:sdmx:org.sdmx.infomodel.datastructure.Dataflow=SDMX:FRUIT_RAW(1.0):ObsLevelDim:TIME_PERIOD" xmlns:message="http://www.sdmx.org/resources/sdmxml/schemas/v2_1/message" xmlns:common="http://www.sdmx.org/resources/sdmxml/schemas/v2_1/common" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" TIME_PERIOD="2017" OBS_VALUE="412"/>

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
~/.virtualenvs/etl/lib/python3.8/site-packages/pandasdmx/reader/sdmxml.py in read_message(self, source, dsd)
    243                     # Parse the element
--> 244                     result =    func(self, element)
    245                     self.push(result)

~/.virtualenvs/etl/lib/python3.8/site-packages/pandasdmx/reader/sdmxml.py in _obs_ss(reader, elem)
   1257     # Extend the DSD if the user failed to provide it
-> 1258     key = dsd.make_key(model.Key, attrib, extend=reader.peek("SS without DSD"))
   1259

AttributeError: 'NoneType' object has no attribute 'make_key'

The above exception was the direct cause of the following exception:

XMLParseError                             Traceback (most recent call last)
<ipython-input-6-e7dfa2011745> in <module>
----> 1 sdmx = read_sdmx('/home/wolkiewicz/fruit.xml')

~/.virtualenvs/etl/lib/python3.8/site-packages/pandasdmx/reader/__init__.py in read_sdmx(filename_or_obj, format, **kwargs)
    162         return reader().read_message(obj, dsd=dsd)
    163     else:
--> 164         return reader().read_message(obj)
    165

~/.virtualenvs/etl/lib/python3.8/site-packages/pandasdmx/reader/sdmxml.py in read_message(self, source, dsd)
    252             self._dump()
    253             print(etree.tostring(element, pretty_print=True).decode())
--> 254             raise XMLParseError from exc
    255
    256         # Parsing complete

XMLParseError: AttributeError: 'NoneType' object has no attribute 'make_key'

I attach the xml file. What I discovered is that when I change a common:StructureUsage tag into common:Structure than it works perfectly. So I am not sure if it is a problem with the file or with your library as I am not that familiar with SDMX format. Error message could be definitly more clear though.
Thank you for help in advance.
fruit.zip

I consider this as bug on the data source's side. A header of a DataMessage cannot contain a StructureUsage artifact. Your intuition to replace this with structure is correct. It is a reference to the DSD structuring the dataset.
Pleas re-open this as needed.

I consider this as bug on the data source's side. A header of a DataMessage cannot contain a StructureUsage artifact. Your intuition to replace this with structure is correct. It is a reference to the DSD structuring the dataset.
Pleas re-open this as needed.

Thank you for response. I contacted the developers of the data source and they disagreed with your point of view. They claim that the Structure tag can contain three types of tags based on reference type:

Structure tag for DataStructureReferenceType,
StructureUsage tag for DataflowReferenceType,
ProvisionAgreement tag for ProvisionAgreementReferenceType.

So i think that it is a bug on the library side as the DataflowReferenceType is not parsed correctly. I am not sure how the ProvisionAgreementReferenceType works as i did not test it.

Thank you for response. I contacted the developers of the data source and they disagreed with your point of view. They claim that the Structure tag can contain three types of tags based on reference type:

Structure tag for DataStructureReferenceType,
StructureUsage tag for DataflowReferenceType,
ProvisionAgreement tag for ProvisionAgreementReferenceType.

So i think that it is a bug on the library side as the DataflowReferenceType is not parsed correctly. I am not sure how the ProvisionAgreementReferenceType works as i did not test it.

Thanks. Your perseverance is much appreciated. I will look into this
asap. This needs to be fixed. My resources are very limited at the
moment though.
No need to say that a PR would be welcome.
Which data source did you contact? A link would be helpful.
On 07/01/2021, Kacper Wolkiewicz<EMAIL_ADDRESS>wrote:

Thank you for response. I contacted the developers of the data source and
they disagreed with your point of view. They claim that the Structure tag
can contain three types of tags based on reference type:

Structure tag for DataStructureReferenceType,
StructureUsage tag for DataflowReferenceType,
ProvisionAgreement tag for ProvisionAgreementReferenceType.

So i think that it is a bug on the library side as the DataflowReferenceType
is not parsed correctly. I am not sure how the
ProvisionAgreementReferenceType works as i did not test it.
--
You are receiving this because you modified the open/close state.
Reply to this email directly or view it on GitHub:
https://github.com/dr-leo/pandaSDMX/issues/197#issuecomment-756055958

Thanks. Your perseverance is much appreciated. I will look into this
asap. This needs to be fixed. My resources are very limited at the
moment though.
No need to say that a PR would be welcome.
Which data source did you contact? A link would be helpful.
On 07/01/2021, Kacper Wolkiewicz<EMAIL_ADDRESS>wrote:

Thank you for response. I contacted the developers of the data source and
they disagreed with your point of view. They claim that the Structure tag
can contain three types of tags based on reference type:

Structure tag for DataStructureReferenceType,
StructureUsage tag for DataflowReferenceType,
ProvisionAgreement tag for ProvisionAgreementReferenceType.

So i think that it is a bug on the library side as the DataflowReferenceType
is not parsed correctly. I am not sure how the
ProvisionAgreementReferenceType works as i did not test it.
--
You are receiving this because you modified the open/close state.
Reply to this email directly or view it on GitHub:
https://github.com/dr-leo/pandaSDMX/issues/197#issuecomment-756055958

We are using Fusion Registry version 10.5.10. You can find out more about it here:
https://metadatatechnology.com/software/FR10.php
To generate sdmx data file in FusionRegistry you need to click "Web service" > "Data" and the proper form with filters will show up. Unfortunately I cannot give you access to our data store now, but I hope the file that I provided will be enough. If you desperately need the access to data store, please contact me by the private message.
I would appreciate if you reopen the issue so it will not be lost in the closed ones. Github does not allow me to do it myself. Thanks for all your help and I hope the issue will be resolved soon.

We are using Fusion Registry version 10.5.10. You can find out more about it here:
https://metadatatechnology.com/software/FR10.php
To generate sdmx data file in FusionRegistry you need to click "Web service" > "Data" and the proper form with filters will show up. Unfortunately I cannot give you access to our data store now, but I hope the file that I provided will be enough. If you desperately need the access to data store, please contact me by the private message.
I would appreciate if you reopen the issue so it will not be lost in the closed ones. Github does not allow me to do it myself. Thanks for all your help and I hope the issue will be resolved soon.

Thanks. Access to further data won't be necessary. I'll see what I can do.

Thanks. Access to further data won't be necessary. I'll see what I can do.

The file does not validate against sdmxmlmessage.xsd. The error_log shows an error in the Structure element of the header. This error does not seem to be related to the AttributeError. Still, I recommend to ensure that the header complies with the XSD.
On a separate note, it is impossible to parse a structure-specific data message without providing a CSD. If you request the data from an agency, pandasdmx attempts to download the CSD on the fly, if not provided by the user. But read_sdmx cannot do this as it does not know which agency to connect to.
That said, pandasdmx should raise a more meaningful exception in such cases.
And it should properly parse a correct header, including all the structural metadata provided or referenced in the header.
Please let me know if this helps.

The file does not validate against sdmxmlmessage.xsd. The error_log shows an error in the Structure element of the header. This error does not seem to be related to the AttributeError. Still, I recommend to ensure that the header complies with the XSD.
On a separate note, it is impossible to parse a structure-specific data message without providing a CSD. If you request the data from an agency, pandasdmx attempts to download the CSD on the fly, if not provided by the user. But read_sdmx cannot do this as it does not know which agency to connect to.
That said, pandasdmx should raise a more meaningful exception in such cases.
And it should properly parse a correct header, including all the structural metadata provided or referenced in the header.
Please let me know if this helps.

I am afraid that I don't understand what do you mean. What is sdmxmlmessage.xsd? Is it an official xsd? Where I can get it from?
I also don't know what a CSD is. I would appreciate explanation.
Do I understand correctly that you suspect the data to be wrong? I am not sure how should I interpret your response.

I am afraid that I don't understand what do you mean. What is sdmxmlmessage.xsd? Is it an official xsd? Where I can get it from?
I also don't know what a CSD is. I would appreciate explanation.
Do I understand correctly that you suspect the data to be wrong? I am not sure how should I interpret your response.

Pls report if error persists in pandasdmx v1.8.0


Hostname - web - data packets

Hi,
How can I get UDP packets and addresses such as the hostname and so on for addresses that are important to me (the page I want to access)? I need the entire unpaired request.

Hi,
As far as I know there is no UDP communication in TWP. Only TCP. (HTTP/3 is not supported)

Hi,
Ok. Can I decompile the library and make modifications for my project?
Regards.

This library is opensource, no need to decompile that... You are here in GitHub, you can find the full source code here.


Open URL meta-field is being ignored

General information

Operating system + version: macOS 10.13.4

Browser + version: Chrome  66.0.3359.181

Information about the host app:

How did you install it?

Downloaded a pre-built binary

If installed an official release, put a version: 2.0.21

Information about the browser extension:

How did you install it?

Installed via webstore

Browserpass extension version as reported by your browser: 2.0.21

Exact steps to reproduce the problem

Create a multiline entry in pass with a Open Url meta field.

# example.com.gpg
password1
username: my-name
url: https://example.com/login

Invoke extension via keyboard shortcut (cmd+l in my case)
Find this entry
Tab, g

What should happen?
Browser should navigate to https://example.com/login
What happened instead?
Browser navigates to https://example.com

I cannot reproduce, my best guess is that an old binary is still alive somewhere on your system at takes over the new binary.
Check the manifest file in either /Library/Google/Chrome/NativeMessagingHosts or $HOME/Library/Application Support/Google/Chrome/NativeMessagingHosts, look to which browserpass binary it points. Then try to run that binary with -v and check the version.
Another test to do is to rename your file from example.com.gpg to example.gpg, my guess is that extension will complain on the absence of the url property in the file, possibly because of the old host app.

I found a file in $HOME/Library/Application Support/Google/Chrome/NativeMessagingHost

com.dannyvankooten.browserpass.json points to a binary that has the version: Browserpass host app version: 2.0.21

I see what's happening. The login URL I was using was actually redirecting me without me noticing! My bad.


[BUG]: Update matx ref for cmake build issues

Version
23.07
Which installation method(s) does this occur on?
Source
Describe the bug.
MatX has some fixes to correct cmake build issues:
https://github.com/NVIDIA/MatX/commit/72c276dc0eedde2744d9d91fd4fe5846a89e898a
It would be good to have that in this project's CPM configuration.
Minimum reproducible example
No response
Relevant log output
/opt/rapids/src/morpheus/.cache/cpm/matx/9fef206bea3cbd7530aaffb07d87b7b16cf97bad/include/matx/transforms/reduce.h(266): error: more than one conversion function from "__half" to a built-in type applies:
            function "__half::operator float() const" (declared at line 217 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator short() const" (declared at line 235 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator unsigned short() const" (declared at line 238 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator int() const" (declared at line 241 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator unsigned int() const" (declared at line 244 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator long long() const" (declared at line 247 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator unsigned long long() const" (declared at line 250 of /usr/local/cuda/include/cuda_fp16.hpp)
            function "__half::operator __nv_bool() const" (declared at line 254 of /usr/local/cuda/include/cuda_fp16.hpp)
    while (val > old.h[offset]) {
                 ^

/opt/rapids/src/morpheus/.cache/cpm/matx/9fef206bea3cbd7530aaffb07d87b7b16cf97bad/include/matx/transforms/reduce.h(687): error: no instance of overloaded function "atomicAdd" matches the argument list
            argument types are: (double *, double)
    atomicAdd(addrp, val.real());
    ^

/opt/rapids/src/morpheus/.cache/cpm/matx/9fef206bea3cbd7530aaffb07d87b7b16cf97bad/include/matx/transforms/reduce.h(688): error: no instance of overloaded function "atomicAdd" matches the argument list
            argument types are: (double *, double)
    atomicAdd(addrp + 1, val.imag());
    ^

4 errors detected in the compilation of "/opt/rapids/src/morpheus/morpheus/_lib/src/utilities/matx_util.cu".

Full env printout
No response
Other/Misc.
No response
Code of Conduct

[X] I agree to follow Morpheus' Code of Conduct
[X] I have searched the open bugs and have found no duplicates for this bug report

Hi @pdmack!
Thanks for submitting this issue - our team has been notified and we'll get back to you as soon as we can!
In the meantime, feel free to add any relevant information to this issue.


Zap support exclude urls

This uses the configuration's "global exclude list".
Note/Warning:

It deletes the list currently configured. By default, this list is not empty, using this option will remove the previously configured list. I am not aware of a method that appends to an existing configuration.
In non contained mode (flatpak, or direct-host), this affects the user's configuration.

Originally, I tried to use the context's "exclude Url", but somehow it didn't seem to work (requests were still being sent to URLs matching the regexp. I am not sure whether it's expected or a bug from ZAP)

I think using the global exclude list is an option we can use, unless it breaks anything.

Rewrote the fix.
Now uses the context's "exclude URLs", which seems to work and is much cleaner that using the global one (i.e.: no more deletion of the previous global excludes).
To exclude URLs:
general:
  urls:
    excludes:
      - "^https?://example.com/do-no-descend-here/.*$"
      - "^https?://example.com/dont-touch-that/.*$"

or, for a scanner specific excludes -

scanners:
  zap:
    urls:
      excludes:
        - "^https?://example.com/do-no-descend-here/.*$"
        - "^https?://example.com/dont-touch-that/.*$"

Let me know if it looks like a good place, or if it should be moved elsewhere.
Also updated pytests & config-template-long.yaml

Note:
The problem with adding it in the general configuration, is that it might create the expectation that future scanners will also support a "exclude URLs", while it might have no support for that, or it might not translate well to ZAP's exclude URL configuration.

The problem with adding it in the general configuration, is that it might create the expectation that future scanners will also support a "exclude URLs", while it might have no support for that

Why don't we add it to the zap now, and move it to general when necessary?  IMO General config should be really something that can be applied to any tools. If we had another type of tool which is not based on URLs, this option being here will cause an issue.

Modified the configuration template as well as the commit message to indicate that this is the preferred configuration statement:
scanners:
  zap:
    urls:
      excludes:
        - "^https?://example.com/do-no-descend-here/.*$"
        - "^https?://example.com/dont-touch-that/.*$"


Added support for dynamic IAT hash scanning for 64-bit hashes

Previously, when scanning for hashed dynamic imports we would check if the database is 32 or 64-bit, which could break hash resolution if the binary was 64-bit, but the hash was 32-bit (see OALabs/hashdb-ida#5).
To fix this issue I've added/removed/changed the following:

The plugin now has a new constant (HASHDB_ALGORITHM_SIZE) to keep track of the size of the hashing algorithm,
the hashdb_settings_t and hunt_result_form_t dialogues now show the size of the hashing algorithm in bits;

Removed code duplicates when setting the HASHDB_ALGORITHM to avoid errors in the future - set_algorithm contains all the necessary checks,
added a check for an edge-case where we would print an empty string in the output window if the API returned an empty string (see an example here) - this would break code generation (enums, etc.),
added a few TODOs regarding error handling and Python 3 syntax usage due to multiple uncertainties (@herrcore please resolve).

Unfortunately at the moment the plugin does a second API request when executing hunt_algorithm, as the API only responds with the algorithm's name (perhaps we can fix this) - we would also need the size and parse it using the added determine_algorithm_size helper function.
The plugin has been tested with the following samples (provided by @herrcore):

32-bit: 1, 2, 3
64-bit: 1, a private sample to test 64-bit hashes when scanning for a hashed IAT.

I'm also a bit concerned about the hash_scan ea increment being tied to the algorithm size... as I mentioned before it's very possible to have 32bit hashes stored in QWORDs.

I've modified the hash_scan function to do the following:

if ea is a defined (integer) type it will step/increase the ea with the size of the type,
if ea is not a defined type (the user manually undefined it, random data, etc.) it will:

read 1 byte and skip the the undefined value (convert_values == True, or
automatically format/convert the data to the HASHDB_ALGORITHM_SIZE integer equivalent (byte, word, dword, qword).

TODO: convert_values should be fetched from the UI (add a checkbox)


Date picker

What
Help users select a date using a calendar. Useful when knowing the day of the week is important.
Related
Date picker component | GOV.UK Design System discussion

I used VoiceOver on a MacBook to navigate (using a keyboard) the Boots appointment booking journey.
Findings:

It wasn’t possible to select a date or time for an appointment
You can tab onto the dates but you can’t select a date
You can’t tab onto and select a time
When I did select a date with my mouse, it didn’t alert me of what times (if any) were available. I would expect it to tell me how many appointments were available on that day and allow me to select a time if available.

https://github.com/nhsuk/nhs-app-design-styles-components-patterns/assets/14331000/a0dbff8d-c445-4db8-999a-96085aa9d86d

Date picker on booksy.com is also not accessible. You can't select a date or time using a keyboard.


Better Recolored Images

I saw your vault tour video and was instantly hooked on your page-blueprint class!
I love the way you managed to recolor images to fit the theme as well, but noticed this could use some improvement.
Your current recolor-images class only works for images like diagrams, where the background is transparent. If there is no transparency in the image, the entire image becomes a single color.
Proposed Solution
To fix this, we thus need a way to transform the brightness of an image to an opacity. We then need to merge the original alpha values of the image with this newly computed alpha mask (to retain the original transparency of the image). Finally, we can colorize the image.
flowchart LR
  A[IMAGE] --> B[LUMINANCE TO ALPHA]
  A --> C[COMPOSITE ALPHA]
  B --> C
  C --> D[COLORIZE]

One decision that is important in this pipeline, is whether you want white or black pixels to show fully drawn after the recolor operation.  This means we need to add an invert(1) operation before the pipeline.
CSS Implementation
This image pipeline is not trivial, but such a pipeline is possible with SVG filters:
<svg xmlns="http://www.w3.org/2000/svg">
  <filter id="luminance-to-alpha">
    <!-- STEP1: Convert luminance to alpha -->
    <!-- https://stackoverflow.com/a/596243 -->
    <feColorMatrix type="matrix" result="lumalpha" values="0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.213 0.715 0.072 0 0"/>

    <!-- STEP2: Multiply original alpha mask with luminance -->
    <feComposite in="SourceGraphic" in2="lumalpha" operator="arithmetic" k1="1" k2="0" k3="0" k4="0" />
  </filter>
</svg>

If this SVG is available somewhere in the HTML file, you can use this filter in the CSS.
Even better, you can embed this entire SVG string entirely in CSS:
img {
  --svg-luminance-alpha: url('data:image/svg+xml,<svg xmlns="http://www.w3.org/2000/svg"><filter id="f"><feColorMatrix type="matrix" result="lumalpha" values="0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.213 0.715 0.072 0 0"/><feComposite in="SourceGraphic" in2="lumalpha" operator="arithmetic" k1="1" /></filter></svg>#f');
  --image-effect: invert(52%) sepia(60%) saturate(2521%) hue-rotate(105deg) brightness(96%) contrast(84%);
  filter: invert(1) var(--svg-luminance-alpha) var(--image-effect);
}

A final "improvement" here is that I removed the first brightness(0) saturate(100%) steps of all of your --image-effect variables. The SVG pipeline already transforms the image to a pure black+alpha version and thus these 2 steps are not needed anymore.
You can find a little demo of this effect here.
In this demo you will see the need to composite the original alpha mask in the first example (jittered borders).
The other examples show the difference of the effect with and without invert(1). Some look better without the inversion, but all are legible with it so that's what I decided to use (see rationale above).

Excalidraw Integration
While I am fine with the inversion choice I made, there is one part where this does not work.
I use excalidraw and make my diagrams with white ink on a dark background in these files.
I thus added a specific CSS selector for my excalidraw drawings and changed the filter to var(--svg-luminance-alpha) var(--image-effect).
The CSS selector for your excalidraw embeds depends on the excalidraw setting: "Image type in markdown preview".
I have it set to "Native SVG". and thus my selector is simply svg {}.

Thanks for sharing your setup and inspiring me to make my notes nicer!
Feel free to do whatever you want with this effect and to discard this issue if it does not fit your needs.
I'll end this issue with a small example of the effect working on one of my notes. The original images are black/white without any transparency, but thanks to the SVG filter everything still looks awesome!

Example

This looks incredible!! Being able to recolor any image without the need for transparency is a massive game changer - I never knew the CSS was possible! Thank you so much for putting in all this effort, I'll try to get this implemented!

Quick note about the invert operator.
While you still need to pick whether you want white or black pixels opaque by default, I noticed you can use the alt property of images to toggle the behavior.
Here is the snippet of code I use:
:is(.page-white, .page-manila, .page-blueprint, .pen-white, .pen-gray, .pen-black, .pen-red, .pen-green, .pen-blue).recolor-img {
  --svg-composite-luminance: url('data:image/svg+xml,<svg xmlns="http://www.w3.org/2000/svg"><filter id="f"><feColorMatrix type="matrix" result="lumalpha" values="0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.213 0.715 0.072 0 0"/><feComposite in="SourceGraphic" in2="lumalpha" operator="arithmetic" k1="1" /></filter></svg>#f');

  img {
    filter: invert(1) var(--svg-composite-luminance) var(--image-effect);
  }
  img[alt*="invert"] {
    filter: var(--svg-composite-luminance) var(--image-effect);
  }

  /* Excalidraw Specific */
  .excalidraw-svg>svg {
    filter: var(--svg-composite-luminance) var(--image-effect);
  }
  .excalidraw-svg-invert>svg {
    filter: invert(1) var(--svg-composite-luminance) var(--image-effect);
  }
}

This allows me to have a default state (black pixels are opaque for images, white for SVGs), but invert the behavior by adding the "invert" word in the alt field:

# Regular mode
![[image.png]]
![[excalidraw drawing]]

# Inverted mode
![[image.png|invert]]
![[excalidraw drawing|invert]]

# Inverted with size options
![[image.png|invert|600]]
![[excalidraw drawing|invert|1000]]

Woah, I thought this couldn't get any better! Sorry for the delay in getting this implemented, it's still very much on my radar and I'll see about getting to this soon!

Wow this is amazing!!