Fix release build due to renamed LICENSE file [phab:D2189]

Created by schroederc at 2018-02-15 18:11:00:

salguarnieri accepted this revision at 2018-02-15 18:13:08

schroederc closed via commit c934b461e1814ba310422c53ab2487e0f674d23e at 2018-02-15 18:14:17


Using RITEway in an EcmaScript module environment?

I cannot get past errors in my attempts to use RITEway in an EcmaScript modules project (not CommonJS).
This demonstrates the problem:
https://github.com/StaticNoiseLog/riteway-with-esm
The line "type": "module", in package.json tells Node that these are EcmaScript modules.
The code in question is math.test.js.
First I tried the import syntax (that works for "Tape"):
import { describe } from 'riteway'
-> SyntaxError: Named export 'describe' not found.
Then the workaround suggested by Node:
import pkg from 'riteway'
const { describe } = pkg
-> TypeError: describe is not a function
I suspected that this might be because I use a style without semicolons. But adding semicolons everywhere did not help.
I am not really familiar with JavaScript and its ecosystem, but as far as I understand it should be possible to use CommonJS modules in EcmaScript modules.
I wonder why I cannot get this to work with RITEway.
Is it possible to use RITEway with EcmaScript modules without Babel or other tooling that I would like to avoid?
Would it make sense to publish RITEway as an EcmaScript module or is that not a good idea?

I'm also trying to use RITEway outside of a React and Babel context, with as little tooling/compilation as possible (I'm using it to write local tests for a Google Apps Script project).
I'm getting:
SyntaxError: Named export 'Try' not found when I try to import { Try } from 'riteway'.
But more importantly, I get:
import { describe } from 'riteway'
         ^^^^^^^^
SyntaxError: Named export 'describe' not found. The requested module 'riteway' is a CommonJS module, which may not support all module.exports as named exports.
CommonJS modules can always be imported via the default export, for example using:

import pkg from 'riteway';
const { describe } = pkg;

If I try the import suggestion mentioned in the end there, I get the TypeError: describe is not a function.
I also tried to make 'riteway' identify as an ES Module, by modifying the package.json of riteway to include "type": "module",. Since RITEway seems to be written using ES Modules internally, and it simply exports to CommonJS by using esm). But when I do that, then I get:
import { describe } from 'riteway'
         ^^^^^^^^
SyntaxError: The requested module 'riteway' does not provide an export named 'describe'

The problem here is that Node.js chose NOT to make ES6 module imports backwards-compatible with common.js the way that literally every compiler in the ecosystem chose to make them work. That decision has made it extremely difficult to upgrade packages built using those compilers to:

Continue working with those compilers with no breaking changes, and
Also work with Node's native ES6 module solution.

RITEway currently works fine with every major compiler. Compile your node code, and you can use RITEWay without issue.
But we have not yet found a solution to support Node's native ES6 module solution without breaking existing apps that rely on RITEway in their build step.
We are open to a pull request if you can get it working without breaking changes.

Maybe we can fix this with --experimental-specifier-resolution=node?

If I install OP’s project, I’m seeing in node_modules/riteway/source/index.js:
require = require('esm')(module);
module.exports = require('./riteway.js');

esm simulates ES modules via the CommonJS infrastructure. It looks like it breaks interop with ESM: If I log what’s exported in the second line, I get an empty object.
I’m not surprised – ESM changes a lot of things internally and I’ve heard a few stories of it causing issues.
On the plus side – given that riteway already uses esm – it should be easy to switch to real ESM. Or riteway switches to real CommonJS; then you should also be able to import it from ESM.

Proof that the switch to ESM should be relatively easy: I could get the code to work by only changing two things.
First, change the import in riteway-with-esm/math.test.js:
import { describe } from 'riteway/source/riteway.js'

Second, add this line to riteway/package.json:
"type": "module",

@rauschma Thank you very much for taking the time to look into this, but I don't think these suggested fixes will work for us.
Convert to real CommonJS is a Breaking Change
Named imports from real CommonJS modules are not supported in ESM modules. Instead, you have to import like:
import riteway from 'riteway';
const { describe } = riteway;

This would not be a terribly big deal except that it will break thousands of build pipelines. 👎
Convert to ESM
Importing EJS in CommonJS is even more problematic. This would break all the CommonJS build pipelines.
Is there any way to export both from one package, or should we deprecate this package and create a new ESM native package?

Named imports from real CommonJS modules are not supported in ESM modules.

You have to use the right syntax: https://2ality.com/2022/10/commonjs-named-exports.html

Is there any way to export both from one package

Yes, that’s possible. Do a web search for “hybrid esm commonjs package”.

Yes, that’s possible. Do a web search for “hybrid esm commonjs package”. The key is to get the package exports right. I haven’t done this myself, though – all my packages are either CommonJS or ESM, never both.

Yeah, I've done this dance before. I can't find an option that won't break existing build pipelines. It looks like we're stuck deprecating this package and creating a new one.

Maybe:

Copy riteway/source/ to riteway/esm/
Add riteway/esm/package.json with only one property:{
  "type": "module"
}

ESM entry point in "exports" of riteway/package.json is riteway/esm/riteway.js

I’m not sure if that works, but it should.
I have also seen people maintain both CommonJS and ESM but the latter was a major version upgrade. Their reasoning: same package, but a breaking change.

@rauschma Thanks! I think this is the best path forward. Those who want to use it in a native ESM environment can import from riteway/esm/. I've released an RC for you guys to test. Please let me know if it works.
This is now available using npm install --save-dev riteway@latest.

Wouldn’t it have to be riteway/esm/index.js (ESM doesn’t support directory imports)?
You could use package exports to change that to riteway or ``riteway/esm`.

Yeah, I'd like to mirror the import instructions for the existing packages, so all you need to do to use the esm is insert esm/. The imports are actually riteway/esm/riteway.js, riteway/esm/match.js, etc. If I understand it correctly the spec actually requires the .js extensions, right?

Ah, OK, makes sense!

@rauschma Thank you again for your help. It's really appreciated. 🙏

Should be fixed in<EMAIL_ADDRESS>


Add Absorb trait bound on PCCommitment

Summary
Using the PCS in a wider context will require absorbing the commitment for Fiat Shamir.
The current challenge is that Absorb is not implemented for AffineRepr, and the current pairing-based schemes in this repo have commitments of the form:
pub struct Commitment<E: Pairing>(
    /// The commitment is a group element.
    pub E::G1Affine,
);

We unfortunately can't add a blanket impl like:
impl<T> Absorb for T
where
    T: AffineRepr,
{
    fn to_sponge_bytes(&self, dest: &mut Vec<u8>) {
        todo!()
    }

    fn to_sponge_field_elements<F: PrimeField>(&self, dest: &mut Vec<F>) {
        todo!()
    }
}

Rust complains "conflicting implementations of trait absorb::Absorb for type u8".
Option 1
We could add Absorb on AffineRepr in the ec crate. However, aside from creating a cyclic dependency from ec to crypto-primitives, I think this is not the best design.
Option 2
One solution is to further restrict G: AffineRepr + Absorb. This propagates into a lot of trait bounds in the poly-commit repo, though. The upside is that it doesn't require any upstream changes, and the two current implementors of AffineRepr which are the structs short_weierstrass::Affine and twisted_edwards::Affine already have Absorb implemented.
Option 3
Larger breaking refactor that makes use of the fact that most pairing computations (and certainly our implementations in ec::models) only ever support SW. The proposal is then to rip out the associated type G1Affine from Pairing, and restrict the class of pairings that can be done to SW-curves, so that we can have:
pub struct Commitment<P: SWCurveConfig>(
    /// The commitment is a group element.
    pub Affine<P>,
);

This almost works, as we still have IPA Commitment struct here in poly-commit which uses the trait AffineRepr (i.e. not an associated type from Pairing):
pub struct Commitment<G: AffineRepr> {
    /// A Pedersen commitment to the polynomial.
    pub comm: G,
    ...
}

And so mixing in Option 2 would need to happen anyway, but limited to one PCS.
Option 4
Any other ideas?

Hm I don't quite see the problem. Presumably, we want PCCommitment: Absorb only because we want to use PC generically, right?
If so, then the only place the P::G1Affine: Absorb requirement will appear is in

impl PCCommitment for Commitment<P>, and
impl PolyCommit for KZG/IPA/etc

Does it appear anywhere else?

@Pratyush see https://github.com/arkworks-rs/poly-commit/pull/144

can i take on this ?


Bytes request payload

Summary
This PR introduces functionality for request payload to be bytes. This is especially useful when sending requests for inference from applications which work with signal processing, i.e. vision or audio.
Example
in preprocessing.py, the body can be converted to an image with:
img = Image.open(io.BytesIO(body)).convert("RGB")
and later inference can be done with sending requests similar to:
curl --request POST \
  --url '<serving>/serve/<endpoint>?=<version>' \
  --header 'Content-Type: image/png' \
  --data '<bytes>'

Test Plan

Build the docker image for serving, as per README
Create model preprocessing which expects bytes and converts them to the underlying data structure (ex. Image)
Send request

Thanks @Aleksandar1932
Looks good to me, let's just add a quick example, wdyt?
from typing import Any

import numpy as np
from PIL import Image, ImageOps

from clearml import StorageManager

# Notice Preprocess class Must be named "Preprocess"
class Preprocess(object):
    def __init__(self):
        # set internal state, this will be called only once. (i.e. not per request)
        pass

    def preprocess(self, body: bytes, state: dict, collect_custom_statistics_fn=None) -> Any:
        # we expect to get a stream of encoded image bytes
        try:
            img = Image.open(io.BytesIO(body)).convert("RGB")
        except Exception:
            raise ValueError("Image could not be decoded")

        image = ImageOps.grayscale(image).resize((28, 28))
        return np.array([np.array(image).flatten()])

    def postprocess(self, data: Any, state: dict, collect_custom_statistics_fn=None) -> dict:
        # post process the data returned from the model inference engine
        # data is the return value from model.predict we will put is inside a return value as Y
        if not isinstance(data, np.ndarray):
            # this should not happen
            return dict(digit=-1)

        # data is returned as probability per class (10 class/digits)
        return dict(digit=int(data.flatten().argmax()))

Thanks @Aleksandar1932 Looks good to me, let's just add a quick example, wdyt?
from typing import Any

import numpy as np
from PIL import Image, ImageOps

from clearml import StorageManager

# Notice Preprocess class Must be named "Preprocess"
class Preprocess(object):
    def __init__(self):
        # set internal state, this will be called only once. (i.e. not per request)
        pass

    def preprocess(self, body: bytes, state: dict, collect_custom_statistics_fn=None) -> Any:
        # we expect to get a stream of encoded image bytes
        try:
            img = Image.open(io.BytesIO(body)).convert("RGB")
        except Exception:
            raise ValueError("Image could not be decoded")

        image = ImageOps.grayscale(image).resize((28, 28))
        return np.array([np.array(image).flatten()])

    def postprocess(self, data: Any, state: dict, collect_custom_statistics_fn=None) -> dict:
        # post process the data returned from the model inference engine
        # data is the return value from model.predict we will put is inside a return value as Y
        if not isinstance(data, np.ndarray):
            # this should not happen
            return dict(digit=-1)

        # data is returned as probability per class (10 class/digits)
        return dict(digit=int(data.flatten().argmax()))

I agree this would be very useful. Extended the current MNIST examples to cover this use case.


0.21 errors + not setting UPnP redirects

The Issue
See below for log. I don't see the UPnP mappings being created, and the TCP port is not open according to canyouseeme.org. Also don't see anything trying to to tear them down on shutdown.
2018-08-06 09:19:44,405 INFO     lbrynet.daemon.DaemonControl:84: Starting lbrynet-daemon from command line
2018-08-06 09:19:45,246 INFO     lbrynet.daemon.auth.factory:36: Using non-authenticated API
2018-08-06 09:19:45,247 INFO     lbrynet.daemon.auth.server:223: lbrynet API listening on TCP localhost:5279
2018-08-06 09:19:45,247 INFO     lbrynet.daemon.Daemon:235: Starting lbrynet-daemon
2018-08-06 09:19:45,332 INFO     lbrynet.daemon.Daemon:236: Platform: {"lbrynet_version": "0.21.0rc4", "platform": "Windows-10-10.0.15063", "os_system": "Windows", "python_version": "2.7.15", "os_release": "10", "lbryum_version": "3.2.3", "ip": "<IP_ADDRESS>", "lbryschema_version": "0.0.16", "processor": "Intel64 Family 6 Model 60 Stepping 3, GenuineIntel", "build": "rc"}
2018-08-06 09:19:45,480 INFO     lbrynet.daemon.Components:127: Loading databases
2018-08-06 09:19:45,482 INFO     lbrynet.database.storage:174: connecting to database: c:\lbrynew\lbrynet.sqlite
2018-08-06 09:19:45,482 INFO     lbrynet.daemon.ExchangeRateManager:217: Starting exchange rate manager
2018-08-06 09:19:45,513 INFO     lbrynet.core.RateLimiter:72: Starting rate limiter.
2018-08-06 09:19:45,746 INFO     lbrynet.daemon.Components:258: lbryumx2.lbry.io:50001 height: 415450, local height: 415450
2018-08-06 09:19:46,513 INFO     lbrynet.daemon.Components:681: set up redirects using txupnp
2018-08-06 09:19:46,515-upnp.py:32->upnp is not available: no devices found
2018-08-06 09:19:46,515 WARNING  txupnp.upnp:32: upnp is not available: no devices found
2018-08-06 09:19:46,515-upnp.py:32->upnp is not available: no devices found
2018-08-06 09:19:46,515 WARNING  txupnp.upnp:32: upnp is not available: no devices found
2018-08-06 09:19:46,632 INFO     lbrynet.dht.protocol:202: DHT listening on UDP <IP_ADDRESS>:4444
2018-08-06 09:19:46,634 INFO     lbrynet.daemon.Components:411: Started the dht
2018-08-06 09:19:46,634 INFO     lbrynet.core.Wallet:92: Starting wallet.
2018-08-06 09:19:46,744 INFO     lbrynet.core.Wallet:880: Loading the wallet
2018-08-06 09:19:48,836 WARNING  lbrynet.core.Wallet:963: Your wallet is excessively large (3052 addresses), please follow instructions here: https://github.com/lbryio/lbry/issues/437 to reduce your wallet size
Unhandled error in Deferred:
2018-08-06 09:19:48,846 CRITICAL twisted:154: Unhandled error in Deferred:

2018-08-06 09:19:48,846 CRITICAL twisted:154:
Traceback (most recent call last):
  File "site-packages\twisted\internet\defer.py", line 1297, in _inlineCallbacks
  File "site-packages\twisted\python\failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages\txupnp\upnp.py", line 159, in get_next_mapping
  File "site-packages\twisted\python\threadpool.py", line 246, in inContext
  File "site-packages\twisted\python\threadpool.py", line 262, in <lambda>
  File "site-packages\twisted\python\context.py", line 118, in callWithContext
  File "site-packages\twisted\python\context.py", line 81, in callWithContext
TypeError: argument 3 must be string, not int
Unhandled error in Deferred:
2018-08-06 09:19:48,848 CRITICAL twisted:154: Unhandled error in Deferred:

2018-08-06 09:19:48,848 CRITICAL twisted:154:
Traceback (most recent call last):
  File "site-packages\twisted\internet\defer.py", line 1297, in _inlineCallbacks
  File "site-packages\twisted\python\failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages\txupnp\upnp.py", line 159, in get_next_mapping
  File "site-packages\twisted\python\threadpool.py", line 246, in inContext
  File "site-packages\twisted\python\threadpool.py", line 262, in <lambda>
  File "site-packages\twisted\python\context.py", line 118, in callWithContext
  File "site-packages\twisted\python\context.py", line 81, in callWithContext
TypeError: argument 3 must be string, not int
2018-08-06 09:19:48,878 INFO     lbrynet.dht.node:249: Attempting to join the DHT network, 0 contacts known so far
2018-08-06 09:19:52,700 INFO     lbrynet.core.Wallet:978: Local Height: 415450, remote height: 415450, behind: 0
2018-08-06 09:19:52,700 INFO     lbrynet.core.Wallet:986: Wallet Loaded
2018-08-06 09:19:52,700 INFO     lbrynet.core.Wallet:903: Subscribing to addresses
2018-08-06 09:19:52,901 INFO     lbrynet.core.Wallet:905: Synchronized wallet
2018-08-06 09:19:52,907 INFO     lbrynet.core.Wallet:907: Set up lbryum command runner
2018-08-06 09:19:52,924 ERROR    lbrynet.daemon.Component:62: Error setting up peer_protocol_server
Traceback (most recent call last):
  File "site-packages\lbrynet\daemon\Component.py", line 56, in _setup
KeyError: 'TCP'
Unhandled error in Deferred:
2018-08-06 09:19:52,934 CRITICAL twisted:154: Unhandled error in Deferred:

2018-08-06 09:19:52,934 CRITICAL twisted:154:
Traceback (most recent call last):
  File "site-packages\twisted\internet\defer.py", line 1297, in _inlineCallbacks
  File "site-packages\twisted\python\failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages\lbrynet\daemon\Component.py", line 63, in _setup
KeyError: 'TCP'
2018-08-06 09:19:52,936 INFO     lbrynet.daemon.Components:549: Starting the file manager
2018-08-06 09:19:52,940 INFO     lbrynet.file_manager.EncryptedFileManager:125: Starting 5 files
2018-08-06 09:19:52,940 INFO     lbrynet.file_manager.EncryptedFileManager:130: Started 5 lbry files
2018-08-06 09:19:52,940 INFO     lbrynet.file_manager.EncryptedFileManager:49: Started file manager
2018-08-06 09:19:52,940 INFO     lbrynet.daemon.Components:553: Done setting up file manager
2018-08-06 09:19:52,940 INFO     lbrynet.daemon.Daemon:238: Started lbrynet-daemon
2018-08-06 09:19:58,479 INFO     lbrynet.dht.node:249: Attempting to join the DHT network, 8 contacts known so far
2018-08-06 09:20:07,823 INFO     lbrynet.dht.node:249: Attempting to join the DHT network, 13 contacts known so far
2018-08-06 09:20:17,171 INFO     lbrynet.daemon.Components:410: Joined the dht
2018-08-06 09:23:50,413 INFO     lbrynet.file_manager.EncryptedFileManager:151: Stopping 5 lbry files
2018-08-06 09:23:50,414 INFO     lbrynet.file_manager.EncryptedFileManager:255: Stopped encrypted file manager
2018-08-06 09:23:50,414 INFO     lbrynet.core.Wallet:104: Stopping wallet.
2018-08-06 09:23:50,483 INFO     lbrynet.core.Wallet:932: Stopped wallet
2018-08-06 09:23:50,484 INFO     lbrynet.core.Wallet:935: Stopped connection to lbryum server
2018-08-06 09:23:50,484 INFO     lbrynet.dht.protocol:493: Stopping DHT
2018-08-06 09:23:50,484 INFO     lbrynet.dht.protocol:496: DHT stopped
2018-08-06 09:23:50,691 INFO     lbrynet.daemon.ExchangeRateManager:222: Stopping exchange rate manager
2018-08-06 09:23:50,693 INFO     lbrynet.core.RateLimiter:83: Stopping rate limiter.

System Configuration

LBRY Daemon version:
LBRY App version:
LBRY Installation ID:
Operating system:

Anything Else

Screenshots

Not sure how that happened, this is a duplicate of: https://github.com/lbryio/lbry/issues/1341


DOC: add deprecation message to index_update and friends

Fixes #8064
Preview the new docs here: https://jax--8065.org.readthedocs.build/en/8065/_autosummary/jax.ops.index_update.html#jax.ops.index_update

This looks good.
There is one further step we probably should do. The index_mul etc docs have an additional and necessary paragraph:
"
Unlike the NumPy code x[idx] *= y, if multiple indices refer to the same location the updates will be multiplied. (NumPy would only apply the last update, rather than multiplying the updates.) The order in which conflicting updates are applied is implementation-defined and may be nondeterministic (e.g., due to concurrency on some hardware platforms).
"
We should probaby add that to the .at[...] documentation, suitably modified.

This looks good.
There is one further step we probably should do. The index_mul etc docs have an additional and necessary paragraph:
" Unlike the NumPy code x[idx] *= y, if multiple indices refer to the same location the updates will be multiplied. (NumPy would only apply the last update, rather than multiplying the updates.) The order in which conflicting updates are applied is implementation-defined and may be nondeterministic (e.g., due to concurrency on some hardware platforms). "
We should probaby add that to the .at[...] documentation, suitably modified.

There is also some useful parameter documentation on those functions that needs to be transferred. Maybe for a future PR, though.

Added the extra paragraph, as well as a TODO to document additional keyword arguments.


WIP Refactor responsibilities out of WebGLPreview

This is a POC for splitting the codebase into smaller classes

oh! this is a great improvement! A very neat and straightforward reorg. Very happy to see this direction 🙌🏻

Another thing that could be split off is all the preview settings (colors, min/max layer etc).

Good idea!!
I'm using that branch as a POC, and opened a draft PR to facilitate visualization and conversations.
I'll split in smaller PRs when we're happy about some individual changes and confident about them

And another idea might be to split line rendering and tube rendering into separate rendering classes.... ?

Of course! That's the next step!

What do we want with this PR? It's part clean up and part parser redesign. And it has a lot of conflicts. May I propose to close this one?

Yes, let's close. The other PR is in a better state.


Quantity.__format__() can sometimes produce wrong results

What happened?
The main issue seems to be that we are doing the calculation about which exponent to use based on the base_value, but then when we convert the base_value to string, the float string conversion does some rounding, that could change how many significant digits we end up with.
For example: if base_value for power is<PHONE_NUMBER>988388, then we consider it is smaller than the next possible exponent (1kW) so we use just the base unit (W), but when doing str(base_value), this number ends up displayed as "1000", so we return "1000 W" when we should have returned "1 kW". This specific case is now resolved, but there are other that prevent, in particular, for this invariant to always be true: Power.from_string(str(power)) == power.
What did you expect instead?
Power.from_string(str(power)) == power always.
Affected version(s)
No response
Affected part(s)
Core components (data structures, etc.) (part:core)
Extra information
The current implementation to handle these weird corner cases is quite complex, and it doesn't seem to be handling all of them. An, less efficient, alternative would be to just do a string round-trip before calculating what's the most appropriate exponent to use, so convert to string, convert again to float, and only then check which exponent is more appropriate, then convert again to string.

Thinking more about this, the test is wrong. We can't possibly always ensure that Power.from_string(str(power)) == power  is true if we are rounding, this doesn't work for float either:
>>> f = 0.1001
>>> f"{f:.3}"
'0.1'
>>> f = 0.1001
>>> f"{f:.3}"
'0.1'
>>> f2 = float(f"{f:.3}")
>>> f == f2
False

So maybe @Marenz it would be useful if you can mention any cases you find that are currently failing, and also we might need to fix the tests.

the comparison is more whether the produced string is the same, not the base value

I didn't get that.

What did you expect instead?
Power.from_string(str(power)) == power always.

str(Power.from_string(str(power))) == str(power)

Mmmmm, I see, still I can see how that might be flaky if Power.from_string(str(power)) == power doesn't hold. But maybe it is still safe...


feat: support RETURNING clause

Resolves #138

Can you please add a test? 🙏🏼

@ginnwork the RETURNING clause is specific to Postgres, can you make this non-generic so it only applies to the applicable dialect(s) and can be overridden as needed?


Use XML-style closing tag for explicitly stated self-closing tags in HTML as well

Fixes jadejs/jade#2082.

Would it make more sense just to always include the /?  For performance, it's negligible and it would simplify things?

@ForbesLindesay Do you mean that we should add a slash for regular HTML5 tags as well? I'd argue that the output is cleaner if we do not do that.

@ForbesLindesay ping.

Yes, that is what I meant, but I don't have a strong opinion on this.


[MM-50534] - Consume modified API for getting license renewal/expand status

Summary
We need to make 2 checks about the self-serve license, is it renewable and are the seats expandable. Instead of having different endpoints to make these 2 checks, on the self-serve portal, there's now one endpoint that can help give information about whether the license is renewable and expandable. Any new information about the self-serve status of a subscription or license can easily be added to this endpoint without need to create a new one.
The changes in this PR make it such that the modified endpoint is used.
Ticket Link
https://mattermost.atlassian.net/browse/MM-50534
Related Pull Requests
https://github.com/mattermost/mattermost-server/pull/22350
https://github.com/mattermost/enterprise/pull/1384
https://github.com/mattermost/customer-web-server/pull/1116
Release Note
NONE

E2E tests not automatically triggered, because PR has no approval yet. Please ask a developer to review and then try again to attach the QA label.

You don't have permissions to trigger this command.
It's only available for organization members.

/e2e-test

Successfully triggered E2E testing!
GitLab pipeline | Test dashboard

Error trying doing the automated Cherry picking. Please do this manually
fatal: No such remote 'upstream'

+++ Returning you to the master branch and cleaning up.

Cherry pick is scheduled.

@AGMETEOR Please open cherry-picks PRs to the release-7.9 branch for the webapp/enterprise/server PRs.


Interactive Storybook with Branching Paths✨

I've added a new project named Interactive Storybook with Branching Paths.
issue no. : #1689
https://github.com/user-attachments/assets/04bf64fe-a8a3-4cda-afc9-4b8f4f86557c

@shriyadindi resolve the conflict

@iamrahulmahato Resolved the conflict!

@shriyadindi not solved

@iamrahulmahato Resolved the conflict!
Please do add the gssoc, hacktoberfest and the level badge.


[DLP] Implementation of computing K Anonymity With EntityId

Implementation of computing K Anonymity With EntityId.
Checklist

[X] I have followed Sample Format Guide
[ ] pom.xml parent set to latest shared-configuration
[ ] Appropriate changes to README are included in PR
[ ] These samples need a new API enabled in testing projects to pass (let us know which ones)
[ ] These samples need a new/updated env vars in testing projects set to pass (let us know which ones)
[X] Tests pass:   mvn clean verify required
[X] Lint  passes: mvn -P lint checkstyle:check required
[ ] Static Analysis:  mvn -P lint clean compile pmd:cpd-check spotbugs:check advisory only
[ ] This sample adds a new sample directory, and I updated the CODEOWNERS file with the codeowners for this sample
[ ] This sample adds a new Product API, and I updated the Blunderbuss issue/PR auto-assigner with the codeowners for this sample
[X] Please merge this PR for me once it is approved

LGTM. Just one minor comment.

Done


Reactoring of reminder implementation

closes #107

The test coverage cannot be improved in this ticket --> see #96


Can you add support for typescript 5.x.x

Can you append || ^5 to this line:
https://github.com/facebook/create-react-app/blob/dd420a6d25d037decd7b81175626dfca817437ff/packages/react-scripts/package.json#L88 And make sure it all keeps working of course.

Somewhat boring, this package is no longer really maintained ... but good idea, actually I can't update typescript to 5.x :(

you can use this workaround until meta/facebook didn't fix this.


Git Hub Actions Build/Test Failure: non-caching, aarch64

$ make clean
$ ./config --banner=Configured --debug enable-asan enable-ubsan no-cached-fetch no-fips no-dtls no-tls1 no-tls1-method no-tls1_1 no-tls1_1-method no-async
$ make -j$(nproc)

1. Build Issue:
/root/openssl/crypto/aes/bsaes-armv8.S:993:(.text+0xdd4): relocation truncated to fit: R_AARCH64_CONDBR19 against symbol `AES_cbc_encrypt' defined in .text section in libcrypto.a(libcrypto-lib-aes_cbc.o)

The following appears to solve the issue:
 crypto/aes/asm/bsaes-armv8.pl | 4 ----
 1 file changed, 4 deletions(-)

diff --git a/crypto/aes/asm/bsaes-armv8.pl b/crypto/aes/asm/bsaes-armv8.pl
index 1d1e886f0329..b3058e38faea 100644
--- a/crypto/aes/asm/bsaes-armv8.pl
+++ b/crypto/aes/asm/bsaes-armv8.pl
@@ -1019,13 +1019,9 @@ sub data
 //   No output registers, usual AAPCS64 register preservation
 ossl_bsaes_cbc_encrypt:
         cmp     x2, #128
-#ifdef __APPLE__
         bhs     .Lcbc_do_bsaes
         b       AES_cbc_encrypt
 .Lcbc_do_bsaes:
-#else
-        blo     AES_cbc_encrypt
-#endif

         // it is up to the caller to make sure we are called with enc == 0

after which:
2. Runtime test issue:
$ make test HARNESS_JOBS=4 OPENSSL_TEST_RAND_ORDER=0 TESTS="-test_fuzz* -test_ssl_* -test_sslapi -test_evp -test_cmp_http -test_verify -test_cms -test_store -test_enc -[01][0-9]" |& head -n100
make depend && make _tests
...
Result: NOTESTS
20-test_cli_fips.t .............. skipped: Test only supported in a fips build with security checks
30-test_acvp.t .................. skipped: ACVP is not supported by this test

crypto/armcap.c:373:10: runtime error: left shift of 255 by 24 places cannot be represented in type 'int'
../../util/wrap.pl ../../apps/openssl => 1
not ok 1 - Run openssl app with no args
# ------------------------------------------------------------------------------70-test_bad_dtls.t .............. skipped: DTLSv1 is not supported by this OpenSSL build

not ok 1 - Running 'openssl enc -list'
# ------------------------------------------------------------------------------
crypto/armcap.c:373:10: runtime error: left shift of 255 by 24 places cannot be represented in type 'int'
...

The following appears to solve the issue:
---
 crypto/arm_arch.h | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/crypto/arm_arch.h b/crypto/arm_arch.h
index 5d8788877f7f..be6e193aff03 100644
--- a/crypto/arm_arch.h
+++ b/crypto/arm_arch.h
@@ -109,7 +109,7 @@ extern unsigned int OPENSSL_armv8_rsa_neonized;
            (((midr) & MIDR_PARTNUM_MASK) >> MIDR_PARTNUM_SHIFT)

 # define MIDR_IMPLEMENTER_SHIFT   24
-# define MIDR_IMPLEMENTER_MASK    (0xff << MIDR_IMPLEMENTER_SHIFT)
+# define MIDR_IMPLEMENTER_MASK    (0xffL << MIDR_IMPLEMENTER_SHIFT)
 # define MIDR_IMPLEMENTER(midr)   \
            (((midr) & MIDR_IMPLEMENTER_MASK) >> MIDR_IMPLEMENTER_SHIFT)

++ make test HARNESS_JOBS=4 OPENSSL_TEST_RAND_ORDER=0 'TESTS=-test_fuzz* -test_ssl_* -test_sslapi -test_evp -test_cmp_http -test_verify -test_cms -test_store -test_enc -[01][0-9]'
make depend && make _tests
make[1]: Entering directory '/root/openssl'
make[1]: Leaving directory '/root/openssl'
make[1]: Entering directory '/root/openssl'
( SRCTOP=. \
  BLDTOP=. \
  PERL="/usr/bin/perl" \
  FIPSKEY="f4556650ac31d35461610bac4ed81b1a181b2d8a43ea2854cbae22ca74560813" \
  EXE_EXT= \
  /usr/bin/perl ./test/run_tests.pl -test_fuzz* -test_ssl_* -test_sslapi -test_evp -test_cmp_http -test_verify -test_cms -test_store -test_enc -[01][0-9] )
Using HARNESS_JOBS=4
00-prep_fipsmodule_cnf.t .. skipped: FIPS module config file only supported in a fips build
Files=1, Tests=0,  1 wallclock secs ( 0.01 usr  0.02 sys +  0.17 cusr  0.01 csys =  0.21 CPU)
Result: NOTESTS
20-test_cli_fips.t .............. skipped: Test only supported in a fips build with security checks
30-test_acvp.t .................. skipped: ACVP is not supported by this test
70-test_bad_dtls.t .............. skipped: DTLSv1 is not supported by this OpenSSL build
70-test_sslversions.t ........... skipped: test_sslversions needs TLS1.3, TLS1.2 and TLS1.1 enabled
75-test_quicapi.t ............... skipped: QUIC protocol is not supported by this OpenSSL build
80-test_dtls.t .................. skipped: No DTLS protocols are supported by this OpenSSL build
80-test_dtls_mtu.t .............. skipped: test_dtls_mtu needs DTLS and PSK support enabled
82-test_tfo_cli.t ............... skipped: test_tfo_cli needs tfo enabled
90-test_async.t ................. skipped: async is not supported by this OpenSSL build
90-test_fipsload.t .............. skipped: Test is disabled with disabled fips
90-test_shlibload.t ............. skipped: Test is disabled in an address sanitizer build
99-test_ecstress.t .............. ok
95-test_external_gost_engine.t .. skipped: No external tests in this configuration
95-test_external_krb5.t ......... skipped: No external tests in this configuration
95-test_external_oqsprovider.t .. skipped: No external tests in this configuration
95-test_external_pyca.t ......... skipped: No external tests in this configuration
95-test_external_tlsfuzzer.t .... skipped: No external tests in this configuration
30-test_defltfips.t ............. ok
30-test_aesgcm.t ................ ok
...

More info
$ git log -1 # build vs commit:
commit 98b183d3c65e56b0f21f4e77b2cd3d2aa62374f2 (HEAD -> master, upstream/master)
Author: Dr. David von Oheimb<EMAIL_ADDRESS>Date:   Thu Jul 14 17:11:22 2022 +0200

$ cat /etc/os-release
NAME="Fedora Linux"
VERSION="36 (Thirty Six)"
$ uname -a
Linux fubar 5.18.11-200.fc36.aarch64 #1 SMP PREEMPT_DYNAMIC Tue Jul 12 22:35:02 UTC 2022 aarch64 aarch64 aarch64 GNU/Linux
$ rpm -qi gcc glibc | grep -P '^(Name|Version|Release|Source RPM|Arch)'
Name        : gcc
Version     : 12.1.1
Release     : 1.fc36
Architecture: aarch64
Source RPM  : gcc-12.1.1-1.fc36.src.rpm
Name        : glibc
Version     : 2.35
Release     : 14.fc36
Architecture: aarch64
Source RPM  : glibc-2.35-14.fc36.src.rpm
$ cat /proc/cpuinfo
processor       : 0
BogoMIPS        : 50.00
Features        : fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp ssbs
CPU implementer : 0x41
CPU architecture: 8
CPU variant     : 0x3
CPU part        : 0xd0c
CPU revision    : 1
...

Config dump
$ perl configdata.pm --dump
Command line (with current working directory = .):

    /usr/bin/perl ./Configure --banner=Configured --debug enable-asan enable-ubsan no-cached-fetch no-fips no-dtls no-tls1 no-tls1-method no-tls1_1 no-tls1_1-method no-async

Perl information:

    /usr/bin/perl
    5.34.1 for aarch64-linux-thread-multi

Enabled features:

    afalgeng
    aria
    asan
    asm
    autoalginit
    autoerrinit
    autoload-config
    bf
    blake2
    bulk
    camellia
    capieng
    cast
    chacha
    cmac
    cmp
    cms
    comp
    ct
    deprecated
    des
    dgram
    dh
    dsa
    dso
    dynamic-engine
    ec
    ec2m
    ecdh
    ecdsa
    engine
    err
    filenames
    gost
    idea
    legacy
    loadereng
    makedepend
    md4
    mdc2
    module
    multiblock
    nextprotoneg
    ocb
    ocsp
    padlockeng
    pic
    pinshared
    poly1305
    posix-io
    psk
    rc2
    rc4
    rdrand
    rfc3779
    rmd160
    scrypt
    secure-memory
    seed
    shared
    siphash
    siv
    sm2
    sm3
    sm4
    sock
    srp
    srtp
    sse2
    ssl
    ssl-trace
    static-engine
    stdio
    tests
    threads
    tls
    ts
    ubsan
    ui-console
    whirlpool
    tls1_2
    tls1_2-method
    tls1_3
    dtls1-method
    dtls1_2-method
Disabled features:

    acvp-tests          [cascade]               OPENSSL_NO_ACVP_TESTS
    async               [option]                OPENSSL_NO_ASYNC
    buildtest-c++       [default]
    cached-fetch        [option]                OPENSSL_NO_CACHED_FETCH
    crypto-mdebug       [default]               OPENSSL_NO_CRYPTO_MDEBUG
    devcryptoeng        [default]               OPENSSL_NO_DEVCRYPTOENG
    dtls                [option(dtls)]          OPENSSL_NO_DTLS
    ec_nistp_64_gcc_128 [default]               OPENSSL_NO_EC_NISTP_64_GCC_128
    egd                 [default]               OPENSSL_NO_EGD
    external-tests      [default]               OPENSSL_NO_EXTERNAL_TESTS
    fips                [option]
    fips-securitychecks [cascade]               OPENSSL_NO_FIPS_SECURITYCHECKS
    fuzz-afl            [default]               OPENSSL_NO_FUZZ_AFL
    fuzz-libfuzzer      [default]               OPENSSL_NO_FUZZ_LIBFUZZER
    ktls                [default]               OPENSSL_NO_KTLS
    md2                 [default]               OPENSSL_NO_MD2 (skip crypto/md2)
    msan                [default]               OPENSSL_NO_MSAN
    quic                [default]               OPENSSL_NO_QUIC
    rc5                 [default]               OPENSSL_NO_RC5 (skip crypto/rc5)
    sctp                [default]               OPENSSL_NO_SCTP
    tfo                 [default]               OPENSSL_NO_TFO
    trace               [default]               OPENSSL_NO_TRACE
    unit-test           [default]               OPENSSL_NO_UNIT_TEST
    uplink              [no uplink_arch]        OPENSSL_NO_UPLINK
    weak-ssl-ciphers    [default]               OPENSSL_NO_WEAK_SSL_CIPHERS
    zlib                [default]
    zlib-dynamic        [default]
    ssl3                [default]               OPENSSL_NO_SSL3
    ssl3-method         [default]               OPENSSL_NO_SSL3_METHOD
    tls1                [option(tls1-method)]   OPENSSL_NO_TLS1
    tls1-method         [option]                OPENSSL_NO_TLS1_METHOD
    tls1_1              [option(tls1_1-method)] OPENSSL_NO_TLS1_1
    tls1_1-method       [option]                OPENSSL_NO_TLS1_1_METHOD
    dtls1               [option(dtls)]          OPENSSL_NO_DTLS1
    dtls1_2             [option(dtls)]          OPENSSL_NO_DTLS1_2

Config target attributes:

    AR => "ar",
    ARFLAGS => "qc",
    CC => "gcc",
    CFLAGS => "-Wall -O0 -g",
    CXX => "g++",
    CXXFLAGS => "-Wall -O0 -g",
    HASHBANGPERL => "/usr/bin/env perl",
    RANLIB => "ranlib",
    RC => "windres",
    asm_arch => "aarch64",
    bn_ops => "SIXTY_FOUR_BIT_LONG RC4_CHAR",
    build_file => "Makefile",
    build_scheme => [ "unified", "unix" ],
    cflags => "-pthread",
    cppflags => "",
    cxxflags => "-std=c++11 -pthread",
    defines => [ "OPENSSL_BUILDING_OPENSSL" ],
    disable => [  ],
    dso_ldflags => "",
    dso_scheme => "dlfcn",
    enable => [ "afalgeng" ],
    ex_libs => "-ldl -pthread",
    includes => [  ],
    lflags => "",
    lib_cflags => "",
    lib_cppflags => "-DOPENSSL_USE_NODELETE",
    lib_defines => [  ],
    module_cflags => "-fPIC",
    module_cxxflags => undef,
    module_ldflags => "-Wl,-znodelete -shared -Wl,-Bsymbolic",
    perl_platform => "Unix",
    perlasm_scheme => "linux64",
    shared_cflag => "-fPIC",
    shared_defflag => "-Wl,--version-script=",
    shared_defines => [  ],
    shared_ldflag => "-Wl,-znodelete -shared -Wl,-Bsymbolic",
    shared_rcflag => "",
    shared_sonameflag => "-Wl,-soname=",
    shared_target => "linux-shared",
    thread_defines => [  ],
    thread_scheme => "pthreads",
    unistd => "<unistd.h>",

Recorded environment:

    AR =
    ARFLAGS =
    AS =
    ASFLAGS =
    BUILDFILE =
    CC =
    CFLAGS =
    CPP =
    CPPDEFINES =
    CPPFLAGS =
    CPPINCLUDES =
    CROSS_COMPILE =
    CXX =
    CXXFLAGS =
    HASHBANGPERL =
    LD =
    LDFLAGS =
    LDLIBS =
    MT =
    MTFLAGS =
    OPENSSL_LOCAL_CONFIG_DIR =
    PERL =
    RANLIB =
    RC =
    RCFLAGS =
    RM =
    WINDRES =
    __CNF_CFLAGS =
    __CNF_CPPDEFINES =
    __CNF_CPPFLAGS =
    __CNF_CPPINCLUDES =
    __CNF_CXXFLAGS =
    __CNF_LDFLAGS =
    __CNF_LDLIBS =

Makevars:

    AR              = ar
    ARFLAGS         = qc
    CC              = gcc
    CFLAGS          = -Wall -O0 -g
    CPPDEFINES      =
    CPPFLAGS        =
    CPPINCLUDES     =
    CXX             = g++
    CXXFLAGS        = -Wall -O0 -g
    HASHBANGPERL    = /usr/bin/env perl
    LDFLAGS         =
    LDLIBS          =
    PERL            = /usr/bin/perl
    RANLIB          = ranlib
    RC              = windres
    RCFLAGS         =

NOTE: These variables only represent the configuration view.  The build file
template may have processed these variables further, please have a look at the
build file for more exact data:
    Makefile

build file:

    Makefile

build file templates:

    Configurations/common0.tmpl
    Configurations/unix-Makefile.tmpl

I think the correct fix for crypto/arm_arch.h is as follows. I'll raise a PR for this (needs to go through internal review).
diff --git a/crypto/arm_arch.h b/crypto/arm_arch.h
index 5d8788877f..be6e193aff 100644
--- a/crypto/arm_arch.h
+++ b/crypto/arm_arch.h
@@ -109,7 +109,7 @@ extern unsigned int OPENSSL_armv8_rsa_neonized;
            (((midr) & MIDR_PARTNUM_MASK) >> MIDR_PARTNUM_SHIFT)

 # define MIDR_IMPLEMENTER_SHIFT   24
-# define MIDR_IMPLEMENTER_MASK    (0xff << MIDR_IMPLEMENTER_SHIFT)
+# define MIDR_IMPLEMENTER_MASK    (0xffU << MIDR_IMPLEMENTER_SHIFT)
 # define MIDR_IMPLEMENTER(midr)   \
            (((midr) & MIDR_IMPLEMENTER_MASK) >> MIDR_IMPLEMENTER_SHIFT)

And for crypto/aes/asm/bsaes-armv8.pl we only need the change when the sanitizers are used, because the problem is due to them increasing the distance the conditional jump needs to go.
diff --git a/crypto/aes/asm/bsaes-armv8.pl b/crypto/aes/asm/bsaes-armv8.pl
index 1d1e886f03..13d02a3d8e 100644
--- a/crypto/aes/asm/bsaes-armv8.pl
+++ b/crypto/aes/asm/bsaes-armv8.pl
@@ -1019,7 +1019,9 @@ _bsaes_key_convert:
 //   No output registers, usual AAPCS64 register preservation
 ossl_bsaes_cbc_encrypt:
         cmp     x2, #128
-#ifdef __APPLE__
+// On Darwin builds, conditional branch requires assembler-local label, but _AES_cbc_encrypt is external
+// On builds with Clang sanitizer, _AES_cbc_encrypt is too far away for a conditional branch
+#if defined(__APPLE__) || (defined(_FORTIFY_SOURCE) && _FORTIFY_SOURCE == 0)
         bhs     .Lcbc_do_bsaes
         b       AES_cbc_encrypt
 .Lcbc_do_bsaes:

@ckalina Can you try with those two patches, to check they solve your problem?

@tom-cosgrove-arm Thanks for the feedback. Both of the patches solve the encountered problem.
-# define MIDR_IMPLEMENTER_MASK    (0xff << MIDR_IMPLEMENTER_SHIFT)
+# define MIDR_IMPLEMENTER_MASK    (0xffU << MIDR_IMPLEMENTER_SHIFT)

You're right. This was my original solution, but for some reason I have since changed the post.
Should I close the issue, or will this be handled after the internal review? Thanks!

Keep the issue open - when the PR gets merged the issue can be closed.
This way if anyone else encounters the problem in the meantime they can have a solution

The u was my first thought too :)
I think it's the better solution.


docs: add GPU installation tips

@Leongrim @sebastianJaeger have a look if this works on WSL. Note that you need WSL 2, but it should be fairly easy (and highly recommended) to upgrade to that if you have Windows Build 19041 (see how to check build and WSL install instructions). I recommend removing your old WSL distros first.


Reduce direct dependencies on database libraries

Currently, denali-node-orm2 depends on 4 or 5 database modules directly (they are the ones supported by node-orm2). Because most apps using this addon will only use 1, the requirement of installing all 5 of them is unnecessary and results in extraneous dependencies.
However, it might be confusing to users if they don't know that their app must explicitly depend on whatever database module they need, so we should do two things to make this as easy to understand as possible.

[ ] Write documentation saying that you must install the database module you need as a direct dependency of your app (and that it will not be automatically installed for you)
[ ] The orm2-connect initializer should be updated to check that the configured database module is installed, and error out with a sane error message if it's not.

After a bit more research, this unfortunately isn't possible. Node's require resolution won't go up past the root folder of this adapter, so even if we could ensure that the module was installed alongside this adapter, orm would still fail to connect b/c of the missing database dependency.

@acburdine are you sure about that? My reading of the Modules docs for Node is that Node will walk all the way up to the filesystem root looking for a node module.

Hmm...I guess I could have been trolled by the fact that I had denali-node-orm2 linked locally. I'll test by pushing a built branch and see what I can figure out


POST to /posts/ not authenticated but still creating object

I'm getting to the create function in /posts/ without being authenticated which is causing issues

Occurs for put as well


Add releases to github through tags and upload to PyPi through twine

The idea is to expand releasing grants tagger through make deploy (a better name is probable release) to create a release in Github and PyPi.
To release in Github we use GitHub tags and to release in PyPi we use twine

 Create and document releases

Btw the username and password I have for PyPi seem to not be correct. Can you send me the ones you use @aCampello? I assume we changed them at some point and I did not update them


Cannot specify multiple ignores in ptconfig.toml

It looks like it's impossible to specify multiple ignores in the global configuration, ~/.ptconfig.toml
A single value works:
  ignore = "node_modules"

  % pt
  ...
  --ignore=             Ignore files/directories matching pattern (default: [node_modules])

This ignores the ignores completely:
  ignore = "third_party"
  ignore = "node_modules"

  % pt
  ...
  --ignore=             Ignore files/directories matching pattern

And this ignores the ignores completely in a different way, notice the double-list:
  ignore = ["third_party", "node_modules"]

  % pt
  ...
  --ignore=             Ignore files/directories matching pattern (default: [[third-party node_modules]])

(v1.7.9 under archlinux, built from aur)

Thanks for reporting.
ptconfig use conflag, and support multiple parameters now.
So, conflag can specify list by the following.
ignore = ["third_party", "node_modules"]

If you use the_platinum_searcher by go get, you can update conflag. (go get github.com/monochromegane/conflag) and re-build pt.
If you use homebrew or binary, I will release new version in December. Please wait :^)

Terrific, it works as a charm!


unable to deploy the code with azd deploy

Please provide us with the following information:

This issue is for a: (mark with an x)
- [ x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Tried to deploy the code via azd deploy command . however, the output.tar.gz file is not as expected and throwing error
does azd deploy command takes care of both building the code and deploying it to the apps service ?

Any log messages given by the failure

Expected/desired behavior

Deploying service backend (Running build process)
Deploying service backend (Running build process)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Starting runtime process, 1 in progress instances, 0 successful instances)
Deploying service backend (Fetching endpoints for app service)
(✓) Done: Deploying service backend

Endpoint: https://app-backend-auecacdaps01.azurewebsites.net/

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)
Linux

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

does azd deploy command takes care of both building the code and deploying it to the apps service ?

No, the azd deploy command only handles deploying the code to the App Service. To build the code and deploy it, you should use the azd up command.

I might have encountered the same issue. Scaling up the App service helped (backend).

@bnodir ; we have restriction to use openai azure instance . and azd up command throws an error because of this policy so we are trying to point to the existing openai service rather than creating a new one via azd up and manually deployed app service as we were not able to continue our deployment via azd up . is there any script that handle only the code build and deploy part.

@bnodir the document states
Deploying again
If you've only changed the backend/frontend code in the app folder, then you don't need to re-provision the Azure resources. You can just run:
if this is the case , shouldnt azd deploy take care of application code build and deploy ?

@svenfeld Thank you soo much i can try this out
am currently using apps service plan  (B1: 1) . can you please let me know what level of scaling done to work this out .

@achu152
P0v3 did the job for me.

@achu152 P0v3 did the job for me.

its not working here, tried out

@bnodir ; we have restriction to use openai azure instance . and azd up command throws an error because of this policy so we are trying to point to the existing openai service rather than creating a new one via azd up and manually deployed app service as we were not able to continue our deployment via azd up . is there any script that handle only the application code backend and frontend app build and deploy part only.

I see your case now. Could you try to check the local build then?
cd .\app
.\start.ps1

will this work when we have to deploy to a external system?

I haven’t done this myself, so I’m not familiar with all the steps. You might find helpful information in this GitHub repository.
Another option could be to try Azure Container Apps. I haven’t used it myself either, but the steps are detailed in this document. You may need to deploy containers manually due to your policy requirements.

The ACA deployment is really nice and fast! I hope to default to it in the future, as its so much faster than App Service deployment, but we're waiting for it to have all the same features as App Service (private endpoints, e.g.)
Definitely try out ACA. Great tip @bnodir

*If you're switching from appservice to ACA, you likely need to delete your App Service/Plan first, so that azd doesnt get confused figuring out which backend to deploy to.


Help in diagnosing MessageHandler not being called

Hi,
I have a solution where I have a business project (where commands, queries and messages exist, Mediator.Abstractions linked), and an api project (where I have Mediator linked).
Commands/queries are working perfect. but not messages. Message handlers are not being called and I don't have any clues about why.
Is there any place where the source generator puts the generated files, so I can check if at least there are any information about my handlers? Or, is there any way I can diagnose this?
Thanks in advance.

See the attached screenshot, you can see the generated code in Visual Studio. I recommend use of the later versions of Visual Studio 2022 as there has been some good improvements in terms of source generators lately.

Do you have some sample code I can look at? Are you talking about pipeline behaviors? In that case there is some sample code you can look at that might help you: https://github.com/martinothamar/Mediator/blob/f32f1ed89f7460ce31b3df6d10b463e4242658ec/samples/SimpleConsole/Program.cs

Ok, found the issue. I was using the method Publish<>, but I was obtaining the message from a list of <INotification>, so the DI was never picking up the handler. Had to cast each entry as (object) so the code now correctly calls Publish(object) instead of Publish<INotification>(INotification).
Thanks anyways for taking your time to answer.

Ahh, thanks for reporting this 👍  I've fixed the generic publish method so that it can do the casting for us as well. It's part of the 2.0 preview (along with some other upcoming changes)

Ah, excelent... thank you for this great project!


Add disclaimer

Hey,
I'm an engineer at JustWatch, and we are getting support requests from people using unofficial libraries or tools using unofficial APIs. We only have an API for official partners. Could you please add some disclaimer at the beginning of the README making it clear that this is an unofficial project?
Thank you!

sure @dewey


Make transition width to mobile smaller

Instead of 796 pixels, we will transition at 650

@DoctorAtom7 - A simple fix, for when you have the time. This calendar changes to a mobile view at 796 pixels, and the new standard is 650. It should be as simple as searching the project for the first number and replacing it with the second


Resolve syncing conflicts from repo_sync_working_branch to master

Pull request opened by Docs to resolve syncing conflicts from repo_sync_working_branch to master.

@huypub : Thanks for your contribution! The author, @zchia, has been notified to review your proposed change.

@ktoliver : Thanks for your contribution! The author, @zchia, has been notified to review your proposed change.


Rewrite user guide in the documentation

A complete rewrite is needed before the next minor release of the project.

Fixed and released.


onItemSwitch callback function load only once after start

This function must be callback for "item switched"?
How can I hook something like "on slide" event?

find in https://github.com/drien/jquery-flipster/issues/104


[Bugfix] Check prompt length < max_model_len for all models in AsyncLLMEngine

Currently, for text-only models, if submitting a request > max_model_len through the AsyncLLMEngine, will trigger an assert failure:
  File "vllm/core/scheduler.py", line 1176, in _schedule
    return self._schedule_chunked_prefill()
  File "vllm/core/scheduler.py", line 1112, in _schedule_chunked_prefill
    running_scheduled = self._schedule_running(budget,
  File "vllm/core/scheduler.py", line 541, in _schedule_running
    assert len(self._async_stopped) == 0
AssertionError

There is already a prompt length check for multi-modal models in AsyncLLMEngine so we just expand that to all models.

It appears that some tests exceed that max_model_len. At least this shows that the PR is working.


GitHub has completely changed its structure

A reader of the Academy has reported that the lesson where we scrape GitHub's pagination doesn't work at all, because GitHub's HTML is now completely different.

Fixed by https://github.com/apify/apify-docs/pull/1108


any plan to support the packages on https://pub.dev/

Yes. Closing as duplicate of https://github.com/ethanblake4/dart_eval/issues/21


To show the signed and the latest DA version to the user -- only two is needed

To show the signed and the latest DA version to the user -- only two is needed

@kashishmalik Requires a wireframe to proceed. Therefore moving it to 'No Version' card.

[ ] The wireframe shall be similar to android and iOS.
[ ] The "bell" icon shall appear next to the usage purpose title and the rest of the workflow is same as in android and iOS


gtk-pipe-viewer: 0.4.8 -> 0.4.9

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/trizen/pipe-viewer/releases.
meta.description for gtk-pipe-viewer is: CLI+GUI YouTube Client
meta.homepage for gtk-pipe-viewer is: https://github.com/trizen/pipe-viewer
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.4.9 with grep in /nix/store/a2k5abx0wpwyvplmxx50cgljj3rcz0zm-perl5.38.2-pipe-viewer-0.4.9
found 0.4.9 in filename of file in /nix/store/a2k5abx0wpwyvplmxx50cgljj3rcz0zm-perl5.38.2-pipe-viewer-0.4.9

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath
gtk-pipe-viewer
pipe-viewer

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/a2k5abx0wpwyvplmxx50cgljj3rcz0zm-perl5.38.2-pipe-viewer-0.4.9 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A gtk-pipe-viewer https://github.com/r-ryantm/nixpkgs/archive/ab297f4e293046bc17d67135e8f5c361312de54f.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/ab297f4e293046bc17d67135e8f5c361312de54f#gtk-pipe-viewer

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/a2k5abx0wpwyvplmxx50cgljj3rcz0zm-perl5.38.2-pipe-viewer-0.4.9
ls -la /nix/store/a2k5abx0wpwyvplmxx50cgljj3rcz0zm-perl5.38.2-pipe-viewer-0.4.9/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

2 packages built:

gtk-pipe-viewer
pipe-viewer

Maintainer pings
cc @ju1m for testing.

Result of nixpkgs-review pr 279292 run on aarch64-darwin 1

4 packages built:

gtk-pipe-viewer
gtk-pipe-viewer.devdoc
pipe-viewer
pipe-viewer.devdoc


Option to disable hardware acceleration

It seems that all UWP applications use hardware acceleration by default, I do not appreciate this. I'm not sure why a calculator application would require hardware acceleration.

This is your friendly Microsoft Issue Bot. I've seen this issue come in and have gone to tell a human about it.

I'm not sure that this issue is a trolling or not... Every single GPU do rendering much-much more faster than CPU. And also they are much more power-efficient in that job. Remember: they are a lot of users with notebooks, tablets, phones (even after how MS messed up the whole WP platform several times).
I'm not sure what would be the benefit of disabling HW acceleration. It's like going back to the stone age.

UWP as a platform uses Hardware Acceleration to render the UI - Calculator also makes use of Acrylic for the window background, and this also uses the GPU

@mdtauk is spot on.

The Visual layer provides a high performance, retained-mode API for graphics, effects and animations, and is the foundation for all UI across Windows devices. You define your UI in a declarative manner and the Visual layer relies on graphics hardware acceleration to ensure your content, effects and animations are rendered in a smooth, glitch-free manner independent of the app's UI thread (source).


Coral dev board doesn't recognize ttyUSB devices

I've been trying to establish a serial connection with several USB devices using the unique USB port that the board has. The connection with Arduino boards was successful, but I've tried with 1) a cellular modem and 2) and FTDI and they are not assigned a ttyUSB port.
I realized the Arduino driver assigns and ttyACM port, which in fact, when I connect my laptop to the Coral dev board via USB (OTG port) uses the same driver as Arduino (cdc_acm).
Now, when I connect either a FTDI chip or the U-Blox cellular modem and using  the ´usb-devices´ command, I realized it lists ´Driver=(None)´. For the case of the U-Blox cellular modem, which uses 4 different drivers, all of them are ´None´.
It presents a critical situation in terms of peripheral capabilities and doesn't help too much to integrate external devices, sensors, or communication interfaces to the Coral dev board, which is absolutely unfortunate and useless.
Is there any way to install the drivers externally or definitively there is no way to work with those devices?
Thanks for your answer. I hope this limitation will be overcome.

Hi, let's keep communication here: https://github.com/google-coral/edgetpu/issues/128


'getsockopt' isn't found in syscall on FreeBSD

The code that looks like this:
import (
        "errors"
        "net"
        "syscall"
        "unsafe"
)
...skipped...
        if err := getsockopt(fd, syscall.IPPROTO_IP, SO_ORIGINAL_DST, uintptr(unsafe.Pointer(&raw)), uintptr(unsafe.Pointer(&siz))); err != nil {
                return nil, err
        }

fails:
# github.com/Dreamacro/clash/proxy/redir
proxy/redir/tcp_freebsd.go:41:12: undefined: getsockopt

getsockopt is supposed to be found in syscall.
go-1.11

I think there is some confusion here. You are calling a private function. Can you show us a complete minimal code which reproduces this ? Your current version is a redacted snippet.

getsockopt is supposed to be found in syscall.

You say it is supposed to be in syscall, but you are not using the syscall library. Please show us the full code.
Are you looking for syscall.Syscall6 using syscall.SYS_GETSOCKOPT ?


You can not use CSS variables loaded from a style sheet can not be used in components.

 Even if styles are not 'scoped', the properties will print as "var(varName)" rather than their value as assigned by the loaded stylesheet.
example:
https://github.com/KyleTryon/vidfire/blob/master/components/vfHeader.vue
This component uses variables defined in a sheet loaded in the config. At this URL you can see that the header is not loading the values listed below.
url: http://localhost:3000/blog/ArticleExample

<style>
    .vfHeader{
        color: var(--color-white);
        background-color: var(--color-main);
    }
. . .

I'm experiencing the same issue. I have a global file (app.sass) with general styles, and it imports some variables (vars.sass). If I want to use those variables in a component (component.vue) I have to import them again. Otherwise, the build task will fail  Undefined variable: " $font-small".
// styles/vars.sass
 $font-small: 8px;

// styles/app.sass
@import './vars.scss';

body {
font-size: $font-small;
}

// nuxt.config.js
css: ['./assets/styles/app.scss'],

// component.vue
<style lang="scss">
@import '~styles/vars.scss'; // If this is not imported the variable is not available.

.div1 {
 font-size: $font-small;
}

I just started using nuxt, and maybe I'm missing something. But I was expecting that the variables would be available globally. They were imported in the app.sass, and that file is injected globally in nuxt.config.js.

https://github.com/nuxt/nuxt.js/issues/1092

I'm having this issue with CSS Variables and PostCSS w/ cssnext as well (I'm not using sass for this project). I might be missing something, but I've tried multiple ways of importing the variables including loading in a style sheet in the Nuxt config file and defining the vars in the :root selector in the default layout file.
Anyone had any luck with this?

I think this is intended behavior, even though it seems a little cumbersome to import the same vars every time. Components should always be explicit about inheriting anything (styles/props, etc). This allows for maximum flexibility inside the component (in the case of styles, if you wanted to use a different vars file, or even a different pre-processor).
I like to use a _settings.scss file that includes all vars, mixins, and any other tools that won't output css. That keeps things somewhat simple.

Same problem for me, tried to pull in vuetify, i referenced the css in the config file but none of the variables are loaded in

I could fix the variables by using nuxt-sass-resources-loader, as described in here: https://github.com/nuxt/nuxt.js/issues/1092#issuecomment-336693839


[BUG] : Timeout exception in WaitForSelectorAsync() when timeout is specified

Context:

Playwright Version: [V1.14.1]
Operating System: [Windows]
Node.js version: [v14.16.1]
Browser: [e.g. All, Chromium, Firefox, WebKit]
Extra: [any specific details about your environment]

Code Snippet
protected async Task<IElementHandle> GetElementAsync()
        {
            return await Frame.WaitForSelectorAsync(Selector, new FrameWaitForSelectorOptions { State = WaitForSelectorState.Attached });
        }

        protected async Task<IElementHandle> GetElementWithoutWaitAsync()
        {
            return await Frame.WaitForSelectorAsync(Selector, new FrameWaitForSelectorOptions { State = WaitForSelectorState.Attached, Timeout = 2 });
        }

Describe the bug
GetElementAsync() method is returning the element whereas the GetElementWithoutWaitAsync() with a timeout is returning Timeout exception eventhough the element is present in page.

very similar situation for me –
1) tests/register_and_confirm_and_test.spec.js:11:1 › basic test =================================

    Timeout of 30000ms exceeded.

    Pending operations:
      - page.waitForSelector at tests/register_and_confirm_and_test.spec.js:96:33

    page.waitForSelector: Target closed
    =========================== logs ===========================
    waiting for selector "text=..." to be visible
    ============================================================

      94 |   console.log("waiting for the confirmation of the email...");
      95 |   page1.setDefaultTimeout(240000);
    > 96 |   const emailLink = await page1.waitForSelector(
         |                                 ^
      97 |     "text=...",
      98 |     { timeout: 240000 }
      99 |   );


Removed nightly openj9 testing

Removed nightly openj9 testing while we do not have fresh nightly/EA builds
Fixes: #119
Signed-off-by: Abhijeet Jejurkar<EMAIL_ADDRESS>

Check failures are unrelated to this PR (raised https://github.com/adoptium/TKG/issues/304 for it).

thanks @abhijeetjejurkar !

Welcome, Looking forward to contribute more :)


Too many levels of symbolic links

sudo: edit-chroot: command not found

Please describe your issue:
I am installing on my external sdcard, and when it tries to run prepare.sh, it spits out this error:
chroot: failed to run command '/prepare.sh': Too many levels of symbolic links
Failed to complete chroot setup.
Unmounting /media/removable/chromebook/crouton/chroots/focal...

Closing because there is a similar post

@WebManageBotOFFICIAL,
Check the permissions & mount options on your external media.
By default I think they have the following mount options:

(rw,nosuid,nodev,noexec,relatime,nosymfollow,dirsync,seclabel)

You'll have to remount it and allow both 'exec' & 'symfollow', at a minimum.
Similar to below, I'm showing /dev/sda1 and  /media/removable/STATE as an example:

sudo mount -i -o remount,exec,symfollow /media/removable/STATE

Hope this helps,
-DennisLfromGA


[Question]: How to save and load knowledge graph.

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
Hi
Can anyone help me to find the solution for saving the knowledge graph  create from KnowledgeGraphIndex.
Thanks

But, I don't sure this code below is correct or not for download knowledge. Because the result when I generate, it not relative with my document.
`llm_predictor = LLMPredictor(llm=LangChainLLM(llm = load_llm()))
embed_model = LangchainEmbedding(HuggingFaceEmbeddings(
model_name = "sentence-transformers/all-MiniLM-L6-v2",
model_kwargs = {'device': 'cuda'}))
service_context = ServiceContext.from_defaults(
llm_predictor=llm_predictor,
chunk_size=1000,
embed_model = embed_model)
storage_context_graph = StorageContext.from_defaults(persist_dir="index_folder")
kg_index = load_index_from_storage(storage_context = storage_context_graph, service_context = service_context)`

That is indeed the correct way to load an index
What's the exact issue you are facing? Is there a difference in behavior before and after saving/loading?

I have an idea to integrate knowledge graph with vector index for receive the better URL link referent. However, at the moment I need save and load the knowledge graph because it too large of data, But I am encountering issues where the results knowledge graph not match with my information in documents and provide incorrect information., and sometimes I receive empty results when the Knowledge graph. This my code below :
def load_llm():
    n_gpu_layers = 32
    n_batch = 512
    callback_manager = CallbackManager([StreamingStdOutCallbackHandler()])
    llm = LlamaCpp(
        model_path="/home/sira/sira_project/meta-Llama2/llama-2-7b-chat.ggmlv3.q8_0.bin",
        callback_manager=callback_manager,
        n_gpu_layers=n_gpu_layers,
        n_batch=n_batch,
        verbose=True,
        n_ctx = 4096,
        temperature = 0.1,
        max_tokens = 4096
    )
    return llm
llm_predictor = LLMPredictor(llm=LangChainLLM(llm = load_llm()))
embed_model = LangchainEmbedding(HuggingFaceEmbeddings(
        model_name = "sentence-transformers/all-MiniLM-L6-v2",
        model_kwargs = {'device': 'cpu'}))
service_context = ServiceContext.from_defaults(
        llm_predictor=llm_predictor,
        chunk_size=1000,
        embed_model = embed_model)

graph_store = SimpleGraphStore()
#Graph Vector
storage_context_graph = StorageContext.from_defaults(persist_dir="./llama7b_graph_index_removeHTML_MaxTriplets10", graph_store=graph_store)
kg_index = load_index_from_storage(storage_context = storage_context_graph, service_context = service_context)

kg_keyword_query_engine = kg_index.as_query_engine(
    # setting to false uses the raw triplets instead of adding the text from the corresponding nodes
    include_text=False,
    retriever_mode="keyword",
    response_mode="tree_summarize",
)

response = kg_keyword_query_engine.query("Who is Dion Wiggins")
display(Markdown(f"<b>{response}</b>"))

Empty results can happen if no keywords from the query match the knowledge graph, then there is no info to generate a response with 🤔
However, you can combine a vector index with a kg index by following this notebook. No need to use nebula though, the default kg index works fine too
https://gpt-index.readthedocs.io/en/stable/examples/index_structs/knowledge_graph/KnowledgeGraphIndex_vs_VectorStoreIndex_vs_CustomIndex_combined.html

@dosu-bot
I'm trying to save and reload a Nebula graph knowledge index using the following example code, but I'm unsure how to proceed. Could you provide some guidance? WHat you provided above is only for SimpleIndexStore. I am using Nebula graph databa.
Reproducible Example
from your_package import NebulaGraphStore, OpenAI, OpenAIEmbedding, ServiceContext, StorageContext, KnowledgeGraphIndex

# Initialize Nebula Graph Store
space_name = "MYEAC_ASSISTANT_TEST"
edge_types, rel_prop_names = ["relationship"], ["relationship"]
tags = ["entity"]

graph_store = NebulaGraphStore(
    space_name=space_name,
    edge_types=edge_types,
    rel_prop_names=rel_prop_names,
    tags=tags,
)

# Initialize Language Models
llm_model_name = 'gpt-3.5-turbo-16k'
embedding_model_name = 'text-embedding-ada-002'

llm = OpenAI(temperature=0, model=llm_model_name)

embedding_llm = OpenAIEmbedding(
    model=embedding_model_name,
    api_key="your_openai_api_key",
    api_base="your_openai_api_base",
    api_type="your_openai_api_type",
    api_version="your_openai_api_version",
)

# Initialize Service Context
service_context = ServiceContext.from_defaults(
    llm=llm,
    embed_model=embedding_llm,
    chunk_size_limit=512
)

# Initialize Graph Storage Context
graph_storage_context = StorageContext.from_defaults(graph_store=graph_store)

# Create Knowledge Graph Index
kg_index = KnowledgeGraphIndex.from_documents(
    "your_base_document_data",
    storage_context=graph_storage_context,
    max_triplets_per_chunk=10,
    space_name=space_name,
    edge_types=edge_types,
    rel_prop_names=rel_prop_names,
    tags=tags,
    include_embeddings=True,
)

Question
Now, I want to save the kg_index object and load it again later. How can I achieve this?

Hey @soufianechami right now Dosu only responds to issue authors to keep the discussion focused to their issue. We're working on a way to allow users to "fork" a conversation and chat without outside of Github, so stay tuned!

@soufianechami the sample code there is basically correct.
Setup the graph store to point to your existing graph store in nebula, throw it into the storage context, and off you go (since it's in nebula, there is no saving step)


ibm-cos-sdk-python cos_credentials file  not working as described in README

cat ~/.bluemix/cos_credentials
{
  "apikey": "zzzzzzzzzzzzzz--XTe",
  "endpoints": "https://control.cloud-object-storage.cloud.ibm.com/v2/endpoints",
  "iam_apikey_description": "Auto-generated for key 34f869a1-e52f-4e89-b2dc-4d3fbe0d6fb4",
  "iam_apikey_name": "vpc3tier-cos-key",
  "iam_role_crn": "crn:v1:bluemix:public:iam::::serviceRole:Writer",
  "iam_serviceid_crn": "crn:v1:bluemix:public:iam-identity::a/713c783d9a507a53135fe6793c37cc74::serviceid:ServiceId-510853c5-3fa9-470b-a1ff-233340cced0e",
  "resource_instance_id": "crn:v1:bluemix:public:cloud-object-storage:global:a/zzzzzzzzzzzzzzzzzz:017a0d19-ded7-436e-bb36-zzzzzzzzzzzz::"
}

Code:
s3 = ibm_boto3.resource('s3')
bucket = s3.Bucket('vpc3tier-000-data')
print(bucket.creation_date)

Exception:
...
  File "/Users/pquiring/github.ibm.com/portfolio-solutions/scenario-3tier/venv/lib/python3.9/site-packages/ibm_botocore/signers.py", line 90, in handler
    return self.sign(operation_name, request)
  File "/Users/pquiring/github.ibm.com/portfolio-solutions/scenario-3tier/venv/lib/python3.9/site-packages/ibm_botocore/signers.py", line 162, in sign
    auth.add_auth(request)
  File "/Users/pquiring/github.ibm.com/portfolio-solutions/scenario-3tier/venv/lib/python3.9/site-packages/ibm_botocore/auth.py", line 368, in add_auth
    signature = self.signature(string_to_sign, request)
  File "/Users/pquiring/github.ibm.com/portfolio-solutions/scenario-3tier/venv/lib/python3.9/site-packages/ibm_botocore/auth.py", line 348, in signature
    k_date = self._sign(('AWS4' + key).encode('utf-8'),

We have someone who will look into this and get back to you.

The readme is out of sync with the official documentation here: https://cloud.ibm.com/docs/cloud-object-storage?topic=cloud-object-storage-python#python-credentials. We will update this.

We have resolved this issue with the release of 2.11.0. Can you verify and close this ticket?

In the readme:

This did not get me to anything useful https://cloud.ibm.com/docs/services/cloud-object-storage/iam/service-credentials.html

I am having a similar issue, just installed 2.11.0 today.  Here is the function which seems to be causing the issue

Thanks for pointing this out. The COS documentation is going through an overhaul, and that seems to be affecting our readme. I'm going to have an internal discussion to see how to more permanently fix these discrepancies.

This issue has been fixed in the latest release. Can you please close this issue


V0.12.4

Dear @ashutosh-b-b,
that's is? I just wait for the local tests to finish.

Dear @ashutosh-b-b, that's is? I just wait for the local tests to finish.
Yes, even I am running some tests that resolve the compat issues FMIImport v0.12 had with other packages. I will reply on this thread then.

All right, just open another PR to v0.12.4 if necessary. If you are ready, just tell me and we can trigger registration.
BTW: For me, tests are running on the local machine with v0.12.4

@ThummeTo can we release this? Sorry for the delay with the testing. Thanks again!

No problem.
Registration is running ... see JuliaRegistries


Clean up in aisle updateSynapsesWeightsDevice()

Line 111 looks like:
synapseType type = synType(neuron_type_map_d, src_neuron, dest_neuron);

This is only used on lines 133, 134:
allSynapsesDevice->W[iSyn] = W_d[src_neuron * num_neurons
      + dest_neuron] * synSign(type) * AllSynapses::SYNAPSE_STRENGTH_ADJUSTMENT;

It would be clearer to just look up the source neuron type (neuron_type_map_d[src_neuron]) and use this to set the synapse sign. Every outgoing synapse from the current neuron has the same sign. This only needs to be computed once per thread.

Actually, given that this kernel needs to be updated so that each thread executes for a destination neuron, you'll need to look up the source neuron type for each synapse. So, the code can be something like:
synSign(synType(neuron_type_map_d, src_neuron, dest_neuron))

Also, it seems you don't need synapse_adjusted in the innermost loop.

Re-reading this, in the context of cleaning up issues for summer 2016, I'm not sure if this applies to the main branch or forward-refactor.

After refactoring, each kernel thread is invoked by a destination neuron basis, so we need to look up source neuron type for each synapse.
We use the global neuron number for source and destination neurons.


docs: add homebrew installation note

Add a homebrew installation note.

Hi @chenrui333, what are the advantages of installing Service Weaver with homebrew instead of installing it with go install?

I'm closing this PR because it's quite stale, but feel free to re-open.


[Bug]: GIT Remote URL Pattern does not accept URLs with hyphen

Is there an existing issue for this?

[X] I have searched the existing issues

Description
The current regex does not works if you provide an URL starting with git@ if the host contains a hyphen.
const GIT_REMOTE_URL_PATTERN = /^((git|ssh)|(git@[\w\.]+))(:(\/\/)?)([\w\.@\:\/\-~\(\)]+)[^\/]$/im;

Matches: git@example.com:user/name.git
Does not match: git@example-something.com:user/name.git
Steps To Reproduce

Go to Edit app.
Click Connect GIT (Beta).
Type a remote URL like git@example-something.com:user/name.git.
Validation fails.
Remove the -something from the URL.
Validation passes.

Public Sample App
No response
Version
Self Hosted - v1.7.10

Thanks @andreoav for reporting this and sharing the piece of code with the problem. We'll check this out and share a fix. Did you run into this bug while trying to use git sync?

@andreoav Thanks for reporting this. It was a known issue and we have already raised a fix for this. Here is the link to the PR - https://github.com/appsmithorg/appsmith/pull/15499
It will be available in the next release. Closing this issue via https://github.com/appsmithorg/appsmith/issues/15432


Default metrics dashboards

Let's make sure metrics dashboards are shown for the OTel distro in the Metrics tab and that the metrics shown are meaningful. This task might also require some UI task coordination and portable dashboard work.
If work was done for this issue, it's possible some of it could be reused.

As agreed in today's APM agents meeting (2024-05-14) the metrics tab should contain only runtime related metrics, in our case node metrics. There is already a PR to add these into semantic conventions https://github.com/open-telemetry/semantic-conventions/issues/990
We should wait for these metrics to land to start implementation (or check if there is already an instrumentation for that).

Kibana PR created https://github.com/elastic/kibana/pull/199353
Next steps

add @opentelemetry/instrumentation-runtime-metrics in EDOT for Node.js once published (ref)
release a new version of EDOT for Node.js

Dashboard also backported to 8.x (kudos to @trentm)
https://github.com/elastic/kibana/pull/200810


Add Twinkly 600

Twinkly 600 LED String Lights

https://www.amazon.com/Twinkly-Multicolor-App-Controlled-Decorations-Generation/dp/B086XJ1RSY
Home Assistant Device information

TWS600STP
by LEDWORKS
Firmware: 2.8.18
Checklist

[X] I have created a single PR per device. When you have multiple submissions please create separate PR's.
[X] For lights - I have only included the gzipped files (*.gz), not the raw CSV files.
[X] For lights - I have provided a CSV file per supported color mode. Look that up in Developer Tools -> States

Additional info

Thanks @brianegge? Doesn't this strip has all kind of different effects, which are mostly used?

Yes, it has any variety of effects. You can download effects from the app and it has memory to store about three on the device. I could try to build a power profile per effect, but note that each effect can be customized in the app for speed,brightness and colors. Oddly, the power used doesn’t really change. Even setting the brightness to 50% doesn’t cut the power much. When it’s off it consumes about 2w but when on it’s 36-38 no matter what it’s doing. So my measurement profile is rather flat. effect_list:  - 0 Diagonal  - 1 Rotor  - 2 Magic Bandsupported_color_modes:  - rgbeffect: 2 Magic Bandcolor_mode: rgbbrightness: 13hs_color:  - 240  - 100rgb_color:  - 0  - 0  - 255xy_color:  - 0.136  - 0.04friendly_name: Christmas Treesupported_features: 4On Nov 29, 2024, at 1:47 AM, Bram Gerritsen @.***> wrote:
Thanks @brianegge? Doesn't this strip has all kind of different effects, which are mostly used?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>

I was thinking about extending the measure tool to cycle through effects, but also need to extend the integration code to support this.
It's rather a big development.
And it won't cover the case where effects can be manipulated through the app, as HA has no knowledge about that.
So we just need to keep it simple imo.
I'm considering to even just use fixed power profile. set to 37W when on and 2.2W when off.
We can just set that in model.json and similarly as here: https://github.com/bramstroker/homeassistant-powercalc/blob/master/profile_library/avm/FRITZ!Repeater 2400/model.json#L12
What do you think?

Perfect, thanks a lot for your efforts. Let's merge!


Mac OS ARM installation

I've been working on installing on Mac OS 13.6 with an M1 Max processor.  There are a few hurdles:

I installed the requirements with conda.  Using conda-forge, I installed the following packages:

gnuradio==3.8* airspy airspyhf boost-cpp click click-plugins cmake codec2 cppzmq cxx-compiler fftw gtk3 gmp gsl libad9361-iio libcblas libiio libsndfile log4cpp lxml mako ninja numpy pkg-config pybind11 pybind11-abi pygobject pyqt python pyyaml qt qwt sdl soapysdr spdlog uhd volk zeromq packaging

For the cmake build, I do the following:

export CFLAGS=-arch=arm64
mkdir build
cd build
cmake -DCMAKE_OSX_ARCHITECTURES=arm64 ..
make

That gets me to:
[ 14%] Building CXX object lib/CMakeFiles/gnuradio-radio_astro.dir/dedispersion_impl.cc.o
[ 28%] Building CXX object lib/CMakeFiles/gnuradio-radio_astro.dir/detect_impl.cc.o
[ 42%] Building CXX object lib/CMakeFiles/gnuradio-radio_astro.dir/vmedian_impl.cc.o
[ 57%] Linking CXX shared library libgnuradio-radio_astro.dylib
[ 57%] Built target gnuradio-radio_astro
[ 57%] Built target radio_astro_swig_swig_doc
[ 71%] Swig source radio_astro_swig.i
swig error : Unrecognized option -relativeimport
Use 'swig -help' for available options.
make[2]: *** [swig/CMakeFiles/radio_astro_swig.dir/radio_astro_swigPYTHON.stamp] Error 1
make[2]: *** Deleting file `swig/CMakeFiles/radio_astro_swig.dir/radio_astro_swigPYTHON.stamp'
make[1]: *** [swig/CMakeFiles/radio_astro_swig_swig_compilation.dir/all] Error 2
make: *** [all] Error 2

@interstellarmedium any idea if there's a specific version of swig required to enable relative imports?

Add swig to the list of installed modules; i was using a super old swig (2.0) while 4.x is needed.

Also add h5py ephem; those appear to be runtime requirements

I added a few more by editing the original post.
I'm still stuck with my hardware not being recognized.

I vaguely remember seeing a similar problem but unfortunately I can't remember what I did to fix it (if indeed that was the error). gnuradio is fairly finicky and goes through frequent updates. Sorry I can't help - I got it working on the computer I use for the radio telescope a long time ago and don't want to mess with it! Plus you understand software better than me @keflavich :)

Dang, ok.  I got the computer to recognize the device and record data, but gnuradio still wouldn't.
This command worked:
airspy_rx -r test_airspy_rx -f 1420 -a 10000000 -t 1 -n 10000000

so if you can think of any last tricks required for gnuradio to recognize it, that'd be super helpful. Otherwise, I can probably maybe figure out how to use that command to record data.

Classes start next week so this is not the best timing for me, but I'll try to take a look asap and will get back to you

No worries, I'll figure something out.   I think the airspy_rx command records data at the desired rate and frequency, I just need to test it with an LNA and a telescope attached to verify it on sky.

if you figure out a solution, I'll try it out, but I've found a workaround to just use the airspy_rx command as above directly. I'll try copying the appropriate parameters (gain etc) from your code.

Hey Adam, I was able to get gnuradio working with airspy ok on my new mac. I got some errors and was about to go down the software route when I double-checked my connections and used a new usb-c to usb-a connector to the airspy and, magically, everything worked! So I don't have a lot of helpful advice for you other than to check the connections!


Added probe for ZFS pool on partition in opnsense-importer (from Smart-Soft)

Added probe for ZFS pool on partition.
I would like to suggest adding the ability to import a configuration from a pool with an arbitrary name.
How it works:
User selects the device, and probe_for_part() determines partition. If probe_zfs_pool() finds ZFS pool on that partition, configuration importing is performed from ZFS pool.

import all possible pools without mounting any filesystems
enumerate pools and search for the one that uses selected partition
export all imported pools except root mounted pool, if exists

Now user must specify exactly "zroot" for import configuration from ZFS, i.e., ZFS supported only on "zroot/ROOT/default"

@fichtner
Yes, I know the way. And proposed function 'probe_zfs_pool()' does it.
I use 'zpool get -H cachefile' command, it lists all imported pools, one per line.

@alexpro good :) it should list all pools here so the users knows what options there are to import from https://github.com/opnsense/core/blob/master/src/sbin/opnsense-importer#L181

I reworked function for ZFS pools probing. Now all available ZFS pools added to the tail of DEVS variable. Any ZFS pool now can be used same as any other device, from command line argument or can be specified manually when prompted.

Merged, thanks!


Basic workflow for basecalling ONT pod5 files. Does not yet include demultiplexing.

This PR creates the necessary files to basecall Oxford Nanopore pod5 files. Running the basecaller (dorado) requires a g5.xlarge machine, with an AMI that is both ECS-optimized and contains GPU-drivers (link). The Instance template can be found here
@willbradshaw I had to specify default values for undefined run.nf parameters as I always got warnings that they were not defined (even though I wasn't running run.nf. I will resolve this in future, though let me know if I can suppress these warnings in some other way.
Also, let me know if there is a more efficient way to get the base_dir leaf, which I'd need to define the name of the nanopore_run:
params {
    mode = "basecall"
    debug = true

    // Directories
    base_dir = "s3://nao-mgs-simon/NAO-ONT-20240905-DCS_RNA2_Test"

    // Run parameters
    // TODO: Automate getting run name from base_dir
    nanopore_run = "NAO-ONT-20240905-DCS_RNA2_Test"

@willbradshaw I had to specify default values for undefined run.nf parameters as I always got warnings that they were not defined (even though I wasn't running run.nf. I will resolve this in future, though let me know if I can suppress these warnings in some other way.

Yeah this is a known issue that someone (possibly me) should look into fixing. If we're going to have multiple workflows running from the same start point this is going to keep coming up.

Also, let me know if there is a more efficient way to get the base_dir leaf, which I'd need to define the name of the nanopore_run

Sorry, I don't understand what you mean by this.

Also, let me know if there is a more efficient way to get the base_dir leaf, which I'd need to define the name of the nanopore_run

Sorry, I don't understand what you mean by this.

Also, let me know if there is a more efficient way to get the base_dir leaf, which I'd need to define the name of the nanopore_run

Sorry, I don't understand what you mean by this.

When the s3 address is s3://foo/bar, I want the nanopore run identifier to be bar. After trying for 5 min I didn't figure out how to do this.


Support for the applications using multiple databases

Hi
I'm installing flipper-active_record and flipper-ui but I'm running into the follow error:
ActiveRecord::ConnectionNotEstablished
No connection pool for 'ActiveRecord::Base' found for the 'reading' role.

I believe this is due to my application using Multiple Databases with Active Record which is configured in ApplicationRecord (which inherits from ActiveRecord::Base) but flipper-active_record uses ActiveRecord::Base as the parent class for the models.
Is it feasible to support a custom parent class? I recently started using the gem good_job which implements in what looks to me like a fairly simple approach: https://github.com/bensheldon/good_job/search?q=active_record_parent_class
With some guidance I'd love to submit a PR :)

Ah, digging a bit more made me realise I can configure the feature and gate classes. This worked:
require 'flipper/adapters/active_record'

class FlipperFeature < ApplicationRecord
end

class FlipperGate < ApplicationRecord
end

Flipper.configure do |config|
  config.adapter do
    Flipper::Adapters::ActiveRecord.new(
      feature_class: FlipperFeature,
      gate_class: FlipperGate,
    )
  end
end

🎉

@jgrau Glad you figured out a solution that will work!
I think you could also do the following if you want to avoid redefining the classes. I don't think it matters either way.
Flipper::Adapters::ActiveRecord::Feature.connects_to database: { writing: :primary, reading: :replica }
Flipper::Adapters::ActiveRecord::Gate.connects_to database: { writing: :primary, reading: :replica }


Fix videoId old reference to the prop id

Sorry @hugobessaa, but I had to change that in the past, because when I call the prop id there is a bug in the syntax hightlight :/


Vim's shortcut "g;" doesn't work (it should jump backwards in the changelist)

:help changelist on vim for an explanation of what should happen.

The vim code is now being maintained at https://github.com/replit/codemirror-vim/ . If this is still important, check whether there is an issue open for it there.


update onChange types for selection controls

onChange ChangeEvents can be better parameterized for selection controls.

Wow, @rosskevin contributing TypeScript! We need an exit plan from flow.


fix typo in message

What is the purpose of the change

Add a description of the overall background and high level changes that this PR introduces

Small typo in a message
Testing and Verifying
(Please pick one of the following options)
This change is a trivial rework / code cleanup without any test coverage.
Documentation and Release Note

[ ] Does this pull request introduce a new feature or user-facing behavior changes?
[ ] Changelog entry added to Unreleased section of CHANGELOG.md?

Where is the change documented?

[ ] Specification (x/{module}/README.md)
[ ] Osmosis documentation site
[ ] Code comments?
[X] N/A

Planning to rebuild binary off of main after merging. Thanks @faboweb for the PR!


Android studio open flutter project is abnormal

Yesterday i upgrade flutter 1.12.13+hotfix.5 and android studio 3.5.3, when i open flutter project with android studio, it's abnormal. android studio auto open flutter's android project, but it's error and can't close.(Then I upgraded it to 3.6 rc1, same problem)

flutter doctor -v
[✓] Flutter (Channel stable, v1.12.13+hotfix.5, on Mac OS X 10.15.2 19C57,
    locale zh-Hans-CN)
    • Flutter version 1.12.13+hotfix.5 at /Users/kamy/flutter
    • Framework revision 27321ebbad (3 weeks ago), 2019-12-10 18:15:01 -0800
    • Engine revision 2994f7e1e6
    • Dart version 2.7.0

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.2)
    • Android SDK at /Users/kamy/Library/Android/sdk
    • Android NDK location not configured (optional; useful for native profiling
      support)
    • Platform android-29, build-tools 29.0.2
    • ANDROID_HOME = /Users/kamy/Library/Android/sdk
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_212-release-1586-b4-5784211)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 11.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 11.3, Build version 11C29
    • CocoaPods version 1.8.4

[✓] Android Studio (version 3.6)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 42.2.2
    • Dart plugin version 192.7761
    • Java version OpenJDK Runtime Environment (build
      1.8.0_212-release-1586-b4-5784211)

[✓] VS Code (version 1.41.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.7.1

[!] Connected device
    ! No devices available

same here, i noticed this behavior started on Android Studio 3.5.3 but dunno if it's a coincidence or something wrong on 3.5.3

same here, i noticed this behavior started on Android Studio 3.5.3 but dunno if it's a coincidence or something wrong on 3.5.3

I went back to 3.5.1 and still have the same problem, there should be a configuration change

Hi @shijinliang
could you please run
flutter clean
flutter pub cache repair
let me know if the issue persists
thank you

@DanTup Should this be moved to Dart-Code? I don't have permission.

@jmagman this is Android Studio not VS Code so I think it should go to https://github.com/flutter/flutter-intellij.

🤦♀ @DanTup I have holiday vacation brain.
io.flutter.android isn't even in that stack so this might be some IntelliJ bug?  They have plugin 42.2.2 installed.
@devoncarew can you move this over for us?

Yeah, I wasn't sure from the stack either - but I think those that work on the Android Studio/IntelliJ plugins would be better able to say for sure.

Yeah, I wasn't sure from the stack either - but I think those that work on the Android Studio/IntelliJ plugins would be better able to say for sure.

When i use IntellIJ IDEA, no additional windows pops up so i think it's Android Studio problem


🐛 BUG: Exporting local  d1 sql to remote fails only when a previous attempt to apply a migration failed.

Which Cloudflare product(s) does this pertain to?
D1
What version(s) of the tool(s) are you using?
3.67.1
What version of Node are you using?
18.19.0
What operating system and version are you using?
Linux Manjaro (arch)
Describe the Bug
Observed behavior
I was applying a migration and failed (this migration succeeds locally, see bug) and then i try to export the local d1 db with d1 export and execute it in remote:
#this failed
npx wrangler d1 migrations apply prods --remote
#this works
npx wrangler d1 export prods --output local_prods.sql --local
#this fails
npx wrangler d1 execute prods --file local_prods.sql --remote
✘ [ERROR] table d1_migrations already exists at offset 14: SQLITE_ERROR

The db info after the failed migration was applied  increased to  12kb to 25kb, no data table was created.
if i do this from a freshly created db, without the failed attempt to apply the migration remotely, it works:
npx wrangler d1 execute prods --file local_prods.sql --remote

My first though was if there was a way to reset the database on which the failed migration was applied, and it seems there is not.
Expected behavior
Steps to reproduce
Please provide the following:

A minimal working subset of your worker code
A minimal working subset of your wrangler.toml
Commands used to start your local dev server, including custom env and cli args
Steps to be performed in the browser, curl commands, or a test we can run that reliably fails (at least a percent of the time)

A git repo we can clone and run a test suite on, or which has a README with step-by-step instructions, is even better. In this case, please use the field below to provide a link to the minimal repro.
Please provide a link to a minimal reproduction
No response
Please provide any relevant error logs
No response

Not really, I found this in a test DB, so I just did what I described in
the issue.
On Fri, Oct 11, 2024 at 5:46 PM maggie44 @.***> wrote:

Did you find a solution to restore functionality of an existing DB?
Deleting and starting over isn't really an option for me.
—
Reply to this email directly, view it on GitHub
https://github.com/cloudflare/workers-sdk/issues/6348#issuecomment-2408100552,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC7MOYXCK4HTNPHPDVMULODZ3A2MDAVCNFSM6AAAAABLQ2UDRSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMBYGEYDANJVGI
.
You are receiving this because you authored the thread.Message ID:
@.***>