Cannot find module (missing .js extension) in packages imported from layers

Environment

Operating System: Darwin
Node Version:     v18.19.0
Nuxt Version:     3.9.1
CLI Version:      3.10.0
Nitro Version:    2.8.1
Package Manager<EMAIL_ADDRESS>Builder:          -
User Config:      devtools, extends
Runtime Modules:  -
Build Modules:    -

Reproduction
https://github.com/fabianwohlfart/test__nuxt-missing-modules
Describe the bug
If we import a package in a layer we have to use the absolute path to this.
In my reproduction it is fs-extra.
If this package is dependent on other packages, in my reproduction it is jsonfile, the nuxt bundler will not correctly import these packages, thus throwing an error: it is importing jsonfile/utils while we need jsonfile/utils.js
yarn build
node .output/server/index.mjs
navigate to localhost:3000/api/test

[nuxt] [request error] [unhandled] [500] Cannot find module '[...]/test__nuxt-build/nuxt/.output/server/node_modules/jsonfile/utils' imported from [...]/nuxt/.output/server/chunks/_slug_.get.mjs
Did you mean to import jsonfile/utils.js?
  at new NodeError (node:internal/errors:405:5)
  at finalizeResolution (node:internal/modules/esm/resolve:327:11)
  at moduleResolve (node:internal/modules/esm/resolve:980:10)
  at defaultResolve (node:internal/modules/esm/resolve:1193:11)
  at ModuleLoader.defaultResolve (node:internal/modules/esm/loader:403:12)
  at ModuleLoader.resolve (node:internal/modules/esm/loader:372:25)
  at ModuleLoader.getModuleJob (node:internal/modules/esm/loader:249:38)
  at ModuleWrap.<anonymous> (node:internal/modules/esm/module_job:76:39)
  at link (node:internal/modules/esm/module_job:75:36)

Additional context
Maybe there simply is a vite / rollup option to add .js?
Logs
No response

I am seeing this same issue with the edgedb package

@fabianwohlfart I also am seeing this with day.js plugins. I have been solving it by using https://www.npmjs.com/package/replace-in-file to add the .js but it is manual based on each project package

This is the behaviour of Node ESM in general, so if any of these packages are 'external' (not bundled) on the server, this is what you would see.
I think there is a question of whether we could add these extensions automatically in nitro, or whether that's just something we should expect people to do.
Would you see if you can reproduce this in pure Nitro (reproduction sandbox), and if so, raise there for discussion? 🙏

Sure will do!

As it is for my initial report it is tied to nuxt layers and their dependencies. I don't see a chance to reproduce this in Nitro @danielroe?
On the other side @corbinu I was also doing a regex to find missing js extensions and fixing it that way, but now i just moved all dependencies out of layer towards my main app, this seems more manageable anyways.

@fabianwohlfart It is happening in just nitro apps (no nuxt at all) in my case.


Implement C# 7 "discards"

Adds support for C# 7's discards.
Because this syntax obviously isn't supported in any shading language, I've chosen to declare these as dummy variables at the start of any method in which they are used. One dummy variable is written out per unique type.
So this:
private void DoSomething(out Vector2 v)
{
    v = Vector2.Zero;
}

public void MyFunc()
{
    DoSomething(out _);
    DoSomething(out _);
}

is converted to (something like) this:
void DoSomething(out float2 v)
{
    v = float2(0, 0);
}

void MyFunc()
{
    float2 _shadergen_discard_float2;
    DoSomething(_shadergen_discard_float2);
    DoSomething(_shadergen_discard_float2);
}

This won't be an often-used feature, but it can be handy for re-using helper methods where you don't need all the functionality of the helper method, and don't care about some of the results. Hopefully the backend shader compilers will get rid of the unused code!

This could be handy. Thanks!


Updated convert script for changed arg

This addition allows the convert script to only execute/convert notebooks that were changed/added in the current commit. Requires nbpages PR#: 6. Calling the convert script with python convert.py --changedsignals the script to only check/execute notebooks that were changed on the current git commit from the master branch.
This should be implemented in the CI config, for example:
if pull_request:
    python convert.py --changed
else:
    python convert.py

This would dramatically save build minutes for CI pull requests, only converting new/changed notebooks.

With CircleCI PR merged, I guess we can close with without merge?

Two things:

I think it's better to have this not be in the convert.py script.  convert.py is meant to be as minimal as possible and defer to nbpages if it can.  So instead I'd say move the "guts" of this to eteq/nbpages#6 ?

Maybe I'm misunderstanding, but I think this is only looking for notebook files. It needs to also re-run all the tests when something more dramatic like changing the convert.py script or the environment file happens.  As an initial shot at this I think the rules should be: 1) if any file in a notebook directory is altered (e.g. the notebook itself or some included data file or the like) re-run that one notebook, 2) If a file is outside a notebook dir (and not a markdown file), re-generate everything.

I moved this over to nbpages PR 6 as suggested, closing this as it is unnecessary.


Unit tests that produce images should put them into a user-specified directory or temp space

Currently, there are some unit tests that produce images. In running, these are placed into the current working directory.
Ideally, these images (which can be artifacts, but should not be generally lumped in with source code) would be placed in a user-specified directory defined by an environmental variable (i.e. TEST_IMAGE_DIR, just like TARGET), or failing that, the temporary directory of the current system (e.g. https://stackoverflow.com/questions/847850/cross-platform-way-of-getting-temp-directory-in-python).

Possibly something that @mdolanme could look at.


MSAL Node does not serialize/desiralize userAssertionHash in OBO

Core Library
MSAL Node (@azure/msal-node)
Core Library Version
1.14.3
Wrapper Library
Not Applicable
Wrapper Library Version
N/A
Public or Confidential Client?
Confidential
Description
At the moment msal-node Serializer and Deserializer classes do not process userAssertionHash property in AccessTokenEntity. This means when cache is persisted via a cachePlugin, msal-node will not be able to read userAssertionHash from the serialized cache entry. Since userAssertionHash is a filter property for retrieving a cached AT in OBO flow, this causes the client object's getCachedAuthenticationResult method to return null when in memory cache is empty (e.g. server restarts etc.)
Error Message
N/A
Msal Logs
[Wed, 16 Nov 2022 20:19:53 GMT]<EMAIL_ADDRESS>: Info - getTokenCache called
[Wed, 16 Nov 2022 20:19:51 GMT]<EMAIL_ADDRESS>: Info - acquireTokenOnBehalfOf called
[Wed, 16 Nov 2022 20:19:51 GMT]<EMAIL_ADDRESS>: Verbose - initializeRequestScopes called
[Wed, 16 Nov 2022 20:19:51 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - buildOauthClientConfiguration called
[Wed, 16 Nov 2022 20:19:51 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - building oauth client configuration with the authority: https://login.microsoftonline.com/cbaf2168-de14-4c72-9d88-f5f05366dbef
[Wed, 16 Nov 2022 20:19:51 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - createAuthority called
[Wed, 16 Nov 2022 20:19:52 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - On behalf of client created
[Wed, 16 Nov 2022 20:19:52 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Info - SilentFlowClient:acquireCachedToken - No access token found in cache for the given properties.
[Wed, 16 Nov 2022 20:19:53 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - Persistence enabled, calling beforeCacheAccess
[Wed, 16 Nov 2022 20:19:53 GMT] : [a325b97b-eb28-49de-ae45-bd0d141b7c57]<EMAIL_ADDRESS>: Verbose - Persistence enabled, calling afterCacheAccess
[Wed, 16 Nov 2022 20:19:53 GMT]<EMAIL_ADDRESS>: Info - getTokenCache called
MSAL Configuration
{
    auth: {
        clientId: "***************",
        authority: "https://login.microsoftonline.com/***************",
        clientSecret: "***************",
    },
    cache: {
        cachePlugin: require('./cachePlugin')('./cache.json')
    },
    system: {
        loggerOptions: {
            loggerCallback(loglevel, message, containsPii) {
                console.log(message);
            },
            piiLoggingEnabled: false,
            logLevel: msal.LogLevel.Verbose,
        }
    }
}

Relevant Code Snippets
const app = express();
const cca = new msal.ConfidentialClientApplication(config);

app.get('/obo', validateJwt, async (req, res, next) => {
    const oboAssertion = req.headers.authorization.split(' ')[1];

    try {
        const cache = cca.getTokenCache();
        const accounts = await cache.getAllAccounts();

        const oboRequest = {
            oboAssertion: oboAssertion,
            scopes: ["user.read"],
        };

        const response = await cca.acquireTokenOnBehalfOf(oboRequest);
        console.log(response);
    } catch(error) {
        next(error)
    }
});

app.listen(SERVER_PORT, () => console.log(`Msal Node Web API listening on port ${SERVER_PORT}!`))

Reproduction Steps

Follow the steps in msal node OBO sample to make an OBO call.
Configure MSAL in each app to use a cachePlugin
Restart the web API server, retry the OBO call.

Expected Behavior
MSAL Node acquireTokenOnBehalfOf API successfully retrieves the cached AT from disk.
Identity Provider
Azure AD / MSA
Browsers Affected (Select all that apply)
None (Server)
Regression
No response
Source
Internal (Microsoft)

cc @bgavrilMS @Robbie-Microsoft could you take a look at this? I've proposed a PR for the fix here


Porkbun API Change

I just received an email from porkbun saying that they are changing their hostname for the API.
It may be important for the dns challenge provider function in the SSL Certificates menu.
CRITICAL UPDATE DETAILS

Type: API Hostname Change

Old Value: porkbun.com

New Value: api.porkbun.com

Deadline: 2024-12-01 00:00:00 UTC

I also received this email and it seems my certificate won't update anymore as a result of this change


Query cancellation not working

Run this slow query, and try to cancel it by hitting CTRL-C. It doesn't get cancelled:
postgres=# create table itbl(i int4);
CREATE TABLE
postgres=# insert into itbl select g from generate_series(1, 1000000) g;
INSERT 0 1000000
postgres=# select avg(gcd(a.i, b.i + 1)+cbrt(a.i)) from itbl a, itbl b;
^CCancel request sent
^CCancel request sent
^CCancel request sent
^CCancel request sent
^CCancel request sent

Yeah, it can be reproduced.
It seems that occurs at pending->ExecuteTask(), which takes a long time to run, however, it does not have any chance to handle query cancellation, because it is running in DuckDB.

It reproduces a bit  inconsistently. But I can get a reproducing case quite easily by adding the following line:
--- a/src/pgduckdb_node.cpp
+++ b/src/pgduckdb_node.cpp
@@ -71,6 +71,7 @@ ExecuteQuery(DuckdbScanState *state) {
    duckdb::PendingExecutionResult execution_result;
    do {
        execution_result = pending->ExecuteTask();
+       elog(WARNING, "pending->ExecuteTask() returned");
        if (QueryCancelPending) {
            // Send an interrupt
            connection->Interrupt();

And then waiting until output stops being flooded with logs. If that doesn't happen within 30 seconds, try again. After a few times you'll see no output being shown anymore (so ExecuteTask() never returns anymore), but still a single core is being maxed out. Pressing Ctrl+C doesn't do anything in that case, obviously because we never get to the the QueryCancelPending check below the log line anymore.
I did a basic perf flamegraph and got the following. All I can really see in it is that it doesn't seem to be stuck in a tight loop in a single function.

elog(WARNING, "pending->ExecuteTask() returned");

Thanks for this, I can reproduce it, though very seldomly on a debug build, much more frequently on release.
The flame graph you provided is likely from a debug build because it contains DataChunk::Verify which is optimized out in a release build.
Since this occurs much more often in release I can't imagine the verification code is relevant here.
I'm not entirely sure what is causing this still, but my hunch so far from debugging is that the PhysicalCrossProduct is processing far too much before it returns from ExecuteTask

I think the reason this isn't caught (/ isn't a problem) in the duckdb CLI is that there is no disconnect between the client<->server.
The client (shell) receives a sigint and immediately calls db->Interrupt(), the interrupted flag is properly being checked during execution, so in the CLI this correctly stops.
In pg_duckdb we have to call Interrupt() ourselves, which we do after ExecuteTask returns, the problem is that ExecuteTask is doing way too much before returning in this case, so Interrupt() doesn't get called and thus the interrupted flag stays off

I've made a PR to fix this upstream in DuckDB, it likely won't land until 1.2 even if it passes CI because it's very close to the core and deemed too risky for a bug fix release

I thought about that, but I think I read that's ill-advised?

Leaving this in the 0.2.0 milestone. Hopefully by the time that 0.2.0 gets released DuckDB 1.2.0 will be released as well and we can benefit from https://github.com/duckdb/duckdb/pull/14034
If that turns out to not be enough. We need to rethink how to fix this, possibly by swapping out the signal handlers.


Volume as an indicator

By default volume is embedded with the stock chart. It would be great if volume could be provided as an indicator such as ElderRay or RSI.

it's shown on the same chart in the examples but it's not embedded in anyway. You can it the same as any indicator to any chart.


Add support for CMEK to Spanner module

This is already supported via the databases.kms_key_name variable attributes.


Problem with colors in the integrated terminal

VSCode Version: 1.44.0
OS Version: Debian testing

Steps to Reproduce:

Run the following bash script in the integrated terminal

#!/bin/bash

LRED='\033[1;31m'
LPURPLE='\033[1;35m'
NC='\033[0m' # No Color

printf "\t${LRED}light red${NC}\n\t${LPURPLE}light purple${NC}\n"

Expected output
Red and purple and rendered differently
Actual output
Purple is rendered as red

Does this issue occur when all extensions are disabled?: Yes

What theme are you using? Does it get better if you change the theme?

What theme are you using? Does it get better if you change the theme?

Right, the problem is the theme I'm using (Zenburn). It does not happen with other themes. Thanks!


Lambda layer should allow injection of globals?

Not a Python expert so I may be missing something here, but I think this line of code in Lambda layer's get_output:
func = types.FunctionType(func, globals())

seems to use the globals from the core module. I think it may be helpful if there is a way for caller to inject their own globals, since a lot of times the function needs custom values.

Hi,
When I wrote the Lambda layer I considered it, but it turns out it would be simply bloating the API.. 99% of the time the Lambda function only uses basic math operators and basic  functions like K.abs, K.exp etc, and scalar constants. Do you have any particular problem you are trying  to solve? I might be able  to provide you a work around without changing the Keras API.
Happy New Year!

Hi, thanks for the quick reply. See https://gist.github.com/jrao1/9117c9f436270e8af158 for an example. Also in the past I tried to use Theano specific functions, and it won't work since core module didn't import Theano.

@jrao1 The easiest way would be to redefine stepsInFuture inside your Lambda function..We can not support injecting globals due to serialization issues.(We have to save models to json / pickle etc)..
As for theano specific functions, you can write import theano and import theano.tensor as T inside your lambda function.

@farizrahman4u Ok, just to be clear (since I'm not totally familiar with Python's scoping), by redefine stepsInFuture, you mean something like this:
def time_slice(output):
    stepsInFuture = 20
    return output[:,-stepsInFuture:,:]

?
If so it seems that this doesn't solve the problem where we had to hardcode a constant inside Lambda function? If say we want to make this model a class, and stepsInFuture to be a class property/variable, passed in in the constructor, then this wouldn't work?

I haven't  tried it, but here is something you could possibly do. Set stepsInFuture as member variable of your Lambda layer. Then inside your  time_slice function, you can access it using self.stepsInFuture.
def time_slice(output):
    return output[:,-self.stepsInFuture:,:]

def shape(input_shape):
    #TODO
    return input_shape
`
lambda_layer = Lambda(time_slice, shape)
setattr(lambda_layer, 'stepsInFuture', 20)

@farizrahman4u This seems to work:
    core = sys.modules['keras.layers.core']
    setattr(core, 'stepsInFuture', 20)

Not pretty but I guess it will do for now, thank you for the idea.


Add release workflow

I am still testing in my local env.

I have tested it in my local env using act, and it works.

@praveingk This is great! A few concerns before I stamp.

Seems like this workflow is triggered on a tag push to the main branch. Do we need any tag protection rules to ensure only maintainers can push tags to the main branch?
There's also concerns of tags on other branches triggering this type of workflow. Can we double check and make sure this doesn't happen or ensure it's not really an issue?
Have you tested the actual binaries that have been created?

@praveingk This is great! A few concerns before I stamp.

Seems like this workflow is triggered on a tag push to the main branch. Do we need any tag protection rules to ensure only maintainers can push tags to the main branch?

Yes, we will need to check and add protection rules if its not already present

There's also concerns of tags on other branches triggering this type of workflow. Can we double check and make sure this doesn't happen or ensure it's not really an issue?

I have changed the "on" action to push on main branch. I am unable to test it out in my local env though.

Have you tested the actual binaries that have been created?

I had used act to test the artifacts, and the binaries worked.

@seankimkdy @praveingk I created a tag protection rule that (for now) requires maintainers to push, modify, or delete all tags. We can weaken this later if needed.


Avoid recreating partial for topk with every request in inference

Makes topk partial function a member of Translator.
Pull Request Checklist

[x] Changes are complete (if posting work-in-progress code, prefix your pull request title with '[WIP]'
until you can check this box.
[x] Unit tests pass (pytest)
[x] Passed code style checking (./style-check.sh)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

This looks good, but can you hold off until after the other stuff goes through so I don't have to remerge? (Or better, rebase this on top of beam_search?) I'll fix the tests today.

Sure no Problem


feat: Allow usage with Working-Directory

It would be nice to pass an option for specifying which directory the code should execute. i.e. in my case, I have the backend and frontend in one repository and the migrations are in the backend folder.

@demenr, you can specify the directory for migrations using the migrations_path parameter. This allows the action to run in the appropriate directory, such as when backend and frontend are in separate folders.
For more details, please, refer to the documentation.

Closing due to inactivity. Since the solution was provided earlier, I'll consider this resolved. Feel free to reopen if needed.


Tool Tip Bug

Hi guys, in the Firebase codelab for friendly chat, there is a mouse tooltip that fires on every part of the page, so every time you move the mouse, the tool tip pops up no matter where you are on the page, it's really annoying and not the right use of a tool tip IMHO. Is this a mistake?
The page I'm on is ...
https://codelabs.developers.google.com/codelabs/firebase-web/#7

This issue was moved to googlecodelabs/tools#97


Version numbers in release titles?

Hi, I'd like to aggregate releases.atom to libreav.org/updates, but the titles that have been given to the releases don't contain the version number so I currently cannot parse that from the releases.atom feed title. Might it be possible to have the version number either at the start or end of the release titles?

i'll add them

i'll add them

That's great, thanks!

That's great, thanks!


Linear Intensity ?

Hi,
I was wondering about the "linear intensity" feature.
I can't see how the synthdefs are affected other than by name?
Can you please point me to where in the code "linear intensity" is actually applied to the
distance parameter?
Thanks a lot!

never mind, I found it and decided to coment it out on my branch.
You can find it here:
https://github.com/thibaudk/mosca
Feed backs are greatly apreciated


Not able to upload my application zip file by PUT /api/zip/{path}

Hi,
I am going through the wiki page of this project. My requirement is to upload application zip file to wwwroot folder from my local folder. I have used below Url to GET my app from wwwroot folder of azure website  and PUT the app to wwwroot folder of azure website.
https://$<sitename>:<publish<EMAIL_ADDRESS>But it redirects me to Azure login page. I want to upload or download my application from wwwroot from a script. I can't use browser or session. My CI box is a linux box, So can't use any windows/powershell command.
How would I pass the credential/ publish profile credentials to deploy my app to wwwroot folder.
Could anyone please guide me ?
Thanks

What tool are you using to do this? Please try with curl.

Hi David,
Thanks for your reply.
Before I had tried with chrome REST plugin. It was giving me redirect status. As per your advice I have used curl tool. but it gives me unauthorized (401) status code. I have executed below command.
curl -i -X GET https://sitename/api/zip/site/wwwroot -u $sitename:password
It responds me Html body with 401 error code. I am using userName and UserPWD from sites publish profile. Please correct me if i am doing something wrong. give me some example , how to use it.
Thanks,

Please try this exact command (this is a test site I just created):
curl -i -o foo.zip -X GET https://tmp676767.scm.azurewebsites.net/api/zip/site/wwwroot -u $Tmp676767:7fgxQYjitttkwJBG5rq2AykGGickx5gGlgw8jXNX3YlE1q5rv8Sb7XY3AlAK

It works fine for me.

Hi David,
I have executed the command given by you. It creates a file foo.zip. But actually doesn't download anything. size of foo.zip is just 1 KB, corrupted zip file.
Thanks,

I think we need to separate the concerns here. What you were seeing initially was a general authentication issue that had nothing to do with the zip controller. Have you moved passed this issue on your own site? Clearly, that part is working for you on my test site, so we need to understand what's different with yours.
For the zip, I was just missing a / after wwwroot, and you don't want to use -i. Try the corrected command above now.
As for upload, try:
curl -X PUT --data-binary @foo.zip https://tmp676767.scm.azurewebsites.net/api/zip/site/wwwroot/ -u $Tmp676767:7fgxQYjitttkwJBG5rq2AykGGickx5gGlgw8jXNX3YlE1q5rv8Sb7XY3AlAK

Thanks a lot David....
I am able to upload and download my application to/from my Azure website.


Investigate issue with storing large logistic regression coefficients > 1000

1000 is the cutoff for storing tensors in a protobuf file for mixed mode serialization in mixed/protobuf serialization mode. There seems to be an issue with MLeap version:
a99dff6
0.5.0
Figure out if this issue is still a problem in MLeap 0.6.0 and fix it if it is.
Link to original discussion: https://github.com/combust/mleap/issues/135

@kaixinyan What version of scalapb is being included in your assembly? Our test cases cover storing large tensors as protobuf and there is no issue. That method value is defined here in scalapb runtime: https://github.com/scalapb/ScalaPB/blob/master/scalapb-runtime/shared/src/main/scala/com/trueaccord/scalapb/GeneratedMessageCompanion.scala
My suspicion at this point is that it is a dependency problem, but I am somewhat grasping at straws. I don't think it is an issue with MLeap directly, but I'm not sure.

I am going to close this for now. Let me know if you solved it or have more information!

@hollinwilkins Is 1000 still the cutoff for storing tensors in a protobuf file?
I use Interaction with two vectors of length 50 , the length (2500) of result vector exceeds the cutoff. And I got the same error, java.lang.NoSuchMethodError: ml.bundle.BasicType.BasicType.value()I. Is the cutoff cause of the error?


ObjectAL don't embed bitcode when building for arm64 iOS simulator

This is nothing really relevant, I just noticed it by accident.
The embedded bitcode is only relevant when publishing in the App Store.

Bitcode appears to be deprecated on XCode and won't be accepted even on AppStore submissions. Do we need to remove it from anywhere else?
https://developer.apple.com/documentation/xcode-release-notes/xcode-14-release-notes
Starting with Xcode 14, bitcode is no longer required for watchOS and tvOS applications, and the App Store no longer accepts bitcode submissions from Xcode 14.

Xcode no longer builds bitcode by default and generates a warning message if a project explicitly enables bitcode: “Building with bitcode is deprecated. Please update your project and/or target settings to disable bitcode.” The capability to build with bitcode will be removed in a future Xcode release. IPAs that contain bitcode will have the bitcode stripped before being submitted to the App Store. Debug symbols for past bitcode submissions remain available for download. (86118779)

Probably jnigen too
https://github.com/libgdx/gdx-jnigen/blob/c405c677c8245bfcfb9087eaf4ec70ea34385b8d/gdx-jnigen/src/main/resources/com/badlogic/gdx/jnigen/resources/scripts/build-ios.xml.template#L252


sensor: scd30: Add initial support for the SCD30 sensor

This pull request add support for the scd30 sensor. Most of the code has been taken from the Sensirion github page and has been modified to work with Zephyr. The Sensirion Code is licensed as BSD 3-Clause.
Before merging please let me know if I should change the License identifier and the copyright notice>
Fixes #39234

I think I have resolved all comments. I have also rebased on main to solve some merge conflict and added a sample application.

The latest push should fix all comments that are open. It also removes scd30_bytes_to_uint*() functions in favor of those
found in sys/byteorder.h.

@burumaj can you squash into:

commit that adds new attribute to sensor.h
commit that adds the driver
commit that adds sample

For anyone looking for an updated SCD30 driver - https://github.com/nobodyguy/sensirion_zephyr_drivers


test: snapshot tests for diagrams

Closes #175.
Summary of Changes
Created tests to check if there are any graphic changes in the seaborn library by adding legacy graphics to compare to
Co-authored-by: patrikguempel<EMAIL_ADDRESS>

🦙 MegaLinter status: ❌ ERROR

Descriptor
Linter
Files
Fixed
Errors
Elapsed time

✅ PYTHON
black
12
4
0
1.03s

❌ PYTHON
mypy
12

1
2.26s

✅ PYTHON
ruff
12
5
0
0.06s

✅ REPOSITORY
git_diff
yes

no
0.03s

See detailed report in MegaLinter reports
Set VALIDATE_ALL_CODEBASE: true in mega-linter.yml to validate all sources, not only the diff
MegaLinter is graciously provided by

Hint: Use the Rename refactoring to rename declarations. This way references also get updated.

Please finish this next week before starting something new.

:tada: This PR is included in version 0.12.0 :tada:
The release is available on:

v0.12.0
GitHub release

Your semantic-release bot :package::rocket:


Apex Chart's - Mouse Position wrong when Scale Transform is used

Bug report
Mous Position does not work when shown in a transformed Container.
Problem is, the site I use, zooms outside of ApexCharts.

Tooltip Shown on MousePosition

What is happening instead?
Tooltip Position is wrong

Problem also is, Chart is embedded in other side, so I cannot remove the transform.

Also having this problem. Any updates on this?

still active

active

I also have this problem. I would like to implement fullscreen option that would also enlarge chart with transform: scale.

is still relevant

still open

I have same problem, any solutions?

We switched away from apex charts


Fix variable name bug to send email

Change variable name from sendgrid to client in order to send email correctly.

Nice catch. Thank you!!

Thanks for contributing to SendGrid Open Source! We think it's awesome when community members contribute to our projects and want to celebrate that.
The following link will ask you to authenticate with Github (so we can verify your identity), it will then ask for a little bit more information and we'll then send you a thanks for contributing.
Click Here to Continue »
Once again, thank you!

My pleasure! @elbuo8 just submitted! Thanks for your awesome work :)


Sentinel-2 data via Coverages

What to do if I want to expose Sentinel-2 via Coverages for which the storageCrs would be multiple UTM zones?

@m-mohr A coverage needs to be in a single storageCrs, so that a client can request data that combines content across those different UTM zones.
So you can either:

A) Have a separate coverage for each UTM zone
B) Have a single coverage supporting CRS84 output and make that the storageCrs

If you choose to go with B, then you can also implement Scenes where /collections/{collectionId}/scenes/{sceneId}/coverage can be in the native UTM zone of that particular scene.

storageCrs says it describes the native CRS, but if I choose B it's not the native CRS anymore once I reprocessed all on-the-fly into EPSG:4326 for example. So this is confusing to me...
A) That's not what people expect, they don't want to load data from X different collections for sure...

@m-mohr

but if I choose B it's not the native CRS anymore once I reprocessed all on-the-fly into EPSG:4326 for example.

The definition of the "native CRS" is somewhat loser. I don't recall where we wrote that, but it is essentially the CRS in which the server can most efficiently return the data.
In the case of sentinel-2 across multiple zones, there is not a single CRS, so CRS84 is likely the "native" aka storageCrs.
And one of the main reasons for /scenes is specifically to still be able to return the true native/storage CRS, but only one scene at a time.

The definition of the "native CRS" is somewhat loser. I don't recall where we wrote that,

7.2.2. -> req. 2J: "The storageCrs property SHALL be set to the native CRS of the coverage"
Should that be default instead of native then?

but it is essentially the CRS in which the server can most efficiently return the data.

Most efficiently is pretty ambiguous, but "most efficient" would probably be understood as no reprojection, so UTM zones. So from that description it storageCrs should not be CRS84.

And one of the main reasons for /scenes is specifically to still be able to return the true native/storage CRS, but only one scene at a time.

Not interested in scenes, I already have a STAC API.

Maybe that should simply be:

That could work.

So from that description the storageCrs should not be CRS84.

CRS84 would likely still be the most efficient CRS that you can request any scene and data across scenes, since there are no better choices.

Not interested in scenes, I already have a more commonly adopted STAC API.

/scenes and /scenes/{sceneId} can pretty much return exactly the same as /items and /items/{itemsId} when negotiating the STAC media types for these, so that should be easy to re-reoute to your existing STAC API.
And you could include the [ogc-rel:coverage] link to /scenes/{sceneId}/coverage in the native zone.
You would also have the assets as well, but the coverage might be a more dynamci endpoint returning multiple bands and itself supporting subsetting etc.

@m-mohr We had a similar issue in API-EDR. Most 'native' NWP models mix the surface and vertical levels together in one structure, but this goes against the 'one CRS' principle. The meteorology communituy are recognising that separate Collections are needed to maintain the homogeneous CRSs to make the API work simply and effectively. The server side maintenance overhead is considered part of the trade-off for the downstream benefits.
In my view, the end users of a Coverage API are significantly different from EDR end users, so the extra API-Coverage complexity may be acceptable to them.
HTH.

@m-mohr As for mandatory CRS84, we relaxed it in API-EDR, to support, for example, engineering coordinates, space-based, medical tomograph 3D scan, etc.

@chris-little

engineering coordinates, space-based, medical tomograph 3D scan, etc.

These are also "relaxes" in Coverages / Common, through the clause "for data referenced to the Earth".
This whole CRS84 being needed is only about the description of the spatial extent for discovery -- there is no requirement that the Coverage (or Maps) be available in CRS84, but that is strongly recommended to facilitate interoperability (again, for data referenced to the Earth only).

SWG 2024-11-27: Here are the actions we can take:

Improve on https://docs.ogc.org/DRAFTS/19-087.html#_extended_collection_description_response_collectionscollectionid requirement 7.2.2 Requirement 2 J regarding what is the storageCrs
Add a note describing the sentinel-2 / LANDSAT use case where the individual parts are likely internally stored in different native CRSs, and the storageCrs is recommended to be CRS84 as it is the easiest way to provide a global coverage sourced from all constituent granules / scenes
The Scenes requirements class will further help with this use case to additionally provide the ability to retrieve a coverage from single parts in their true native CRS, but it was agreed to move this to a future part (#196)


Message too large for server

Hi, i got the "Message too large for server" error when trying to send an email. How do I increase that limit?

Any log on the server?

I only get this when trying to send the email:
Oct  7 16:03:16 mail3 postfix/submission/smtpd[21588]: warning: connect to Milter service inet:localhost:54321: Connection refused
Then I get that "Message too large for server" error message in my email client (K-@ Mail on Android)

I restarted and the Milter error dissapeared, but still getting that size limit message on the email client

Solved, I increased limit by adding
message_size_limit = 102400000
to config/postfix-main.cf
as default was 10MB:
message_size_limit = 10240000

Great!


Handle the except statement

https://github.com/Porthmeus/MeMoMe/blob/fc2041b3c4b9cc85d69f7bb94304e1ed66e9c3c1/src/annotateModelSEED.py#L155
Please insert a sensible return statement

Related to #8 if the identifiers file could not be downloaded

See comments on #105


Project search and find all references no results

Check for existing issues

[X] Completed

Describe the bug / provide steps to reproduce it
I don't know if it is because of the monorepo structure or the project is too big. But project search just gives no results, no matter what you search or what mode you use (regex, word, case). Same for find all references
Environment
Zed: v0.77.3 (stable)
OS: macOS 13.1.0
Memory: 32 GiB
Architecture: aarch64
If applicable, add mockups / screenshots to help explain present your vision of the feature

If applicable, attach your ~/Library/Logs/Zed/Zed.log file to this issue.
If you only need the most recent lines, you can run the zed: open log command palette action to see the last 1000.
No response

Hey @IuryPiva, just out of curiosity, does your project setup look anything like this user's?

https://github.com/zed-industries/community/issues/780

Yes! Thanks @JosephTLyons I'll close this issue =)


Staging should have a button to copy a project from (but not to) prod

I'd like to have a button in the admin dashboard on staging that allows us to copy a project from production (but never to production). Then LF staging could be set up to point to LD staging, and we'd be able to test Send/Receive on real projects without risking contaminating the user's project on production with our test data.

Implementation ideas:

Button kept inside a <DevContent> element so won't be visible in production
ALSO inside an <AdminContent> so anyone using staging won't see it unless they're an admin
When you click the button, it queries https://languagedepot.org/api/user/currentUser (with the https://languagedepot.org part of that URL configurable with an environment variable named PRODUCTION_BASE_URL or similar) to check if you're logged in and an admin in production
If you're not logged in, it produces a link that opens in a new tab, saying "Please log in to the production server"
Once you're logged into production, it uses the currentUser result to check if you're an admin in production ("role": "ADMIN")
If you're an admin in production, then it allows you to copy a project.

To copy a project:

Send a GraphQL request to get the project details we want to copy
Create project locally, copying project name, code, and description. Do NOT copy project members.
Send a request to /api/project/backupProject/{code} to get a backup .zip file
Follow reset-project steps locally, upload that .zip file
Immediately delete the .zip file after upload success so it doesn't stick around on staging/local-dev

This should result in a project on staging (or in local dev) with the same Mercurial commits as the one in production

After discussion in today's standup, it seems like a shell script or bookmarklet would make more sense than a button in the UI.

I wonder if we could make a taskfile command for this? Not sure how best to handle auth though, that's probably the hardest part.


Add Mistral 7B v0.2 Instruct

Prevents error when loading Mistral 7B v0.2 Instruct

Sorry, there's one change on 0.2 (it doesn't use the sliding attention window and has a longer context length instead), I'll update the PR shortly

@ArthurConmy I updated the docs and the config

@ArthurConmy there really isn't a way to get that list to repopulate. Once the agreements are accepted, the models behave exactly the same way as if they were any other model. The only way to conceivably do something like that is to run a REST request, and pull the meta information on the model to see if it is gated. That's quite a bit of work for what comes down to a pretty small block in the docs.
I am at the start of revamping the model submission process. One of the pieces of that is to setup a PR template for submitting new models. This situation will be noted in that template to make sure whoever is submitted is informing us of the requirement, and also to make sure they edit this doc.

Thanks Bryce! No need to do a REST thing, thanks for clarifying this.


Trainer crashed when optimizer frequency is defined.

🐛 Bug

To Reproduce
Steps to reproduce the behavior:
Run the following code:
https://gist.github.com/24hours/ec67de5384bb05e28544d580ae424639

Traceback (most recent call last):
  File "pl_bug.py", line 40, in <module>
    trainer.fit(mnist_model, train_loader)
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/states.py", line 48, in wrapped_fn
    result = fn(self, *args, **kwargs)
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 1073, in fit
    results = self.accelerator_backend.train(model)
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/accelerators/gpu_backend.py", line 51, in train
    results = self.trainer.run_pretrain_routine(model)
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/trainer.py", line 1239, in run_pretrain_routine
    self.train()
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/training_loop.py", line 394, in train
    self.run_training_epoch()
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/training_loop.py", line 491, in run_training_epoch
    batch_output = self.run_training_batch(batch, batch_idx)
  File "/opt/conda/lib/python3.6/site-packages/pytorch_lightning/trainer/training_loop.py", line 883, in run_training_batch
    batch_outputs[opt_idx].append(opt_closure_result.training_step_output_for_epoch_end)

Code sample
    def configure_optimizers(self):
        optimizer_G = torch.optim.Adam(self.parameters(), lr=0.1, weight_decay=1e-5)
        optimizer_D = torch.optim.Adam(self.parameters(), lr=0.1, weight_decay=1e-5)

        return [
                {'optimizer': optimizer_D, 'frequency': 5},
                {'optimizer': optimizer_G, 'frequency': 1}
            ]

the culprit is 'frequency' : 5, removing the line will allow trainer to run smoothly.
https://pytorch-lightning.readthedocs.io/en/latest/lightning-module.html?highlight=optimizers#configure-optimizers
The definition is correct according to this documentation.
Expected behavior
Model should train without crash.
The code work in 0.8.5 environment.
Environment

CUDA:

GPU:

GeForce GTX TITAN X

available:         True
version:           11.0

Packages:

numpy:             1.18.5
pyTorch_debug:     False
pyTorch_version:   1.6.0a0+9907a3e
pytorch-lightning: 0.9.0
tensorboard:       2.2.0
tqdm:              4.48.2

System:

OS:                Linux
architecture:

64bit

processor:         x86_64
python:            3.6.10
version:           #110-Ubuntu SMP Tue Jun 23 02:39:32 UTC 2020

this is the case with multiple optimizers, you need to spec them.. so you would prefer having default 1 if freq is not specified?

the exception occur because trainer_loop.py incorrect count number of optimizer if frequency is defined. Since this configuration work in version 0.8.5, this look like regression error.
Unless of course if the configuration is unsupported in version 0.9.0

so you would prefer having default 1 if freq is not specified?

That is a totally different case I think. If the frequency is not specified we run train_step for both optimizers but if it is specified to 1 for both then in such case it will run 1st batch for opt_1, 2nd for opt_2, 3rd for opt_1, 4th for opt_2...
A simple fix here can be:
https://github.com/PyTorchLightning/pytorch-lightning/blob/a7705c8677b9e2b5105e26a38db9d1b650182576/pytorch_lightning/trainer/training_loop.py#L872
if len(batch_outputs) == 1:  # when frequencies are defined
    batch_outputs[0].append(opt_closure_result.training_step_output_for_epoch_end)
else:  # no frequencies
    batch_outputs[opt_idx].append(opt_closure_result.training_step_output_for_epoch_end)

ok, can someone write a test and submit a PR for this? show the test failing on master first.
@awaelchli  or @rohitgr7 ?


Add Facebook and Email Icons

What version of starlight are you using?
0.10.0
What is your idea?
Add Facebook and Email icons so they can be used in socials.
Why is this feature necessary?
Adding Facebook and Email icons would be a nice to have for anyone looking to add those to their starlight project.
Do you have examples of this feature in other projects?
No response
Participation

[X] I am willing to submit a pull request for this issue.

Thanks for the issue @EpicPizza — would be happy to receive a PR adding these.
We use the Unicons icon library, so I’d suggest grabbing icons from there.
I’ll also note that #709 will soon unlock adding any custom markup to the icons component, which could help for use cases like this where a custom icon is desired.


sccache support

It'd be great to have sccache for installation with the toolchain action (and a corresponding use_sccache flag or similar on the cargo action), particularly with a cached version of sccache (as with other binaries) to avoid the penalty of compiling every time.

Looks like this is mitigated with https://github.com/actions-rs/install


node.js20 update

Fix warning like: Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20:

This fixes https://github.com/Azure/k8s-deploy/issues/313.
Can we get a new release of this action with the updated Node version soon?


[s3 payload] catch ioerror, and provide more context on s3 object error

to: @ryandeivert
cc: @airbnb/streamalert-maintainers
size: small
resolves #613 , resolves #629
Background
There were two small bugs with the S3 Payload pre-parsing.  One was a vague error message when downloading from S3, one was failing to catch an IOError when the Lambda container's disk is full
Changes

Catch IOError on download from S3
Show the key and bucket when the object size is too big
Update tests

Testing
Local CI testing with nose and pylint

Coverage increased (+0.005%) to 95.762% when pulling 40a2e18b9890499f0e5e243537f814fff83ccd0b on jacknaglieri-fix-various-s3-bugs into cc20bc211b2eef469d0641a3ad5dfefbcb2f816b on master.


Fix typo for hovered dropdown destroy

There was obviously a typo removeEventHandlers instead of removeEventListener
Proposed changes
Replace with the correct calls
Types of changes

[x] Bug fix (non-breaking change which fixes an issue).
[ ] New feature (non-breaking change which adds functionality).
[ ] Breaking change (fix or feature that would cause existing functionality to change).

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

Thanks!


Use FusionSolar REST api instead of Kiosk mode

Hi @tijsverkoyen
Until last firmware upgrade, I was using huawei_solar integration from emilv2 in order to obtain quality info from my Huawei Solar inverter. Unfortunately, Huawei has deprecated modtbus direct access in SUN2000L inverter series and now I have to downgrade firmware. Probably, in a few some upgrades they will remove access to FusionSolar for older firmware version like they did in December and so it's just a matter of time until we loose rich inverter monitoring.
I've been looking at your integration and I thing that instead of using Kiosk mode, we could use Fusionsolar API. This API give us plenty more information about inverter status and is used by FusionSolar portal. I'm not programmer although I'm able to modify code programmed by others, but in this case it's out of my skills.
There is also a FusionSolar API already documented (more or less)
By inspecting Fusionsolar web, we can obtain plenty data from our inverters like daily performance:

Energy flow:

Or realtime information:

At this point I have no intention to switch to the FusionSolar REST API. To be able to use the FusionSolar API you have to do a lot os steps, including contacting the service team to obtain an openAPI account. Which is not something most users will be able to understand/do.


Scrutinizer Auto-Fixes

@ovac requested this pull request.
It consists of patches automatically generated for this project on Scrutinizer:
https://scrutinizer-ci.com/g/ovac/laravel-hubtel-payment/

Coverage remained the same at 100.0% when pulling 252a17c805f9d0512fa61cde1f8638dd45c4b365 on scrutinizer-patch-1 into c269e67c4e1c74e9ede4d0db26c8b9100725a3f0 on master.

Coverage remained the same at 100.0% when pulling 252a17c805f9d0512fa61cde1f8638dd45c4b365 on scrutinizer-patch-1 into c269e67c4e1c74e9ede4d0db26c8b9100725a3f0 on master.

Coverage remained the same at 100.0% when pulling 252a17c805f9d0512fa61cde1f8638dd45c4b365 on scrutinizer-patch-1 into c269e67c4e1c74e9ede4d0db26c8b9100725a3f0 on master.


DS-4260: Remove non-existing command from oai harvester's help

https://jira.duraspace.org/browse/DS-4260

I also created a PR against DSpace 7: https://github.com/DSpace/DSpace/pull/2438


Selfsigned certs

Motivation
Showcase app didn't work with selfsigned certificates
Tasks:

[x] Upgrade the Xamarin Forms dep to 3.x (was 2.x)
[x] Upgrade all deps depending on Xamarin Form 2.x
[x] Change code to comply to the new dep version
[x] Check that metrics are published with self signed cert
[x] Test the whole app

👀

verified for both IDM and metrics service and it is working on the android device.


[release] Version 0.7.0

Blocked by #86 and #90.

Closed https://github.com/openwisp/django-x509/pull/93


Add updated nq topics

We should move away from DPR topics as there are some mistakes that lead to a difference of about half a point. This is a switch to using the EfficientQA dev/test sets.

@ronakice can you document this error?

These are my results using this set of topics (results on old set whenever available indicated in (...):
BM25
Test:
Top1	accuracy: 0.22825484764542936
Top20	accuracy: 0.6398891966759003 (0.6294)
Top100	accuracy: 0.7922437673130194 (0.7825)
Top1000	accuracy: 0.8894736842105263

Dev:
Top1	accuracy: 0.22816032887975335
Top20	accuracy: 0.6326367477446614
Top100	accuracy: 0.7703551444558638
Top1000	accuracy: 0.8700468196871075

DPR
Test:
Top1	accuracy: 0.4445983379501385
Top20	accuracy: 0.7983379501385042 (0.7947)
Top100	accuracy: 0.8664819944598338 (0.8609)
Top1000	accuracy: 0.9210526315789473

Dev:
Top1	accuracy: 0.44615735982642457
Top20	accuracy: 0.7793764988009593
Top100	accuracy: 0.8546305812492863
Top1000	accuracy: 0.9093296791138518

DKRR-DPR
Test:
Top1	accuracy: 0.49418282548476455
Top20	accuracy: 0.8426592797783934 (0.8376731301939058)
Top100	accuracy: 0.8933518005540166 (0.8875346260387812)
Top1000	accuracy: 0.9343490304709141

Dev:
Top1	accuracy: 0.4862395797647596
Top20	accuracy: 0.8314491264131552
Top100	accuracy: 0.8874043622245061 (small improvement in our codebase)
Top1000	accuracy: 0.9228046134520954  (small improvement in our codebase)

There are some query changes, I've added 1 example each in dev/test set for both topics, you can see them in the tests. Topic generation script will be added to pyserini later today.
Some examples:
gimme was preprocessed to gim me
don't was preprocessed to do n' t
etc.
Note some of these improvements might also be because of bugs in the preprocessing of answers. Here most of these should be fixed as we match results in their latest FiD codebase.
I only ran into it because the DKRR/FiD replication was missing a few points (with the new preprocessed set it is replicable at the same if not slightly better level).


refactor/Rename ecosystem to SDK Matrix in Nav

This PR

Renames Ecosystem to SDK Matrix which is more direct.
Related Issues

Notes

Not sure what people feel about this - happy for comments!
Follow-up Tasks

How to test
Look at the netflify preview deploy and see what your feelings are

I personally think the term ecosystem works better here. I would expect an SDK matrix to basically be a table that lists the version and supported version of various SDKs.
I've started working on a script that pulls in SDK readmes. You can see the PR here. Perhaps it could also be extended to generate a matrix of some sort.
@jamescarr, is that in line with what you mentioned in Slack?

@beeme1mr Yeah, that is exactly what I am thinking. A table that shows which version of the spec an sdk implements, current version, etc.

I'll try and prototype something tomorrow.

I haven't had a chance to build the matrix yet, but I think we should able to parse what we need out of some well-formatted SDK READMEs. I've been testing this out with the Go SDK. You can see the result here.

I've created an issue to add an SDK matrix page that should address @jamescarr request.
I'm going to close this because I think the Ecosystem page serves a different purpose than the SDK Matrix Page.


[Fix-13977][SQL] 3.2.0_schema mysql ddl sql error

Purpose of the pull request

This PR closes https://github.com/apache/dolphinscheduler/issues/13977

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:

(or)
If your pull request contain incompatible change, you should also add it to docs/docs/en/guide/upgrede/incompatible.md

cc @zhuangchong

Codecov Report

Merging #13979 (5b3364a) into dev (26c5f3c) will decrease coverage by 0.05%.
The diff coverage is n/a.

:exclamation: Current head 5b3364a differs from pull request most recent head 4e57dc4. Consider uploading reports for the commit 4e57dc4 to get more accurate results

@@             Coverage Diff              @@
##                dev   #13979      +/-   ##
============================================
- Coverage     38.91%   38.87%   -0.05%
+ Complexity     4469     4466       -3
============================================
  Files          1164     1164
  Lines         42444    42367      -77
  Branches       4761     4741      -20
============================================
- Hits          16518    16470      -48
+ Misses        24106    24076      -30
- Partials       1820     1821       +1

see 58 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Dask.distributed demo repository

Setting up a cluster and then setting up dask.distributed is probably a big enough speedbump to derail most potential users.  It would be good to have a simple-yet-motivating example.  This would demonstrate

How to set up a cluster on EC2 (perhaps using conda-cluster)
How to set up dask.distributed on that cluster (perhaps using IPython parallel)
How to compute on some public dataset (perhaps hosted on S3 (I should build S3 hooks into dask.bag))
How to connect a collection like dask.bag up to dask.distributed using the Client.get method

The artifact here is probably a public repository on github.  This could serve as a public reference example both for dask.distributed and for conda-cluster.  It would be a nice example use case to use in presentations and would probably serve well when communicating with new users on mailing lists.

cc @quasiben @danielfrg @cowlicks

We could push to make this fairly easy.  Could dask.distributed be setup in a local mode on a single machine?  IPython Parallel has no issues here I don't think

Dask has other schedulers that support that case well.  The goal here is to demonstrate capability on a distributed machine.

There is a prototype here https://github.com/ContinuumIO/dask-distributed-demo (private repo)
@chdoig could you move this to the blaze org? Or maybe we should wait for @mrocklin's planned distributed changes.

My current plan is to avoid committing resources to the current dask.distributed system.  I'm open to other suggestions.  My work at github.com/mrocklin/distributed is slowgoing but also somewhat steady.

The distributed scheduler has been moved to its own project: https://github.com/dask/distributed. Closing.


Update to support the complete re-writing of the R parser

The R grammar (https://github.com/r-lib/tree-sitter-r) was recently rewrote, which introduced breaking changes in nvim-treesitter. See https://github.com/nvim-treesitter/nvim-treesitter/commit/5373c90c55a33408604d17713edaa9560306b83d.
These breaking changes were addressed in these two commits:

https://github.com/nvim-treesitter/nvim-treesitter/commit/3e535e826da265748b875b18dbfb361bd1a1701c
https://github.com/nvim-treesitter/nvim-treesitter/commit/f0e3b5c5fe38d0012c63368db90017fef87c85a2

However, the changes in tree-sitter-r also broke nvim-treesitter-textobjets because node names were change (https://github.com/nvim-treesitter/nvim-treesitter/issues/6849):
Error detected while processing BufNewFile Autocommands for "*":
Error executing lua callback: ...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:36: BufNewFile Autocommands for "*"..FileType Autocommands for "*": Vim(append):Error executing lua callback: ...-linux64/
share/nvim/runtime/lua/vim/treesitter/query.lua:252: Query error at 12:2. Invalid node type "if":
(if
 ^

stack traceback:
        [C]: in function '_ts_parse_query'
        ...-linux64/share/nvim/runtime/lua/vim/treesitter/query.lua:252: in function 'fn'
        ...vim-linux64/share/nvim/runtime/lua/vim/func/_memoize.lua:58: in function 'fn'
        ...vim-linux64/share/nvim/runtime/lua/vim/func/_memoize.lua:58: in function 'get_query'
        ...r-textobjects/lua/nvim-treesitter/textobjects/shared.lua:99: in function 'available_textobjects'
        ...r-textobjects/lua/nvim-treesitter/textobjects/select.lua:173: in function 'attach'
        ...vim/lazy/nvim-treesitter/lua/nvim-treesitter/configs.lua:509: in function 'attach_module'
        ...vim/lazy/nvim-treesitter/lua/nvim-treesitter/configs.lua:532: in function 'reattach_module'
        ...vim/lazy/nvim-treesitter/lua/nvim-treesitter/configs.lua:133: in function <...vim/lazy/nvim-treesitter/lua/nvim-treesitter/configs.lua:132>
        [C]: in function 'nvim_cmd'
        ...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:36: in function <...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:35>
        [C]: in function 'pcall'
        vim/shared.lua: in function <vim/shared.lua:0>
        [C]: in function '_with'
        ...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:35: in function <...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:10>
stack traceback:
        [C]: in function '_with'
        ...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:35: in function <...bob/nightly/nvim-linux64/share/nvim/runtime/filetype.lua:10>

This PR is my attempt to fix these issues. I am by no mean a treesitter expert, but I have tested it and it seems to be working fine.

I tried this patch, I notice there is an incorrect behavior:
In the following example
for (i in 1:20) {
    if (i > 20) {
        p<cursorPosition>rint(i)
    }
}

select the @inner.condition should select print(i), but instead it selects i > 20

Thank you very much!

Any updates on things that are needed to do to merge this PR?  Currently R users have to completely disable this plugin or rollback to an older version in able to write R in Neovim, otherwise they can not even save the file.

The following patch works for me on main branch:
diff --git a/plugin/query_predicates.lua b/plugin/query_predicates.lua
index b92f43d..9ba6d93 100644
--- a/plugin/query_predicates.lua
+++ b/plugin/query_predicates.lua
@@ -10,7 +10,9 @@ ts.query.add_directive("make-range!", function(match, pattern, buf, predicate, m
   local start_nodes = match[start_node_id]
   local end_nodes = match[end_node_id]

-  assert(#start_nodes == 1, "#make-range! does not support captures on multiple nodes")
+  if start_nodes then
+    assert(#start_nodes == 1, "#make-range! does not support captures on multiple nodes")
+  end
   if end_nodes then
     assert(#end_nodes == 1, "#make-range! does not support captures on multiple nodes")
   end
diff --git a/queries/r/textobjects.scm b/queries/r/textobjects.scm
index b14a37e..5cce11b 100644
--- a/queries/r/textobjects.scm
+++ b/queries/r/textobjects.scm
@@ -9,68 +9,56 @@
 (comment) @comment.outer

 ; conditional
-(if
+(if_statement
   condition: (_)? @conditional.inner) @conditional.outer

 ; function
-[
-  (function_definition)
-  (lambda_function)
-] @function.outer
-
 (function_definition
   [
     (call)
-    (binary)
-    (brace_list)
-  ] @function.inner) @function.outer
-
-(lambda_function
-  [
-    (call)
-    (binary)
-    (brace_list)
+    (binary_operator)
+    (braced_expression)
   ] @function.inner) @function.outer

 ; loop
 [
-  (while)
-  (repeat)
-  (for)
+  (while_statement)
+  (repeat_statement)
+  (for_statement)
 ] @loop.outer

-(while
+(while_statement
   body: (_) @loop.inner)

-(repeat
+(repeat_statement
   body: (_) @loop.inner)

-(for
+(for_statement
   body: (_) @loop.inner)

 ; statement
-(brace_list
+(braced_expression
   (_) @statement.outer)

 (program
   (_) @statement.outer)

 ; parameter
-((formal_parameters
-  "," @_start
+((parameters
+  (comma) @_start
   .
   (_) @parameter.inner)
   (#make-range! "parameter.outer" @_start @parameter.inner))

-((formal_parameters
+((parameters
   .
   (_) @parameter.inner
   .
-  ","? @_end)
+  (comma)? @_end)
   (#make-range! "parameter.outer" @parameter.inner @_end))

 ((arguments
-  "," @_start
+  (comma)? @_start
   .
   (_) @parameter.inner)
   (#make-range! "parameter.outer" @_start @parameter.inner))
@@ -79,44 +67,44 @@
   .
   (_) @parameter.inner
   .
-  ","? @_end)
+  (comma)? @_end)
   (#make-range! "parameter.outer" @parameter.inner @_end))

 ; number
 (float) @number.inner

 ; assignment
-(left_assignment
+("<-"
   name: (_) @assignment.lhs
   value: (_) @assignment.inner @assignment.rhs) @assignment.outer

-(left_assignment
+("<-"
   name: (_) @assignment.inner)

-(right_assignment
+("->"
   value: (_) @assignment.inner @assignment.lhs
   name: (_) @assignment.rhs) @assignment.outer

-(right_assignment
+("->"
   name: (_) @assignment.inner)

-(equals_assignment
+((comma)
   name: (_) @assignment.lhs
   value: (_) @assignment.inner @assignment.rhs) @assignment.outer

-(equals_assignment
+((comma)
   name: (_) @assignment.inner)

-(super_assignment
+("<<-"
   name: (_) @assignment.lhs
   value: (_) @assignment.inner @assignment.rhs) @assignment.outer

-(super_assignment
+("<<-"
   name: (_) @assignment.inner)

-(super_right_assignment
+("->>"
   value: (_) @assignment.inner @assignment.lhs
   name: (_) @assignment.rhs) @assignment.outer

-(super_right_assignment
-  name: (_) @assignment.inner)
+(binary_operator)
+  name: (_) @assignment.inner

This following patch is required:
-  assert(#start_nodes == 1, "#make-range! does not support captures on multiple nodes")
+  if start_nodes then
+    assert(#start_nodes == 1, "#make-range! does not support captures on multiple nodes")
+  end

Otherwise will get the following error:
E5108: Error executing lua: .../nvim-treesitter-textobjects/plugin/query_predicates.lua:13: attempt to get length of local 'start_nodes' (a nil value)

Anything that needs to be done on my side at this point?

Anything that needs to be done on my side at this point?

I think you don’t need to do anything?
The main branch will supersede the master branch in the future (similar to what happens in the nvim-treesitter repo). Since the two branch are not compatible… Maybe we can wait until this PR is merged in the master branch and back ported, and then to see what is the next step in the main branch?

Maybe we can wait until this PR is merged in the master branch and back ported, and then to see what is the next step in the main branch?

I think so. I am not sure if anything is missing for that PR to be merged.

Thanks! that fixes my issues
Fixes r-lib/tree-sitter-r#131
Fixes nvim-treesitter/nvim-treesitter#7001

Checks are failing, so that's an obvious thing that should be fixed.

And ignore the main branch, the master branch is still the default.

The failed check seems to be related to another grammar:
Checking tact textobjects
Check failed:
...bQDB/usr/share/nvim/runtime/lua/vim/treesitter/query.lua:252: Query error at 5:2. Invalid node type "static_function":
(static_function

Ugh. This repo is in worse shape than I thought.
@lucario387 can you take a look at the query format failure?

@lucario387 can you take a look at the query format failure?

Oops did not handle this :) I'll add a PR later

Please remove the emojis from the commit message :). All three of them

Please remove the emojis from the commit message :). All three of them

Done.

Thank you.

Thanks!


t0065: bad column names in link sat

Column names in the satellite of the link shoul not have the _TTT postfix

is fixed


Demo: Improve scrollwheel zoom vs. scroll example

I got an email from Zach suggesting that ScottPlot mouse interactivity is odd when using the WpfPlot control inside a ScrollViewer:

I recently added a scroll bar to my wpf app and noticed that, when I try to zoom in on the ScottPlots, the scrolling action simultaneously zooms in on the plot (slightly) and moves the scroll bar. This makes it difficult to zoom in, because I need to unscroll the scroll bar each time I try to zoom in a bit, such that zooming in a lot requires a lot of unscrolling.
This is likely something I need to do on my end to disable the scroll bar when mousing over the plot and not something that can be addressed within ScottPlot. DataGrids, which are native to wpf, have this functionality.

It might be good to figure out how to do this and add an example for the demo application.

I now better understand this problem. Typically the mouse scroll wheel moves the ScrollViewer up and down. It still does, but those scroll events are also getting detected as scroll-wheel-zoom events.
I will fix this by adding something like:
wpfPlot.Configure(enableScrollWheelZoom: false);

Hello,
Is there a solution for this problem other than canceling the zoom in and out?

Hi @saklanmazozgur,
Defining the Problem

Is there a solution for this problem other than canceling the zoom in and out?

You can use the mouse scroll wheel to scroll or to zoom but not both at the same time.
If you choose to make the wheel scroll the window up and down, it cannot be used for zoom.
If you choose to make the wheel zoom in and out, the wheel cannot be used to scroll the window.
Current Solution
Users who want the scroll wheel to scroll the window up and down (rather than zoom in and out) can disable scroll wheel zoom.
The API changed a bit since this issue was first posted. There is an example of this concept in the ScottPlot demo application https://swharden.com/scottplot/demo/
wpfPlot.Configuration.ScrollWheelZoom = false;

https://github.com/ScottPlot/ScottPlot/blob/1f68020e0c874140cd668752cf9769398727c3a8/src/demo/ScottPlot.Demo.WPF/WpfDemos/PlotInScrollViewer.xaml#L9-L15
https://github.com/ScottPlot/ScottPlot/blob/1f68020e0c874140cd668752cf9769398727c3a8/src/demo/ScottPlot.Demo.WPF/WpfDemos/PlotInScrollViewer.xaml.cs#L24-L38

Hello, my problem is that both are used. I want it to be like you mentioned. I only want the graphic to zoom in and out when hovering over the graphic.
I have uploaded a sample video. I can share the code if you want. I am using homepage structure in MaterialDesignInXamlToolkit. As an example, we can take reference there.
Since I can't upload the video, I'm sharing it on another site.
Video Link

Improve Demo

I only want the graphic to zoom in and out when hovering over the graphic.

I think the demo shows how to make the scrollwheel scroll (not zoom).
I can extend the demo to also show how to make the scrollwheel zoom (not scroll).
This may make it easier to figure out how to solve this problem.
Demonstrating the Issue

Since I can't upload the video, I'm sharing it on another site.

GitHub supports videos in comments 😉
https://user-images.githubusercontent.com/4165489/129747262-c5c68274-47bf-4f73-857d-b378e677691a.mp4

Hi @saklanmazozgur,
This was harder than I expected to figure out, but I arrived at a solution that seems to work well!

<ScrollViewer PreviewMouseWheel="ScrollViewer_PreviewMouseWheel">
    <StackPanel>
        <ScottPlot:WpfPlot Height="300" Name="wpfPlot1"/>
        <ScottPlot:WpfPlot Height="300" Name="wpfPlot2"/>
        <ScottPlot:WpfPlot Height="300" Name="wpfPlot3"/>
    </StackPanel>
</ScrollViewer>

private void ScrollViewer_PreviewMouseWheel(object sender, MouseWheelEventArgs e)
{
    ScrollViewer myScrollViewer = (ScrollViewer)sender;

    if (ScrollRadio.IsChecked.Value)
    {
        // manually scroll the window then mark the event as handled so it does not zoom
        double scrollOffset = myScrollViewer.VerticalOffset - (e.Delta * .2);
        myScrollViewer.ScrollToVerticalOffset(scrollOffset);
        e.Handled = true;
        return;
    }

    if (ZoomRadio.IsChecked.Value)
    {
        // manually scroll (zero offset) to complete the scroll action, then proceed to zooming
        myScrollViewer.ScrollToVerticalOffset(myScrollViewer.VerticalOffset);
        return;
    }
}

Following-up, in WinForms the same thing can be achieved a different way:

public PlotsInScrollViewer()
{
    InitializeComponent();

    Random rand = new Random();
    formsPlot1.Plot.AddSignal(DataGen.RandomWalk(rand, 100));
    formsPlot2.Plot.AddSignal(DataGen.RandomWalk(rand, 100));
    formsPlot3.Plot.AddSignal(DataGen.RandomWalk(rand, 100));

    formsPlot1.MouseWheel += FormsPlot_MouseWheel;
    formsPlot2.MouseWheel += FormsPlot_MouseWheel;
    formsPlot3.MouseWheel += FormsPlot_MouseWheel;
}

private void FormsPlot_MouseWheel(object sender, MouseEventArgs e)
{
    ((HandledMouseEventArgs)e).Handled = rbZoom.Checked;
}

private void rbScroll_CheckedChanged(object sender, EventArgs e)
{
    formsPlot1.Configuration.ScrollWheelZoom = false;
    formsPlot2.Configuration.ScrollWheelZoom = false;
    formsPlot3.Configuration.ScrollWheelZoom = false;
}

private void rbZoom_CheckedChanged(object sender, EventArgs e)
{
    formsPlot1.Configuration.ScrollWheelZoom = true;
    formsPlot2.Configuration.ScrollWheelZoom = true;
    formsPlot3.Configuration.ScrollWheelZoom = true;
}

I know there is video support in the comments, but when I try to upload a video, I keep getting an error. I didn't understand why. :)
Also thank you for the demo. I will implement it in my project.


Updated index.md in release-3.0  to direct users to the latest 4.0 documentation

fixes #1960

Documentation Update: This pull request updates the index.md file for Release 3.0 to direct users to the latest documentation, ensuring they have access to the most current and relevant information.

SEO Consideration: In light of the recent SEO issues affecting search engine indexing, this update is crucial to prevent users from landing on outdated documentation pages

Note: In a separate pull request for the Release 4.0 branch, I am proposing an update to the robots.txt file. This change is designed to prevent search engines from indexing older versions of the documentation, thereby enhancing the visibility and accessibility of the most current documentation for users.

.gitignore should not be committed

@jrobinAV pls check, its undone now


Adds support for Aglio's "include" directive

Resolves a crash when using the include directive in a large API Blueprint project split into multiple files.

Cleans up the temporary file used during rendering.

Note: This requires Aglio 2.1.0 or higher, with support for the -n command line option.

Thanks!


feat: Add proto annotations for amino json

Closes: https://github.com/osmosis-labs/cosmos-sdk/issues/400
What is the purpose of the change
Manually brought changes from https://github.com/cosmos/cosmos-sdk/pull/13501, this could be used to better improve client tooling and proto annotations. Planning to get a PR for Osmosis code base as well once we have merged this
Brief Changelog

Add proto annotaitons for amino json

Documentation and Release Note

Does this pull request introduce a new feature or user-facing behavior changes? (yes / no)
Is a relevant changelog entry added to the Unreleased section in CHANGELOG.md? (yes / no)
How is the feature or change documented? (not applicable   /   specification (x/<module>/spec/)  /  Osmosis docs repo   /   not documented)

LGTM!

Hey @mattverse . Can you please look into conflicts here when you have time?

Merging this once CI is passing

🙌🏻


Add data to package

Add atlases and lookuptables, possibly example data (although likely better to have data fetcher)

Made part of #12


how to train on my own database?

how can i train on my own database? can anyone help?

I created a repo for this. Might help: https://github.com/metobom/prepare-data-for-UNet

I created a repo for this. Might help: https://github.com/metobom/prepare-data-for-UNet

sorry, I  have visit you put forwar the websit, but I cannot understand your meanning.

I created a repo for this. Might help: https://github.com/metobom/prepare-data-for-UNet

sorry, I have visit you put forwar the website, but I cannot understand your meanning.

Which part you couldn't understand? I can answer your questions.

I created a repo for this. Might help: https://github.com/metobom/prepare-data-for-UNet

sorry, I have visit you put forwar the website, but I cannot understand your meanning.

Which part you couldn't understand? I can answer your questions.

I am doing multi-classification and segmentation. I want to ask you how to conduct the training data. Is the 8-bit grayscale feasible? Can you explain it in detail?

I created a repo for this. Might help: https://github.com/metobom/prepare-data-for-UNet

sorry, I have visit you put forwar the website, but I cannot understand your meanning.

Which part you couldn't understand? I can answer your questions.

I am doing multi-classification and segmentation. I want to ask you how to conduct the training data. Is the 8-bit grayscale feasible? Can you explain it in detail?

Sorry I only did binary classification. But you can take a look at "adjustData" function inside of data.py.

i have small database of RGB medical retina images and i want to segment it using UNET. How to do it using this repo??

Actually i have generated more dilated images and want to segment those. Please help. THANKS


[Bug] Update the README

What is the problem?
When I first used the tool, I found that the README referenced pq instead of the current postgres driver it installs when you select postgres, which is pgx. This is a minor change that led me to believe that the driver installed would be pq.
Operating System
all
Architecture Version (x86, x64, arm, etc)
x86
Steps to reproduce
Look at the README and click the postgres link.
Relevant log output
No response

You referring to the issue with the incorrect link in the README file for the PSQL driver:

This is correct link for README.md update
https://github.com/jackc/pgx/


[Mod] Unsanitize CSS (another kbin bugfix)

Kbin currently allows magazines to declare custom CSS that is applied while viewing them, and users can also change the CSS of the site in their settings.
This behavior is currently bugged however. Any CSS defined this way gets HTML escaped, causing certain characters like > and & to be replaced with HTML escape codes. This causes any CSS rule that uses them to not actually work, causing confusion and imposing unnecessary limitations on what can be achieved.
Until kbin fixes this bug themselves, I've implemented this fix as a mod.
I doubt this has a lot of use on its own currently, especially with how underused CSS is on kbin in the first place. And anyone who tests their code wouldn't have CSS that needs this mod running on their magazine anyway. For user CSS, I recommend userstyles over kbin's builtin functionality anyway.
This is very much a "just in case" mod with the reason I'm implementing it now being to act as a dependency (so a use case for the discussed depends_on, once that's implemented) for another bugfix mod which needs to know which style tag contains the magazine CSS.
Add-ons (mods):

[x] A directory containing the add-on's JS code and a standalone JSON manifest containing metadata, both prefixed with the same name, was included
[x] The PR does not modify KES files other than those within its own directory.
[x] If calling GM functions, safeGM was used
[x] If the add-on recurs when contents update, it does not call its own mutation observers (this is handled by KES)
[x] The add-on has a clearly defined entry point function, and this function is listed by name in the manifest
[x] Some explicit toggle logic handles both TRUE and FALSE states (setup and teardown) and reverts the page to its prior state

Is there a magazine using custom CSS you can link to?
Also, I was thinking of reorganizing the mod pages a bit and putting this and the repair codeblocks under "debug," does that seem reasonable?

Is there a magazine using custom CSS you can link to?

Yeah, mine.
The magazine title in the sidebar is supposed to be red as a test, but it doesn't work because I used > as a selector and that gets escaped to >. I first ran into the issue when I tried to help someone implement a magazine banner, which was way too much of a struggle to get working.

with the reason I'm implementing it now being to act as a dependency (so a use case for the discussed depends_on, once that's implemented) for another bugfix mod which needs to know which style tag contains the magazine CSS.

Actually I just realized that won't work like I was expecting it to... since it's not guaranteed magazine css uses > or &... So this isn't a guaranteed way to identify the magazine css style element.

Also, I was thinking of reorganizing the mod pages a bit and putting this and the repair codeblocks under "debug," does that seem reasonable?

Hmm, I think debug is a bit too technical a term, there's the danger that users won't look in there. I think taking the name literally it makes sense, but usually debug stuff is only meant to be used by the developer, so people who know that would probably not look in there unless they're developing their own mod.

The banner is a big red rectangle for me (with no mod applied), is that correct?
Maybe there should be a "Fixes" page. I feel like General is starting to get too cluttered with things that aren't exactly general in nature.

The banner is a big red rectangle for me (with no mod applied), is that correct?

Yeah, that's what I ultimately managed to throw together after other attempts failed because of this issue.

Maybe there should be a "Fixes" page. I feel like General is starting to get too cluttered with things that aren't exactly general in nature.

Yeah, I've been wondering if there's a better place for them too. A new Fixes category makes sense.


F1 values of WHU-CD and DSIFN-CD

Hello, I am trying to reproduce the BIT-CD model code, and it looks incorrect when using WHU-CD dataset as well as DSIFN-CD dataset, and the result appears too high than your result. But it looks normal when using LEVID-CD dataset. Do I need to change the pre-training?

@yuwanting828
Did you use the same hyperparameter values given in the paper?

Thank you very much for your reply. The hyperparameters I set in the experiment are based on those in the original paper BIT-CD.

@yuwanting828 Interesting. Could be due to different train/val/test splits?

Thanks again for your reply, in my experiments I used the dataset links you provided in the Readme file in the ChangeFormer project and in your reply to the issue.


Metrics & Tracing

Hi,
I am trying OTEL as sidecar on ECS with EC2. I am unable to have one config with metrics and tracing. It seems for tracing app container has to be linked with otel-collector. And for Metrics otel-collector has to be linked with app.
For me getting an error Failed to scrape Prometheus endpoint. Please advise.
Thank you
Sajeesh

@sajeeshraws Can you provide more details about your setup and configuration as well as pipeline details? It is not clear with the description you've provided so far.
Are you sending metrics to AMP (Amazon Managed Service for Prometheus)? and traces to X-Ray?


Make this module work with terraform 0.13

Hi,
we would like to use this module in TF 0.13 with an outer count module, outside providers, etc.
I believe some small changes should be made to make this work

Tried to run the code from examples with Terraform 0.13 here: https://github.com/grem11n/terraform-aws-vpc-peering/pull/60
There is an issue with one of the tests but seems to be unrelated

I'm not sure if the change I did can fix, but I need to work with this module using depends_on = [], and it currently doesn't work because of the inner providers.

I see. Ok, this is something I need to investigate.
Basically, it looks like an ability to specify AWS tokens explicitly as variables was lost somewhere. Therefore, the tests failed.
I need to check, how to move the providers outside of the module.

@eliranw , please, check the configuration from https://github.com/grem11n/terraform-aws-vpc-peering/pull/60
Does it fix your issue?
According to this discussion, proxy provider configuration is required to explicitly pass the providers to the module. Basically, I followed this doc
Also, could you elaborate with some code examples / workflows, which involve depends_on functionality? Unfortunately, I'm not using Terraform 0.13. Therefore, it's hard for me to come up with some test scenario, which could be another one test case.

I've tried to investigate depends_on behavior a little bit. I tried to use a public VPC module to create VPCs and then this module to set up a peering connection. All the module definitions were a part of the same root module.
However, I got an error:
The "count" value depends on resource attributes that cannot be determined
until apply, so Terraform cannot predict how many instances will be created.
To work around this, use the -target argument to first apply only the
resources that the count depends on.

A quick search brought me to this issue comment: https://github.com/hashicorp/terraform/issues/26078#issuecomment-687093646 It looks like depends_on doesn't work as expected

@grem11n have you find a solution for this issue? We wanted to use the module from CI pipeline where using the recommended "-target" solution is not really an option...

Hey @Cajga, well this module works with Terraform v0.13 per se. A behavior mentioned in this issue doesn't. Likely due to the bug I linked above.
However, I haven't tried this with newer versions of Terraform. Perhaps, it's not a problem anymore. Do you have a prototype or some code examples I can use to test the behavior specific to your use case?

Hi @grem11n,
I am using the latest terraform in the CI pipeline but the issue is still there. The problem with the module (as well as few other VPC modules in the registry) is that you have to create the VPC in a first run and then apply the peering module in a second. You will not be able to create the whole infra with one terraform run.
This is due to the use of id in count. It is explained in the documentation as well as in the this comment from a developer.  IMHO, this behavior will not change in the near future.
For a reproducer, create 2 VPCs with the https://github.com/terraform-aws-modules/terraform-aws-vpc module and use your module to try to peer them. It is important to try to do this from scratch with one terraform run. You will always receive the output that you mentioned above...
The solution is (as the developer recommends in his comment as well) is to use variables/locals like this module does:
https://github.com/cornfeedhobo/terraform-aws-vpc-peering

Thank you for the clarification!
I will add the test to reproduce it. Hopefully, I'll be able to figure out, how to apply everything in a single blow. I'm not sure if I can avoid using count, though. I need to somehow retrieve information regarding VPC setup and I don't want to handle VPC creation with this module for sure.

Another thing I've noticed: my module doesn't work with the latest 0.14.6 version. Which is a problem indeed.
I'm going to investigate it here: https://github.com/grem11n/terraform-aws-vpc-peering/issues/62

Maybe you could move the use of ids down to a local variable and use that variable in the count. I believe that would work but I did not try it yet.
Another way is receiving the ids in a variable (that is how the module that I linked does) and that works fine.

I haven't created a test case, which covers the simultaneous creation of both VPCs and peerings yet, but you can check the code from this PR: https://github.com/grem11n/terraform-aws-vpc-peering/pull/61
I have removed count from the data sources. It's still present in main.tf, though. Not sure if I can remove count completely.
I've tested that code with Terraform 0.13 and it works fine (current test cases). I also tested it locally with 0.14 and it works. Apparently, there is something happening when I try to run tests with Terratest

@eliranw , @Cajga ,
With https://github.com/grem11n/terraform-aws-vpc-peering/pull/61 merged, it should be possible now to use depends_on with this module from the master branch.
You can find an example here
Generally, this is recommended to always pin the module version. However, I want to make a few more cosmetic changes like README update and so on before creating a new tag. Hence, if you need this behavior right away, you can use unpinned version.
I will keep this ticket open not to forget to make the aforementioned changes and make a new release.
Also, please keep in mind that I only tested this module with Terraform 0.13.6. I'm not sure if it's going to work with 0.14. In theory, it should, but I had some problems with the Terratest run with TF 0.14


fix: invalid JSON in examples/data-rights/example.json

See https://github.com/EKGF/dprod/blame/a78e2f110d9ec729fbe6f74317db3b379cfade56/examples/data-rights/example.json#L5.
Doesn't look like valid JSON.
Neither does "rightOperand": [region:EMEA, region:APAC] in the same file.

@joshcornejo ?

I only changed the areas that were the reported problem.
All fixed now.


Axis2.xml configuration reset at startup for api-devportal profile

I setup a WSO2 3.0.0 instance with the profile api-devportal.
When I launch the profilesetup.sh for this profile, axis2.xml file is modified correctly by commenting two transportSender:
INFO - Disabled the <transportSender name="ws" class="org.wso2.carbon.websocket.transport.WebsocketTransportSender"> from axis2.xml file
INFO - Disabled the <transportSender name="wss" class="org.wso2.carbon.websocket.transport.WebsocketTransportSender"> from axis2.xml file
But when I start the instance with the profile api-devportal, axis2.xml configuration is dropped and those two tags are uncommented.

Hi @Khelnor
The configurations in APIM-3.0.0 is now done in the deployment.toml file. The default configuration xml files get overriden by the configurations specified in the deployment.toml file.
Please add the following configurations in the deployment.toml file found in <APIM_HOME>/repositorty/conf
[transport]
wss.sender.enable=false
ws.sender.enable=false

You could find more information about configuration parameters in our Configuration Catalog.

Thanks for the information. But the transport configuration is not listed in the catalog documentation. Do you have a complete documentation of the configuration that can be override through the TOML file ?

We will add the configuration to the Configuration Catalog.


removed device vitals

removed device vitals https://saucedev.atlassian.net/browse/MRE-476
New device vitals will live here: https://docs.saucelabs.com/mobile-apps/features/device-vitals/

Description

Motivation and Context

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation fix (typos, incorrect content, missing content, etc.)

Checklist

[ ] I have read the contributing document.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

@kristofmuhi Should we also remove Device Vitals in https://docs.saucelabs.com/mobile-apps/live-testing/live-mobile-app-testing/#device-vitals?


"Numpy is not available" Error

Windows 10 Pro
Resolve 18.6
I get this error in the Davinci Console after trying to generate the subs. The auto-subs menu is also stuck in the "Transcribing Audio...".
I've tried both, the auto and manual install route. Should i try to unnistall the NumPy 2.0 version and install the 1.0?
Here is the Resolve Console Log:
A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "C:\ProgramData\Blackmagic Design\DaVinci Resolve\Fusion\Scripts\Utility\auto-subs.py", line 26, in <module>
    import stable_whisper
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\__init__.py", line 1, in <module>
    from .whisper_word_level import *
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\whisper_word_level\__init__.py", line 2, in <module>
    from .cli import cli
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\whisper_word_level\cli.py", line 11, in <module>
    from ..result import WhisperResult
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\result.py", line 11, in <module>
    from .stabilization import suppress_silence, get_vad_silence_func, VAD_SAMPLE_RATES
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\stabilization\__init__.py", line 7, in <module>
    from .nonvad import NONVAD_SAMPLE_RATES, audio2loudness, wav2mask, visualize_mask
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\stabilization\nonvad.py", line 8, in <module>
    from ..audio.utils import audio_to_tensor_resample
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\audio\__init__.py", line 7, in <module>
    from .utils import (
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\audio\utils.py", line 7, in <module>
    import torchaudio
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\torchaudio\__init__.py", line 13, in <module>
    from . import (  # noqa: F401
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\torchaudio\compliance\__init__.py", line 1, in <module>
    from . import kaldi
  File "C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\torchaudio\compliance\kaldi.py", line 22, in <module>
    EPSILON = torch.tensor(torch.finfo(torch.float).eps)
C:\Users\Admin\AppData\Local\Programs\Python\Python312\Lib\site-packages\torchaudio\compliance\kaldi.py:22: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at ..\torch\csrc\utils\tensor_numpy.cpp:84.)
  EPSILON = torch.tensor(torch.finfo(torch.float).eps)
Using model -> [ small.en ]
MarkIn: 216000
Rendering Audio for Transcription...
Progress:  0 %
Progress:  100 %
Audio Rendering Complete!
Transcribing Audio...
Numpy is not available

Uninstall NumPy 2.0
Install a Compatible Version of NumPy
[pip install numpy==1.23.5]
Verify the Installation
[python -c "import numpy; print(numpy.version)"]
Test Your Davinci Resolve Setup
[pip install --force-reinstall stable_whisper torchaudio]

Uninstall NumPy 2.0
Install a Compatible Version of NumPy
[pip install numpy==1.23.5]
Verify the Installation
[python -c "import numpy; print(numpy.version)"]
Test Your Davinci Resolve Setup
[pip install --force-reinstall stable_whisper torchaudio]

i have sam issue but in installing procses u get this:
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

Here's how I solved it:

pip uninstall numpy
pip install numpy==1.26.4 (1.26.4 is the latest 1.xx version of numpy, I don't know where the 1.23.5 version mentioned earlier came from)
python -c "import numpy; print(numpy.__version__)"
Don't do this step, no need to install or use the --force-reinstall option. By the way the correct package is openai-whisper or stable-ts, not stable_whisper.

Here's how I solved it:
1. `pip uninstall numpy`

2. `pip install numpy==1.26.4` (**1.26.4** is the latest 1.xx version of numpy, I don't know where the 1.23.5 version mentioned earlier came from)

3. `python -c "import numpy; print(numpy.__version__)"`

4. Don't do this step, no need to install or use the --force-reinstall option. By the way the correct package is `openai-whisper` or `stable-ts`, not `stable_whisper`.

Thanks a lot, I've managed to make them work.

Installing the latest version of Numpy 1 also worked for me. The install script should be updated to avoid numpy 2.
This is the ideal way, rather than specifying the exact version:
pip install "numpy<2"

Installing the latest version of Numpy 1 also worked for me. The install script should be updated to avoid numpy 2.
This is the ideal way, rather than specifying the exact version:
pip install "numpy<2"

I don't even see a direct download for Numpy it makes no sense

For me, the NumPy error is gone, but it still doesn't run, it looks like it really can't import stable_whisper. I'm using Python 3.12.4 and PyTorch 2.4.0.
Traceback (most recent call last):
  File "C:\ProgramData\Blackmagic Design\DaVinci Resolve\Fusion\Scripts\Utility\auto-subs.py", line 26, in <module>
    import stable_whisper
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\__init__.py", line 1, in <module>
    from .stabilization import *
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\stable_whisper\stabilization.py", line 6, in <module>
    from whisper.tokenizer import Tokenizer
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\whisper\__init__.py", line 12, in <module>
    from .decoding import DecodingOptions, DecodingResult, decode, detect_language
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\whisper\decoding.py", line 11, in <module>
    from .tokenizer import Tokenizer, get_tokenizer
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\whisper\tokenizer.py", line 8, in <module>
    from transformers import GPT2TokenizerFast
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\__init__.py", line 26, in <module>
    from . import dependency_versions_check
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\dependency_versions_check.py", line 16, in <module>
    from .utils.versions import require_version, require_version_core
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\utils\__init__.py", line 34, in <module>
    from .generic import (
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\utils\generic.py", line 32, in <module>
    from .import_utils import (
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\utils\import_utils.py", line 37, in <module>
    logger = logging.get_logger(__name__)  # pylint: disable=invalid-name
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\utils\logging.py", line 157, in get_logger
    _configure_library_root_logger()
  File "C:\Users\kaian\AppData\Local\Programs\Python\Python312\Lib\site-packages\transformers\utils\logging.py", line 93, in _configure_library_root_logger
    _default_handler.flush = sys.stderr.flush
                             ^^^^^^^^^^^^^^^^
AttributeError: module 'fu_stderr' has no attribute 'flush'