memoQ 9.8 Plugin

OPUS - CAT plaugin for memoQ 9.8.6  is not working
no translation comes from MT
please fix it
I suggest adding a Pre/Post MT Tweaking using a glossary to replace specific terms with user-defined ones
check this
https://github.com/RWS/Sdl-Community/tree/master/MT Enhanced Provider
and this
https://appstore.sdl.com/language/app/rys-google-cloud-translate-nmt/775/

Hi,
Seems that memoQ changed the plugin API in 9.7.10, I changed the plugin to fix that earlier this year, and then memoQ changed the plugin API back in later versions. Looks like the older memoQ plugin works with 9.8.6, I've updated the installation page to reflect this: https://helsinki-nlp.github.io/OPUS-CAT/install. So you should be able to use the memoQ plugin by installing the following plugin file: https://github.com/Helsinki-NLP/OPUS-CAT/raw/develop/build/2020-10-07/FiskmoMTPlugin.dll.
I have pre- and post-processing of MT input and output planned, hopefully I can add it soon.

Thank for clarification
but neither the old nor new plugin worked with 9.8.6 version

Sorry about the late reply. The plugin file that I linked to earlier works in my 9.8.6., so I don't really know what could cause the problem. The only thing I can think of is that maybe the dll file has not been unblocked after download (right-click file, choose Properties, check the Unblock box in the bottom right of the Properties window).

Hello Dear
could you please send me your plugin as an attachment here
Regards
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10
From: @.>
Sent: Monday, August 2, 2021 4:58 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Helsinki-NLP/OPUS-CAT] memoQ 9.8 Plugin (#21)
Sorry about the late reply. The plugin file that I linked to earlier works in my 9.8.6., so I don't really know what could cause the problem. The only thing I can think of is that maybe the dll file has not been unblocked after download (right-click file, choose Properties, check the Unblock box in the bottom right of the Properties window).
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-891049403, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AABHMW4BR7XSDU77FWQ75ZDT22P6RANCNFSM477SEFRQ.

Here you go (had to zip it since Github won't allow attaching dll's): FiskmoMTPlugin.zip

Thank you very much
I will check it and update you
best
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows 10
From: @.>
Sent: Monday, August 2, 2021 5:06 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Helsinki-NLP/OPUS-CAT] memoQ 9.8 Plugin (#21)
Here you go (had to zip it since Github won't allow attaching dll's): FiskmoMTPlugin.ziphttps://github.com/Helsinki-NLP/OPUS-CAT/files/6917525/FiskmoMTPlugin.zip
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-891056467, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AABHMW4FXTOIKW6SN6TEX7LT22Q6HANCNFSM477SEFRQ.

Hello
it is working now with memoQ 9.8.7
Could you please train a new English Arabic model from scratch
I have a high quality medical TMX 500.000 segments plus to 180.000 medical terms
Regards
From: @.>
Sent: Monday, August 2, 2021 5:06 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Helsinki-NLP/OPUS-CAT] memoQ 9.8 Plugin (#21)
Here you go (had to zip it since Github won't allow attaching dll's): FiskmoMTPlugin.ziphttps://github.com/Helsinki-NLP/OPUS-CAT/files/6917525/FiskmoMTPlugin.zip
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-891056467, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AABHMW4FXTOIKW6SN6TEX7LT22Q6HANCNFSM477SEFRQ.

Hi,
Unfortunately we can't specifically train new models for users, but there are few options to incorporate your own data into OPUS-CAT models:

First, if you own the rights to the data, you can contribute the data to the OPUS project (https://opus.nlpl.eu/). The contributed data would eventually be used to train new models for OPUS-MT, which would make it available in OPUS-CAT (but it would probably take a long time for the data to be used in training of new models, they aren't updated that often).
A quicker option is to use the fine-tuning functionality in the OPUS-CAT MT Engine to finetune one of the existing models with your own data, instructions are here (the info is for version <IP_ADDRESS> of the engine, but the main functionality is the same): https://helsinki-nlp.github.io/OPUS-CAT/enginefinetune. Your tmx is pretty large, but you might be able to use it for fine-tuning without problems (although it would take a lot of time to run to completion, at least a couple of days). If you use the Trados plugin, you can fine-tune with job-specific data (100 percent and fuzzy matches of the source text), which makes the fine-tuning much more efficient, as only relevant data is used: https://helsinki-nlp.github.io/OPUS-CAT/tradospluginfinetune.

-Tommi

Hi,
Seems that memoQ changed the plugin API in 9.7.10, I changed the plugin to fix that earlier this year, and then memoQ changed the plugin API back in later versions. Looks like the older memoQ plugin works with 9.8.6, I've updated the installation page to reflect this: https://helsinki-nlp.github.io/OPUS-CAT/install. So you should be able to use the memoQ plugin by installing the following plugin file: https://github.com/Helsinki-NLP/OPUS-CAT/raw/develop/build/2020-10-07/FiskmoMTPlugin.dll.
I have pre- and post-processing of MT input and output planned, hopefully I can add it soon.

This was my experience too. I had to update the memoQ plugin to get Opus to work but then, after a memoQ update, Opus would not work until I dropped back down to the old memoQ plugin

I am a user of memoQ 9.8.8 English-French. The plugin you shared in this feed works with memoQ in standlaone mode, but not with 'server-based' memoQ. I connect to a company's memoQ domain in order to translate for them using their TMX resources, and in this case Fiskmo does not work, although DeepL and Modern MT do).  Anything else I can try?

It is better to try intento with 35 Machine translation included
https://inten.to/
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows
From: @.>
Sent: Sunday, October 3, 2021 8:46 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Helsinki-NLP/OPUS-CAT] memoQ 9.8 Plugin (#21)
I am a user of memoQ 9.8.8 English-French. The plugin you shared in this feed works with memoQ in standlaone mode, but not with 'server-based' memoQ. I connect to a company's memoQ domain in order to translate for them using their TMX resources, and in this case Fiskmo does not work, although DeepL and Modern MT do).  Anything else I can try?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-932995674, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AABHMW6IKVUZMAXTHW67PTDUFCJF7ANCNFSM477SEFRQ.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Thank you for your quick response.
Intento is not free, and is rather used for its ability to pick the right
combination of languages for a multi-language environment. My environment
is simpler: only English to French, and it is cheaper to go directly with
DeepL or Modern MT.
I trained a model in Friskmo with a sizeable TMX file and it surprisingly
gave me good results. I wish I could train DeepL like that!
Vicken
On Sun, 3 Oct 2021 at 13:48, drkhateeb @.***> wrote:

It is better to try intento with 35 Machine translation included
https://inten.to/
Sent from Mailhttps://go.microsoft.com/fwlink/?LinkId=550986 for Windows
From: @.>
Sent: Sunday, October 3, 2021 8:46 PM
To: @.>
Cc: @.>; @.>
Subject: Re: [Helsinki-NLP/OPUS-CAT] memoQ 9.8 Plugin (#21)
I am a user of memoQ 9.8.8 English-French. The plugin you shared in this
feed works with memoQ in standlaone mode, but not with 'server-based'
memoQ. I connect to a company's memoQ domain in order to translate for them
using their TMX resources, and in this case Fiskmo does not work, although
DeepL and Modern MT do).  Anything else I
can try?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<
https://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-932995674>,
or unsubscribe<
https://github.com/notifications/unsubscribe-auth/AABHMW6IKVUZMAXTHW67PTDUFCJF7ANCNFSM477SEFRQ

.
Triage notifications on the go with GitHub Mobile for iOS<
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
or Android<
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/Helsinki-NLP/OPUS-CAT/issues/21#issuecomment-932996013,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AV4WTOL3MB5OYMJWULUMNX3UFCJPDANCNFSM477SEFRQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Hello Vicken2 and all
The bundling of Opus MT in memoQ is up on the memoQ ideas portal but for the moment, it has not been chosen by memoQ as a priority
But when I posted this request, I did mention Gergely Bereczki at memoQ who works in support and seems to know a fair bit about Opus MT
The only thing I can think of is that you contact him, just in the hope that he knows how to "tweak" memoQ so that Opus works with a memoQ server. But it's a long shot. In the meantime, I will add a comment to this Ideas Portal pointing out that Opus MT does not work with server projects, so perhaps if the idea is taken up by memoQ, then they could look at this too
Regards
Dave Neve (SafeTex)

Thanks for your answer, Dave.
Unfortunately, I can't set up a testing environment for server-based memoQ, so even if it would be possible to get the plugin to work with the server-based memoQ, I can't really explore the possibility.

Hello Tommi
I assume you have memoQ in order to do what you have already done???
Is the problem simply that you don't have anyone to give you an online project 'cos if that's the problem, I may be able to arrange this.
if you don't have memoQ, I might be able to arrange this too (but no promises)
Thanks

Hi Dave,
I've used memoQ in the free mode for testing the plugin (memoQ is pretty good in that respect, it's a lot harder to test Trados, since their trial versions expire, and I don't want to buy licenses for three different Trados releases that we support). But the downside is I can't set up online projects with the free mode (and I'm not sure if I can even access online projects with the free mode). So I could use an online project for testing (and I'd appreciate if you can set that up), but I'm not sure whether it will work.
-Tommi


Duplicating the command for each client

I've ran into this while showing this tool to my collegue. When ever I would run the command kitchen converge The first few people to connect are actually good, but then at some point every refresh/new connection cause the command the be ran gain.
EDIT: it seems to stop at 2... The first ps is at start with me watching, then the second one is after my collegue joined.

Yes, currently that is the expected  behaviour. Every client connected to gotty gets a new process of the command you provided As described in the README, you can use tmux or gnu screen when you want share a single process with the other clients.
I have a plan to implement a simple pty shareing to gotty, however using tmux is a solid and reliable way to share your view for now.

Ohhh I got the part where it said you could not share with multiple people but I failed to understand that it would create a new instance of the command. Thanks for the explaination!!!


Old version of CLI tools provided by console

Describe the bug
Using console, click on question mark in menu bar, select Command Line Tools
Under header "oc - OpenShift Command Line Interface (CLI)" select "Download oc for Mac for x86_64"
Download resulting file and unzip it.
execute ./oc version
result is "Client Version: v4.2.0-alpha.0-625-ge40bd2d"
should be "Client Version: 4.5.0-0.okd-2020-09-04-180756"
These should all be reviewed to be current.  Or change to refer to https://github.com/openshift/okd/releases
Version
OKD version 4.5.0-0.okd-2020-09-04-180756, UPI on vSphere 6.7
How reproducible
100%
Log bundle
will provide if needed (must-gather zip is 500MB)

Same here, with Windows client, downloaded from a 2020-08-12 cluster.

oc reports invalid base version, although the commit is recent - https://github.com/openshift/oc/commit/e40bd2d.
@soltysh do you know if oc build script needs some variables set to have the version updated?

@vrutkovs yeah, I'd suggest at least setting $(SOURCE_GIT_TAG) when invoking make

Problem still present in 4.6.0-0.okd-2021-01-17-185703

Problem still present in 4.6.0-0.okd-2021-01-17-185703

Interesting, the bot has reverted our commit - https://github.com/openshift/release/pull/11851

Interesting, the bot has reverted our commit - https://github.com/openshift/release/pull/11851

Still present in 4.6.0-0.okd-2021-01-23-132511 at least for Download oc for Mac for x86_64:
./oc version
Client Version: v4.2.0-alpha.0-833-g5797eae
Kubernetes Version: v1.20.0

Still present in 4.6.0-0.okd-2021-01-23-132511 at least for Download oc for Mac for x86_64:
./oc version
Client Version: v4.2.0-alpha.0-833-g5797eae
Kubernetes Version: v1.20.0

doh, we need a new commit in oc to rebuild it.
We're planning a rebuild as a part of #402 fix anyway

doh, we need a new commit in oc to rebuild it.
We're planning a rebuild as a part of #402 fix anyway

do I get a badge for the most trivial but persistent bug? :-)

do I get a badge for the most trivial but persistent bug? :-)


Fix connect-datastore config (closes #314)

The kind option should be set on the object passed into the DatastoreStore constructor otherwise it will not be used and entries will instead have the default kind: 'Session'.

I signed the cla


"Change themes based on the system theme" not working on macOS

Didn't work for me on macOS unfortunately, the system changed from light to dark automatically and automaticDark didn't pick up on it and stayed light. This is with the "Change themes based on the system theme" setting enabled
Originally posted by @derekschinke in https://github.com/skhzhang/time-based-themes/issues/8#issuecomment-626264274

I just did a quick test, and this does work as intended for me if I manually change system themes in Catalina's system preferences. I will have to wait until this evening to see whether it works during an automatic theme change or when opening my MacBook in the morning for the first time.

I think my issue may be that I'm using Shifty to change the theme automatically, and not relying on Apple's settings alone. This is because Apple's settings require the computer to be closed, or logged out, for the theme change to take place. Shifty changes the theme automatically with the computer still on. One would think that this is equivalent to manually changing themes in settings, but it may not be.

@derekschinke I am using f.lux to change the system theme at sunset and am having the same problem as you. This extension does not seem to respect this setting unless you manually set it in the system preferences, which is unfortunate. FWIW, the Dark Reader add-on handles this just fine, so it definitely can be done.

For me, it works when macOS automatically changes from light to dark. But if I turn my computer off when it's at dark mode and turn it on later when it's in light mode, my theme is still at the one I chose for dark mode. Toggling between the options in the "Daytime theme" dropdown applies those options for a bit, but it soon reverts back to the Nighttime theme.

I'm using Shifty to change the theme automatically, and not relying on Apple's settings alone.

Same here, but I am using DarkModeBuddy (which is a great, game-changing little software and I strongly suggest you to check it out, btw) and the Firefox theme goes crazy.
As of right now, when I open Firefox, regardless of the theme MacOS has, it is in light mode. Nevertheless, while I use it, it is always in dark mode. I do not understand.
I am using Firefox 86 on MacOS 11

I also mentioned this on #22, but there are major issues with the "Change themes based on the system theme" option because the extension uses prefers-color-scheme to detect the system theme.
Per https://bugzilla.mozilla.org/show_bug.cgi?id=1529323, Firefox will set prefers-color-scheme based on whatever theme is currently set. This causes issues with the extension which I'm still trying to work out.

I've made changes to the "Change themes based on the system theme" option on 1.4.0. Note you will need Firefox 95 or later for this version. Please let me know if the issue persists with 1.4.0.
Thanks!

It doesn´t seem to work on my end (version 1.4.1), but maybe this has to do with me being on beta?

Doesn't seem to work on Ubuntu/Linux with Gnome 43 either

Same in Kubuntu 23.04 in Firefox 111


ENH: Clean up navbar spacing on mobile

This is a small improvement to the spacing of icons on mobile. It adds a bit of vertical spacing and makes the icon links stack horizontally.
See this before/after GIF:

I like the change... it is an improvement because it is eating less vertical space.
Maybe there is a way to have all the switchers and icons aligned in one horizontal line?

OK - the latest push applies the same logic to all navbar-end items, so anything in the right-most navbar area should now be stacked horizontally.

Will merge this one as I think that I addressed your suggestion

Thanks!


COMPASS-3806: create long from string or number based on object type

Description
A bit more logic around casting to Int64:

when casting from a number like int32 (literal or object) create Long from a
number
when casting from an object like another int64 object, create a string from
the object first, and then create long from string
when casting from a string, create long from string.

Checklist

[x] New tests and/or benchmarks are included
~- [ ] Documentation is changed or added~

Dependents
This will require a pull with updated version of this package to compass-crud to
take full effect.
Types of changes

[x] Minor (non-breaking change which adds functionality)

📦 5.1.0


Chinese translate enhance and edit

OwO

since the last translate was updated about 10 months ago so I made this change...I think it is also okay to contact with @WHMHammer about how the change would be done.
Or,I would like to recommend crowdin to enhance the i18n progress.

I've been busy on something else recently, so I haven't monitored the changes in text seeds for a while. Thank you for your contribution!
Regarding how the changes would be done: I'm not sure if you are talking about changes in the translation texts themselves or the way for the game client to read translations. For the former, we have a discord channel, and there is a translation sub-channel where @0auBSQ publishes new text seeds to be translated. You can find the discord link in the README. For the way from the game client to read translations, I'm not very experienced in i18n coding structures, so I can't really comment on that. The current way is probably good enough for now. I'm open to possibilities though.

I've been busy on something else recently, so I haven't monitored the changes in text seeds for a while. Thank you for your contribution!
Regarding how the changes would be done: I'm not sure if you are talking about changes in the translation texts themselves or the way for the game client to read translations. For the former, we have a discord channel, and there is a translation sub-channel where @0auBSQ publishes new text seeds to be translated. You can find the discord link in the README. For the way from the game client to read translations, I'm not very experienced in i18n coding structures, so I can't really comment on that. The current way is probably good enough for now. I'm open to possibilities though.

I've been banned because of some reason...so I can't get into the discord group.I tried to rejoin but failed.
So,maybe that's not possible for me to discuss in discord,and that's for game client reading.
I also make some enhancement to make the text much easier to read and understand.


[Identity] Adjust CI setup script

The version of Azure CLI no longer needs to be pinned. Removing this pin should also resolve the CI failures trying to install it.

/azp run python - identity - tests-weekly


Replacing Live Server Test that was deleted

created live server test file to test profile edit and profile page


chore: be more specific with indexed object type

Issue or need
Be nitty

Proposed changes
Be nitty

Quick reminders

🤝 I will follow Code of Conduct
✅ No existing pull request already does almost same changes
👁 Contributing docs are something I've taken a look at
📝 Commit messages convention has been followed
💬 TSDoc comments have been added or updated indicating API visibility if API surface has changed.
🧪 Tests have been added if needed. For instance, if adding new features or fixing a bug. Or removed if removing features.
⚙ API Report has been updated if API surface is altered.

#815  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @davidlj95 and the rest of your teammates on  Graphite


Style Y110 - decorators

Discuss

It would be cool to have a separate ticket to investigate the benefits and possible implementations of core error handling service

-1; core error handling service would be good and may overlap with how we do marketing stuff.


Resource Unit Should Not Be Converted

Description of the bug:
Using Size.gibibytes(2) generates 2048Mi instead of 2Gi. This is a bit of a problem in GitOps setup (since it shows there's a diff). Essentially I guess ideally there should be no conversions of such kind at all, if possible.
Reproduction Steps:
My code is like this:
    const deployment = new Deployment(this, "deployment", {
      replicas: props.replicas,
    });

    deployment.addContainer({
      image: props.image,
      portNumber: props.port,
      resources: {
        memory: {
          request: Size.gibibytes(1),
          limit: Size.gibibytes(2),
        },
      },
    });

(Let me know if the above code doesn't work for you. Happy to provide a sample project.)
Error Log:
And the output contains:
apiVersion: apps/v1
kind: Deployment
#... other stuff
          resources:
            limits:
              memory: 2048Mi
            requests:
              memory: 1024Mi
# ... other stuff

Environment:

Framework Version: CDK8S v2.5.78
OS: macOS v13.1

Other:

This is :bug: Bug Report

If you use the cdk8s instead of cdk8s-plus you can use eg. Quantity.fromString('512Mi') in resources definitions. You might already know this but wanted to point out as way around 🙂


white background - no video playing on mobile

http://www.ecosmartroofer.com/ - what do I do wrong here?
on mobile in Android Chrome or Android Browser it just displays white screen, video is not playing
(Nexus 5 - latest Android 5.1)
Any option to not play video on mobile and just display poster?
Or tell me what is the issue there?
on iOS - it opens native player and works fine.

Hello.
Use v0.3.5, this patch fixes your issue.

Solved! Thanks

video still not playing on background in mobile how can i fix this


[Feature Request]: Add CHANGELOG.md

What is the Desired Behavior?
Add a changelog to track changes between feature additions and releases. See CHANGELOG.md for a solid example. Should be based on Keep a Changelog.
What value will this add?
This will add valuable tracking features for developers and users. Not to mention look good in the thesis!
What board revisions would support this feature?
All
What is the priority for this new feature?
5

Added. Closing


Question - Filtering out replies?

Is there a way to filter out tweets that replies to another tweet? I am looking to scrape original tweets if possible.
Thank you for you help and awesome work!

You can use this in your query string: -
-filter:replies
e.g.
"brexit -filter:replies"

If you're referring to a Twitter thread, I haven't found a way to completely collect that data properly.
If you're just trying to collect replies from a user, --replies (in the Dev branch for now) will do it.


In all pages all columbo box is not loading properly

inline editors are converted to external/form-editor

ok


feat: allow setting different React Native path

Summary:
This PR fixes require.resolve logic for looking up React Native location. It will now resolve React Native from the current working directory, instead of __dirname. Thanks to this subtle change, we don't need react-native to be a dev dependency of CLI. We will now load React Native from the "node_modules" of a project we are testing CLI on.
It also allows to overwrite path to react-native when require.resolve does not provide good results. For example, we can pass a location to React Native repository (when we have it cloned) to run CLI on master of React Native (case: checking compatibility without releasing a new version) or to run RNTester example app (where there is no React Native package in node_modules).
Partially addresses #143. I will send another follow-up fixing run-android and run-ios behaviour later.
Test Plan:
When testing CLI locally, go to a project with React Native and run CLI: node: ../<path_to_cli>/packages/cli/build/index.js. It will load React Native from your project "node_module"s, instead of CLI.

When this gets merged, we can remove "metro.config.js" we added to React Native a while ago to overcome this issue.

🎉


Fix example sed command

sed -i '' 's/production.example/development/g' config/ENV/development/services/*`
must be
sed -i '' 's/production.example/development/g' config/ENV/development/services/*

@nazarok plan to check everything in a few days. Thanks for notification!

done


[Flink-12164][tests] Harden JobMasterTest.testJobFailureWhenTaskExecutorHeartbeatTimeout

What is the purpose of the change

Harden unstable case, JobMasterTest.testJobFailureWhenTaskExecutorHeartbeatTimeout

Brief change log

Enrich TestingHeartbeatServices, support manually trigger timeout for testing
Make JobMasterTest.testJobFailureWhenTaskExecutorHeartbeatTimeout not relying on timeout anymore
Correct invalid format of JobMasterTest

Verifying this change

This change is already covered by existing tests, such as JobMasterTest

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changed class annotated with @Public(Evolving): no
The serializers: no
The runtime per-record code paths (performance sensitive): no
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
The S3 file system connector: no

Documentation

Does this pull request introduce a new feature? no
If yes, how is the feature documented? not applicable

The Travis building fails due to a known unstable case, see https://issues.apache.org/jira/browse/FLINK-13242

@flinkbot attention @tillrohrmann

Bad luck. Travis building fails due to another unstable case, see https://issues.apache.org/jira/browse/FLINK-9900.
Will re-trigger Travis building.

This PR overrides too much basic logic, I should re-implement it. Close it for now.


Support setting PYTHONHOME from within Java

This pull request relates to issue #143 .  I needed the capability to set PYTHONHOME from within Java, so I added a "hook" to Py_SetPythonHome().
Note - this PR includes the other PRs that I submitted #137 and #141 .
I did not add tests for this code.  I have tested on Windows with Python 3.6 and Python 2.7, using Anaconda environments.

This won't work with Python 3.4, because there is no obvious way to me of converting a char * to a wchar_t *.  Python added Py_DecodeLocale() in Python 3.5 to deal with this.
IMHO, you should drop Python 3.4 support and update the testing scripts accordingly.
Latest commit takes care of that.

@Dr-Irv would you mind documenting the fact, that jpy now supports setting PYTHONHOME from within Java.

@forman See #145 (and some other ideas there)


okta-aws-cli: 2.1.0 -> 2.1.2

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/okta/okta-aws-cli/releases.
meta.description for okta-aws-cli is: A CLI for having Okta as the IdP for AWS CLI operations
meta.homepage for okta-aws-cli is: https://github.com/okta/okta-aws-cli
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.1.1 with grep in /nix/store/2s3a71gmcmnwn8jixyadzzklwvblkqp6-okta-aws-cli-2.1.1
found 2.1.1 in filename of file in /nix/store/2s3a71gmcmnwn8jixyadzzklwvblkqp6-okta-aws-cli-2.1.1

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
okta-aws-cli

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/2s3a71gmcmnwn8jixyadzzklwvblkqp6-okta-aws-cli-2.1.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A okta-aws-cli https://github.com/r-ryantm/nixpkgs/archive/ce8cfc24fe2abb32fae793e510536767e13fc357.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/ce8cfc24fe2abb32fae793e510536767e13fc357#okta-aws-cli

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/2s3a71gmcmnwn8jixyadzzklwvblkqp6-okta-aws-cli-2.1.1
ls -la /nix/store/2s3a71gmcmnwn8jixyadzzklwvblkqp6-okta-aws-cli-2.1.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

okta-aws-cli

Maintainer pings
cc @daniyalsuri6 for testing.

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/okta/okta-aws-cli/releases.
meta.description for okta-aws-cli is: A CLI for having Okta as the IdP for AWS CLI operations
meta.homepage for okta-aws-cli is: https://github.com/okta/okta-aws-cli
Updates performed

Golang update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.1.2 with grep in /nix/store/9l9c2g5j9dxscdvdiq1qpiys11yv7pai-okta-aws-cli-2.1.2
found 2.1.2 in filename of file in /nix/store/9l9c2g5j9dxscdvdiq1qpiys11yv7pai-okta-aws-cli-2.1.2

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
okta-aws-cli

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/9l9c2g5j9dxscdvdiq1qpiys11yv7pai-okta-aws-cli-2.1.2 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A okta-aws-cli https://github.com/r-ryantm/nixpkgs/archive/36d430514a8bed421e53eca45cd5507b7d43b60a.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/36d430514a8bed421e53eca45cd5507b7d43b60a#okta-aws-cli

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/9l9c2g5j9dxscdvdiq1qpiys11yv7pai-okta-aws-cli-2.1.2
ls -la /nix/store/9l9c2g5j9dxscdvdiq1qpiys11yv7pai-okta-aws-cli-2.1.2/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

1 package built:

okta-aws-cli

Maintainer pings
cc @daniyalsuri6 for testing.


Fixing environments where pkg-config isn't installed.

Depending on the presence of pkg-config, we're not necessarily doing the right thing in the Makefile. Zlib is a pkg-config dependency, but libm, libpthread, librt aren't.

Reverted this as it broke our build (and I think I got confused when I merged it).


Should not be able to delete a resource that appears in a resource list

Steps to Reproduce

Create a site
Sync some resources from gdrive
Create a resource list, like https://ocw-studio-rc.odl.mit.edu/sites/peters-test-site-for-unpbulishing/type/resource-list/edit/4509f5ad-abcc-4c51-a3f1-d0a3d9eb7464/
Delete one of the resources in the resource list from gdrive
Sync the site with gdrive
Publish the course (draft or production)

Expected Behavior

sync should fail with an error similar to https://github.com/mitodl/ocw-studio/issues/1752
the course should publish

Actual Behavior

no error message: the resource is removed from the site
publishing fails when Hugo tries to build the resource list, with the error in https://github.com/mitodl/ocw-hugo-themes/issues/1132

Stacktrace
from this failed build, from https://cicd-qa.odl.mit.edu/teams/ocw/pipelines/draft/jobs/build-ocw-site/builds/22?vars.site="peters-test-site-for-unpbulishing"#L643b9c77:19
selected worker: ip-10-1-3-236

streaming volume static-resources from ip-10-1-3-182

+ [ -f ../ocw-hugo-projects/ocw-course-v2/config-offline.yaml ]

+ cp ../webpack-json/webpack.json ../ocw-hugo-themes/base-theme/data

+ mkdir -p ./content/static_resources

+ mkdir -p ./static/static_resources

+ mkdir -p ./static/static_shared

+ cp -r ../static-resources/. ./content/static_resources

+ find ./content/static_resources -name *.mp4 -type f -delete

+ + wcls -l

 -1 ./content/static_resources/*.html

+ HTML_COUNT=0

+ [ 0 != 0 ]

+ touch ./content/static_resources/_index.md

+ aws s3 sync s3://ocw-content-draft-qa/static_shared ./static/static_shared --exclude *.js.map

+ hugo --themesDir ../ocw-hugo-themes/ --config ../ocw-hugo-projects/ocw-course-v2/config-offline.yaml --baseUrl / --destination output-offline --buildDrafts

Start building sites …

hugo v0.110.0-e32a493b7826d02763c3b79623952e625402b168+extended linux/amd64 BuildDate=2023-01-17T12:16:09Z VendorInfo=gohugoio

Error: Error building site: failed to render pages: render of "page" failed: "/tmp/build/a69529f2/ocw-hugo-themes/course-v2/layouts/lists/single.html:14:38": execute of template failed: template: lists/single.html:14:38: executing "main" at <append (index $page 0)>: error calling append: reflect: call of reflect.Value.Type on zero Value

Total in 327 ms

Related Issues
discovered while testing https://github.com/mitodl/ocw-studio/pull/1724

I think this issue should be a bit more broad than just resource lists. Resource lists are just one example of content that can be linked using the relation widget. Resources are linked to lists in the ocw-course starter here: https://github.com/mitodl/ocw-hugo-projects/blob/a90237cdec19e56e36f3022f225777cda7c74803/ocw-course-v2/ocw-studio.yaml#L64. Basically, I think that for anything that defines widget: relation, we should be preventing deletion of content actively being "related" to.

@gumaerc thank you for the insight. We're currently only checking the content of type page for resource references. I agree that we should probably be checking for references in all "presentable" content.
A good place to start would be to create a better resource reference discovery mechanism, the current one can be found here.
https://github.com/mitodl/ocw-studio/blob/80882b3a9951ce780ebea89c1ec61b91bb693216/gdrive_sync/api.py#L645

The fix in the PR https://github.com/mitodl/ocw-studio/pull/1759 focuses on courses. It checks for resource usage inside the content of a course and prevents deletion if there is any.
The content checked for usage is page, resource-list, video-gallery, navmenu, and sitemetadata.
I don't know how www uses its resources so I'm not sure if that is a concern at the moment. I'll look into it tomorrow.

I've added 4 additional types to the fix https://github.com/mitodl/ocw-studio/pull/1759. The types are resouce_collection, course-collection, promo, and stories. These types are used inside www sites.
I believe this should cover all of the cases. I don't see anything else in the UI or the configurations.


Bump Kubevirtci

What this PR does / why we need it:
1b9174d centos8: update SELinux policy version
e1cf770 robust stack: Fix sanity check
bc50e16 Add WFFC variation of rook-ceph-block
656d01a centos8: set SELinux boolean that is now required for chardev access by containers
31e5860 vm based providers: Introduce robust stack provider
15b2c14 Refresh snapshot CRDs follow up for 1.26-centos9 provider
0163752 Enable Seccomp configuration
e037eb1 Adds note about CLI dependencies
9c37b86 k8s-1.24-psa: Remove leftovers
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Was created manually because the following changes are needed as well:
The SELinux policy in the latest Centos 8 base image is now similar to Centos 9, which means it has all the permissions we need but somehow prevents us from loading a custom policy.
The 3rd commit of this PR disables the custom SELinux policy on all lanes to be compatible with that.
This is a good thing overall, since we don't want to have to use our custom SELinux policy.
Thanks @jean-edouard
The 2nd commit of this PR adapts dual stack assertion to be skipped for
KUBEVIRT_SINGLE_STACK instead if the provider is x.yz-ipv6,
since we support robust stack providers now.
Remove legacy providers from the condition as well.
Release note:
NONE

/cc @brianmcarey

Might need also the fix of https://github.com/kubevirt/kubevirt/pull/9373 (or vice versa)

@oshoval we're both bumping + fixing, my PR is https://github.com/kubevirt/kubevirt/pull/9373
Maybe I should cherry-pick your fix, or you mine?

@oshoval we're both bumping + fixing, my PR is #9373 Maybe I should cherry-pick your fix, or you mine?

Sure, meant that as well, will cherry-pick yours if its fine

@jean-edouard
Cherry-picked your fix, and rebased, can you please take a look ?
Thanks

Running here the single stack with 2580
https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/pull/kubevirt_project-infra/2580/rehearsal-pull-kubevirt-e2e-k8s-1.25-ipv6-sig-network/1633001999035273216
/cc @brianmcarey @jean-edouard

Thanks Jed, Brian


Is there a tutorial for the plugin?

i don't know where else to post this as I can't find much on the subject. This is incredibly hard to do. It took me several hours to render an image.
Wondering if there is any tutorial (text or video) where someone is correctly rendering a single image that uses the hotspot option.
I don't know what I'm doing at all. (sorry if you hate this post)
impacto[] {
                    text fields....,
                    imagen {
                        asset -> {
                            url
                        },
                        hotspot,
                        crop
                    }
                },

I had to specify all of my other text fields on my query besides the image itself, else it wouldn't render. I am confident somebody smarter than me has come to a conclusion.
The rest of my code is a mess as well as I feel am being redundant.
        $impacto = collect($data[0]['impacto'])->map(function ($item) {
            // start of image processing
            $imagen = $item['imagen'];

            $imageUrl = $imagen['asset']['url'];
            $hotspot = $imagen['hotspot'];
            $crop = $imagen['crop'];

            return [
                'imagenUrl' => $imageUrl,
                'hotspot' => $hotspot,
                'crop' => $crop,
            ];
        });

This "works" but the image isn't cropped and considering the amount of lines I had to write for a single document with just a few fields, this will surely cramp up my controllers.
Is there a better way to render images without the need to specify every single text field? Currently i have to package every single variable into a return array and i would like to avoid doing that. Thank you so much.

i don't know where else to post this as I can't find much on the subject. This is incredibly hard to do. It took me several hours to render an image.
Wondering if there is any tutorial (text or video) where someone is correctly rendering a single image that uses the hotspot option. I don't know what I'm doing at all. (sorry if you hate this post)
impacto[] {
                    text fields....,
                    imagen {
                        asset -> {
                            url
                        },
                        hotspot,
                        crop
                    }
                },

I had to specify all of my other text fields on my query besides the image itself, else it wouldn't render. I am confident somebody smarter than me has come to a conclusion.
The rest of my code is a mess as well as I feel am being redundant.
        $impacto = collect($data[0]['impacto'])->map(function ($item) {
            // start of image processing
            $imagen = $item['imagen'];

            $imageUrl = $imagen['asset']['url'];
            $hotspot = $imagen['hotspot'];
            $crop = $imagen['crop'];

            return [
                'imagenUrl' => $imageUrl,
                'hotspot' => $hotspot,
                'crop' => $crop,
            ];
        });

This "works" but the image isn't cropped and considering the amount of lines I had to write for a single document with just a few fields, this will surely cramp up my controllers.
Is there a better way to render images without the need to specify every single text field? Currently i have to package every single variable into a return array and i would like to avoid doing that. Thank you so much.

i was able to make some progress, still the hotspot/crop thing doesn't work.
this is what's worked:
            $imagenRef = $item['imagen']['asset']['_ref'];
            $hotspot = $item['imagen']['hotspot'];
            $crop = $item['imagen']['crop'];

            // make url
            $imagenUrl = $sanity->urlFor($imagenRef)->url();

            //dd($imagenUrl);

sanity is a variable im using from a service and implied as a parameter in my controller.

this worked and now i am getting the cropped version of an imagen.
        $impacto = collect($data[0]['impacto'])->map(function ($item) use ($sanity) {
            $imagenRef = $item['imagen']['asset']['_ref'];
            $hotspot = $item['imagen']['hotspot'];
            $crop = $item['imagen']['crop'];

            $imagenUrl = $sanity->urlFor($imagenRef)->url();

            // obtener dimensiones de la imagen
            $width = 1920;  // You need to get this from your image metadata
            $height = 2837; // You need to get this from your image metadata

            // parametros rect
            $left = round($crop['left'] * $width);
            $top = round($crop['top'] * $height);
            $right = round($crop['right'] * $width);
            $bottom = round($crop['bottom'] * $height);

            $rectWidth = $width - $left - $right;
            $rectHeight = $height - $top - $bottom;

            // construir la url
            $imagenUrl .= '?rect=' . implode(',', [$left, $top, $rectWidth, $rectHeight]);

            // parametros hotspot
            if ($hotspot) {
                $imagenUrl .= '&fp-x=' . $hotspot['x'] . '&fp-y=' . $hotspot['y'];
            }

            return [
                'encabezado' => $item['encabezado'],
                'subtitulo' => SanityHelpers::processBlockText($item['subtitulo']),
                'testimonioMetrica' => SanityHelpers::processBlockText($item['testimonioMetrica']),
                'botonCTA' => $item['botonCTA'],
                'imagenUrl' => $imagenUrl,
            ];
        });

now i need to figure out how to get the actual dimensions of the image since the "metadata" array from the image object returns undefined.


XPath functions in templates

This is a question, not an issue:
In Nustache  you can use an XML document as the data for rendering, and then you can use XPath expressions that return nodes in the templates, like {{parent/child/node}}
Is it possible to use XPath functions in the templates?
It'll be really powerful to use something like {{sum(items/price)}}

That currently isn't something that is offered. You could implement something similar by creating a ValueGetterFactory and ValueGetter looking at XmlNodes and then compiling the expression and trying to run it. Hopefully this gives you the right direction.


Dead link to the GitHub repo for vulcano sample data

Hi there,
Could you please provide corect link to the vulcano sample data  repository. I get 404 on this one
https://github.com/Azure-Samples/azure-cosmos-db-sample-data/blob/master/SampleData/VolcanoData.json

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: db43c478-6301-7b69-131a-c4289797c49d
Version Independent ID: 5f991bdb-919e-f712-1fe0-050eba25ebaf
Content: Power BI tutorial for Azure Cosmos DB connector
Content Source: articles/cosmos-db/powerbi-visualize.md
Service: cosmos-db
GitHub Login: @SnehaGunda
Microsoft Alias: sngun

@krasnovandr Thank you very much for your interest in Azure products and services. In looking through the document, I am not experiencing any HTTP 404 errors from any linked pages.

I was able to reproduce when I clicked on the sample-volcano-data link. Therefore doesn't work for me.

@krasnovandr the repo was private so you couldn't access it. I changed it to Public. You should be able to access it now.

#please-close

Works for me. Thanks for the quick fix!


Override Version Properties

Description
closes #95

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 88.42%. Comparing base (0006bce) to head (0e7d5ec).

Additional details and impacted files
@@             Coverage Diff              @@
##               main      #96      +/-   ##
============================================
+ Coverage     88.35%   88.42%   +0.06%
- Complexity       95       96       +1
============================================
  Files            12       12
  Lines           378      380       +2
  Branches         61       61
============================================
+ Hits            334      336       +2
  Misses           15       15
  Partials         29       29

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Allow configuration to be saved

It would make sense to allow saving a user's username/password combination, i.e. in some file at ~/.hpiconfig or something like that - just like git lets you store your credentials in ~/.gitconfig.
From a privacy perspective, I don't see that many concerns as the file could be accessible only to the current user.

It is never a good idea to store passwords in plain text. The password would need to be saved in the os keychain. As different linux distros use different keychains, this feature won't be a lot of fun to implement, anyway, feel free to open a pull request.
(Actually, git does not store HTTP credentials by default. On macOS and Windows Git is able to utilize the plattform's keychain to store the password encrypted. On linux you can tell Git to store your password in plain tex, however, this is not recommended. Just use a SSH key :P)

Oh, I see. You're right of course.
I'll close this issue then.

@marcelgarus it was a good idea, but I'm just not motivated enough to implement that keychain mess


Remove support for build-gcs and the gcs-fetcher image

Changes
Fixes #3734, and implements TEP-0037 to remove support for build-gcs PipelineResources and the gcs-fetcher image, which were deprecated in the latest release v0.21.0
/kind cleanup
Submitter Checklist
These are the criteria that every PR should meet, please check them off as you
review them:

[y] Includes tests (if functionality changed/added)
[y] Includes docs (if user facing)
[y] Commit messages follow commit message best practices
[y] Release notes block has been filled in or deleted (only if no user facing changes)

See the contribution guide for more details.
Double check this list of stuff that's easy to miss:

If you are adding a new binary/image to the cmd dir, please update
the release Task to build and release this image.

Reviewer Notes
If API changes are included, additive changes must be approved by at least two OWNERS and backwards incompatible changes must be approved by more than 50% of the OWNERS, and they must first be added in a backwards compatible way.
Release Notes
Remove support for build-gcs and the gcs-fetcher image

/lgtm

/lgtm


Does not Recognize External Thunderbolt Radeon GPU, Neural Compute Stick, or internal Intel OneAPI GPU

Not sure where to start and this may land nowhere: but in the process of discovery here I am. This post gets rather long so GPT4 summarizes it as: Summary: The issue aims to enhance Easy Diffusion's functionality by enabling it to recognize and utilize all available devices and cores in a system, including CPUs, NVIDIA and AMD GPUs, Compute Sticks, and Intel OneAPI GPUs. The current behavior only detects CPU cores or NVIDIA GPUs. The author seeks a solution that can manage multiple backends and virtual environments, such as Anaconda or Docker, to improve performance and avoid "out of memory" situations. Although their Python skills are limited, the author is willing to contribute by testing potential solutions.
Hello! I'm here to explore the possibility of enhancing Easy Diffusion's functionality to better utilize all available devices and cores in a system.
Expected behavior: Easy Diffusion should recognize all devices and use them collectively to avoid "out of memory" situations, and to fully utilize all available cores during a session, rather than just one or the other.
Current behavior: Easy Diffusion only recognizes CPU cores or the NVIDIA GPU. AMD GPU, Compute Stick, and Intel OneAPI GPU are not detected.
Hardware Setup:
Core i7-9750H 6 Core / 12 Thread CPU (Comet Lake 14nm AVX2 CPU)
32GB DDR4-2666MHz
Integrated Intel UHD 630 CFL GT2 GPU with 24EU (sharing 32GB system RAM w/Core i7) (GFX9/GFX9.5)
Intel Neural Compute Stick 2 with 12 "shave cores" and 4GB VPURAM (Movidius Myriad cores, soon to be integrated into 14th Gen CPUs)
NVIDIA RTX 2080 Max-Q w/8GB GDDR5 VRAM (internal)
AMD Vega Frontier Edition 16GB GDDR5 VRAM via Razer Thunderbolt enclosure
Operating Environment:
I am using EndeavourOS rolling release (downstream of Arch Linux, but Arch is being installed as we speak for testing). The system has all necessary toolkits and SDKs packages-list-foreign.txt
packages-list-native.txt installed for each GPU, including:

CUDA
TensorRT
OptiX
HIP-Runtime-AMD and all associated HIP packages (for ROCm)
All Intel Level Zero and OneAPI packages, compilers, runtimes, and headers
OpenVINO and drivers for the neural compute stick
OpenCV
OpenVDK
OSPRay
OpenVKL
OpenIMPI
OpenMPI with HIP backend

Upcoming or Existing Practical Examples of Diffusion for On-Device Distributed Workloads / Personal HSA Systems:

OpenVINO + OneAPI: Upcoming 14th Generation Intel CPUs with integrated Movidius and Xe (Arc-based) graphics cores, along with additional add-on Intel Arc GPUs
ROCm/HIP/OpenSYCL + CUDA: Ryzen 7000-series CPU paired with NVIDIA GPU and/or Radeon GPUs
OneAPI+OpenVINO+HIP/ROCm: 14th Generation Intel CPU (or 13th generation + compute stick) paired with AMD graphics solutions

Summary:
I previously posted this issue on the Arch4Edu group, which focuses on creating custom packages. The response suggested using Anaconda or Docker for each virtual environment (CPU, neural compute, CUDA, ROCm, OneAPI, etc.) and an interface to link them together. Unfortunately, my Python skills are limited, and I cannot develop a unified, multi-platform, multi-SDK, Easy Diffusion backend. However, I can contribute by testing!
Link to Arch4Edu Github
Also of Note:
If this mysterious "neural fabric" is created to make Easy Diffusion work on multiple platforms on one PC via virtual environments connected via this "interlink" that has yet to exist: it could also apply to a multi-device on-network or WAN distributed Easy Diffusion session.

PyTorch itself, running all this ML code, needs to be compiled for specific devices, and PyTorch itself only supports a couple:https://pytorch.org/get-started/locally/

PyTorch itself, running all this ML code, needs to be compiled for specific devices, and PyTorch itself only supports a couple: https://pytorch.org/get-started/locally/
For example, for a radeon card, it needs ROCm compatible PyTorch compiled for it. Beyond that, Diffusers, itself, may also not support multiple special case devices, as they're a wrapper for PyTorch operations.
I haven't done much with Diffusers in months, I mainly use WebUI, or ComfyUI. I have a node package for ComfyUI that has a lot of features I put into Easy Diffusion: https://github.com/WASasquatch/was-node-suite-comfyui

I am using Arch Linux, which has multiple packages. This means there is a "pytorch-opt-rocm" which has rocm + avx2 cpu optimizations. There is also a "pytorch opt-cuda" which is for cuda +avx2. There is also a pytorch-tensorrt for the tensor cores.
I will see if I can use the default PKGBUILD templates for each as a recipe to compile a system package that has support for all. If not, then I will message on the Arch forums... and from there the pytorch project I suppose to support multiple backends.
That being said, I thought I recently saw a campaign/project that "permits" accessing multiple backends across multiple virtual environments to "slice" the jobs, then distribute across each VE>


How to transfer the pretrained bart-base model in fairseq to transformers

I found that the vocabs for bart-based used in fairseq and transformers are not the same.
I have done bart-base further pretrain with fairseq and now how can i use this model to do other tasks in transformers?

I have the same problem

I have the same problem
I think i have solved the problem.
The vocab in fairseq is larger than that in transformers.But i found that they are almost the same.The vocab in fairseq contains more madeupwords,it has little impact on the model.
So, it's ok to transfer.

How to implement it on the code, I am a novice so there are many things I don't understand


Discussion: Remove method to retrieve data for single component

The current method supports requests for data only for a single component. This is reflected in the name of the method, which is not a simple mapping of the gRPC function that is called.
In future, the client will support data from multiple components in a single request (see https://github.com/frequenz-floss/frequenz-client-reporting-python/issues/19). For that a function list_microgrid_components_data will be implemented that maps to the gRPC function that it calls.
The existing function could then be kept, removed or integrated into the new function.
See comment: https://github.com/frequenz-floss/frequenz-client-reporting-python/pull/16/files#r1554004758

Any reason not to put discussions in https://github.com/frequenz-floss/frequenz-client-reporting-python/discussions? You can even easily convert them:


[JS] New 'react-native init'

'react-native init' should have an option where it creates a small app for you, using best practices. Right now 'react-native init' creates an "app" for you which is useless. I have to go and read lots of documentation and tutorials to figure out how to do completely basic things like navigation and state management. We have a great opportunity to make 'init' create something useful.
The new template would be a small app that includes Navigation, one screen with a ListView that renders JSON data fetched from a HTTP endpoint, and Redux for state management. It should also include tests.
We should include a basic local node server that serves the data and stores updates in memory, so that you can do 'init', run and see the whole thing working end-to-end.
For this, previous experience with building RN apps is essential.
You can implement this in steps, by first implementing a subset:

react-native init --navigation creates an app with a ListView with static hardcoded items, tapping an item takes you to a screen representing that item
react-native init --redux creates an similar to the above, plus uses Redux for data management, and also allows editing the data via the detail screen. For this there should be a small local node server included that the user can start with a simple command.

See the discussion: https://www.facebook.com/groups/reactnativeoss/permalink/1558844321078863
This might be a good writeup to look at<EMAIL_ADDRESS>

Please do this without using Yeoman generators. We want to remove Yeoman from the tree because it has too many dependencies.

Happy to give it a shot next week. I already have working code which generates a project from a template.

BTW, should we wait for NavigationExperimental to be stable?

@satya164 I'd be fine with using NavigationExperimental in the template. Hopefully it will be an easy codemod later :)

@ericvicenti Do you have a rough ETA on removing the Experimental suffix? Will it be called Navigation?

The NavigationTransitioner is very close to stable, so that can be moved to the normal core soon because we're using it at Fb. But there are other parts of NavigaitonExperimental like the Header and Card which aren't used by Fb in production, and they should probably be maintained by the community. Ideally somebody would own those outside of the RN core, otherwise they may be experimental indefinitely.

@ericvicenti The whole Navigation scene in React Native right now is a mess. We've got Navigator which is being deprecated support wise, and NavigatorIOS which is maintained by the community, and I believe will also come deprecated once NavigatorExperimental comes out (or will it?).
With your above comment it just adds to the confusion/mess. If one part of NavigatorExperimental will be maintained by Facebook and one part by the community, won't we have just another Navigation solution which sorts of works - but isn't great since it might not be kept up-to-date by the community?
In my opinion, we need a single Navigation solution which is fully supported with great documentation - right now every time I see/deal with a RN app navigation feels like a hack to get it implemented.

@ericvicenti Thanks for replying! Is it going to be called NavigationTransitioner or can it be simply called Navigation? (I vote for the simple name if it makes sense to use it.)

Sorry that things are currently a mess! It is difficult for me to keep things sane for the community while continuing work on internal projects. But I'd really like to help clear things up.
@mkonicek I see your point and agree that it makes sense to ship RN with opinionated default components. I'd like to propose these modules/names for un-experimentalizing:
Navigation - Namespace for these modules to avoid muddying the react-native namespace
Navigation.Transitioner - Coordinate animations between scenes
Navigaiton.StateUtils - Utilities to help modify the navigation state for your app (push, pop, etc)
Navigation.Card - Default scene component that looks platform-appropriate
Navigaiton.Header - Default header component that looks platform-appropriate
Navigation.CardStack - Default integration of Transitioner and Card (and possibly Header). Behaves like a declarative Navigator
As far as the existing components go:
Navigator - Will be deprecated as we un-experimentalize the things above
NavigatorIOS - Will NOT be deprecated, but we need somebody to switch it to a declarative API like that of CardStack
We can switch these things over as soon as we kill NavigationAnimatedView, by moving CardStack to depend on Transitioner instead.
cc @hedgerwang

Are we really ready to deprecate Navigator? I think before we deprecate it we should have a clear migration guide from Navigator to Navigation, and make sure there aren't big missing components. We don't want to leave things in a half-deprecated-but-not-really mode like NavigatorIOS currently is.

@ericvicenti Is there anything the community can do to help move to forward faster? Now that the API is close to stable, it would be great if you or @hedgerwang created issues for things that needs to be done before 'experimental' can be dropped. I am happy to help out.
🍺

@jmurzy, Thanks for offering! I think the main thing that needs to be changed at this point is to move NavigationCardStack over to NavigationTransitioner rather than NavigationAnimatedView. It should be pretty straightforward if you want to give it a shot! Filed as #8262
@lacker, I agree we should put together a migration guide. With some very minor cosmetic differences, NavigationCardStack can support anything we did with Navigator- let me know if there are any use cases which we don't support yet!

@ericvicenti Having done that sorta migration at least a few times over the last couple weeks, that shouldn't take too long. Will report back.
🍺

We should be sure to make our docs that talk about navigation encourage the same "best practices" as a new-app template creates for you. cc @hramos who is working on navigation-documentation. Also we should be sure that our navigation docs get updated with the precise messaging about when/what is deprecated.

This has kinda turned into a couple other projects like create-react-native-app so I think this issue has served its purpose and should be closed. Thanks folks for chiming in!


Minor code quality improvements

Upgrade ruff version for precommit
Minor change to improve code readibility

YOLO, merged prior ro RPM builds completeing


[Bug] No results found message should be displayed if the entered calculator is not found.

Description
If the user is searching a calculator and it is not found in the predefined calculators in websites it should display the message "no results found". By customizing the html and css code i will solve this issue.
Screenshots

Here time complexity calculator is not found. But it is not displaying any message.
Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.
[X] I am a GSSOC'24 contributor.
[ ] I am a IWOC'24 contributor.
[ ] I am a JWOC'24 contributor.
[ ] I am a SWOC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

@Rakesh9100

Proceed @Janani-m17


Resetting values of command-states

Actually, the states in the control-channel are not reset after using. So the state start remains on true, the zoneClean holds the last zone entered. This is quite annoying while using it in the vis. I've tried to use some bool-button with different texts for true and false, but as all the states remain on true, this doesn't work out.
As for now I use a trigger on the mihome-vacuum.0.info.state, but it would be very nice to have this done by the adapter itself.
So for the logic:
state 6 or 8 resets start, spotclean, pause, zoneclean.
state 8 resets "home" (going home)
state 11 (spot cleaning) resets start, pause
etcpp..

Wouldn't it be enough just to set all states to "false" if the Status is 2, 3, 6 or 8?
Because normally you never set "start" to true and then set for example "spot clean" to true without the cleaner reached state 2 3 6 or 8 after the normal "start"?

Except Home, this should go to false after state 8, but not with 6.

For the state pause, this is a little bit different. If triggered from outside, it should go to true by state 10 and go to false by any other state.

Do you just need it for displaying the states in VIS?
You can apply CSS to the widgets with an "if statement"..
For example "if mihome-vacuum.0.info.state == 8 then ......" so you can apply any styles with CSS to that Widget.
Maybe you should open a thread on forum.iobroker.de where we better can talk about that.

This doesnt work with bool-switches. They are supposed to have a different look according to the value of the state. Of course its possible to overwrite this by a bit of js, but to have a reliable value in state would be much better. Will try to explain this in the forum..

Did you already post anything about that in the forum?

Just a second ago:
https://forum.iobroker.net/viewtopic.php?f=23&t=16952
Its in german..

Hey,
I'd like to refresh this issue, same problem here. Bool objects in control or object "RoomClean" stay "true".
It would be perfect if states reset after changes (e.g. RoomClean=true until cleaning of room finished or canceled)
Thanks and regards,
Ralf

If a Button is triggered it id now Set to true, if action is triggered, gut this is Not the Cleaning Time.
As long as the robot is Cleaning the state control.clean_home is Set to true


Make the constant maxPerPage configurable.

Summary
The constant maxPerPage of rpc/core/env.go is hard-coded currently. But it's better to change this value to be configurable.
maxPerPage = 10000

Problem Definition

Proposal

For Admin Use

[ ] Not duplicate issue
[ ] Appropriate labels applied
[ ] Appropriate contributors tagged
[ ] Contributor assigned/self-assigned

(accidentally closed by bot😱)


Esri layers preview in some case fails

I will check this with @ingenieroariel

This was fixed by migrating to MapProxy 1.9 and higher.


Add stop method

Once the bot is created it runs forever and there is no way to stop it. Please add this ability.

This ability is not responsibility of this library. Whereas, the native function process.exit() is able to terminate any process regardless of what is keeping it active
try to use it this way:
const telegram = require('telegram-bot-api');
const api = new telegram({
        token: ''
});
api.sendPhoto({
    chat_id,
    photo: './img.jpg',
  }).then(()=>process.exit())

More information:
https://stackoverflow.com/questions/5266152/how-to-exit-in-node-js

In case you don't need to receive updates.
Another even simpler way is:
var api = new telegram({
        token: '',
        updates: {
            enabled: false
        }

});

The process will end after executing all the api-calls in the script

Stop functionality for getUpdates and webhook will be available in 2.0 which is under development

Fixed in 2.0


Add Elasticsearch Event Formatter

Based on the Elasticsearch-rails instrumentation (https://github.com/elastic/elasticsearch-rails/blob/master/elasticsearch-rails/lib/elasticsearch/rails/instrumentation/publishers.rb and https://github.com/elastic/elasticsearch-rails/tree/master/elasticsearch-rails#activesupport-instrumentation)

:+1:


Error

After command "python2.7 compiler.py":
File "compiler.py", line 47
match line:
^
SyntaxError: invalid syntax

Traceback (most recent call last):
File "C:\Users\macch\OneDrive\Dokumenty\GitHub\PySilon-malware\tools\PyInstaller_main_.py", line 21, in
from PyInstaller import version
ModuleNotFoundError: No module named 'PyInstaller'
I tried on windows and i got this error after enter all these values

Try: pip install pyinstaller

it worked. But when I open keylogger it has this error in cmd
file "C:\Users\macch\OneDrive\Dokumenty\GitHub\PySilon-malware\main_prepared.py", line 20, in
from browser_history import get_history
ModuleNotFoundError: No module named 'browser_history'

i used: pip install browser-history
and it worked

Sorry I forgot to put this in requirements.txt

After launch keylogger:
[2022-12-03 15:01:43] [ERROR   ] discord.client: Ignoring exception in on_ready
Traceback (most recent call last):
File "discord\client.py", line 409, in _run_event
File "main_prepared.py", line 94, in on_ready
AttributeError: 'NoneType' object has no attribute 'content'

Please copy-paste here lines 90-100 of main_prepared.py and I will take a look

Oh i know. Send something on file related channel

*recordings sorry

Because this rat reads last message to decide if you want to get microphone recordings (if you send "disable" on this channel, bot wont send recordings from the next launch). And since recordings channel is empty, when bot reads last message it raises an error. I need to fix this.

It should work now. I fixed this

I guess that .join command won't work because of not uploading ffmpeg portable folder, give me a minute

no, i messed up lol. Ffmpeg WILL be essential for screen live streaming in future :). Everything should be fine. I'm closing this ticket and if you encounter any other bugs, just create new one.


Update nscplugin, sbt-scala-native, ... to 0.4.14 in main

Updates

org.scala-native:nscplugin
org.scala-native:sbt-scala-native
org.scala-native:scala3lib
org.scala-native:scalalib
org.scala-native:test-interface

from 0.4.12 to 0.4.14.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-native" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scala-native" }
}]

labels: library-update, early-semver-minor, semver-spec-patch, commit-count:1

Superseded by #76.


[backport] Fix file mode of mushrooms.csv

Backport of #6693

[automatic post] Jenkins, test this please.

Jenkins CI test (for commit 20bc9e2ae23389bf2ad06fa03c48bebfa349e604, target branch v5) succeeded!

Closing as v5 branch has been freezed.


SDK can not be installed with<EMAIL_ADDRESS>

There is no released version of the SDK compatible with the 1.0.0 api release from last week. The newest API version is not usable. This was fixed in https://github.com/open-telemetry/opentelemetry-js/pull/2276 but needs to be released.
What version of OpenTelemetry are you using?
{
  "name": "npmotel1",
  "version": "1.0.0",
  "description": "",
  "main": "index.js",
  "scripts": {
    "test": "echo \"Error: no test specified\" && exit 1"
  },
  "keywords": [],
  "author": "",
  "license": "ISC",
  "dependencies": {
    "@opentelemetry/api": "^1.0.0"
  }
}

What version of Node are you using?
~/tmp/npmotel1$ node --version
v12.21.0
~/tmp/npmotel1$ npm --version
7.13.0

Please provide the code you used to setup the OpenTelemetry SDK
n/a
What did you do?
Try to install an SDK package like @opentelemetry/tracing
$ npm install @opentelemetry/tracing@next

What did you expect to see?
Package should install
What did you see instead?
$ npm install @opentelemetry/tracing@next
npm ERR! code ERESOLVE
npm ERR! ERESOLVE unable to resolve dependency tree
npm ERR!
npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/@opentelemetry/api
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/@opentelemetry/tracing
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
npm ERR!
npm ERR! See /usr/local/google/home/aaronabbott/.npm/eresolve-report.txt for a full report.

npm ERR! A complete log of this run can be found in:
npm ERR!     /usr/local/google/home/aaronabbott/.npm/_logs/2021-06-14T17_16_49_782Z-debug.log

cc @dyladan don't know if you wanted to wait for a particular PR to release a SDK version compatible with 1.0 (which should stay in the 0.x version i expect) ?

yes we will keep it in the 0.x versions for now. I was not waiting for any particular PR

yes we will keep it in the 0.x versions for now. I was not waiting for any particular PR

Why not use the most recent and now stable 1.0.0 release though? If we want people to use 1.0.0, it should be compatible with any SDK.


Add numpy as a dependency

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (fc6507d) 100.00% compared to head (cbd225f) 100.00%.

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #310   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           94        94
  Lines         3197      3197
  Branches       241       241
=========================================
  Hits          3197      3197

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[stable/prometheus-adapter] add apiVersion

Adding the apiVersion for chart.yaml
to fix the issue: https://github.com/helm/charts/issues/13763
Checklist

[x] DCO signed
[x] Chart Version bumped
[x] title of the PR contains starts with chart name e.g. [stable/chart]

/assign @mattfarina

/test pull-charts-e2e

@maorfr PTAL

/lgtm


Added nav rate display and Galileo nav rate change for AHRS branch.

AHRS calculation used to be inside calcGPSAttitude() which is no longer being called when IMU is enabled. This PR moves the calculation code to a dedicated function to ensure nav rate can still be displayed in IMU AHRS mode to help evaluating GPS performance.
Also includes changes from #597

This is helpful. Merged into AHRS branch.


Junit5 assert throws

Convert all legacy junit v4 exception checking to junit v5 assertThrows.
Test not run locally due to this error in master.
% mvn clean install
[INFO] Scanning for projects...
[ERROR] [ERROR] The projects in the reactor contain a cyclic reference: Edge between 'Vertex{label='org.apache.commons:commons-proxy2-build-tools:2.1-SNAPSHOT'}' and 'Vertex{label='org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT'}' introduces to cycle in the graph org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT --> org.apache.commons:commons-proxy2-build-tools:2.1-SNAPSHOT --> org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT @
[ERROR] The projects in the reactor contain a cyclic reference: Edge between 'Vertex{label='org.apache.commons:commons-proxy2-build-tools:2.1-SNAPSHOT'}' and 'Vertex{label='org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT'}' introduces to cycle in the graph org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT --> org.apache.commons:commons-proxy2-build-tools:2.1-SNAPSHOT --> org.apache.commons:commons-proxy2-parent:2.1-SNAPSHOT -> [Help 1]

Splitting into separate PR so easier to re-merge if takes long time to get merged


🐞  Uploading pickled model to BucketFS does not work

Summary
Uploading a pickled ... model to BucketFS fails with an exception.
Reproducing the Issue
Product ML file
import pandas as pd
import numpy as np
from sklearn.linear_model import LinearRegression
from sklearn.metrics import mean_squared_error

# Create a dummy dataset with 10,000 rows
np.random.seed(42)
data = {'X1': np.random.rand(10000),
        'X2': np.random.rand(10000),
        'X3': np.random.rand(10000),
        'y': np.random.rand(10000)}
df = pd.DataFrame(data)

# Split the data into features (X) and target variable (y)
X = df[['X1', 'X2', 'X3']]
y = df['y']

# Create a linear regression model
model = LinearRegression().fit(X, y)

# Fit the model to the data
#model.

# Generate 2,000 rows for X_new
np.random.seed(42)
X_new = pd.DataFrame({'X1': np.random.rand(2000),
                      'X2': np.random.rand(2000),
                      'X3': np.random.rand(2000)})

# Predict on new data
y_pred = model.predict(X_new)

# Print the predicted values
print("Predicted values:")
print(y_pred)

# Calculate the mean squared error
y_pred_train = model.predict(X)
mse = mean_squared_error(y, y_pred_train)
print("Mean Squared Error:", mse)

Pickled model
import pickle
from sklearn.linear_model import LinearRegression

# Save the model to a file
filename = 'dummy_linear_regression_model.sav'
pickle.dump(model, open(filename, 'wb'))

print("Model saved successfully.")

Failing code
import io
from exasol.bucketfs import Service

URL = "http://localhost:2581"
CREDENTAILS = {"default": {"username": "w", "password": "BBiSzwGaD6X7zLcjfpcP0OdGA317JABg"}}

bucketfs = Service(URL, CREDENTAILS)
bucket = bucketfs["default"]

filename = 'dummy_linear_regression_model.sav'
loaded_model = pickle.load(open(filename, 'rb'))

# Upload bytes
data = loaded_model
bucket["dummy/dummy_linear_regression_model.sav"] = data

# Upload file like object
# file_like = io.BytesIO(loaded_model)
# bucket.upload("dummy/dummy_linear_regression_model.sav", file_like)

# bucket.upload("dummy/dummy_linear_regression_model.sav", loaded_model)

Expected Behavior
Uploading model is successful.
Actual Behavior
Uploading model fails with exception
Root Cause (optional)
unknown
Screenshots

Reported by: @exa-eswar

Hi @exa-eswar,
I assume the problem is an "miss use" of the API, uploading in memory live object is not supported at the moment.
I think what you actually want to do is the following:
import io
from exasol.bucketfs import (
    Service,
    MappedBucket,
)

URL = "http://localhost:2581"
CREDENTAILS = {"default": {"username": "w", "password": "BBiSzwGaD6X7zLcjfpcP0OdGA317JABg"}}

bucketfs = Service(URL, CREDENTAILS)
bucket = MappedBucket(bucketfs["default"])

filename = 'dummy_linear_regression_model.sav'
with open(filename, 'rb') as data:
    # Upload bytes
    bucket["dummy/dummy_linear_regression_model.sav"] = data

looking forward to get your feedback on this.

@tkilias good point, but that rather is a feature than a bug ;).
Giving it some more thought ,I am not 100% sure if this functionality should be part of bucketfs library.
I think this is rather a functionality of this specific client code, pickling is a very specific use case.

@Nicoretti , Thanks for feedback and fix. I can confirm that this is working well.

@Nicoretti yeah, it is a feature and probably not directly related to buckets, but something which we probably need, but maybe not as part of this repo, but one on top of it.

thx @exa-eswar for the feedback


Increase API versions to 6.3

#1169 introduced a new API function which is the reason for this change.


pgls analysis

Hi @PaviS0102 - keep me posted on this analysis. I am going to make a few more pushes today and tomorrow for light availability, but feel free to start a new script for pgls.

@PaviS0102 Excellent work on the PGLS script!
Couple of thoughts:
a) I pushed the scripts again with some minor changes
b) the best way to code in categorical predictors is to define them as factors and run them in the model
c) I love the way you coded the median time to darkness for dawn and dusk - I think that's a nice way to explore it.
d) I am getting a p value of 0.0398 for median_StartTime (not what you got) - maybe I am doing something wrong?
Anyway - take a look at this script and let me know what you think.
I think the Mikula et al. 2020 paper is also worth visiting in terms of how they included PGLS analyses (they included scaling of variables and had a categorical predictor - but I believe they ran phylolm() instead of gls). [Not that we need to follow their approach, but I found it noteworthy to mention]
Let me know when you take a look at the script. The next steps would be to plot the results of the same (say a ggplot of the coefficients?)

I was thinking a bit more about this - @PaviS0102 - I think that having a coefficient plot (ggpredicts or sjPlot::plot_model()) to showcase that predicted coefficients for median startTime implies that ~with increasing time/light levels, we have higher % of detections?
Anyway, looking forward to your pull request, following code changes.

@PaviS0102 To your question about habitat_type, I think including (whether a site is restored, unrestored, or a benchmark site) within a pglmm maybe worth exploring - essentially the site_type/habitat_type is a random effect here.
I came across this R code: https://daijiang.github.io/phyr/
[sorry for the barrage of comments, but I think we are getting closer to wrapping up the analysis!]

Hi Vijay,
I am so sorry for this delay in response, was travelling. Will get back to
you with the Pgls script by this afternoon.
Thank you very much,
Pavithra
On Tue, 28 May 2024 at 15:41, Vijay Ramesh @.***> wrote:

@PaviS0102 https://github.com/PaviS0102 To your question about
habitat_type, I think including (whether a site is restored, unrestored, or
a benchmark site) within a pglmm maybe worth exploring - essentially the
site_type/habitat_type is a random effect here.
I came across this R code: https://daijiang.github.io/phyr/
[sorry for the barrage of comments, but I think we are getting closer to
wrapping up the analysis!]
—
Reply to this email directly, view it on GitHub
https://github.com/vjjan91/diurnal-Acoustics/issues/8#issuecomment-2135981452,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5ORAZMLWHXHOZEROIOQKGDZETMVPAVCNFSM6AAAAABIGHITE6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZVHE4DCNBVGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

@PaviS0102 Thanks for your work on this!
I pulled your script and reran some analyses (made some minor modifications)
a) I removed the logging of median peak frequency and just scaled it
b) I removed all the univariate models, after realizing that the AIC of all of them are far higher than the multivariate approach.
c) I ran two models: one with percent_normalized_detections and the other with just percent_detections and both of them show a marginal, yet significant association with weakly territorial species and median start time, respectively.
[the second model has a lower AIC compared to the first model, by about a value of 2].
I am trying to wrap my head around what maybe the best approach here and sent both outputs to Laurel.
Could you include a PGLMM as a code chunk below the same? I think it would be a single/two models you would run.
And please let me know what you think?
I pushed the scripts.

I am still convinced that there is something going on between light levels and detections (check

out the plots below)

I am still convinced that there is something going on between light levels and detections. See below

Vijay, thanks for this! Sure, I will code for PGLMM, include it as a chunk
below this, and push the script soon. I will go over the script and get
back to you.
I just chatted with Meghana about this project. She suggested a few points:

PGLMM would be easier to interpret and help account for habitat type
differences. It could help account for differences in vocal activity of
ground-level and canopy-level birds as well.
There could be some interaction between trophic niche and light
availability.
If going ahead with PGLS, look at which model (Brownian/Pagel/one or two
others) would be best suited.
Could it be worth exploring models for dawn and dusk data separately?

Oh! This is so cool- yes! The correlation seems to be fairly high as well!
On Wed, 29 May 2024 at 11:13, Vijay Ramesh @.***> wrote:

I am still convinced that there is something going on between light levels
and detections. See below
Screenshot.2024-05-29.111205.png (view on web)
https://github.com/vjjan91/diurnal-Acoustics/assets/20208291/acb2081c-1a0c-457b-800a-2552b7893eca
Screenshot.2024-05-29.111016.png (view on web)
https://github.com/vjjan91/diurnal-Acoustics/assets/20208291/57170d29-82f3-47aa-a248-c5387c852576
—
Reply to this email directly, view it on GitHub
https://github.com/vjjan91/diurnal-Acoustics/issues/8#issuecomment-2137662509,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5ORAZNPR2DZH6Y3UAKM66TZEXWCTAVCNFSM6AAAAABIGHITE6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZXGY3DENJQHE
.
You are receiving this because you were mentioned.Message ID:
@.***>

Sounds good:
PGLMM would be easier to interpret and help account for habitat type differences. It could help account for differences in vocal activity of ground-level and canopy-level birds as well.
Sure, I doubt that habitat type has a strong effect, but either which way - let's run this to be sure.
There could be some interaction between trophic niche and light availability.
Perhaps run a model and see what it shows? I am still convinced that we need to figure out what's happening with the linear predictors before we move on.
If going ahead with PGLS, look at which model (Brownian/Pagel/one or two others) would be best suited.
Shouldn't matter much - choose one of them and we just justify it in the methods. This may matter more for larger sample sizes ~ 1000s of species.
4) Could it be worth exploring models for dawn and dusk data separately?
I doubt it - the only model in which this may be worth exploring is a model with just start_times. The rest of the predictors and their values are all the same irrespective of dawn or dusk

Thanks for the excellent work on the PGLMM @PaviS0102  - The model is running/has been running for the last 5 minutes on my 64gig desktop station and hasn't stopped/converged yet.
I am trying to synthesize what we have done so far in our shared ppt and will send an email to everyone soon. I think our paper so far shows a no-result/non result, which is fine, because we tested all potential hypotheses.
I haven't run into the error you ran into for the pglmm so far.

Closing this comment by pushing the pglmm as a supplementary script. I don't think we are gaining any novel information with that analysis for now, and we can always show this to reviewers if they ask/would like to see other analyses?

Vijay, I haven't been able to work on it as I was feeling a little unwell
the past few days. Yes, that sounds good to me! Will go through the Word
doc and reply to your email soon.
On Mon, 3 Jun 2024 at 11:29, Vijay Ramesh @.***> wrote:

Thanks for the excellent work on the PGLMM @PaviS0102
https://github.com/PaviS0102 - The model is running/has been running
for the last 5 minutes on my 64gig desktop station and hasn't
stopped/converged yet.
I am trying to synthesize what we have done so far in our shared ppt and
will send an email to everyone soon. I think our paper so far shows a
no-result/non result, which is fine, because we tested all potential
hypotheses.
I haven't run into the error you ran into for the pglmm so far.
—
Reply to this email directly, view it on GitHub
https://github.com/vjjan91/diurnal-Acoustics/issues/8#issuecomment-2145514316,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A5ORAZP73JWBPCYPKOPDYATZFSDVJAVCNFSM6AAAAABIGHITE6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBVGUYTIMZRGY
.
You are receiving this because you were mentioned.Message ID:
@.***>


Add abitlity to do async completion without having to specify task token

Replaced new interface with ManualActivityCompletionClient since it already does exactly what we need and simply added a new implementation that is completion and task token aware.


Add Skeletal PPP

#29

Codecov Report
Base: 72.15% // Head: 72.15% // No change to project coverage :thumbsup:

Coverage data is based on head (bf3935d) compared to base (1f53e3d).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff            @@
##             master      #47   +/-   ##
=========================================
  Coverage     72.15%   72.15%
  Complexity      399      399
=========================================
  Files            70       70
  Lines          1232     1232
  Branches        125      125
=========================================
  Hits            889      889
  Misses          311      311
  Partials         32       32

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Which non-ASCII characters are allowed in Red words?

Since the lexer apparently aims to accept all Unicode characters, through their UTF-8 encoding, the question arises what characters will be allowed in Red words. It is clear which ones below U+007F are NOT allowed, but it would seem that the C1 controls (U+0080 - U+009F) should also not be allowed. Above U+00A0 (itself a whitespace) there is a huge range of characters from virtually all scripts of the world, but also many signs and "dingbats". What will the policy be?

Could you please re-post that question rather on the Red mailing-list? I would prefer keeping tickets for issues that require actions on repository files (including documentation files).
Also, the mailing-list gives more exposure to such questions, so others might be interested to participate.
Thanks in advance.

Will do.


Kernel refactor experiment to extract related code into foundation classes

"When one class does the work of two, awkwardness results."

The goal of this experiment is to extract related code from the HydeKernel, without changing end usage. I'm doing this by creating new foundation classes, and redirecting method calls to them.
If this is something that works out, each foundation class should have a test, and a contract (that both the class and the kernel implement)

Since all the tests are so scattered into unit tests it's hard to migrate all of them, so I expect there to be some mess as I can't really migrate everything right now.


Clean up supported cars

There are a few cars on the readme that we don't sell harnesses for, plus I'm not sure if they even work anymore. We should get confirmation that there are still users of the following cars. If there aren't we should remove them from the readme and codebase.

Buick Regal 2018
Cadillac ATS 2018
GMC Acadia Denali 2018
Holden Astra 2017

I'm not sure why we would want to remove these cars. Our regression testing should be good enough that they should continue to work.

I'm not sure why we would want to remove these cars. Our regression testing should be good enough that they should continue to work.


Make having app.json optional [again]

Please consider :grinning:

Or maybe read app json should be a property of the directory module ?

One thing to consider here is that, without an app.json, docker:init won't work (it won't know what image to provide).
If we're going to do this, I'd like to do it without totally disabling one of the commands... one option to make app.json optional while leaving :init intact might be to require an 'image' from somewhere else, like heroku docker:init --image heroku/nodejs. If --image is not provided, we look to app.json for that data. If it can't be found in app.json, then we error out.
How does that sound?

@matthew-andrews take a look at https://github.com/heroku/heroku-docker/pull/121 to see if that will be satisfactory for you folks


[discussion]: Should we include the k8s-dashboard in production?

The k8s-dashboard is currently available in staging, thanks to @mecampbellsoup putting together the chart, configuration, and his PR in the upstream that adds a feature to the dashboard that lets you configure a namespace header (in our case x-consumer-permissions), and a namespace regex that would extract the authorized namespaces from the header values, which makes the dashboard work in our multi-tenant environment, where a tenant has access to a few namespaces but not all namespaces.
There are still a few issues that need to be worked out before we can consider putting this into production (#1 #2 #3 #4), but before time and energy are invested into addressing those issues it would be good to have a discussion to understand whether or not we want to include this in production.
Pros:

The dashboard is an open source project that has implemented a fair amount of functionality (viewing and searching resources), that we can integrate into our multi-tenant environment for a relatively low cost of configuration
if done right (confusing parts mitigated/removed), it is a value-add for customers, especially for those that aren't familiar with kubectl.

Cons:

There is still some work that needs to be done, and it's not yet clear if the fixes would leverage a one-off fix that is only applicable to the dashboard, or if they would leverage a greater fix that could have other uses (e.g. auth proxy for tenant cluster)
This work is targeting the legacy model which is not a priority compared to NGCP

Questions to explore:

How valuable do we think it would be to customers? If we release it, how would we measure that?
To what extent can we repurpose/leverage the work done here for NGCP?

Decision is: No


developer sign in broken on localhost

The storage key is not yet setup on localhost when trying to access the oauth state.

Not relevant anymore.


Fix memset in USBDDriver_Initialize

Fix memset in USBDDriver_Initialize
Description

As #1103 described, the memset usage is incorrect.
Test Steps

Checklist:

[ ] I have tested my changes. No regression in existing tests.
[ ] I have modified and/or added unit-tests to cover the code changes in this Pull Request.

Related Issue

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Since this file is not maintained by us. Trying to contact partner to address this.


unit test: Convert unneeded lambda functions

What this PR does / why we need it:
Convert inline functions to static functions.
Defining it as a named lambda needlessly adds mental burden, as the read need to keep in mind that it
may change in the future.
Beside that:
Remove unrequired interface usage, by using the casted variable.
Use libdv, and add WithName decorator for libdv.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Checklist
This checklist is not enforcing, but it's a reminder of items that could be relevant to every PR.
Approvers are expected to review this list.

[ ] Design: A design document was considered and is present (link) or not required
[ ] PR: The PR description is expressive enough and will help future contributors
[ ] Code: Write code that humans can understand and Keep it simple
[ ] Refactor: You have left the code cleaner than you found it (Boy Scout Rule)
[ ] Upgrade: Impact of this change on upgrade flows was considered and addressed if required
[ ] Testing: New code requires new unit tests. New features and bug fixes require at least on e2e test
[ ] Documentation: A user-guide update was considered and is present (link) or not required. You want a user-guide update if it's a user facing feature / API change.
[ ] Community: Announcement to kubevirt-dev was considered

Release note:

None

it is weird that pull-kubevirt-e2e-k8s-1.28-sig-compute-migrations appears here
it doesnt even exists, only on branch 1.1
trying to run it, to see what happens
/test pull-kubevirt-e2e-k8s-1.28-sig-compute-migrations

addressed comments, ptal

used libdv

@brianmcarey
Hi
No space left on device, fyi please
https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/pull/kubevirt_kubevirt/11072/pull-kubevirt-goveralls/1749831695449722880#1:build-log.txt%3A309

/retest

Addressed comments

/test pull-kubevirt-build-arm64
not sure what goes there yet

/approve