iCloud3 v3.1 ➤ Questions & Answers

Post any questions you have to this issue. Create a new issue if you are having problems.

Gary,
With the release of v3.1, did the update require further operations? I just updated mine (on my MacOS HA browser), and I see the following as the 'Apple ID'. Tried to use it, but didn't get authentication code.

Me the same. I tested it today morning...

APPLE ACCOUNT iCLOUD DEVICE - Apple iCloud device providing location data
🍎 ~~~~ xxxxx, Apple Account #1 of 1 ~~~~ 0 of 0 Tracked ~~~~
there  0 of 0 Tracked   , can't Tracked anything

Mine is showingg 0 out of 7 devices being tracked with no way of adding them.

@wormvortex
See iCloud3 docs here for adding devices

Gary, so I'm a little confused. My v3.1 Event Log does indeed show issues...but when I go to the integration and look at the entities, they're showing actual data (which they weren't before v3.1).

@wormvortex
See iCloud3 docs here for adding devices

I've looked in all the options and I don't have a
"iCloud Account & Mobile App screen"
Has it changed in the new version.

I have exact the same event log like @NR3Y. No operations are capabble. I have 13 Automations on mine and my Wifes Iphone and will not experiment to much.

So, has anyone tried deleting the integration, rebooting/restart HA, then reinstalling it from HACS? I'm wondering whether a fresh install would 'clear' out the issues?
(For https://github.com/Darkwulf183 issue, you probably would need to delete the automation, they'd just be there ready for when you reinstall iCloud3 again.)

@NR3Y

@asinwang @Darkwulf183 @NR3Y The Apple account should be refreshed when iCloud3 starts to load the devices. Yours says 0 of 0 devices tracked, indicating that refresh did not happen. I am looking into that. Try doing an Event Log > Actions >, Locate all Devices with iCloud or Restart iCloud3 and look at Stage 3 & 4 to see if a refresh was done and the devices in your account are available.

This problem occurred on the second account I added. After the upgrade was completed, there was no problem with the original account. In addition, I created a new environment and tested it without success.

I managed to have the devices installed and it seems to work now, but I had to do a restart after each change (removing account and devices -> restart. Adding one device -> restart. Add the next one -> restart aso.) BUT, in the event log header bar, IC3Zone, Interval, Travel and Distance are empty. The only zone that is shown is the one of MobileApp. However, looking at the details of the exported event log, all of the above is updated and available (IC3, Intervl, TrvTime, Dist, Arrival etc). That said, it's probably only cosmetics.
However, Waze seems to have sporadically issues:
Waze Connection Error, Region-ROW > No data returned. The route distance will be calculated, Travel Time is not available.
I won't log an issue, given Gary is working already on a bugfix release.

@akrigator
You should be able to go to the Configure Settings > Data Sources > Apple Account Username/Password screen, select your account, edit the current password, select Login... and Submit. It will validate it and update the config files with the new p/w.

short info I'm out. I bought the HA Cloud solution and use the original app solution. I'm going to assign a new branch to the original app for the automations and see when Icloud 3 starts running properly again. As I control heating and hot water including setback temperatures via the geo positions, I can't wait any longer. Just to let you know that I can't and won't test anything for the time being. Thanks anyway for your effort. :-)

short info I'm out. I bought the HA Cloud solution and use the original app solution. I'm going to assign a new branch to the original app for the automations and see when Icloud 3 starts running properly again. As I control heating and hot water including setback temperatures via the geo positions, I can't wait any longer. Just to let you know that I can't and won't test anything for the time being. Thanks anyway for your effort. :-)

4th grade called:  they miss you.  Please bring the ball back.
Seriously, I understand criticality, I just went thru this with local APIs from my Wx stations as I drive HVAC both with conditions provided from those as well as presence.
But dude... this is a change by Apple and Gary is not a paid dev for HA, Apple, or anyone else.  He's a retired developer who has given a metric sxxx ton of his personal time to write, maintain, and support this integration.  His responsiveness is better than most paid software.
Responses like yours are what lead to devs like Gary saying "I don't need this abuse" and stopping work on integrations like this.  Please think before responding just how your response comes across.

Hi @JtwoA , I absolutely understand what you mean. My intention was in no way to belittle gary's work. I have the utmost respect for his work. I just wanted to inform you with the thread that I won't be testing any further for the time being. I don't have the time at the moment and we have 0 degrees in my corner of Germany almost every night, so I need a functioning heating system... that's all it was. He is outstanding with his work that he has tackled the whole issue in this way. Sorry if that came across differently.

iCloud3 v3.1.1 has been to HACS
Release page is here
Change Log - v3.1.1

LOCATING DEVICES:

Added additional checks to insure the Apple Account location data was refreshed during startup and while configuing iCloud3 settings. Fixed a problem where the location information data from Apple was not being initialized properly.
Fixed the location refresh not being done that caused the '0 of 0' to be displayed in the Configure Setting screens, leading to the Apple Account selection lists to not be populated.
Fixed some problems where 'Locate All Devices = False' would still locate all the devices in the Apple account
Added error checking to make sure the Locate All Devices can not be disabled if there were Family devices that
were assigned to that Apple account. If it was disabled, they would never be located.

UPDATE DEVICE SCREEN - Added (and fixed) the TOOLS - RESET DATA SOURCE(S), DELETE DEVICE(S) option where you can reset the device's Apple Account and Mobile App to default values (None) and fixed a problem deleting devices. Reworked the Apple Account selection list to provide more information and identify setup errors.
UPDATE APPLE ACCOUNT USERNAME/PASSWORD SCREEN - Added checks to insure Locating All Devices can not be disabled if there are tracked devices assigned to this account that are in the Family list.
OTHER THINGS - Changed several things under the covers.

@Darkwulf183
I think v3.1.1 fixes a bunch of stuff. I understand you need things to work 100% (well maybe 99%). Apple really screwed me up, as you can imagine. I had not planned on releasing v3.1 this early but it was better working with the new code than trying to implement it in v3.0. That would have been a lot worse and you would have had a poorer experience. Keep an eye on these issues and I'll see you when it settles down.
Gary

I've install 3.1.1, and after wiping out the stored account information under .storage, I can finally add my account back in.
However when I request a verification code, it never comes through, and this error message in the icloud3-0.log
11-07 14:21:42 iCloud3 v3.1.1
Traceback (most recent call last):
File "/config/custom_components/icloud3/support/pyicloud_ic3.py", line 655, in init
self.authenticate()
File "/config/custom_components/icloud3/support/pyicloud_ic3.py", line 827, in authenticate
raise PyiCloudFailedLoginException(err_msg)
custom_components.icloud3.support.pyicloud_ic3.PyiCloudFailedLoginException: jspeckman, Authentication Failed, Python SRP Library Credentials Error. The Python module that creates the Secure Remote Password hash key has calculated an incorrect value for a valid Username/Password. Try changing the Password to see if the Apple Acct can be logged into. ErrorCode-401

@jspeckman
See my note [here]{https://github.com/gcobb321/icloud3_v3/issues/341#issuecomment-2458440469} about the password problem.  Changing it has worked for others.

@Darkwulf183
I think v3.1.1 fixes a bunch of stuff. I understand you need things to work 100% (well maybe 99%). Apple really screwed me up, as you can imagine. I had not planned on releasing v3.1 this early but it was better working with the new code than trying to implement it in v3.0. That would have been a lot worse and you would have had a poorer experience. Keep an eye on these issues and I'll see you when it settles down.
Gary

Gary you are a real role model for me, I started to get into programming stories in 2007 at the technical school for mechanical engineering. If I ever get 20 percent of what you can do, then I'll take my hat off to myself. People like you are the absolute top hammer for me. As soon as there is something to test, I can now test freely. I deactivated iCloud 3 for the time being. I used the evening to clean everything to the cloud solution, i.e. to replace all the sensors. So now I can also test freely. If something breaks, it's no big deal. Thank you again for your time and the work you put into the project, such people are becoming increasingly rare.  Thank you very much 😄

@de5013
I monitor the HACS data file every 15-minutes for a version change. I’m not sure when HACS updates its files.  The notification should come once HACS does that. Feel free to install it other ways. Over be patient.
Gary Cobb, aka geekstergary

From: DE5013 @.>
Sent: Thursday, November 7, 2024 5:34:59 PM
To: gcobb321/icloud3_v3 @.>
Cc: Gary Cobb @.>; Author @.>
Subject: Re: [gcobb321/icloud3_v3] iCloud3 v3.1 ➤ Questions & Answers (Issue #350)
Should I be seeing an automatic request to upgrade from v3.1 -> v3.1.1 in HACS or the Integration dashboard? If so, I'm not. Maybe I need to be patient.
—
Reply to this email directly, view it on GitHubhttps://github.com/gcobb321/icloud3_v3/issues/350#issuecomment-2463362021, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AIOOVB6C6HU26EIUFLQMTDLZ7PTJFAVCNFSM6AAAAABRETCHQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINRTGM3DEMBSGE.
You are receiving this because you authored the thread.Message ID: @.***>

v3.1.1 - working beautifully (thank you!).
Except... when using the MAP card where I've added 4 iCloud3 entities "device_tracker.xxxx_phone".
The 'Name' in the Map icons stays blank - it would show initials in the map circle.  The icon is in the right location on the map.  An unrelated 'KL' device_tracker from another integration displays correctly.
I can't see where in my iCloud3 entities to add/update to expose the name to the Map card.
Previously (before the glitch) it worked fine.
Thoughts / pointers?

Do you have entries in your customize.yaml file for the IC3 entities?
device_tracker.xxxx_phone:
  entity_picture: /local/xxxxx.jpg
  friendly_name: Rebecca

customize.yaml is the "old school" way to configure entities. You can perform the same functions using the UI now. Select entities from the iCloud3 integration to configure naming, icon, etc.
The easiest way to clear your current IC3 installation would be to restore a backup from before you attempted the first IC3 installation.  However, you may not need to start from scratch. If the integration remains available on the UI, you could walk through the configuration again looking for and correcting errors. Confirm your icloud account at Apple lists all the devices you wish to track and that each device is setup for Find My. I've setup Family Share for myself and my spouse so only one icloud account needs to be verified.

I’ll give it a try, thank you!
Sent from my iPhone
On 14 Nov 2024, at 15:17, Gary Kelley @.***> wrote:

customize.yaml is the "old school" way to configure entities. You can perform the same functions using the UI now. Select entities from the iCloud3 integration to configure naming, icon, etc.
The easiest way to clear your current IC3 installation would be to restore a backup from before you attempted the first IC3 installation. However, you may not need to start from scratch. If the integration remains available on the UI, you could walk through the configuration again looking for and correcting errors. Confirm your icloud account at Apple lists all the devices you wish to track and that each device is setup for Find My. I've setup Family Share for myself and my spouse so only one icloud account needs to be verified.
—
Reply to this email directly, view it on GitHubhttps://github.com/gcobb321/icloud3_v3/issues/350#issuecomment-2476671165, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AQWQK33HSV7FGWOTSTF2CY32AS5GXAVCNFSM6AAAAABRETCHQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZWGY3TCMJWGU.
You are receiving this because you commented.Message ID: @.***>

The easiest way to clear your current IC3 installation would be to restore a backup from before you attempted the first IC3 installation.

Thanks Gary.  I am having seemingly endless problems with my installation.  Sign-in takes an eternity - and the UI wont recognise successful login (the logs confirm it's OK), neither does the UI recognise successful validation code (again, log confirms OK).  A couple of times I have nudged it along and got IC3 to take me to device configuration, but I'm not being presented with my device or any of my family sharing devices.
I have deleted and recreated the integration.  I have tried several of the fixes shared during the recent issue investigation.  I have reviewed the IC3 logs but they don't obviously flag an error.
To confirm, i am trying to register one iCloud account (my own).  My account has FindMy sharing with 3 members of my family (working 100% on iPhone).
It feels like something is fundamentally wrong with my install and - before I undertake further investigation - I'd like to do a 100% clean re-install of IC3.  Can you confirm the steps needed to do this? Which files and directories need removing?
In other posts you've pointed to removing /icloud, /icloud3, .storage/icloud3.apple_acct ...  any others?  I do not have a backup to fall back to.
Thanks in advance for your support.  I very much hope it's all user error on my part! ;-)

The directories are:

/icloud3 - iCloud3 program files, Delete iCloud3 integration before you do this.
.storage/icloud3 - Configuration files
.storage/icloud3.apple_acct - Apple login cookies and session files
.storage/icloud - Old Apple acct cookies and session files (also used by the iCloud integration if it is installed)

Hi Gary. I have a rather odd question and maybe it's not even an issue. But it's related to my wife and if the WAF is at stake, I run ;-) I have my garage door use case linked to your solution and for me, it works fine in most of the cases. Turns out that my wife complains, that whenever she comes home, the garage doesn't open and she had to wait for hours. Well, seconds, but you know how this is.
Today, we came home together (in the same car) and I used this opportunity, to compare the log entires. I see that her phone is checking in at home zone few seconds after mine, but I'm not good in reading and understanding the log very well hence I appreciated your support in how to solve this (if it can be solved at at all). The file is attached. Thx a lot for your support. Much appreciated. Cheers, Mike
icloud3-event-log_2024.1116-18.08.log

Hi all. I've been trying to get this working on and off unsuccessfully. I'm relatively new to HA so this is all a learning curve for me at the moment. I'm running the latest version of HA and iCloud on a raspberry PI. I have an apple account (although don't own any apple devices, the kids and missus do) and I only use this account so I can login to the apple "find me" website to see where my kids are.
So with this icloud app, I have logged in with my credentials, but it says 0 of 0 iCloud Devices Tracked, Tracked-(), Untracked-().   When I try to add a device, it keeps giving me this message "The configured device was not found in any of the Apple Accounts" on the "update icloud 3 device" page.
And then I keep going around in circles!
Any ideas / pointers please guys?

Hi all. I've been trying to get this working on and off unsuccessfully. I'm relatively new to HA so this is all a learning curve for me at the moment. I'm running the latest version of HA and iCloud on a raspberry PI. I have an apple account (although don't own any apple devices, the kids and missus do) and I only use this account so I can login to the apple "find me" website to see where my kids are.
So with this icloud app, I have logged in with my credentials, but it says 0 of 0 iCloud Devices Tracked, Tracked-(), Untracked-(). When I try to add a device, it keeps giving me this message "The configured device was not found in any of the Apple Accounts" on the "update icloud 3 device" page.
And then I keep going around in circles!
Any ideas / pointers please guys?

Please ensure you are installing v<IP_ADDRESS> and nothing later.  Review the open issues for details on Apple changes.

@Jinkler
See here for more information about this problem

Thanks! Currently trying that now, but the 6-digit verification code isn't coming through, I've tried re-requesting it a number of times. (Note, I do not own any apple devices, but I do have an apple account, if that makes a difference).


upgrade to superset 3.0.0 (helmchart 0.10.10) breaks okta integration (working in superset 2.1.0 helmchart 0.10.6)

We are using okta integration in superset and it works perfectly in superset v 2.1.0 (we use helm chart 0.10.6). We use CustomSsoSecurityManager() for our okta integration and we have faced no issues so far. However recently we upgraded to superset v 3.0.0 via helmchart 0.10.10 and we found that our okta integration breaks. When we try to login to superset on clicking login option - we continue to get redirected back to login screen with below error mentioned in superset pod log (on kubernetes)
Expected result - is that user should get logged to superset and should be able to access sqllab feature
Error in logs
ERROR:flask_appbuilder.security.views:Error authorizing OAuth access token: mismatching_state: CSRF Warning! State not equal in request and response."
Okta configuration used in superset_config_overrides.py file are below
class CustomSsoSecurityManager(SupersetSecurityManager):
    def oauth_user_info(self, provider="okta", response=None):
        if provider == "okta":
            res = self.appbuilder.sm.oauth_remotes[provider].get("userinfo")
            me = res.json()
            -- if user is attached to a group that starts with superset
            -- use that group else use SUPERSET_PUBLIC
            superset_groups = []
            if "groups" in me:
                for g in me["groups"]:
                    if "SUPERSET" in g:
                        superset_groups.append(g)

            if not superset_groups:
                superset_groups.append("SUPERSET_PUBLIC")
            return {
                "username": me["email"],
                "name": me["name"],
                "email": me["email"],
                "first_name": me["given_name"],
                "last_name": me["family_name"],
                "role_keys": superset_groups,
            }

OKTA_DOMAIN = get_env_variable("OKTA_DOMAIN")
OKTA_KEY = get_env_variable("OKTA_KEY")
OKTA_SECRET = get_env_variable("OKTA_SECRET")
AUTH_TYPE = AUTH_OAUTH
-- registration configs
AUTH_USER_REGISTRATION = True  # allow users who are not already in the FAB DB

the list of providers which the user can choose from
OAUTH_PROVIDERS = [
    {
        "name": "okta",
        "icon": "fa-circle-o",
        "token_key": "access_token",
        "remote_app": {
            "client_id": OKTA_KEY,
            "client_secret": OKTA_SECRET,
            "api_base_url": OKTA_DOMAIN + "/oauth2/v1/",
            "client_kwargs": {"scope": "openid profile email groups"},
            "access_token_url": OKTA_DOMAIN + "/oauth2/v1/token",
            "authorize_url": OKTA_DOMAIN + "/oauth2/v1/authorize",
            "server_metadata_url": OKTA_DOMAIN
            + "/.well-known/openid-configuration",
        },
    },
]

-- if we should replace ALL the user's roles each login, or only on registration
AUTH_ROLES_SYNC_AT_LOGIN = True
-- force users to re-auth after 3hours of inactivity (to keep roles in sync)
PERMANENT_SESSION_LIFETIME = int(get_env_variable("USER_IDLE_SESSION_TIME", 10800))
-- okta user groups to SuperSet role mapping
AUTH_ROLES_MAPPING = {
    "SUPERSET_PUBLIC": ["Public", "Alpha", "Gamma", "sql_lab"],
    "SUPERSET_ADMINS": ["Admin"],
}
CUSTOM_SECURITY_MANAGER = CustomSsoSecurityManager

Possible duplicate of https://github.com/apache/superset/issues/24579.  Between 2.1.0 and 3.0.0 several security settings were tightened by default.  If you weren't specifying these, perhaps that's the issue.  See the workarounds discussed in that thread.

# Create a custom view to authenticate the user
  AuthRemoteUserView=BaseSecurityManager.authremoteuserview
  class CustomAuthUserView(AuthRemoteUserView):
      @expose('/login/')
      def login(self):
          token = request.args.get('token')
          next = request.args.get('next')
          sm = self.appbuilder.sm
          session = sm.get_session
          user = session.query(sm.user_model).filter_by(username='admin').first()
          if token == 'some token':
              login_user(user, remember=False, force=True)
              if (next is not None):
                  return redirect(next)
              else:
                  return redirect(self.appbuilder.get_url_for_index)
          else:
              flash('Unable to auto login', 'warning')
              return super(CustomAuthUserView,self).login()

I have added this code in my-values.yml file to create custom login with token but this login is not working with version 3.0.1 but it was perfectly working fine with version 2.0.

Are either of you (@arpitgargfk or @codebat-hasan) still facing issues here - it's been about 5 months, so I'm wondering if newer helm charts solved the problem or if you've moved on in some other way.


Swap ArenaColor to ComponentType enum

This is a precursor change for supporting configurable colors. This is mostly a 1:1 swap from a user facing perspective, but there are a handful of minor changes to tether colors in P4S, P7S, Zurvan Unreal, and possibly a couple more.

Need to rethink this


Set up Integration in yaml rather than HACS

I'm wondering if it's still possible to set up this integration via yaml rather than HACS. I'm running and older, pre-HACS build of Home Assistant and am trying to avoid an upgrade because of the breaking changes that will need to be corrected when I do.
I took the files from here and placed them into my custom integrations folder, but wasn't sure what to put in the yaml files - I tried unsuccessfully with a few syntaxes in both my sensors file and the top level config.
Thanks!

There is no need for HACS for any integration AFAIK.

Okay, perfect - that was also my understanding.
I've tried adding it as a sensor based on the old README.md file, but get an invalid configuration error. Is there some other way I should be configuring? Thanks!
- platform: babybuddy
   address: https://10.x.x.x
   port: 8000
   path: ""
   api_key: !secret babybuddy_api_key

Configuration invalid: Platform error sensor.babybuddy - cannot import name 'SensorDeviceClass' from 'homeassistant.components.sensor' (/usr/src/homeassistant/homeassistant/components/sensor/init.py)

It seems like maybe you are on a version of HA that is old enough it doesn't have certain classes the integration uses?

Could be..  Appreciate it!


Rubyforge down, documentation inaccessible

Put the documentation on dropbox or something in plaintext as a fallback, the lack of it is bringing the project to a halt.

Yard docs.

Eg the project needs Yard setup and published to rubydoc.


[SPARK-15600][CORE] Make local mode as default mode

What changes were proposed in this pull request?
(Please fill in changes proposed in this fix)
Make local[4] as spark.master if it is not specified.

Test build #59485 has started for PR 13357 at commit b7f81b0.

Test build #59485 has finished for PR 13357 at commit b7f81b0.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59485/
Test FAILed.

Merged build finished. Test FAILed.

I think that's actually a fairly significant change. Tests and apps have always had to specify a master. I remember @mateiz suggested he wanted it this way on purpose when a similar proposal was made last year. I think we want to leave this. You can easily set the master in your test harness.

Yeah I don't think we want to change this behavior. The motivation you described in the JIRA isn't super compelling.

I believe we should close this PR


Initial commit of Hoodie example

Example of how to use Hoodie as a storage mechanism for Ampersand.

@mikehedman thanks for the Hoodie example. The message says "initial commit" - is there more to come?

@mikehedman thanks for the Hoodie example. The message says "initial commit" - is there more to come?

While there is more that could/should be done, I probably won't get to it for a while. Specifically, it would be great to add in the rest of the Hoodie user management capabilities that are in Hoodie's reference app - things like change password, etc.
the "initial commit" message in this repo is a bit deceptive, as there have been many more commits in my original repo: https://github.com/mikehedman/ampersand-hoodie-example.  But the commit here was really just for porting the code over to the Ampersand Example repo.
Do my suggestion would be to go forward with this version, and hopefully it'll be enhanced over time.

While there is more that could/should be done, I probably won't get to it for a while. Specifically, it would be great to add in the rest of the Hoodie user management capabilities that are in Hoodie's reference app - things like change password, etc.
the "initial commit" message in this repo is a bit deceptive, as there have been many more commits in my original repo: https://github.com/mikehedman/ampersand-hoodie-example.  But the commit here was really just for porting the code over to the Ampersand Example repo.
Do my suggestion would be to go forward with this version, and hopefully it'll be enhanced over time.

@mikehedman awesome, thanks for the clarification...and thanks again for the PR!


Unhandled error occurred

"Cannot read properties of undefined (reading 'id')" at https://stellar.expert/explorer/public/tx/166118820931653632#166118820931653633
TypeError: Cannot read properties of undefined (reading 'id')
at o (https://stellar.expert/distr/explorer.js:1:163365)
at oa (https://stellar.expert/distr/app.js?v=0.19.1:2:501848)
at Ks (https://stellar.expert/distr/app.js?v=0.19.1:2:554087)
at Pu (https://stellar.expert/distr/app.js?v=0.19.1:2:541293)
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.127 Safari/537.36

Fixed


Relaxed the requirement regarding atomic override of destination registers for LD to allow more implementation options

The previous definition prevented some implementations for low end MCUs, which may be desirable. Particularly, for devices with a 32b data interface and a 2R1W register file, atomic write back to the pair would only be possible by disabling interrupts during the operation. The requirement for atomic writeback was unnecessarily restrictive. This change relaxed the requirement to the minimum needed to ensure fault handling is possible. The change is backwards compatible as any implementation complying to the more restrictive requirement complies to the updated one

prepared this draft for review. To merged only as resolution during public review. @Wren6991, please check if this resolution would address your issue.

Yes thank you, this fully addresses the issue I raised in #51. I'll leave any minor wording issues to the spec maintainers.

The Arc has given the approval for this change. I would still like to ask input on the wording. Especially if a native speaker could check this, that would be great.

I would still like to ask input on the wording.

I think the normative part is fine, and presumably this is what the ARC reviewed so we'd best not change it. I have a couple of suggestions for the informative part. Current wording:

If an implementation performs a doubleword access atomically and the register file allows writing the pair, the mentioned atomicity requirements are inherently fulfilled.
Otherwise, an implementation either needs to delay the writeback until the write can be performed atomically,
or order sequential writes to the registers to ensure the requirement above is satisfied.

My suggested tweaks in bold:

If an implementation performs a doubleword load atomically, and the register file implements 64-bit writeback, the mentioned atomicity requirements are inherently fulfilled.
Otherwise, if the doubleword load is implemented as multiple bus accesses, an implementation either needs to delay the writeback until it can be performed atomically,
or order sequential writes to the registers to ensure the requirement above is satisfied.

Reasons for suggestions:

This discussion only applies to loads, so let's be specific (loads and stores do not necessarily have the same atomicity)
"writing the pair" is a bit vague -- we are specifically talking about all 64 bits of load data being written to the register file in a single transaction, so I tried to spell it out a bit more
"Otherwise" is ambiguous when preceded by two conditions; only the first is false in this clause, so specify it

I would still like to ask input on the wording.

I think the normative part is fine, and presumably this is what the ARC reviewed so we'd best not change it. I have a couple of suggestions for the informative part. Current wording:

If an implementation performs a doubleword access atomically and the register file allows writing the pair, the mentioned atomicity requirements are inherently fulfilled.
Otherwise, an implementation either needs to delay the writeback until the write can be performed atomically,
or order sequential writes to the registers to ensure the requirement above is satisfied.

My suggested tweaks in bold:

If an implementation performs a doubleword load atomically, and the register file implements 64-bit writeback, the mentioned atomicity requirements are inherently fulfilled.
Otherwise, if the doubleword load is implemented as multiple bus accesses, an implementation either needs to delay the writeback until it can be performed atomically,
or order sequential writes to the registers to ensure the requirement above is satisfied.

Reasons for suggestions:

This discussion only applies to loads, so let's be specific (loads and stores do not necessarily have the same atomicity)
"writing the pair" is a bit vague -- we are specifically talking about all 64 bits of load data being written to the register file in a single transaction, so I tried to spell it out a bit more
"Otherwise" is ambiguous when preceded by two conditions; only the first is false in this clause, so specify it

I took over the first two points (374422e). On the last one, I think the text will be too convoluted if we actually make it precise. This is the else condition to the previous sentence, and it would contain another if-else. For a non-normative text, I think this is good enough, as it just provides some implementation hints.

As there is no further feedback, I would wait until tomorrow, and merge if no additional comments arise.


Update gradle and provide compatibility with material-stepper

@ganfra

@briananderson1222  Thank you.

@ganfra  any plans to pull in this PR?

Has this commit been rolled into a newer version of MaterialSpinner? I still get attr conflicts with MaterialStepper.


move the com.kazurayam.materialstore.net.data package under other package

move

com.kazurayam.materialstore.net.data.DataURLEnabler -> com.kazurayam.materialstore.materialize.net.data.DataURLEnabler
com.kazurayam.materialstore.net.data.Handler -> com.kazurayam.materialstore.materialize.net.data.Handler

Why?
The DataURLEnabler and Handler is functionally insignificant. These are used to support the special URL scheme data:. This will rarely used. So this package should not stand in front.

the materialize package is not very suitable.
the filesytem package is better.


[B13] Everfull Urn does not always allow interaction with bucket

I trying to use the Everfull urn for supporting some water-requiring machines early game (I'm primarily focusing to magic, not tech). After place the urn, it allows me to pull a bucket of water out but after a shorter period of time, it refuses to fill my bucket. I cannot guess what conditions cause this.
There is no real reproduction steps for this. Place down an Urn, use it few times, leave it alone, try to use again - boom, no water of bucket. Picking/replacing fixes this. No FakePlayer involved here, I, hron84, with a bucket in my bare hand try to pull a water but no success.
EDIT The only cause I can guess is chunkloading issue, I checked my base and I'm not perfectly sure if the urn was chunkloaded properly. I use FTBUtils for chunkloading.
Also, I'm not sure if it is a bug or a feature, but pipes do not connect to them. If it is not a bug, I'll fill a suggestion issue for this, but please let me know.

I have also experienced that issue, you are not alone but it is questionable as to the cause. Also you could in previous version connect a pipe to the top but it currently does not so I am assuming this is a bug.

The urn uses vis to fill it's internal store, and a bucket will only fill if the urn is 'full' (it contains one buckets worth of liquid.
Apparently somewhere during my conversion of the the urn to TC6 I removed and forgot to re-add the fluid handing code, meaning it no longer counts as a liquid source container. Oops.

Could you please add some particles or something that reveals if the urn is unable to provide water? Or a redstone comparator signal, anything that help me to determine if urn can or cannot work.


Setting a UnityMember field changes the next one instead

When multiple UnityMember fields are editable in the Inspector, setting the member on one field changes the member on the next one instead (if there is any).
On the screenshots you can see me edit the 1st field member, but the 2nd one gets modified instead. Since the game object on the 2nd field is not the same, the method will be invalid when called runtime.

The bug occurs even when there is another type of field between the UnityMembers.
I had a quick look at UnityMemberDrawer but I can't find anything suspicious. I thought some static variable or something was used and leaked from a drawer to the other, but no. nameProperty seems in order.
For now, I go into Debug mode in the Inspector and set the component name and member name manually.
Note: the bug was not here in the previous version, where I saw using UnityMethod instead of UnityMember.

This issue is caused by faulty immediate mode GUI handling in DropdownGUI from Ludiq.Controls:
https://github.com/lazlo-bonin/ludiq-controls/blob/master/Controls/Editor/DropdownGUI.cs
Unfortunately, I'm no longer maintaining either repositories. I'm working on a much more robust Unity reflection library which will replace them both, but I have no time frame for its release.


Add less css module support

https://lesscss.org/

I'm sorry, it didn't work properly under less because I didn't initialize it.


Freelance Rate

Fixes Issue🛠
Closes #1158
Description👨💻
The Freelance Rate Calculator is a tool that helps freelancers determine their optimal hourly or project-based rates based on various factors like desired annual income, billable hours per week, and vacation weeks per year.
Type of change📄

[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)

Checklist✅

[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my own code
[X] I have commented my code, particularly in hard-to-understand areas
[X] I am an Open Source Contributor

Screenshots/GIF📷

Where are the files of your calculator, you have just added your calculator part in the main index.html file @mahek0620


Update for recent C API changes

Updates this binding for bytecodealliance/wasmtime#2579

This'll be dependent on https://github.com/bytecodealliance/wasmtime/pull/2584 landing

This'll be dependent on https://github.com/bytecodealliance/wasmtime/pull/2584 landing


fix: removed unnecessary conditional in private access security group

PR o'clock
Description
Issue: https://github.com/terraform-aws-modules/terraform-aws-eks/issues/914
This fix corrects an incorrect behavior, in which the module requires the user to have enable manage_aws_auth variable for the creation of a security_group with the ingress rules necessary to access the private endpoint of the EKS cluster.
Checklist

[x] CI tests are passing
[ ] README.md has been updated after any changes to variables and outputs. See https://github.com/terraform-aws-modules/terraform-aws-eks/#doc-generation

hello
I'm using 12.2.0 and I can't find a way to disable this security group creation.
Back in 12.1.0, I did not need it and was doing fine without it.
But because of this change, I can't find a way to prevent the creation of this security group rule.
Even worse, because I have a lmited access to the cluster, I'm stuck with this error:
module.eks.aws_security_group_rule.cluster_private_access[0]: Creating...

Error: Error authorizing security group rule type ingress: UnauthorizedOperation: You are not authorized to perform this operation. Encoded authorization failure message: TXgpzCB6noNIFS4     [.....]  WVUtmemnuvt2UFhHAU
        status code: 403, request id: 5f92d5   [.....]    566

Can you please revert this breaking change?
Thank you

@anthonydahanne This PR "corrects" an incorrect behavior. The SG creation doesn't have any relation with the managed_aws_auth. The SG you're referring to is created only for private EKS endpoint.
But maybe the correct one should use var.cluster_create_security_group instead of var.manage_aws_auth ? @dpiddockcmp do you confirm ?

thanks @barryib for your comment!
Indeed, it seems more natural to use the variable named var.cluster_create_security_group instead of var.manage_aws_auth to create.... a security group rule!
It's not because users have a private EKS endpoint that they necessarily need the creation of security groups.
I don't think it's uncommon to have users, like me, interacting with an AWS account that has most VPC resources already in place, without any rights to create additional ones.
Shall I go ahead and create an issue and corresponding PR ?

Shall I go ahead and create an issue and corresponding PR ?

Yes please.

there it is @barryib :
Issue: https://github.com/terraform-aws-modules/terraform-aws-eks/issues/980
PR:  https://github.com/terraform-aws-modules/terraform-aws-eks/pull/981
thanks for your suggestion!


Add an @open-pipe option

tmux-open uses the copy-pipe-and-cancel command when opening a file, but the behavior copying the selection and quitting the copy-mode should be optional.
This option allows users to use another variant of pipe commands like pipe-no-clear or pipe-and-cancel instead of copy-pipe-and-cancel.

Actually I decided to write my own implementation of a similar plugin from scratch: https://github.com/knu/tmux-open-anything
It supports not only URLs but also file paths including support for the tilde notation, handles shell meta-characters cleanly, has more flexible configuration, and does not depend on bash to work.


fix wrong order triggering for Flash Playback

This bug occurs when using Flash Playback was causing wrong data for report using ClapprStats plugin.
The issue is the player saying the video is playing when actually is not yet, thus making the report begin to count before it should do.
The startup time is less than the initial buffering, which does not make sense. Because startup time began to count when play was triggered, but not when actually the video really started to play.
This log was printed by using this callback:
clapprStats: {
    runEach: 5000,
    onReport: function(metrics) {
        console.warn(metrics['timers'])
    },
},

Here the startup timer is bigger than buffering, which makes sense, after the first buffering was completed the video really started.
 Object <--- bug fixed
     buffering: 1577.9450000000006 <--- here
     latency: 0
     pause: 0
     session: 5000.075000000001
     startup: 1675.6250000000005    <--- and here
     watch: 3127.865000000007

And here is the wrong version logged.
Object <--- with bug
    buffering: 2042.39 <--- here
    latency: 0
    pause: 0i
    session: 4999.985000000001
    startup:<PHONE_NUMBER>9999987 <--- and here
    watch: 4711.104999999999

Coverage increased (+0.07%) to 71.812% when pulling d07c3eeca5b1eace096739085e2b3750fe96eca5 on kafeltz:master into ca38748a9baee66afd8e8072ef756b5152e4f0f2 on clappr:master.

This line has an issue: https://github.com/clappr/clappr/blob/master/src/playbacks/flash/flash.js#L115
There is a idle state checking with a immediately empty return statement with no handling.
It should set some state and send a trigger as all other statements.
The same issue happen here: https://github.com/clappr/clappr/blob/master/src/playbacks/flash/Player.as
There are a lot of: playbackState without  _triggerEvent('statechanged');
Briefing:
The correct behavior should be the lower level component report its state/behavior to upper level component. As result, some statements are handled where it shouldn't be as the src/playbacks/flash/flash.js

Coverage increased (+0.04%) to 71.781% when pulling abca67e7dd89e8a38cbf57818e12b19d37990ebd on kafeltz:master into e49fd375c2a2c45fc64572d9c1946f21a5966d00 on clappr:master.

Thanks, @kafeltz :)
I saw that there is a small  code style making the build to refuse to pass, https://travis-ci.org/clappr/clappr/builds/185463271 .

Besides the small code style thing, everything is looking great! I'll leave the merge for @towerz , I don't know if we need to change anything else to build a new flash version.


Fix ' Warning: Ignoring unknown fps="" ' Error

Fix the Warning: Ignoring unknown fps="" error that occurs when compiling with the respective latest version of Use this template.

This was fixed in the experimental branch

oh thanks

im closing


Crash when opening OCR window

I'm using Develop gradle flavor, tried both this commit and the most recent one, after starting the app and clicking on "Open image" button, after selecting the image the app crashes. Same happens when I take a photo.

I'm not actively maintaining this repo anymore but maybe I can give you some pointers if you post a stack trace.

@renard314 it seems I figured it out on my own, it happens on release builds, but not debug, seems proguard is removing something it shouldn't.
02-17 13:34:48.718 I/ActivityManager( 1443): START u0 {cmp=com.renard.ocr/.documents.creation.crop.CropImageActivity} from uid 10716
02-17 13:34:48.759 I/e       (23775): onCreate: class com.renard.ocr.documents.creation.crop.CropImageActivity
02-17 13:34:48.763 E/AndroidRuntime(23775): Process: com.renard.ocr, PID: 23775
02-17 13:34:48.763 E/AndroidRuntime(23775): java.lang.RuntimeException: Unable to start activity ComponentInfo{com.renard.ocr/com.renard.ocr.documents.creation.crop.CropImageActivity}: l.a.a.e: Subscriber class com.renard.ocr.documents.creation.crop.CropImageActivity has no public methods called onEvent
02-17 13:34:48.763 E/AndroidRuntime(23775): Caused by: l.a.a.e: Subscriber class com.renard.ocr.documents.creation.crop.CropImageActivity has no public methods called onEvent
02-17 13:34:48.763 E/AndroidRuntime(23775): 	at com.renard.ocr.documents.creation.crop.CropImageActivity.onCreate(Unknown Source:7)
02-17 13:34:48.768 W/ActivityManager( 1443):   Force finishing activity com.renard.ocr/.documents.creation.crop.CropImageActivity
02-17 13:34:48.810 I/ActivityManager( 1443): Process com.renard.ocr (pid 23775) has died: fore TOP
02-17 13:34:48.810 I/WindowManager( 1443): WIN DEATH: Window{4e9a346 u0 com.renard.ocr/com.renard.ocr.documents.viewing.grid.DocumentGridActivity}
02-17 13:34:48.814 I/WindowManager( 1443): WIN DEATH: Window{ebf3248 u0 com.renard.ocr/com.renard.ocr.documents.viewing.grid.DocumentGridActivity EXITING}
02-17 13:34:48.822 W/ActivityManager( 1443): Force removing ActivityRecord{c32ff7d u0 com.renard.ocr/.documents.viewing.grid.DocumentGridActivity t602}: app died, no saved state

you can just add a Keep annotation to CropImageActivity to retain the onEvent method


Face recognition using principal component analysis (pca) in Matlab

Article checklist
ATTENTION: In your PR - add the ISSUE (topic form) # that this PR corresponds to. You can do this by also adding a comment that states "This fixes #(enter your Idea Content Form #)" to link and close your Idea Content (issue) when the PR is merged.
Closes #2550
NOTE: (Please ensure that you have only one open issue + linked pull request at a time. This will ensure that we complete the article in a timely manner from inception to publishing.)
If you have not already please go over our Resources Page for more tips and tricks on how to improve our overall technical writing.
Preliminary Checks - Formatting and Structure

[x] Does your article follow any of the suggested structure formats? - see example formats
[x] Is your article properly formatted in Markdown? - see Github Markdown guide
[x] Have you used the correct folder and file structure? - see Contribution Guidelines
[x] Is your article over 750 words? - Tool: Wordcounter.net
[x] Have you used our preferred heading structure? - H3 (###) and up
[x] Does your article provide enough value and detail about your topic? - Articles should be clear, accurate, and fully explained.
[x] Can your article be understood by beginners? - Assume the audience is smart but has no prior exposure to the common terminology in your article.
[x] Have you included a hero image that is 600x400 pixels and have the copyright to use it? - Tools: Pixlr Image Editor for resizing and Unsplash for Creative Commons images
[x] In your PR - add a comment that states "This fixes #(enter your Idea Content Form #)" to link and close your Idea Content (issue) when the PR is merged.

Grammar & plagiarism checks

[x] Have you spellchecked and grammar checked your article? - Tools: Write&Improve - ProWritingAid -  Grammarly
[x] Please place your article through a 3rd party plagiarism checker? We suggest using Quetext, this tool is free and has a daily limit. We typically accept articles with 10% or less.
[x] Have you checked your article for readability? - Tool: Hemmingway
[x] Have you added sources for quotes and images that aren't yours?

Technical checks

[x] Are your code snippets properly formatted for syntax highlighting - see Syntax guide

Contribution guidelines
For first-time contributors and for more details, see Contributing Guidelines

@linetachieng
Good afternoon and thank you for submitting your article for publishing.
Your article has been entered into our queue and should be reviewed (and published pending any changes) as soon as a peer reviewer is finished with the ones in the queue before it. 🚀
Thank you.

plagiarism check completed - all good
2120420-8a067cae0845813df963-1626819545814.pdf

@kayere I see I only sent four files, that is index.md, image1, image2 and hero image but Incase it's there, it just by a mistake,, thank you

Overall - good work!
Made some minor changes for flow - found the article just a bit difficult to get through.
Please review the changes to see what can be implemented to future articles.
Overall great work 👍
🚀
cc @kayere - the formatting was looking great - made some minor edits for flow - please review as well.


Editorial final version editor closed automatically by autoupdate

Create motion and set to 'accepted'
No create "Editorial final version"
Open editor of editorial
Click to "edit" icon
Keep editor open
=> sometime (e.g. if you get some special? autoupdates) the editor closed automatically - without saving!

Can't reproduce it exactly - but while event I get this error serveral times.

@bastianjoel Any idea? Can you stop all automatically switching from editor to read-only view?

To replicate open motion in another tab, edit motion, add something to the motion text and save.


Package Dependency update

Bug demonstration repository: N/A
The current version of yargs in the project, 15.0.2 contains a known security vulnerability with a package it is dependent on: y18n (^4.0.0): https://snyk.io/vuln/SNYK-JS-Y18N-1021887.
Please update yargs to 16.2.0 to remove the security vulnerability.

^4.0.0 allows install of 4.0.1 where the vulnerability is fixed.  This is how semver ranges work, you need to update your local install (possibly regenerate package-lock.json).


Weighted soft_rank

A weighted soft_rank would be a great addition to have!
It could by weighted by element index, by a weighting function, or by a vector of weights.
My initial attempt was this:
def wsrank(x, w, regularization="l2", regularization_strength=1.):
    """
    >>> import torch
    >>> soft_rank(torch.tensor([[1., 2, 2, 3]]))
    tensor([[1.5000, 2.5000, 2.5000, 3.5000]])
    >>> wsrank(torch.tensor([[1., 2, 2, 3]]), torch.tensor([1., 1, 1, 1]))
    tensor([1.5000, 2.5000, 2.5000, 3.5000])
    >>> wsrank(torch.tensor([[1., 2, 3, 4]]), torch.tensor([1., 1/2, 1/3, 1/4]))
    tensor([1.0000, 1.5000, 1.8333, 2.0833])
    >>> wsrank(torch.tensor([[1., 2, 3, 4]], requires_grad=True), torch.tensor([1., 1/2, 1/3, 1/4])).sum().backward()
    """
    r = soft_rank(x, regularization=regularization, regularization_strength=regularization_strength).view(x.shape[1])
    d = hstack([r[0], diff(r)])
    s = cumsum((d * w) / 1, dim=0)
    return s

However it seems to be too optimistic (near 1.0) when compared to, e.g., weightedtau (around 0.6 in a random test I did here). The original/no-weights soft-spearman works fine, being just a little more optimistic (~5% in some tests) than its hard counterpart, which makes sense to me.

A soft, and possibly weighted, kendall-tau B would also be a great thing to have.
It probably doesn't need sorting or ranking, just a sigmoid-like function to soften the agreement/disagreement/tie counters.

Thanks for the suggestions @davips. Do you have any references for the weighted rank? Its not exactly clear to me the intended output of the function (even in an exact/"hard" setting).
I agree that a soft kendall-tau B would be great to have, although it may be out of scope of this library. I believe this could likely be done, as you said, without any sorting or ranking. I'm thinking you'd be able to do this with just plain PyTorch by constructing an n x n pairwise difference matrix for each variable, multiplying by some regularization value (so differences $\to {-\infty, 0, \infty}$  as regularization term $\to \infty$), then handling the concordant/discordant pairs with activation functions. Definitely feasible with differentiable operations, but I'm not sure how "smooth" it would be for low regularization values. Not sure if I have the time to implement this myself, but I'd be happy to iterate on any ideas you might have.

@teddykoker , your suggestion is pretty similar to what I am trying now. If we find a common ground, I can contribute to the library. I often use python packages as a mean to organize work done and make it available to future work, so when I have some free time it is certainly possible.
The weighting scheme is simple. Higher ranks (i.e. lower values) have higher weights defined by a custom function which could be anything, e.g., cauchy or harmonic progression (not as good as a distribution, but it was recommended by Vigna in weighted tau, more details later).
This is my soft_kendalltau so far:
from torch import sigmoid, sum, triu_indices

def pdiffs(x):
    dis = x.unsqueeze(1) - x
    indices = triu_indices(*dis.shape, offset=1)
    return dis[indices[0], indices[1]]

def surrogate_tau(a, b, reg=10):
    da, db = pdiffs(a), pdiffs(b)
    return sum(sigmoid(reg * da * db))

soft_kendalltau = surrogate_tau(pred, target) / (len(pred) * (len(pred) - 1) / 2)

This is my soft_weigthed_kendalltau so far:
from torch import sigmoid, sum, triu_indices

def pdiffs(x):
    dis = x.unsqueeze(1) - x
    indices = triu_indices(*dis.shape, offset=1)
    return dis[indices[0], indices[1]]

def psums(x):
    dis = x.unsqueeze(1) + x
    indices = torch.triu_indices(*dis.shape, offset=1)
    return dis[indices[0], indices[1]]

def surrogate_wtau(a, b, w, reg=10):
    da, db, sw = pdiffs(a), pdiffs(b), psums(w)
    return sum(sigmoid(reg * da * db) * sw) / sum(sw)

soft_weigthed_kendalltau = surrogate_wtau(pred, target, weights)

# Missing part: the weights are defined according to the rank of each value in `target`.
#               Such a ranking depends on `soft_rank`.
#               I will try with `cau = scipy.stats.cauchy(0).pdf`:
#               w = tensor([cau(r) for r in soft_rank(target)], requires_grad=True)
#               Perhaps this will work fine.

I am not experienced with regularization. I assume that lower reg values make it softer and easier for the gradient to descend, at the expense of having a less reliable approximation to the real (hard) concept.
The paper on weighted tau doesn't seem trivial to follow (at a first glance), and the implementation is so optimized that it looks more complicated than what the problem really is: scipy weighted tau
In a nut shell: you may help me taking a look the soft_kendalltau and soft_weigthed_kendalltau code above to assess if it makes sense, and to decide if it is in a possible scope of the library.

A Weighted soft_rank implementation would be a more general addition to the library, that could be used to replace parts of the code I wrote above.


Why is Graph-RAG more expensive and less effective(namely, slower)?

Why is Graph-RAG more expensive and less effective(namely, slower)? Does it have to search the whole graph for each query?
理论上难道不是建立了知识图谱，去索引的时候，会更高效吗？还是每次查整个knowledge graph还要很久？

其实只有全局查询慢，局部查询挺快的 但需要流式输出才行，响应很快。我已经开发出来了。

Yes, as @KylinMountain notes, global search is slower and more expensive and local search is usually faster and less expensive. I discuss this a bit more in #721, and the global search algorithm is also discussed in detail in the arxiv paper. In short, global search does a lot more summarization, so it requires many more LLM calls

其实只有全局查询慢，局部查询挺快的 但需要流式输出才行，响应很快。我已经开发出来了。

大约能做到多快呢？我使用了一本80k字数的汉字书籍，qwen-plus，每次对概念提问的回复大约都需要1分钟左右才能完成输出。

其实只有全局查询慢，局部查询挺快的 但需要流式输出才行，响应很快。我已经开发出来了。

大约能做到多快呢？我使用了一本80k字数的汉字书籍，qwen-plus，每次对概念提问的回复大约都需要1分钟左右才能完成输出。

local question it will stream output instantly, you can check my video in bilibili.com. https://www.bilibili.com/video/BV113v8e6EZn/?vd_source=e3cbf0ac6779ce544ca98ef21d25c413
global question about 12-15 seconds and then streaming ouput, but this may take long due to your reports size.
你试试吧，本地查询基本秒出


add vectorstore codes, with base classes and chroma.ts

Classes added:

Base Retreiver
Base VectorStore
Chroma Class

Tests:

Base Retreiver
Base VectorStore
Chroma (only with mocked client, and mocked embeddings only)

@Ikochoy  It would be very helpful to add at least one embedding Class. Please let me know if it can be Serializable or Callable because I want to add a node for embeddings. My expectation of the node can convert natual language to vector embeddings.

@Ikochoy Would be nice. Would be nice if you can write some use cases

Do you mean on how we use vectorstore?

@Ikochoy Would be nice. Would be nice if you can write some use cases

Do you mean on how we use vectorstore?

You can refer to Gemini and BaseLLM. So the answer is yes, you need to guide people who either extend the BaseVectorStore or use VectorStore.

Closing this issue. See the modified implementation in #70


fix(backend): log stack trace included

🍰 Pullrequest

Include log stack trace
Issues

fixes https://github.com/gradido/gradido/issues/2357
fixes https://github.com/gradido/gradido/pull/2751

Todo

[X] None

@clauspeterhuebner this is because we call
console.log('ogger.info(`Server is running at http://localhost:${CONFIG.PORT}`)


Rename plug-ins to apps and move them to  bottom menu to make more visible

Plug-ins are our top-1 advantage. We need to move them to bottom menu and make them more visible to users and devs
Also, plug-ins should be renamed to apps, as we need to show to devs that they can build anything with our tech

@mdmohsin7 please take it. don't forget to update @kodjima33 , as he might have some great insights to help you finish the ticket well.


Add documentation for different Cortex-M architectures

Most of the RTIC documentation focuses on ARMv7-M architectures. Here's some initial thoughts on useful information I would have liked to know before starting with RTIC on ARMv6-M.

Closes #667

@perlindgren Moving this down here for continued discussion:

Great to see that the "under the hood" section gets some love! Thanks all for your contributions.
Some general comments:

RTIC implements SRP (or rather SRP with fixed/static priorities).

For the cortex-m architecture we have two implementations thereof

BASEPRI (for those architectures that provides BASEPRI), and for other cases
source masking.

Both approaches achieves the same thing, i.e., raising the current SRP system ceiling once a resource is locked. Notice here, source masking disables ALL tasks with priority equal or less than the current SRP system ceiling (not just the tasks using the particular resource being locked). This way RTIC ensures the singe blocking property of SRP. Although a small detail this has huge implications to the response time guarantees as transitive blocking is a can of worms when it comes to guarantees.
As an example, if just disabling task A in the example, any task N (with a priority larger than B less/equal A) could preempt B (while B holds the shared resource) and thus further block A from starting.

The proposed text is mostly correct. It should be made clear that both approaches implements SRP, where the current system ceiling is implemented either using BASEPRI or source masking.
A technical detail is that (at least for the M0/M0+) the maximum number of interrupt sources/vectors is 32, thus a single (32 bit) mask register is sufficient. This makes the source masking atomic and almost as efficient as the BASEPRI implementation. The difference is that setting a BASEPRI regisiter is done with a core register write (single instruction), while manipulating the NVIC requires the NVIC_ISER/NVIC_ICER address to be held in a register (at the cost of setting up the address and slight increase of "register pressure" for the LLVM backend).

Nice catch. I forgot about the SRP aspect of exception masking as the issue I ran into had to do with resource sharing specifically. I'll revise the example to incorporate masking all interrupts at or below the new priority ceiling.

Super, thanks for your efforts.

By the way, I think an example with a third task (with in the middle priority ) would be great, as it highlights the above problem and allows you to better explain the coupling to SRP.


Update Set-ComplianceSecurityFilter.md

Companion updates to 10075.

Learn Build status updates of commit 017b523:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/Set-ComplianceSecurityFilter.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

Learn Build status updates of commit aa097ea:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/New-Label.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Set-ComplianceSecurityFilter.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

Learn Build status updates of commit aa097ea:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/New-Label.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Set-ComplianceSecurityFilter.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel


Temporary fix Amazon Prime EU (+global?) - removal of api usage

Added a service for Amazon Prime EU. Just using the same way the other services work.
Still needs fix for history sync, but not sure how we can solve this so both the EU and American version works
By the way, is there an option to add names to the "suggestion" list?
Shameless is called "Shameless: the complete series", but can't be found that way. I fixed it at this moment with splitting the title. But that's not best practice :)

I don't like the idea of adding separate versions of a service for different regions. It should be just one for all. There's a way to make it work by taking advantage of the fact that it uses the next method as fallback when a method doesn't work. I can work on it when I have some time.

By the way, is there an option to add names to the "suggestion" list?

Not entirely sure what you mean. You can't correct it by providing the URL to the correct item?

You're totally right. I just made a separate one for the ease of use at this moment. I wasn't sure what you're idea is with the Prime API.
Just wanted to share :)

Not entirely sure what you mean. You can't correct it by providing the URL to the correct item?
No, it just doesn't recognize the item if i remove the split function. So I can't provide a correct url :)

What is the status of this branch? Is it relevant?

Not really.
The code could be used to make a fallback for the non-api version, and the API version should be extended with regional API url's. But I lack the experience with typescript to do this myself

Yeah, I'll work on this soon.


Progress Bar is not loading

When an analysis is running, the progress bar is not working.
Note in the video that the number of annotations increases, but the bar is still empty
https://www.loom.com/share/5700eddc5a48440ebf7af88f113e7b44

Hey @vewe-richard, would you be able to take a look into this issue while we wait in ibex & DeepBio, thanks!

It's the same behavior from latest cytomine and a fresh server. From the code, we can not find any clue that progress bar is updating. We can make the progress bar working but we need change its code, and have to host the algorithm in our repos.
As this is not a big issue, and user can view progress from number of annotations.
After dicussion, let's close it.


Add missing perf/loss baselines for paxml

There are currently still two missing tests for the paxml MGMN test suite:
### Tasks
[ ]  1DP8TP1PP
[ ]  2DP2TP4PP

@ashors1 has an example run showing that 2DP2TP4PP is now working, so we should re-run to get that baseline now (without TE first)
Then we should add TP=8 back when it's fixed

Also, we should probably pytest.mark.skip some of the parametrizations for which we do not have baselines for so that when inspecting the CI output, we can know that the coverage is not complete: https://github.com/NVIDIA/JAX-Toolbox/blob/d5778009df216ac316f7c61044c3e5334204f9cf/.github/workflows/baselines/test_pax_mgmn_metrics.py#L31


User without write permission at the directory level can delete files created by others

Alluxio Version:
Alluxio 2.4.1
Describe the bug
User does not have w permission in the directory, but can delete files created by other users
To Reproduce

Setup Alluxio and Alluxio Fuse, for my case, I use the NFS on my host machine as the root UFS. Also, make sure the alluxio.fuse.user.group.translation.enabled=true and mount option allow_other is added.
Create some files in the Alluxio Fuse mount point. Let's say Alluxio Fuse mount point is /mnt/alluxio, then create a directory with permission 755 or 775 (just make sure other users except yourself do not have w permission in this directory) named testdir; then create a test file named tetfile and write some random data into it.
Start a docker container and use -v option to mount the hostpath /mnt/alluxio into container. For example, docker run -v /mnt/alluxio:/mnt/alluxio -u 12345:12346 -it ubuntu:16.04 /bin/bash, this will mount the hostpath /mnt/alluxio into container path /mnt/alluxio, and -u 12345:12346 is just some random uid and gid which do not exist.
In the container, go to the directory /mnt/alluxio/testdir and try to delete testfile, and it will succeed, which is unexpected. Try to create new file or write to existing file, and these will failed, which is expected.

Expected behavior
A user without w permission on the directory should not be able to delete files created by other users. (According to this document: https://docs.alluxio.io/os/user/stable/en/operation/Security.html)
Urgency
It will prevent us from using Alluxio because it's kind of insecure
Additional context
Add any other context about the problem here.

@LuQQiu do you think it is still valid? otherwise, help me close this please

cc @LuQQiu


Heroku button in README should only deploy stable versions

The issue came up because a sales demo was deployed with known bugs.
Heroku lets you point to a branch / tag in the button ( https://devcenter.heroku.com/articles/heroku-button#using-a-custom-git-branch ), but the issue is that the README would need to be updated with every release.
If that's planned anyways, switching to git flow like done in the commercetools PHP ecosystem would solve the topic automatically as master would always equal "latest stable" (which would have advantages for other reasons, too, e.g. people naively cloning the repo and building projects on unstable versions).

Thanks for the tip, I didn't see the template parameter before. I've created a stable tag and linked the Heroku button to that. It was really good timing since the master version is currently unstable in Heroku.
I'm planning on moving to a development branch, as it is quite important for Sunrise to have a stable master. Until I change the flow, I will change manually the Heroku button tag.


How the Model View Controller Architecture Works

Proposed title of article
How the Model View Controller Architecture Works
Introduction paragraph (2-3 paragraphs):
Websites have evolved from simple pages with a little CSS to far more complicated and powerful applications in recent years.
Programmers use different patterns and software architectures to make the code less difficult, making these applications easier to develop.
What is software architecture?
Architecture is a systematic way in which software is described. It also refers to its relationship with other software, and how they interact with each other.
The most popular software architecture, by far, is the Model-View-Controller, or MVC.
In this article, we will look at the Model-View-Controller software architecture.
Key takeaways:

Software architecture Definition in detail
Model-View-Controller (MVC) Architecture
How MVC Architecture works
Benefits of  Model-View-Controller

References:
N/A
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

@Eztaezta
Good afternoon and thank you for submitting your topic suggestion.
Your topic form has been entered into our queue and should be reviewed (for approval) as soon as a content moderator is finished reviewing the ones in the queue before it. 🚀

Hi @Eztaezta
This sounds like a helpful article, especially for beginners.
Please let's be sure it adds value beyond what is covered in other blog sites.
Also, ensure it does not conflict with any other already published content.
topic approved

@Eztaezta
Just pinging you on this topic form - as I'm making some room in the topic queue.
No rush if you're still working on this one - if you need more time we can always re-open at a later date.

@hectorkambow. Please re-open the topic.
I apologize for the delay.


Keys not being generated

Summary of the issue
I am unable to get the correct response from the Redis Cache,  it's not creating the collection of keys or creating other keys once it already has the keys for any other get request.
Environment
The in-use version: 1.6.1
Operating system: Windows 10
IDE: VS 2017

Example code/Steps to reproduce:

Add a couple of Employees
Copy & Paste any Id from the Get All request to the Get By Id
See the Redis Cache
Try a couple of other Ids and check the results both on Redis and response you get

Opiniated.zip
Output:
I am not getting the correct response.

It won't work with ProjectTo of auto-mapper. the Cacheable method needs to evaluate the expression tree to find dependencies and also its hash and it's not possible with the ProjectTo method.

But I have removed it from the get single request handler. I am using ahtomapper after I have the result and it caches first item but not the other items.
-A

On 01-Aug-2018, at 4:53 PM, Vahid Nasiri<EMAIL_ADDRESS>wrote:
It won't work with ProjectTo of auto-mapper. the Cacheable method needs to evaluate the expression tree to find dependencies and also its hash and it's not possible with the ProjectTo method.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Following is the code for RestSingleGetHandler
protected override async Task<TSingleGetModel> OnHandleAsync(
            RestSingleGetRequest<TEntity, TSingleGetModel> message,
            CancellationToken cancellationToken)
        {
            var ret = await UnitOfWork.GetRepository<TEntity>()
                .GetAll()
                .Cacheable()
                .FirstOrDefaultAsync(e => e.Id == message.Id, cancellationToken);

            if (ret == null) throw new EntityNotFoundException(typeof(TEntity), message.Id);

            return Mapper.Map<TSingleGetModel>(ret);
        }

It works for the first time and create cache in Redis but for next requests it gives weird results.

don't use it if doen't work with your over engineered solution with its 100 dependencies.


Stub socket support malformed

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.40%. Comparing base (68ccdb7) to head (0d3fd95).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #288      +/-   ##
==========================================
+ Coverage   94.07%   94.40%   +0.32%
==========================================
  Files         151      151
  Lines        8985     8984       -1
==========================================
+ Hits         8453     8481      +28
+ Misses        532      503      -29

Files
Coverage Δ

include/async_mqtt/impl/endpoint_recv.hpp
76.89% <100.00%> (+6.03%)
:arrow_up:


OSSM-4753 Bump Versions to 2.2.11

https://issues.redhat.com/browse/OSSM-4753

The maistra/istio repo doesn't seem to have any new changes in branch maistra-2.2 compared to branch releases/2.2.10 (see #1 and #2), so why are we releasing 2.2.11?
#1 https://github.com/maistra/istio/commits/maistra-2.2
#2 https://github.com/maistra/istio/commits/releases/2.2.10

Ah, I forgot about the base image changes.

@mayleighnmyers How come this wasn't merged yet?

@mayleighnmyers How come this wasn't merged yet?

This also doesn't allow me to add the label


Backend: Fix rare race condition in mock authentication

Description :sparkles:
Handle a rare race condition in the mocked rest authentication.
django.db.utils.IntegrityError: duplicate key value violates unique constraint "oidc_oidcprofile_user_id_key"

Issues :bug:
Testing :alembic:
Screenshots :camera_flash:
Additional notes :spiral_notepad:

Codecov Report

Merging #226 (98b8ea0) into develop (8cd4c8a) will decrease coverage by 0.95%.
The diff coverage is 82.60%.

@@             Coverage Diff             @@
##           develop     #226      +/-   ##
===========================================
- Coverage    95.59%   94.64%   -0.96%
===========================================
  Files          134       75      -59
  Lines         4407     2239    -2168
===========================================
- Hits          4213     2119    -2094
+ Misses         194      120      -74

Impacted Files
Coverage Δ

backend/shared/shared/oidc/auth.py
85.71% <82.60%> (-2.45%)
:arrow_down:

backend/benefit/common/tests/conftest.py

backend/benefit/companies/models.py

...applications/api/v1/status_transition_validator.py

backend/benefit/applications/models.py

backend/benefit/common/debug_util.py

backend/benefit/applications/api/v1/serializers.py

.../migrations/0006_field_changes_for_employee_api.py

backend/benefit/users/tests/test_user_model.py

.../applications/migrations/0014_application_batch.py

... and 50 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8cd4c8a...98b8ea0. Read the comment docs.

The factories here are used for the mocked login. So if you put MOCK_FLAG=1 and go to the home page and click "log in" it won't redirect you to suomi.fi but do a local login. It will create a dummy user with dummy company, OIDCProfile and EAuthorizationProfile. This is used mainly by the browser tests but can be used by the developers as well.


Unable to access generated destination composable

after building the project the destination composables in visible in generated folder but when i try to access that file it is not accessible over there

Hi! I really need way more info to be able to help 😅
What exactly are you seeing? What isn’t working? Maybe some screenshots would help. Also what versions of Kotlin, Compose and Compose Destinations are you using?

Closing this for being stale for 3 weeks. I'll be happy to reopen if you have more info for me 🙂


Unexpected token ... on v3.0.0

Describe the bug
I've just updated to the latest version 3.0.0 as soon as I run npm start (electron .) on my Electron app I get this:
...\node_modules\readdirp\index.js:82
    const opts = {...ReaddirpStream.defaultOptions, ...options};
                  ^^^
SyntaxError: Unexpected token ...
    at Object.exports.runInThisContext (vm.js:76:16)
    at Module._compile (module.js:528:28)
    at Object.Module._extensions..js (module.js:565:10)
    at Module.load (module.js:473:32)
    at tryModuleLoad (module.js:432:12)
    at Function.Module._load (module.js:424:3)
    at Module.require (module.js:483:17)
    at require (internal/module.js:20:19)

Versions (please complete the following information):

Chokidar 3.0.0
Node 8.11.4
OS version: Windows 10
Electron Builder: 20.28.2
Electron Rebuild: 1.8.2

Additional context
It works fine with the previous version of Chokidar, what would be the ideal Node version to use with chokidar v3?

Are you sure it's 8.11.4?

Yes

Try this in your node shell:
opts = {...{a: 1}, ...{b: 2}}

returns { a: 1, b: 2 }

Try git clone https://github.com/paulmillr/readdirp, then cd readdirp, then npm install and do node index.js — does it work properly?

It works, well nothing happens after node index.js

As you can see in your main post, there is a syntax error in this code: const opts = {...ReaddirpStream.defaultOptions, ...options};
Syntax error happens because node doesn't support object spread (...{a: 1}). Node.js versions before 8.5 or so didn't support object spreads. So the very plausible thing here is that the node version is <8.5.
This can happen if electron executes different node.js than the one on your system.
You're saying it's 8.11.4 and you've shown 8.11.4 works great with the same code.

You are right, It has to be electron then.

Update your electron-builder and electron-rebuild, that should help

I was able to solve it by upgrading my electron version! Probably my old version was somehow using its own node version, not my system node. Appreciate your time! Thanks!

Great!


Ascending order should be default

When swithing order by column, ascendind order should be selected.

Fixed.


Truncates used artifact id to workaround issue in docker 1.8.X

Truncates artifact id to workaround docker/docker#16218.
It also formats all the code according to go fmt standards.

Closing this as original issue was closed.


Install Jupyter and Run SAP AI API Client SDK on Python

Tutorials: https://developers.sap.com/tutorials/ai-core-aiapi-clientsdk-setup.html
Hi,
somehow the tutorial did not work for me in the first place, so I deleted the service instance on SAP BTP and created a new ai core service and service key. Without any creation of additional resources I still see the app ( aicore-test-app-m6600) from my old instance when calling
ai_api_client.rest_client.get(
path="/admin/applications"
)
ai_api_client.rest_client.get(
path="/admin/applications"
)
{'count': 1,
'resources': [{'application_name': 'aicore-test-app-m6600',
'path': 'workflows',
'repository_url': 'https://github.com/MarcusSchiffer/aicore-test',
'revision': 'HEAD'}]}
Also secrets etc seem to be existing also.
How to get rid of these and start from scratch?
Regards
Marcus

Hi @MarcusSchiffer
Please follow this guide to properly opt for Service Offboarding of SAP AI Core.
LINK: https://help.sap.com/viewer/2d6c5984063c40a59eda62f4a9135bee/LATEST/en-US/08303fe594ce48768265235323963283.html
Your concern that, you are able to retain the component of you SAP AI Core is answered in the page (link above).
Regards,
Deepak.

Thank you for your feedback. The issue seems to be resolved, so I am closing the issue.
If you still have questions, feel free to reopen the issue.


⚠ T:Riza Docs has degraded performance

In a1752b9, T:Riza Docs (https://docs.triza.dev) experienced degraded performance:

HTTP code: 200
Response time: 7829 ms

Resolved: T:Riza Docs performance has improved in 55d5baa.


Explicitly tell sphinx that theme is parallel safe

Setting the parallel_read_safe sphinx metadata key would allow for faster builds using this theme.
It would also avoid the following warning when building documentation using the theme:
WARNING: the pydata_sphinx_theme extension does not declare if it is safe for parallel reading, assuming it isn't - please ask the extension author to check and make it explic
it
WARNING: doing serial read

I have tested the new settings on the documentation on my own project and I cannot see any problems.

this seems pretty reasonable to me - maybe @jorisvandenbossche can confirm that he also agrees it is parallel read/write safe?
Can you fix the linting bug (my guess is that it comes with not black-ifying your change)

Yes, I don't directly see a reason why it wouldn't be parallel safe, so this sounds good!

Thanks for considering this! I amended the fix for the linter to the same commit

thanks very much @rikardn !


Updating community page

Docs Build status updates of commit 0fbf8ac:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

mixed-reality-docs/community.md
:white_check_mark:Succeeded
View

mixed-reality-docs/images/BiographyImages/EricProvencher270x270.jpg
:white_check_mark:Succeeded
View

mixed-reality-docs/images/BiographyImages/JesseMcCulloch270x270.png
:white_check_mark:Succeeded
View

mixed-reality-docs/images/BiographyImages/tamasdeme_270.png
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Handling DateTypeCode for Thesaurus citation - Keyword Originating CV

When validating dataset metadata I see that reference validator requires codelist value to be included both as a element-value and a attribute.
<gmd:CI_DateTypeCode codeList="http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/resources/Codelist/gmxCodelists.xml#CI_DateTypeCode"
 codeListValue="publication">publication</gmd:CI_DateTypeCode>

instead of just referencing the codeListValue
<gmd:CI_DateTypeCode codeList="http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/resources/Codelist/gmxCodelists.xml#CI_DateTypeCode"                                                   codeListValue="publication"/>
But when checking the requirements it seems that it should be enough to only add a attribute
https://github.com/inspire-eu-validation/metadata/blob/2.0/common/keyword-originating-cv.md
This requirement is for TG 2.0. Its not as clear for TG 1.3 (as far as I can find information)
The requirement on having the codelist values also as element-values (either as identical value or Describing text) seems to be different element for element. Eg Hierarchical level do not require the value to be stored as a element value.
Can someone give some clarification on how the coding should be done ?

Clause 2.1 of TG 2.0 says (of TG Requirement C.3)
"Both the value of the codeList attribute (a URL that references a code list definition within a register or a code list catalogue) and the textual content of the ISO 19139 element are purely informative. The codeList value may e.g. point to the code list dictionary in the ISO 19139 repository at http://standards.iso.org/iso/19139/resources/codelist/, and if a text is provided, it may contain the translation of the code list value in the language of the metadata."
Presumably, where the 'textual content' is not required/encouraged, the team took the view that this is a term that does not get translated. As a native English speaker, I'm not well placed to judge whether they made the right call in all cases. But I suspect they had in mind these statements in ISO 19139:2006:
"The Name column of the CodeList tables in ISO 19115, Annex B, contains a value that all software will
use to recognize the unique concept or option defined in a row of a CodeList table. As the result, this
value is not a proper name in any language even English."
"The content of the element is either the name of the codelist value in the given code space or the name corresponding to the codelist value in the default language of the metadata when the codeSpace attribute is not present." (but then ignoring the codeSpace attribute)
I cannot find any requirement for having the element values, only this note & a number of examples. Perhaps the reference validator is being over zealous here?
(TG1.3 discussed use of the textual content in a comment & examples, specific to 2.2.7 Resource language


[Bug] Error after update from version 0.7.6 to 0.7.9

Hello cooler-Team,
I just updated from version 0.7.6 to 0.7.9. I get now the following error:
File<EMAIL_ADDRESS>line 156, in main |  hic_ma.save(path + basename_obs_exp, pSymmetric=False, pApplyCorrection=False) |  File<EMAIL_ADDRESS>line 1495, in save |  self.save_cooler(pMatrixName, pSymmetric=pSymmetric, pApplyCorrection=pApplyCorrection) |  File<EMAIL_ADDRESS>line 1367, in save_cooler |  append=False) |  File<EMAIL_ADDRESS>line 286, in create |  file_path, target, meta.columns, iterable, h5opts, lock) |  File<EMAIL_ADDRESS>line 203, in write_pixels |  for i, chunk in enumerate(iterable): |  File<EMAIL_ADDRESS>line 1358, in _validate_pixels |  raise BadInputError("Found bin1_id greater than bin2_id") |  cooler._binning.BadInputError: Found bin1_id greater than bin2_id
Have you changed anything in the way how cooler.io.create works? I am using it in this way:
cooler.io.create(cool_uri=pFileName,                              bins=bins_data_frame,                              pixels=matrix_data_frame,                              append=False)
With version 0.7.6 this was working well.
Thanks for your help.

I've added stricter input validation. Is matrix_data_frame lex-sorted by bin1_id then bin2_id?

Let me know if it still complains after passing in matrix_data_frame.sort_values(['bin1_id', 'bin2_id']).
Btw, for more general cases, there are now input sanitizers you can use, depending on your input dataframe: sanitize_records if your input is in genomic coordinates and you haven't assigned bin IDs to it, or sanitize_pixels if the bin IDs are already assigned. Sanitizers basically do mate "flipping", bounds checking, sorting, and bin assignment in the former case.
If your input is really large, you can also break it up into dataframe chunks and load them in any order by using create_from_unordered(). This has been used to implement cooler cload pairs and cooler load, which can now accept streaming input. This was all part of trying to make creation more flexible and less error prone. We should eventually consolidate these into a higher level create API that does input sanitization automatically.

Thanks.


Updated URLs for simple-crud-python-sqlalchemy repo

Updating the external links to the https://github.com/cockroachlabs/simple-crud-python-sqlalchemy repo (the original repo has been renamed).
I'll add remote-includes and the relevant docs updates in a forthcoming PR.

This change is


version 0.27 is installing but no app and no program folder

ℹ Computer information

PowerToys version: 0.27
PowerToy Utility:
Running PowerToys as Admin: yes (during installation)
Windows build number: [run "winver"]17763.1577

📝 Provide detailed reproduction steps (if any)

… install it as admin
…
…

✔ Expected result
it should be installed
❌ Actual result
it does something but nothing appears afterwards, no app, no program folder
📷 Screenshots
powertoys-bootstrapper-0.27.0.log
powertoys-bootstrapper-msi-0.27.0.log
i tried it on another device, same windows version and its working but may its interesting for you why it doesnt work, may other have same issue as well

@enricogior ideas here?

@crutkas
I don't see any error in the log:
Windows Installer installed the product. Product Name: PowerToys (Preview). Product Version: 0.27.0. Product Language: 1033. Manufacturer: Microsoft. Installation success or error status: 0.

If the C:\Program Files\PowerToys folder is not there, it has been removed by a third party.

yes its really strange and as i said on another machine everything works fine. during installation on the faulty device i do not see any powertoys folder and there is nothing installed which should remove it immediately. Other installations are working fine. Its not a big thing - its windows maybe it will need a reboot :)

The msi log shows that the installation completed successfully, nothing the PowerToys can do about that beside acknowledging that the installation was successful.

@Saxomania
the problem is still happening?


place the images in the public folder

ALL images needs to be in the public folder.

also needs to change the path for all the trams.


Add documentation on migrating from UserProfileImage to UserAvatar

Some examples of migration guides

Carbon v11 guide
Security migration notes[^1][^2]

[^1]: Truncated list
[^2]: Security migration guide
### Tasks
- [x] Document changes between `UserProfileImage` and `UserAvatar`
- [x] Add migration notes in section of `UserAvatar` mdx

@davidmenendez Can we decouple the documentation on migrating the UserProfileImage to UserAvatar from the deprecation? We are going to wait to actually deprecate UserProfileImage since it’s currently stable.


Translation - question

I wanted to provide translation on polish, but I don't really see "get started" button or something. Can u send me some screenshot, or something to find it?

Make a new Issue. I forgot to bring the Issue Templates to the 1.15 branch.


Controller hook

Problems of data management doesn't end at fetching from database. In real world systems, we often have controller, model and view.
I would like to advance further into controller.
Therefore what there could be, would be some middle ware, that will transform resulting row, or smart row, by some hook, into proper object for handling by the program, therefore controller. Automatic translation of e.g. user returning row, into user class object, with all the capabilities of controller.

Can you clarify what you are suggesting?
I am not sure what concretely you are suggesting or asking for. Thanks.

Middle ware between response and it's return(middleware in before Promise resolving) that would call function for every element of response on the way to Promise resolving. It would allow for hooks, e.g. for making a class that database object is serialization of.

Is this maybe already possible via https://www.prisma.io/docs/concepts/components/prisma-client/client-extensions?

ping @bwarre471

I just want to run one extra Promised step meanwhile maybe maybe after...
e.g. I need to adjust keywords in compresion hook that streams used data to
dense disk with log and original data, then use the data from model. Then I
can load data, from compressed space, if I need later, to pass it to
different function I created by genetically modifyed algo, so I can see if
result is correct.
On Sun, Sep 17, 2023, 10:25 Jan Piotrowski @.***> wrote:

ping @bwarre471 https://github.com/bwarre471
—
Reply to this email directly, view it on GitHub
https://github.com/prisma/prisma/issues/20542#issuecomment-1722423606,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BBROIIZ77EFO3EHWA63XQELX22XZJANCNFSM6AAAAAA3DJNXGM
.
You are receiving this because you were mentioned.Message ID:
@.***>


python37Packages.rubymarshal: 1.0.3 -> 1.2.6

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/python3.7-rubymarshal/versions.
meta.description for python37Packages.rubymarshal is: '"Read and write Ruby-marshalled data"'.
meta.homepage for python37Packages.rubymarshal is: '"https://github.com/d9pouces/RubyMarshal/"

Checks done (click to expand)

built on NixOS
Warning: a test defined in passthru.tests did not pass
/bin/sh passed the binary check.
1 of 1 passed binary check by having a zero exit code.
0 of 1 passed binary check by having the new version present in output.
found 1.2.6 with grep in /nix/store/ylymcjkzzrlwp9m7whh1xk92k2pzwq2s-python3.7-rubymarshal-1.2.6
directory tree listing: https://gist.github.com/5fc30895b7d038aa572e49e6f3e987dc
du listing: https://gist.github.com/d392f4c86a73a1a62cf82355c725ae4e

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)
2 package rebuild(s)
2 x86_64-linux rebuild(s)
2 i686-linux rebuild(s)
2 x86_64-darwin rebuild(s)
2 aarch64-linux rebuild(s)
First fifty rebuilds by attrpath
python27Packages.rubymarshal
python37Packages.rubymarshal

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/ylymcjkzzrlwp9m7whh1xk92k2pzwq2s-python3.7-rubymarshal-1.2.6 \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
Or, build yourself:
nix-build -A python37Packages.rubymarshal https://github.com/r-ryantm/nixpkgs/archive/33656e9734b76b20b63b0341936ebe73177089ea.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/ylymcjkzzrlwp9m7whh1xk92k2pzwq2s-python3.7-rubymarshal-1.2.6
ls -la /nix/store/ylymcjkzzrlwp9m7whh1xk92k2pzwq2s-python3.7-rubymarshal-1.2.6/bin

cc @ryantm for testing.

I tested this update and it looks like it works.


Entity Framework should not throw NullReferenceException

Entity Framework should show an explanatory exception message rather than throwing NRE from its own code.
I'm going to have to split the actual table into two rather than this manual TPH construction because Entity Framework can't use a unique constraint in place of a primary key, but it'll make directly working with the table much more confusing.
System.NullReferenceException
  HResult=0x80004003
  Message=Object reference not set to an instance of an object.
  Source=mscorlib
  StackTrace:
   at System.Object.GetType()
   at System.Data.Entity.Core.EntityKey.ValidateTypeOfKeyValue(MetadataWorkspace workspace, EdmMember keyMember, Object keyValue, Boolean isArgumentException, String argumentName)
   at System.Data.Entity.Core.EntityKey.ValidateEntityKey(MetadataWorkspace workspace, EntitySet entitySet, Boolean isArgumentException, String argumentName)
   at System.Data.Entity.Core.Objects.ObjectStateManager.CheckKeyMatchesEntity(IEntityWrapper wrappedEntity, EntityKey entityKey, EntitySet entitySetForType, Boolean forAttach)
   at System.Data.Entity.Core.Objects.ObjectStateManager.AddEntry(IEntityWrapper wrappedObject, EntityKey passedKey, EntitySet entitySet, String argumentName, Boolean isAdded)
   at System.Data.Entity.Core.Common.Internal.Materialization.Shaper.HandleEntityAppendOnly[TEntity](Func`2 constructEntityDelegate, EntityKey entityKey, EntitySet entitySet)
   at System.Data.Entity.Core.Common.Internal.Materialization.Coordinator`1.ReadNextElement(Shaper shaper)
   at System.Data.Entity.Core.Common.Internal.Materialization.Shaper`1.SimpleEnumerator.MoveNext()
   at System.Data.Entity.QueryableExtensions.Load(IQueryable source)
   at Program.Main() in C:\Users\jmusser\Source\Repos\EF6 repro\EF6 repro\Program.cs:line 40

Steps to reproduce
<Project Sdk="Microsoft.NET.Sdk">

  <PropertyGroup>
    <OutputType>Exe</OutputType>
    <TargetFramework>net472</TargetFramework>
    <RootNamespace></RootNamespace>
  </PropertyGroup>

  <ItemGroup>
    <PackageReference Include="EntityFramework" Version="6.2.0" />
  </ItemGroup>

</Project>

using System.Data.Entity;
using System.Data.SqlClient;

public sealed class Program
{
    public static void Main()
    {
        using (var connection = new SqlConnection("Data Source=(local);Integrated Security=true"))
        {
            connection.Open();

            using (var command = new SqlCommand(@"
                if db_id('EF6_repro') is not null drop database EF6_repro;
                create database EF6_repro;",
                connection))
            {
                command.ExecuteNonQuery();
            }

            using (var command = new SqlCommand(@"
                use EF6_repro;

                create table dbo.TestEntities
                (
                    A int not null,
                    B int,
                    -- Can’t create a primary key across a nullable column
                    constraint UQ_TestEntities unique (A, B)
                );

                insert dbo.TestEntities values (1, null);",
                connection))
            {
                command.ExecuteNonQuery();
            }
        }

        using (var db = new TestDbContext())
        {
            db.TestEntities.Load();
        }
    }
}

public sealed class TestDbContext : DbContext
{
    public TestDbContext() : base("Data Source=(local);Initial Catalog=EF6_repro;Integrated Security=true")
    {
    }

    public DbSet<TestEntity> TestEntities { get; set; }

    protected override void OnModelCreating(DbModelBuilder b)
    {
        // Entity Framework needs us to define a primary key
        b.Entity<TestEntity>().HasKey(k => new { k.A, k.B });
    }
}

public sealed class TestEntity
{
    public int A { get; set; }
    public int? B { get; set; }
}

Further technical details
EF version: 6.2.0
Database Provider: EntityFramework.SqlServer
Operating system: Windows 10
IDE: Visual Studio 2017 15.8 Preview 5

EF Team Triage: This issue is not something that our team is planning to address in the EF6.x code base.  This does not mean that we would not consider a community contribution to address this issue.
Moving forwards, our team will be fixing bugs, implementing small improvements, and accepting community contributions to the EF6.x code base. Larger feature work and innovation will happen in the EF Core code base (https://github.com/aspnet/EntityFramework).
Closing an issue in the EF6.x project does not exclude us addressing it in EF Core. In fact, a number of popular feature requests for EF have already been implemented in EF Core (alternate keys, batching in SaveChanges, etc.).
BTW this is a canned response and may have info or details that do not directly apply to this particular issue. While we'd like to spend the time to uniquely address every incoming issue, we get a lot traffic on the EF projects and that is not practical. To ensure we maximize the time we have to work on fixing bugs, implementing new features, etc. we use canned responses for common triage decisions.


Add EFM32PG22 series

Generated with:
target-gen$ cargo build run --release --locked -- arm --filter GeckoPlatform_EFM32PG22

Resetting, flashing, and debugging on a PG22-DK2503A works at a first glance.

LGTM but please add a changelog entry

Sorry for missing this out. Added.

Thanks!


Theme not fully showing up

Description of the problem or steps to reproduce
Whenever i get a theme the image provided as preview shows a beautiful and complete theme but when i set the theme after downloading (i also restart micro) the theme seems unfinished the background color doesn't change and the theme isn't as shown
(happened with multiple themes)
Specifications
Commit hash: micro version 2.0.11
OS: Windows 10
Terminal: The exe (cmd i guess)

It’s probably because the windows cmd.exe terminal doesn’t support 256 colors. I recommend using a terminal with support for more colors, such as windows terminal or cmder.

Thanks :D