[Bug]: Supported Camera(s) [Floodlight Camera Pro T8423 & SoloCam S40 Solar Spotlight Camera T8124] Not Showing Up In HomeKit #173

What happened?
After installing the plugin, only the spotlights are added to Homekit for the Eufy Floodlight Camera Pro T8423 and the SoloCam S40 Solar Spotlight Camera T8124, but the cameras don't appear!
Additionally, the log is showing the following messages regarding the Doorbell camera T8200. I'm wondering if the Doorbell is affecting the Sunsa blind. Does this suggest I need to add the plugin as a child bridge?
Eufy Security BridgeERROR[Eufy Security Bridge DC5F@Selected RTP Stream Configuration] The write handler for the characteristic 'Selected RTP Stream Configuration' on the accessory 'Doorbell' was slow to respond!
9/26/2022, 4:52:46 PM
Sunsa BridgeSunsaSunsa API Error: Response timeout
Device Type
Floodlight (Supported)
Plugin Version
v2.0.x (Supported)
HomeBridge Version
v1.4.x (Supported)
NodeJS Version
v12 (Supported)
Operating System
Mac OS X 11+ (Supported)
Relevant log output
9/27/2022, 4:01:53 PMEufy Security BridgeERROR[Eufy Security Bridge DC5F@Selected RTP Stream Configuration] The write handler for the characteristic 'Selected RTP Stream Configuration' on the accessory 'Doorbell' was slow to respond!

9/27/2022, 5:41:02 PMSunsa BridgeSunsaSunsa API Error: Response timeout

config
{
    "accessories": [],
    "platforms": [
        {
            "platform": "EufySecurity",
            "username"<EMAIL_ADDRESS>            "password": "****************",
            "enableDetailedLogging": 0,
            "pollingIntervalMinutes": 10,
            "ignoreDevices": [
                "T8410P3121367942,T8410P31213686D8"
            ]
        }
    ]
}

Please confirm receipt and ability to access the attached log file.
log.txt

Done

Looks like I'm taking some steps backward.  Since enabling debug, reloading, and restarting the plugin, now the doorbell camera is no longer working.  I see the following in the log file.
9/28/2022, 3:10:47 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:10:47 PM] [EufySecurity-2.1.0] DEBUG: Snapshot requested: 1280 x 720 Doorbell undefined
9/28/2022, 3:10:47 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:10:47 PM] [EufySecurity-2.1.0] DEBUG: [Doorbell] [Snapshot Resize Process] Process command: /var/lib/hoobs/eufysecuritybridge/node_modules/ffmpeg-for-homebridge/ffmpeg -hide_banner -loglevel level+verbose -i pipe: -frames:v 1 -filter:v scale='min(1280,iw)':'min(720,ih)':force_original_aspect_ratio=decrease,scale='trunc(iw/2)*2:trunc(ih/2)*2' -f image2 pipe:1 -progress tcp://<IP_ADDRESS>:16493
9/28/2022, 3:10:47 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:10:47 PM] [EufySecurity-2.1.0] DEBUG: [Doorbell] [Snapshot Resize Process] process started. Getting the first response took 0.156 seconds.
9/28/2022, 3:10:47 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:10:47 PM] [EufySecurity-2.1.0] DEBUG: snapshot byte lenght: 26304
9/28/2022, 3:11:13 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:12 PM] [EufySecurity-2.1.0] DEBUG: Doorbell VIDEOCONFIG: {"useSeparateProcesses":false}
9/28/2022, 3:11:13 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:12 PM] [EufySecurity-2.1.0] DEBUG: Doorbell RTSP rtspStream:false
9/28/2022, 3:11:13 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:12 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Looks like not compatible with RTSP
9/28/2022, 3:11:13 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:12 PM] [EufySecurity-2.1.0] DEBUG: Doorbell New instance requests livestream. There were 0 instance(s) using the livestream until now.
9/28/2022, 3:11:13 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:12 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Start new station livestream (P2P Session)...
9/28/2022, 3:11:15 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:15 PM] [EufySecurity-2.1.0] INFO:  Doorbell station livestream (P2P session) for Doorbell has started.
9/28/2022, 3:11:15 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:15 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Stream metadata: {"videoCodec":0,"videoFPS":15,"videoHeight":1200,"videoWidth":1600,"audioCodec":0}
9/28/2022, 3:11:15 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:15 PM] [EufySecurity-2.1.0] DEBUG: Doorbell New livestream started. Proxy stream has id: 2.
9/28/2022, 3:11:15 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:15 PM] [EufySecurity-2.1.0] DEBUG: [Doorbell] [Video Process] Stream command: /var/lib/hoobs/eufysecuritybridge/node_modules/ffmpeg-for-homebridge/ffmpeg -hide_banner -loglevel level+verbose -use_wallclock_as_timestamps 1 -i tcp://<IP_ADDRESS>:17630 -an -sn -dn -r 30 -vcodec libx264 -pix_fmt yuv420p -color_range mpeg -preset ultrafast -tune zerolatency -filter:v scale='min(1280,iw)':'min(720,ih)':force_original_aspect_ratio=decrease,scale='trunc(iw/2)*2:trunc(ih/2)*2' -b:v 299k -bufsize 598k -maxrate 299k -payload_type 99 -ssrc 3628417 -f rtp -srtp_out_suite AES_CM_128_HMAC_SHA1_80 -srtp_out_params DxXd9+vYP319fqyrzNOc9nxnbPaz8k8PqA4rT4ha srtp://<IP_ADDRESS>:61533?rtcpport=61533&pkt_size=1128 -progress tcp://<IP_ADDRESS>:13193
9/28/2022, 3:11:15 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:15 PM] [EufySecurity-2.1.0] INFO:  [Doorbell] [Video Process] Starting video stream: 1280x720, 30 fps, 299 kbps
9/28/2022, 3:11:16 PM Eufy Security Bridge [ ERROR ] [Eufy Security Bridge 90DF@Selected RTP Stream Configuration] The write handler for the characteristic 'Selected RTP Stream Configuration' on the accessory 'Doorbell' was slow to respond!
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Device appears to be inactive. Stopping video stream.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Stopping session with id: 5d471350-88c8-486e-8863-7d2021b90728
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell RTSP rtspStream:false
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Looks like not compatible with RTSP
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Audiostream was stopped after transmission of 0 data chunks.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Videostream was stopped after transmission of 0 data chunks.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell One stream instance (id: 2) released livestream. There are now 0 instance(s) using the livestream.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell All proxy instances to the livestream have terminated.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] DEBUG: Doorbell Stopping station livestream.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] INFO:  Doorbell Stopped video stream.
9/28/2022, 3:11:16 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:16 PM] [EufySecurity-2.1.0] INFO:  Doorbell station livestream for Doorbell has stopped.
9/28/2022, 3:11:20 PM Eufy Security Bridge [ DEBUG ] [9/28/2022, 7:11:20 PM] [EufySecurity-2.1.0] INFO:  [Doorbell] [Video Process] FFmpeg exited with code: null and signal: SIGKILL (Forced)
9/28/2022, 3:11:22 PM Eufy Security Bridge [ ERROR ] [Eufy Security Bridge 90DF@Selected RTP Stream Configuration] The write handler for the characteristic 'Selected RTP Stream Configuration' on the accessory 'Doorbell' didn't respond at all!. Please check that you properly call the callback!

Hi @GitHubPanther
So I've analysed your log and you haven't configured the plugin correctly. Since you use hoobs, you can't configure it via the ui that is provided by homebridge-ui and have to set it up in the json file yourself.
Every camera (apart from doorbells) will have to have set a enableCamera option.
In your case you could do something like:
{
    "platform": "EufySecurity",
    "username"<EMAIL_ADDRESS>    "password": "****************",
    "enableDetailedLogging": 0,
    "pollingIntervalMinutes": 10,
    "ignoreDevices": [
        "T8410P3121367942,T8410P31213686D8"
    ],
   "cameras": [
       {
          "serialNumber": "T8423N1021360749",
          "enableCamera": true,
          "unbridge": false,
       },
       {
          "serialNumber": "T8124P20212906C2",
          "enableCamera": true,
          "unbridge": false,
       },

      .... and so on

   ]
}

As for the problem with your Sunsa blind: it might well be, if the plugin can't return a request fast enough and it is not unbridged, other accessories might hang. So either use a child bridge or set the unbridge setting to true.
With the latter option, you'll have to add the cameras manually to HomeKit, since these will be unbridged on their own. You can read more about this here
There are also more per camera settings like talkback and so on. If you need additional help here, let me know.

Theiren,
SOS, I am having difficulties with the json configuration!  This configuration never enables any streaming of the Floodlight cameras although Homekit does allow me to add the motion and switch for the cameras. Why no Floodlight camera images?  Additionally, the Great Room camera appears in both the plugin and Homekit, but the Lanai camera does not even show up in the plugin. So, I am unable to see or add it to Homekit.  If I could ever get this to work, I probably need to use an unbridged or child bridge as you've previously suggested.
{
"platform": "EufySecurity",
"username"<EMAIL_ADDRESS>"password": "**************",
"enableDetailedLogging": 0,
"pollingIntervalMinutes": 10,
"cameras": [
{
"serialNumber": "T8410P3121367942", 	// Lanai Indoor Camera Pan & Tilt
"enableCamera": true,
"unbridge": false
},
{
"serialNumber": "T8410P31213686D8",	// Great Room Indoor Camera Pan & Tilt
"enableCamera": true,
"unbridge": false
},
{
"serialNumber": "T8423N1021360B44",	// Back Floodlight Camera Pro
"enableCamera": true,
"unbridge": false
},
{
"serialNumber": "T8423N1021360749",	// Front Floodlight Camera Pro
"enableCamera": true,
"unbridge": false
}
{
"serialNumber": "T8124P2022130BB0",	// North Spotlight SoloCam S40
"enableCamera": true,
"unbridge": false
}
{
"serialNumber": "T8124P20212906C2",	// South Spotlight SoloCam S40
"enableCamera": true,
"unbridge": false
}
]
}

Thieren,
I should also have mentioned that the Spotlight cameras also don't provide a streamed image in Homekit.

Hey thieren,
Any suggestions at all??
Please and thank you

Hey @GitHubPanther
Sorry for not getting back to you sooner. I'm really busy lately with private stuff.
As for the floodlights: Unfortunately I don't have that much time right now to get into this, but isn't this related to #143 ?
If you read that thread you'll find that there is a fix planned but we'll have to wait until it is updated in eufy-security-client.
Sorry for the inconvenience.

Hey @GitHubPanther
With the latest release the new version of eufy-security-client was added. Any chance this did the trick for you?
Also regarding
but the Lanai camera does not even show up in the plugin
Are you sure you shared this exact device with your guest admin account? Maybe try logging in with the guest account in the eufy app and double check. (Just a hunch)

Thanks for responding!  I had given up before your latest message.  Now after trying again, I still have the same issues. I did confirm that both Indoor Pan & Tilt cameras were shared with (and are visible in) the guest account.  However, the Lanai camera still doesn't appear in the HOOBS bridge as an accessory (only the Great Room Pan & Tilt camera).
Lastly, I still have not been able to have the following code successfully added and accepted using the HOOBS Advance configuration feature.   But to my understanding this is basically just a linux running homebridge. So it should not be THAT different.

Lastly, I still have not been able to have the following code successfully added and accepted using the HOOBS Advance configuration feature. Are you able to provide any HOOBS guidance?

Can you share your complete json config for the platform? So something like
{
    "platform": "EufySecurity",
    "username"<EMAIL_ADDRESS>    "password": "****************",
    "enableDetailedLogging": 0,
    "pollingIntervalMinutes": 10,
    "ignoreDevices": [
        "T8410P3121367942,T8410P31213686D8"
    ],
   "cameras": [
       {
          "serialNumber": "T8423N1021360749",
          "enableCamera": true,
          "unbridge": false,
       },
       {
          "serialNumber": "T8124P20212906C2",
          "enableCamera": true,
          "unbridge": false,
       },

      .... and so on

   ]
}

As for the rest, the best would be to enable the debug logging ("enableDetailedLogging": true) and get the full logs. The important log files would be eufy-log.log and log-log.log from the plugin store path. If you don't know where this is, there is a debug message displayed at the start of the plugin reading plugin data store: [...]
You can upload theses log files to a cloud service (dropbox, google, iCloud) and share a link. I can then have a look.

Could you please remove the comments in the json? The json specification does not support comments and therefore homebridge normally deletes these, but maybe hoobs doesn't do this automatically and errors here?

@GitHubPanther
I have not received any link. There is also no link in your post.

Here is another attempt using a link to the log file: https://www.icloud.com/iclouddrive/0e0oJml0pNCQAXOhhg0L-6T7Q#log

On Nov 23, 2022, at 12:56 AM, thieren @.***> wrote:
@GitHubPanther https://github.com/GitHubPanther
I have not received any link. There is also no link in your post.
—
Reply to this email directly, view it on GitHub https://github.com/homebridge-eufy-security/plugin/issues/177#issuecomment-1324584692, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIO6FRDQ73LTYKQSG3YTYX3WJWWZ3ANCNFSM6AAAAAAQXXTFHQ.
You are receiving this because you were mentioned.

Hallo Rene Thierbach,
du hast vor Kurzem @.*** ausgewählt, um auf ein mit dir geteiltes Objekt zuzugreifen. Bestätige, dass diese E‑Mail-Adresse dir gehört, indem du den unten stehenden Link verwendest und dich mit deiner Apple‑ID anmeldest.
Jetzt bestätigen:
https://icloud.com/v/UOibDBoovHLhFIidQBCEcA
Sobald diese E‑Mail-Adresse bestätigt und deiner Apple‑ID hinzugefügt wurde, können Freunde und Familie sie auch verwenden, um dich über iMessage, FaceTime, Game Center und mehr zu erreichen.
Warum du diese E‑Mail erhalten hast
Bei jeder an deiner Apple‑ID vorgenommenen Änderung benötigt Apple eine Bestätigung.
Wenn du diese Änderung nicht vorgenommen hast oder der Meinung bist, dass eine unbefugte Person auf deinen Account zugegriffen hat, solltest du über die Apple‑ID-Seite unter https://appleid.apple.com so schnell wie möglich dein Passwort ändern.
Mit freundlichen Grüßen
Apple Support

Apple‑ID
https://appleid.apple.com
Support
https://support.apple.com/de-de
Datenschutzrichtlinie
https://www.apple.com/legal/privacy
Copyright (c) 2022 Apple Distribution International, Hollyhill Industrial Estate, Hollyhill, Cork, Ireland. Alle Rechte vorbehalten.

@GitHubPanther
according to your logs the storage Path is:
11/22/2022, 4:13:49 PM Eufy Security Bridge [ DEBUG ] [11/22/2022, 9:13:49 PM] [EufySecurity-2.1.3] DEBUG: plugin data store: /var/lib/hoobs/eufysecuritybridge/eufysecurity
But regarding your Lanai camera I don't see any problem in the logs. It is constructed successfully and should therefore be added to your Home App.
Have you updated to iOS 16 already? If not, is it possible that the camera was added to a room in the Home app, that you haven't checked yet?
Apart from that it could be that the Homebridge/HOOBS Cache is corrupted. In that case you would have to delete that device from HOOBS cache. I can't say how to do it, but the procedure for Homebridge is described here.
You could also try to change the unbridge setting for that camera. Then it will be added as a new device that should not be affected by the cache, but you'll have to add it manually to the Home app afterwards. That's also explained in the link above.

Hello Thierin,
I am running iOS 16.1.1, but the issues I'm having are not just with the Lanai camera not showing up in Homekit. The Doorbell isn't showing up either and no images from the Doorbell or Spotlight cameras (i.e North, South, Front or Back) show up either.  At this point, since you've suggested a cache issue, I'm going to totally remove the Eufy bridge and start all over again.  I'm wondering if there also may be an issue that both the Pan & Tilt (Great Room and Lanai) cameras are actually Homekit compatible and show up in Homekit even before installing the plugin!!  So of the two, why does only the Lanai camera not show up as a plugin accessory??
Lastly, I'm clearly over my head with this stuff.  I don't know if it would be any more helpful if I share the other logs (eufy-log.log, config-ui.log, or log-lib.log) with you.  However, even if true, I'll have to do some digging because I can't seem to find the /var/lib/hoobs/eufysecuritybridge/eufysecurity directory on my MacBook.

The Doorbell isn't showing up either and no images from the Doorbell or Spotlight cameras (i.e North, South, Front or Back) show up either.

I'm not entirely sure if I get what you're trying to say here. What's the difference between 'not showing up' and 'no images show up'? You don't see the entire device in HomeKit, right? Then I don't get what 'no images' means.

I'm going to totally remove the Eufy bridge and start all over again

Yeah, try that. Although I'm not sure if removing the child bridge also removes the entire cache for these devices. You'll have to try I guess.

I'm wondering if there also may be an issue that both the Pan & Tilt (Great Room and Lanai) cameras are actually Homekit compatible and show up in Homekit even before installing the plugin!! So of the two, why does only the Lanai camera not show up as a plugin accessory??

I don't think that this would be a problem. But if you'd like, you can always disable the HomeKit feature in the eufy app. But then again, why don't use these cameras as HomeKit native and ignore them in the plugin?

However, even if true, I'll have to do some digging because I can't seem to find the /var/lib/hoobs/eufysecuritybridge/eufysecurity directory on my MacBook.

This path is not on your MacBook but on the hoobs system. As far as I know you can login on the system (most likely through ssh) and download the logs from there.

Thierin,
Apologies for the confusion and lack of clarity.  My statement is regarding "no [camera] images" for the Doorbell, North, South, Front, or Back spotlight cameras showing up in Homekit at all and neither the Doorbell nor the Lanai even showing up as accessories in the plugin of my HOOBS application!  I've shared a number of Homekit screenshots with you that show how the Homekit accessories are displayed and other HOOBS screenshots showing how the accessories are displayed in HOOBS.  Additionally, perhaps you can help me understand the HOOBS camera icons that show the Home, Away, Night, and Off settings and how those settings should be utilized.
As you suggest, I'll set the Great Room & Lanai Pan & Tilt cameras to be ignored by the plugin since at least I can see their images as accessories in the Homekit application. I wish I could do the same for the Doorbell camera.

Thierin,
Removing the plugin, clearing the HOOBS cache, and ignoring the two Pan & Tilt cameras in the plugin configuration seemed to enable all camera images (Doorbell, Front, Back, North & South spotlights, and the two Pan & Tilts (i.e. Lanai & Great Room) to show up in the Homekit applications now!!  However, all the camera images show up in the HOOBS application except the Great Room Pan & Tilt camera.  I'm not sure why that is, so it will take a bit more troubleshooting.  Do you see anything indicating why that might be the case in the Latest Eufy Security Plugin Log file?

I've shared a number of Homekit screenshots with you that show how the Homekit accessories are displayed and other HOOBS screenshots showing how the accessories are displayed in HOOBS.

Sorry but I didn't get any sharing invitation for screenshots or the latest log either.

Please check again for an email invitation sharing the iCloud folder.

Please check again for an email invitation sharing the iCloud folder.

I didn't receive an invitation. What email did you use?

I simply copied and used<EMAIL_ADDRESS>

Should I use<EMAIL_ADDRESS>

Thierin,
Let me know if this one makes it to you.
Open my shared folder:
Eufy Security Plugin Info
iCloud Drive

I just tried again using a different email address.

Both mentioned mail addresses are GitHub mails, not mine.
Please use<EMAIL_ADDRESS>This should do the trick.

Thierin,
You should receive the invitation shortly.

Did you receive access to the folder?

Did you receive access to the folder?

Yes, just accepted the invitation. But might be a few days until I get to analyse it. Stay tuned!

Thierin,
Understood, no problem. I actually think everything is working as it should now, but any feedback you have will be appreciated.  I must correct my prior statement about the Great Room Pan & Tilt camera not showing up in the HOOBS accessory!  In fact, neither of the Pan & Tilts show up in HOOBS as they shouldn't since I've set them to be ignored due to their ability to run natively in Homekit.
Also, I now better understand the (Home and Away) settings.  I inadvertently had the Great Room set for Away and I triggered its motion sensor and siren.  Nice!  I'll have to do some research to understand how to use the Night setting.

Glad that it's working now for you. From the logs I see that some streaming sessions didn't worked. But without the full logs, I'll be unable to see why that was exactly. Do you still have trouble streaming?

Other than with the Eufy Security app, the only cameras that I can get live streaming views in the Homekit app are the Pan & Tilts.
I am trying to figure it out but I may have to reach out to HOOBS support for guidance on getting the full Eufy Security plugin logs needed to perhaps see why streaming is not happening for the other cameras.

Thierin,
I believe I have added the latest Eufy Security debug-enabled logs to the folder previously shared with you.  Please confirm your ability to access and open the Latest Eufy Security Plugin Log - 28-Nov-22.txt file and let me know what you suggest regarding the lack of streaming for most of the cameras in Homekit.

I think there is the eufy-log.lib file missing.

I'm sorry Thierin,
I'm not sure what else I can do to get a different log file from the HOOBS system.  I've followed the HOOBS Support guidance to obtain the Eufy Security Plugin log file and have even posted another one from yesterday to the shared folder for your review.
The HOOBS Support team has offered the following after going back to them with your note that it seems the eufy-log.log file was missing. This is the same guidance I followed to provide the initial and yesterday's logs to you!
_**Hello,
Please watch the following video to see how to down the log to your computer:
https://www.youtube.com/watch?v=eqPdzC6mUHc
If the plugin developer is needing something else, please have them do a remote session with you to help you get what they are needing, but this is how to get the log.
If you have any questions it's OK to reply to this email, and your ticket will be updated.
Thank You,
HOOBS Support Team**_

This plugin does not write all log messages to the 'standard' homebridge (or in this case hoobs) log, since it would clutter this logs pretty fast. The logging for the eufy-security-client is therefore outsourced in a dedicated log file which is stored in the plugin data path. You will not be able to obtain this log through the hoobs interface.
We have a download button in the normal homebridge config ui, but this is not supported by hoobs. That's one of the reasons we do not support hoobs officially.
As mentioned before you would need to start a terminal session and copy this file manually to your computer.
The ssh connection to the hoobs device is described here for example: https://support.hoobs.org/docs/60e6310b6c19a6a5ca8f5c5f
If you're running linux or macOS you could start a terminal and something like
scp hoobs@hoobs.local:/var/lib/hoobs/eufysecuritybridge/eufysecurity/eufy-log.log ~/
should do the trick. (Maybe you'll need to change 'hoobs.local' to the actual IP of the hoobs device.
If you're on windows there is no built-in ssh client I think. You then could do it with a program called 'PuTTy' which you'll have to download and install.
We also could try the remote session, like suggested by the hoobs support, but if you're unable to use ssh I quite frankly don't know if you'll be able to config your network to allow me to login remotely. Sorry.

Thierin,
I'm trying to follow the guidance provided, but I'm not clear as to whether I should use the Mac's Terminal app for entry of the scp... command or should I be at the HOOBS terminal command language interface.  Please see the HOOBS Terminal screen shot file I just loaded to the shared folder.

Ok, I was being a bit misleading here. You use the macOS terminal that's right. But you don't login via ssh. In fact the scp command initiates a ssh session on its own and will copy the log file to your user directory on your Mac.
If I read your screenshots right, you logged in via ssh and then run the command. This would then copy the log file to the user directory on the hoobs device - and that's no good. :-D
Just open a new terminal and rund the scp command without logging in via ssh. That should do the trick. After that you'll find it in Finder in your user directory.

Thierin,
Check the eufy-log.log file posted at the shared folder! Whew

Thierin,
Check the eufy-log.log file posted at the shared folder! Whew

Yeah it's not uploaded. Good work!
Unfortunately this log only covers Nov. 30th and it seems that you haven't tried to livestream that day at all. At least I've found no trace of a stream start command in the logs.
Please try a streaming session and get the logs another time after that fails. Then I can have a look.
Also there is another file log-lib.log. You can retrieve it just the same way as the other one. Just replace the file name in the command.
Ideally you could delete the logs first and restart the hoobs device/the plugin and then try to stream. This way the logs would have all the necessary information and will not be that big. But that's not mandatory. Skip it if you don't know how.

Thierin,
Please check out the files posted to the shared folder.  I truly appreciate your patience and willingness to work with me to resolve the issues.
I posted one image streamed from the Front Spotlight Camera that was successful.  The other camera streaming attempts ended with "No Response" & "This camera is not responding". Hopefully, the pre and post-streaming attempt log files will provide some insight.

According to your logs it's just two cameras that sometimes have problems streaming, right? The others work so far?
And of those two, sometimes it works, and sometimes it doesn't, right?
What I've found is, that for some reason the stream start command is not send in some cases.
I'd like to give this to the maintainer of eufy-security-client so that he can have a look at it and maybe figure out what the deal is.
Would be ok for you, if I share the logs with him?

To be clearer, none of the camera streams are reliable except for the two Pan & Tilt cameras which are directly Homekit compatible.  I was able to show you a couple of screenshots where the streams were successful, but even the Doorbell and Front Spotlight cameras are inconsistent and more often get the "No Response" screen.
Please share the logs and let me know if I can do or provide more to pinpoint the issue.

Any updates or anything found in the logs?

I've opened an issue in the other repo here.
But there was no response yet.


dd: writes null bytes to device if stdout is redirect to device

@jfinkels I took the liberty to open a new issue with a summary for all the findings you published in https://github.com/uutils/coreutils/issues/3447
gnu/tests/dd/skip-seek-past-dev.sh runs
device=$(df --output=source . | tail -n1)
dev_size=$(blockdev --getsize64 $device)
DEV_OFLOW=$(expr $dev_size + 1)
dd bs=1 seek=$DEV_OFLOW count=0 status=noxfer > "$device"

and expects $?=1 and stderr=dd: 'standard output': cannot seek: Invalid argument.
However, uu_tail does not check if stdout is a redirect to a seekable device and then writes null bytes to $device !
https://github.com/uutils/coreutils/blob/d894847fc69bcc2e9901b72de689a84cf24837dc/src/uu/dd/src/dd.rs#L301-L309
possible fix
Haven't looked into it much but a possible fix could be to get the redirect for /dev/stdout similar to this:
https://github.com/uutils/coreutils/blob/d894847fc69bcc2e9901b72de689a84cf24837dc/src/uu/stat/src/stat.rs#L558-L562
and then apply the seek checks for the new path.

Thank you for creating a new issue :+1:


ActiveRecord compatible association reflection

This pull request provides an ActiveRecord compatible API for reflecting on associations. It allows MongoMapper to be used with association helpers in simple_form and formtastic. It would close #356 and it is an alternative to #362.
I prefer this approach of using an adapter over the approach in #362. I've tested this in simple_form but not formtastic. After @bkeepers decides which, if either, of the pull requests to merge then I'd be happy to test with simple_form. Maybe @jjoe64 and @bjornblomqvist can test with formtastic.
@bkeepers Let me know if you have any feedback. I'd be happy revise things.

How do you feel about just putting this in the existing Rails module? The list of plugins is already a little overwhelming, and this functionality seems to fit with the Rails module.

This looks much better than my patch.
My changes would not work with simple_form. Why it works with formtastic is becouse formtastic has a code path for mongo.
https://github.com/justinfrench/formtastic/blob/master/lib/formtastic/helpers/reflection.rb
So if this is the code that gets merged some one should do a update over at formtastic to remove the mongo code path.

I moved reflect_on_association to the Rails module. Good suggestion; it was silly to create a new module for one method. I left the tests in a separate file. Let me know if there's anything else I can do.


FileNotFoundError is not defined

I am suddenly getthing this error whenever I am not in a directory of a git repo:
Traceback (most recent call last):
  File "/home/rogermortis/dotfiles/bash/promptastic/segments/git.py", line 42, in get_branch_name
    raise FileNotFoundError
NameError: global name 'FileNotFoundError' is not defined

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/rogermortis/promptastic/promptastic.py", line 164, in <module>
    prompt.first_line_right.append(git.Git())
  File "/home/rogermortis/dotfiles/bash/promptastic/segments/__init__.py", line 22, in __init__
    self.init(*args, **kwargs)
  File "/home/rogermortis/dotfiles/bash/promptastic/segments/git.py", line 11, in init
    branch_name = self.get_branch_name()
  File "/home/rogermortis/dotfiles/bash/promptastic/segments/git.py", line 43, in get_branch_name
    except FileNotFoundError:
NameError: global name 'FileNotFoundError' is not defined

I don't think I changed anything...

FileNotFoundError is a Python 3 exception which does not exist in Python 2. So my guess is that you are trying to run Promptastic with Python 2.
Can you make sure that your file promptastic.py starts with #!/usr/bin/env python3?
Btw I am planning to update Promptastic soon and make it compatible with both Python 2 and 3.

I definitely have Python 3 installed and the shebang is there:
https://github.com/jkdf2/dotfiles/blob/master/bash/promptastic/promptastic.py

After reading this: http://stackoverflow.com/questions/15032108/pythons-open-throws-different-errors-for-file-not-found-how-to-handle-b
I changed FileNotFoundError to OSError. All seems to be working now.


Hindi Translation of ui-text #1887

This is an enhancement or feature.

Summary
Add translation for ui-text in Hindi.
Context
Fixes #1887

Thanks for the PR!


Missing assets for example app

When I try to run the example app I get this error:
Exception has occurred.
FlutterError (Unable to load asset: "assets/AppHomeImage.png".
The asset does not exist or has empty data.)

I think you just forgot to check in the assets.

And a big thanks for making this repo public. I am really excited about this project 👍 🤩


Lock-free IOQueue

Second half of https://github.com/aspnet/AspNetCore/pull/4060
The lock contention shows up on my 4 core (8-HT) machine at around 12% of IOQueue.Schedule

and is the highest source (33%) of lock connection (1.8% of run) from the traces @sebastienros sent me (from back in Nov) from the 14 core (28 Hyper-threaded cores) benchmarking machines:

+59% on microbenchmark
           Method |      Mean |         Op/s | Scaled |  Allocated |
----------------- |----------:|-------------:|-------:|-----------:|
 LockBasedIOQueue |  38.74 ns | 25,810,514.1 |   1.00 |    1.76 KB |
  LockFreeIOQueue |  24.38 ns | 41,017,208.3 |   0.63 |    1.74 KB |
 ThreadPoolDirect | 114.95 ns |  8,699,475.6 |   2.97 | 1257.78 KB |

Resolves https://github.com/aspnet/AspNetCore/issues/6153
/cc @davidfowl @pakrym @halter73

cc @stephentoub Can you take a look when you return from vacay?

Yup.

I need to make a parallel scheduling benchmark as the main impact is the lock contention in Schedule

I don't think we should without a benchmark showing an op/sec improvement. I'm OK with it being a microbenchmark as long as it represents a reasonably realistic scenario.

Added benchmark; looks to be 40% faster
     Method |     Mean |    Error |   StdDev |        Op/s | Scaled |
 ---------- |---------:|---------:|---------:|------------:|-------:|
  LockBased | 148.4 ns | 1.552 ns | 1.452 ns | 6,738,778.0 |   1.00 |
   LockFree | 104.9 ns | 1.503 ns | 1.406 ns | 9,536,418.9 |   0.71 |

Improving benchmark

           Method |      Mean |     Error |    StdDev |         Op/s | Scaled |
----------------- |----------:|----------:|----------:|-------------:|-------:|
 LockBasedIOQueue |  38.74 ns | 0.5645 ns | 0.5280 ns | 25,810,514.1 |   1.00 |
  LockFreeIOQueue |  24.38 ns | 0.4856 ns | 0.7416 ns | 41,017,208.3 |   0.63 |
 ThreadPoolDirect | 114.95 ns | 1.3691 ns | 1.2806 ns |  8,699,475.6 |   2.97 |

I don't think we should without a benchmark showing an op/sec improvement. I'm OK with it being a microbenchmark as long as it represents a reasonably realistic scenario.

@halter73 added benchmark, looks to be +59%
           Method |      Mean |         Op/s | Scaled |  Allocated |
----------------- |----------:|-------------:|-------:|-----------:|
 LockBasedIOQueue |  38.74 ns | 25,810,514.1 |   1.00 |    1.76 KB |
  LockFreeIOQueue |  24.38 ns | 41,017,208.3 |   0.63 |    1.74 KB |
 ThreadPoolDirect | 114.95 ns |  8,699,475.6 |   2.97 | 1257.78 KB |

AspNetCore-helix-test failure unreleated (all HttpSys.HttpsTests)
Windows.10.Amd64.ClientRS4.VS2017.Open
Failed   Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_EchoHelloWorld_Success
Error Message:
 System.Net.Http.HttpRequestException : An error occurred while sending the request.
---- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The connection with the server was terminated abnormally'.
Stack Trace:
   at System.Net.Http.HttpClient.FinishSendAsyncBuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.SendRequestAsync(String uri, String upload) in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 155
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_EchoHelloWorld_Success() in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 63
--- End of stack trace from previous location where exception was thrown ---
----- Inner Stack Trace -----
   at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
   at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
Failed   Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_SendHelloWorld_Success
Error Message:
 System.Net.Http.HttpRequestException : An error occurred while sending the request.
---- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The connection with the server was terminated abnormally'.
Stack Trace:
   at System.Net.Http.HttpClient.FinishSendAsyncUnbuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
   at System.Net.Http.HttpClient.GetStringAsyncCore(Task`1 getTask)
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.SendRequestAsync(String uri, X509Certificate cert) in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 145
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_SendHelloWorld_Success() in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 45
--- End of stack trace from previous location where exception was thrown ---
----- Inner Stack Trace -----
   at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
   at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
[xUnit.net 00:00:22.14]     Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_200OK_Success [FAIL]
[xUnit.net 00:00:22.15]     Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_ClientCertNotSent_ClientCertNotPresent [FAIL]
[xUnit.net 00:00:22.16]     Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_SetsITlsHandshakeFeature [FAIL]
Failed   Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_200OK_Success
Error Message:
 System.Net.Http.HttpRequestException : An error occurred while sending the request.
---- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The connection with the server was terminated abnormally'.
Stack Trace:
   at System.Net.Http.HttpClient.FinishSendAsyncUnbuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
   at System.Net.Http.HttpClient.GetStringAsyncCore(Task`1 getTask)
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.SendRequestAsync(String uri, X509Certificate cert) in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 145
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_200OK_Success() in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 30
--- End of stack trace from previous location where exception was thrown ---
----- Inner Stack Trace -----
   at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
   at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
Failed   Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_ClientCertNotSent_ClientCertNotPresent
Error Message:
 System.Net.Http.HttpRequestException : An error occurred while sending the request.
---- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The connection with the server was terminated abnormally'.
Stack Trace:
   at System.Net.Http.HttpClient.FinishSendAsyncUnbuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
   at System.Net.Http.HttpClient.GetStringAsyncCore(Task`1 getTask)
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.SendRequestAsync(String uri, X509Certificate cert) in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 145
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_ClientCertNotSent_ClientCertNotPresent() in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 80
--- End of stack trace from previous location where exception was thrown ---
----- Inner Stack Trace -----
   at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
   at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
Failed   Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_SetsITlsHandshakeFeature
Error Message:
 System.Net.Http.HttpRequestException : An error occurred while sending the request.
---- System.Net.Http.WinHttpException : Error 12030 calling WINHTTP_CALLBACK_STATUS_REQUEST_ERROR, 'The connection with the server was terminated abnormally'.
Stack Trace:
   at System.Net.Http.HttpClient.FinishSendAsyncUnbuffered(Task`1 sendTask, HttpRequestMessage request, CancellationTokenSource cts, Boolean disposeCts)
   at System.Net.Http.HttpClient.GetStringAsyncCore(Task`1 getTask)
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.SendRequestAsync(String uri, X509Certificate cert) in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 145
   at Microsoft.AspNetCore.Server.HttpSys.HttpsTests.Https_SetsITlsHandshakeFeature() in /_/src/Servers/HttpSys/test/FunctionalTests/HttpsTests.cs:line 129
--- End of stack trace from previous location where exception was thrown ---
----- Inner Stack Trace -----
   at System.Threading.Tasks.RendezvousAwaitable`1.GetResult()
   at System.Net.Http.WinHttpHandler.StartRequest(WinHttpRequestState state)
Results File: C:\dotnetbuild\work\3142c8fb-dd66-48ae-9253-8513f3203f07\Work\e9e2bdc0-2c6a-4844-b1a2-781973d03aa1\Exec\TestResults\runner_a0002L0_2019-02-15_17_27_26.trx

Total tests: 354. Passed: 347. Failed: 5. Skipped: 2.

@benaadams https://github.com/aspnet/AspNetCore/pull/7578

/AzurePipelines run AspNetCore-benchmarking-pr

@benaadams ah ah ;)

Worth a go ;)

Changed benchmark to be in terms of the three schedulers and wait for completion of the scheduled actions
              Method |       Mean |          Op/s | Scaled |  Allocated |
-------------------- |-----------:|--------------:|-------:|-----------:|
 ThreadPoolScheduler | 115.480 ns |   8,659,474.5 |   1.00 | 1442.47 KB |
    IOQueueScheduler |  24.712 ns |  40,466,207.6 |   0.21 |    1.98 KB |
     InlineScheduler |   2.408 ns | 415,296,773.2 |   0.02 |    2.01 KB |

Sweet. I ran the new benchmark on my machine with the old lock-based queue just to see:
                    Method |       Mean |     Error |    StdDev |          Op/s | Scaled |   Gen 0 |  Allocated |
-------------------------- |-----------:|----------:|----------:|--------------:|-------:|--------:|-----------:|
       ThreadPoolScheduler | 224.771 ns | 2.4460 ns | 2.2880 ns |   4,448,981.1 |  1.000 | 15.6250 | 2031.78 KB |
          IOQueueScheduler |  20.292 ns | 0.4024 ns | 0.7943 ns |  49,281,174.9 |  0.090 |       - |     2.2 KB |
 IOQueueLockBasedScheduler |  31.582 ns | 0.6119 ns | 0.6284 ns |  31,663,199.1 |  0.141 |       - |    2.24 KB |
           InlineScheduler |   2.029 ns | 0.0120 ns | 0.0106 ns | 492,837,028.4 |  0.009 |       - |    2.18 KB |

Are these numbers measured some locking code change using a single thread?

Are these numbers measured some locking code change using a single thread?

Using Parrallel.For and with Math.Min(Environment.ProcessorCount, 16) schedulers

Are these numbers measured some locking code change using a single thread?

No. That would be silly. https://github.com/aspnet/AspNetCore/pull/6154/files#diff-664eb3f03edb04b620cb5b062c1fad26R80

I benchmarked PlaintextNonPipelined using Ben's build he shared with me.
Linux
| Description |     RPS | CPU (%) | Memory (MB) | Avg. Latency (ms) | Startup (ms) | First Request (ms) | Latency (ms) | Ratio |
| ----------- | ------- | ------- | ----------- | ----------------- | ------------ | ------------------ | ------------ | ----- |
|    baseline | 468,139 |      95 |         181 |                 1 |          242 |                 63 |          0.5 |  1.00 |
|         ben | 477,854 |      97 |         184 |                 1 |          241 |               68.8 |          0.6 |  1.02 |

Windows
| Description |     RPS | CPU (%) | Memory (MB) | Avg. Latency (ms) | Startup (ms) | First Request (ms) | Latency (ms) | Ratio |
| ----------- | ------- | ------- | ----------- | ----------------- | ------------ | ------------------ | ------------ | ----- |
|    baseline | 484,481 |      84 |         164 |               1.7 |          344 |               40.6 |          0.5 |  1.00 |
|         ben | 488,621 |      85 |         159 |               3.5 |          346 |               45.1 |          0.5 |  1.01 |

And Pipelined (Non platform)?

Windows - Plaintext
| Description |       RPS | CPU (%) | Memory (MB) | Avg. Latency (ms) | Startup (ms) | First Request (ms) | Latency (ms) | Ratio |
| ----------- | --------- | ------- | ----------- | ----------------- | ------------ | ------------------ | ------------ | ----- |
|    baseline | 2,194,857 |      93 |         169 |               3.3 |          336 |               41.1 |          0.5 |  1.00 |
|         ben | 2,182,283 |      95 |         171 |               5.2 |          344 |               43.9 |          0.5 |  0.99 |

Note that on Windows both benchmarks show a significant increase in average latency. They are with 5 runs each.

Might be shifting the contention to other locks like the pipeline shared locks e.g. https://github.com/dotnet/corefx/pull/35234 and https://github.com/dotnet/corefx/pull/35267

I am not very concerned with this number, the 50th, 75th and 90th are the same as before, so it's either due to wrk not reporting 99th (very often) and messing up with the average.

Is bigger than this PR but in total 5.7% of the run time looks to be in acquiring and releasing locks

Most of that is the lock in pipelines


[Related Artists] Fix left margin of grid view

Fix #131
cc @katarinabatina, this is what I went with:

@katarinabatina updated!
@sarahscott the magical code added property was space-around on justifyContent rather than flex-start

@mennenia 💯  magic! 👏

Awesome, well done 👍

@mennenia The only problem here is that the last item might be centered instead of aligned left - do you have any screenshots with the last row when there's an item on its own?

See #101

I don't know if this is relevant for us but someone else suggests using a spacer: http://stackoverflow.com/questions/18744164/flex-box-align-last-row-to-grid

@sarahscott Ah, so this is basically what you had previously? If all else fails in a timely manner (we need to release this week) then I'm not at all opposed to adding a dummy element.

Current situation:

rebase reminder 😁

@mennenia magical magic of magicness 👏 👏 👏 👏  kudos!

Cheers @katarinabatina ^_^ this was proper team effort from @sarahscott and @alloy also :D.
@sarahscott - comments addressed, master merged. Good to go on my end :)!

merging!


statistics of Type DiskRegionStatistics is not correct after recovery from eviction GEODE-5224

Thank you for submitting a contribution to Apache Geode.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[ ] Is there a JIRA ticket associated with this PR? Is it referenced in the commit message?

[ ] Has your PR been rebased against the latest commit within the target branch (typically develop)?

[ ] Is your initial contribution a single, squashed commit?

[ ] Does gradlew build run cleanly?

[ ] Have you written or updated unit tests to verify your changes?

[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?

Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and
submit an update to your PR as soon as possible. If you need help, please send an
email to<EMAIL_ADDRESS>

Would it be possible to clean this PR up? It currently has 23 commits and I think 22 of them are not about this stat fix. Instead they are about the ThreadMonitoring work which belongs to another pull request. I will go ahead and review the change in the 23rd commit but please clean this one up. You might want to just start with a new PR based off of develop.


hierarchical_dialog generate text questions

hierarchical_dialog should provide test scripts, decoder to text
for example,
inputs: AAA
outputs: BBB

https://github.com/asyml/texar/blob/master/examples/gpt-2/gpt2_generate_main.py gpt-2 provide

Generated samples can be accessed here (w/ random sample decoding) and here (w/ beam search decoding)

I see it, beam_sample_text, beam_lengths should be generate 's text, this example data is not general, because other data don't have data_batch['refs_text']. why not to compare target's reply with source's generate nlg

I feel this can be achieved with simple tweaks of the current code. The examples are mainly for demonstrating the use of core modules, while adapting to particular datasets/settings should be straightforwardly done.
We welcome any contributions of course :)

@ZhitingHu thks your reply. I have new question about data preprocessing,
https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py#L85
inputs:
dialogue_session:
A B
outputs:
no result...

Hi @qichaotang , could you provide more detail of the operation you made in your new question?
As I understand, you want to check the variables in https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py#L85. In this case you cannot see them because sw1c2r is not called if data_root exists: https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py#L194-L209, you may remove the downloaded data before checking the variables.

@TomNong thanks for your reply,
I have two question.
First question:
in my Scenes, dialogue session data is:
user_query_1 bot_reply_1
user_query_2 bot_reply_2
...
In my opinion, I only need to predict bot_reply by using user's query-reply context.
So I need construct model's input
user_query_1 -> bot_reply_1
user_query_1|||bot_reply_1|||user_query_2 -> bot_reply_2
So I modify this preprocess's scripts

Are you think this modify ok ?

Second question:
https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py#L220
https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py#L225
{}-source-spk-{}.txt and {}-target-spk.txt 's effect is distinguish the dialogists. In your example, The dialogists A and B is equal. this will be two states:
One: A's Context -> B_reply
Two: B's Context -> A_reply
So you need the {}-source-spk-{}.txt and {}-target-spk.txt.
In my opinion, In your example, The dialogists A and B is not equal. this will be one states:
One: A's Context -> B_reply
So I can del the {}-source-spk-{}.txt and {}-target-spk.txt ?  And I need modify this model file to del this two file's tensor calc

@qichaotang thanks for the information. For the first question, I'm not sure because we can't verify your dataset. I would suggest you to test your assumption on current example data, then it would probably work for your own data.
For the second question, I don't think {}-source-spk-{}.txt and {}-target-spk.txt should be deleted, because we can't verify your assumption now. But you can make your test by modifying the example to prove it, and feel free to let us know.

@TomNong Two question may be related with my Scenes.
But third question:
https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/hred.py#L58

for one batch, data_batch['source_length']'s utterance_cnt < config_data.max_utterance_cnt,
https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/hred.py#L62

this will be shape's diff, this is bug！！！

@qichaotang for the new question I checked with the test results, https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/hred.py#L62 will not cause error because data_batch['source_length']'s size is compatible with spk_src. If you encounter error at that point, could you screen the error message and the operation details?

@TomNong because your test data 's reason. while I use other test data, this will be an question

https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/config_data.py#L14
https://github.com/asyml/texar/blob/master/texar/tf/data/data_decoders.py#L346
max_utterance_cnt = 9
data demo
for a batch
AA||BB||CC -> DD
AA -> BB
for this batch data, utterance_cnt_shape = 3
data_batch['source_length']'s utterance_cnt  == 3
config_data.max_utterance_cnt == 9
this tf.concat will be error, because shape's diff

@qichaotang  thanks for the information, the max_utterance_cnt = 9 you mentioned is compatible with the dataset we use, you can refer to https://github.com/asyml/texar/blob/master/examples/hierarchical_dialog/sw_loader.py to see how we generate the utterance.
As I understand, you are using a dataset with different utterance size. For our example, you are welcomed to customize the config_data.py to fit your data, since our examples is aimed to demo the usage for Texar with certain data.

closed due to inactivity


after reading entire queue, "loading more results" hangs

Steps to reproduce:

load user script
hit -> arrow button until queue has no items in it

What happens?

user script hangs on this window infinitely

What should happen instead?

user script should add additional items to queue

Misc

tried opening a new window/instance of the user script and it populated some items. so the problem isn't a lack of items available

Fixed. Will be added in the next update (hopefully in the next few days).


Enhancement of text to voice

Choice of different voices
Rate and volume control
Better error handling
Could you please assign me this task so that I can contribute with addition of labels like gssoc-ext, hacktoberfest-accepted and level and work on in by the earliest

Do I add a new file or edit the new one

Add a new file
On Sat, 5 Oct, 2024, 4:02 pm Vuppu Chinmay, @.***>
wrote:

Do I add a new file or edit the one
—
Reply to this email directly, view it on GitHub
https://github.com/suryanshsk/Python-Voice-Assistant-Suryanshsk/issues/28#issuecomment-2395011704,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVBBZFJZYZ24L4LHH7YXPQTZZ652RAVCNFSM6AAAAABPNHESSOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJVGAYTCNZQGQ
.
You are receiving this because you were assigned.Message ID:
@.***
com>

Done with both could you please check it

Yes, it looks good. I already merged that in my project
On Sat, 5 Oct, 2024, 4:09 pm Vuppu Chinmay, @.***>
wrote:

Done with both could you please check it
—
Reply to this email directly, view it on GitHub
https://github.com/suryanshsk/Python-Voice-Assistant-Suryanshsk/issues/28#issuecomment-2395013631,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVBBZFMQB7T2LB3PG76XV43ZZ66V5AVCNFSM6AAAAABPNHESSOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJVGAYTGNRTGE
.
You are receiving this because you were assigned.Message ID:
@.***
com>

Thanks for the support

Glad to hear it!
On Sat, 5 Oct, 2024, 4:12 pm Vuppu Chinmay, @.***>
wrote:

Thanks for the support
—
Reply to this email directly, view it on GitHub
https://github.com/suryanshsk/Python-Voice-Assistant-Suryanshsk/issues/28#issuecomment-2395014385,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AVBBZFIRPWAYEE3QJSRLJJ3ZZ67AVAVCNFSM6AAAAABPNHESSOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGOJVGAYTIMZYGU
.
You are receiving this because you were assigned.Message ID:
@.***
com>


[FR] Self-provided --user-data-dir

Currently you always need the temp dir in --allow-write because the following is not gated so you'll always hit a permission request:
https://github.com/lino-levan/astral/blob/7e91588e342561a2e5a3b515e7b3cedf6683d02b/src/browser.ts#L253
And the arg --user-data-dir is always set by astral:
https://github.com/lino-levan/astral/blob/7e91588e342561a2e5a3b515e7b3cedf6683d02b/src/browser.ts#L261
But it'd be nice if the above lines are ignored if user specify the arg theymselves in args:
https://github.com/lino-levan/astral/blob/7e91588e342561a2e5a3b515e7b3cedf6683d02b/src/browser.ts#L232
Basically doing something like:
if (!args.find(arg => arg.startsWith("--user-data-dir=")) {
  const tempDir = Deno.makeTempDirSync();
  args.push(`--user-data-dir=${tempDir}`)
}

I know the workaround from #56, but setting TMPDIR is not always convenient because:

it sets the value globally for all the program and its dependencies, not only astral
it conflicts with users wanting to manually set this parameter

additionally it prevents the pattern where a single directory is used to store all of app's cache/data, etc.
users cannot handle the lifecycle of their app completly as there's no way to retrieve the generated user-data-dir so it cannot be cleaned when exiting (although leaving stuff in temp dir is usually not a big deal, but it's still a small inconvenience)

not sure as I haven't personally tested yet, but firefox may not have this arg so it'd mean that an extra permission is requested although it may be unneeded

Basically doing something like:
if (!args.find(arg => arg.startsWith("--user-data-dir=")) {
const tempDir = Deno.makeTempDirSync();
args.push(--user-data-dir=${tempDir})
}

I would support this. If you want to submit a PR this makes sense to me.

I haven't personally tested yet, but firefox may not have this arg

Firefox compatibility is currently really broken.


README: Simplify GStreamer stream playback command

Nowadays gst-play-1.0 hides away the complexity of the pipeline. We only need to pass a valid URI to it.

Effectively this approach works with streams that contain video and audio, only video and only audio, while the actual one works only with streams that contain video and audio. Approved, thanks


Admin nav items

Add nav items for /admin and /export.
(Not sure why the merge commits got in here... Needs to be a squash commit if this is merged)

Coverage decreased (-0.2%) to 32.834% when pulling fff9340de9cd4cd5f3347fbe481c1c40d30b0020 on admin-navitems into 45bcd1b867d41eedac08233e31a7c3a99c36c9ef on master.


Feature request: For automation, add more defaults (and ideally, an all option for some) for generate sources

Is your feature request related to a problem? Please describe.
I'm trying to run generate sources automatically via cron on a virtual machine. But, from what I can tell, there isn't a way to suppress some of the prompts (choose relations, flatten JSON, etc.).
It also seems that I have to hardcode the schemas I'd like, using config.yml.
Describe the solution you'd like
I'd like a simple way to be able to generate sources for all relations in a schema, and for all schemas in a database.
I'd like to be able to have the following in my config

"all" for schemas
"all" for relations"
a default for flattening JSON
an default update strategy for existing staging models

Describe alternatives you've considered
Not being able to automate it. Closest I've come is by hard coding my schemas in config.yml and then still needing to execute manually so I can interact with the prompts.

@jaredx435k2d0 we've just added a new --no-prompt flag to dbt-coves generate commands (sources, properties and metadata). Check it out in our newest a28 version
This allows you to automate the creation of resources, alongside the usage of already existent flags/args.
For example, the following would generate all sources in all schemas on your DB:
dbt-coves generate sources --schemas "*" --no-prompt
It will auto-flatten and generate all the resulting resources with the filter(s) you use.
A more complex filtering:
dbt-coves generate sources --schemas "my_schema" --select-relations "prefix_*" --update-strategy recreate --no-prompt

This is awesome! I'm planning to use some dbt-coves commands in a regular automation, so this will be perfect.
Just to be clear, there is currently no way to choose to have it NOT flatten JSON, is that correct?

Can you please explain the new recreate option? Does that delete and recreate, as in I'd lose any existing documentation? Or would it retain that, but just "recreate" in the sense that it refreshes / would now not include any items deleted since the last execution?


Windows 11 10.0.22621.1928 not supported

termsrv.zip
Plz help me!

Plz help me too!

The offsets was added
https://github.com/sebaxakerhtc/rdpwrap.ini/commit/79144d4c2e5b66812f3a8dac1637ba0ce2da6246

Reopened. Not included in official INI (by Stas'M)

any .ini files available?

any .ini files available?

All ini files available

any .ini files available?

All ini files available

Freshman here bro,
where can I get complete .ini file for 10.0.22621.1928
really appreciate it

any .ini files available?

All ini files available

Freshman here bro, where can I get complete .ini file for 10.0.22621.1928 really appreciate it

Just open your eyes and look up for comments
https://github.com/stascorp/rdpwrap/issues/2258#issuecomment-1610917405

@binarymaster mentioned that this is the one ini file i need. i installed it but it is still under not supported. Any help? I was the one opening issue  #2292

@TheMazoo

not supported

You need replace the C:\Program Files\RDP Wrapper\rdpwrap.ini file.

CMD as Administrator --> net stop termService or reboot to safe mode
Replace file from https://raw.githubusercontent.com/sebaxakerhtc/rdpwrap.ini/master/rdpwrap.ini
Check, then LAST line in your ini IS BLANK!!!
Reboot
Enjoy!

@TheMazoo

not supported

You need replace the C:\Program Files\RDP Wrapper\rdpwrap.ini file.

CMD as Administrator --> net stop termService or reboot to safe mode
Replace file from https://raw.githubusercontent.com/sebaxakerhtc/rdpwrap.ini/master/rdpwrap.ini
Check, then LAST line in your ini IS BLANK!!!
Reboot
Enjoy!

Thanks for your guide, but this still isnt working (inside a Win 11 Pro 22H2 Build 22621.1992 With latest RDPWrapper, i am still getting the Message "other user is logged in, should he be disconncted)

@funky123

i am still getting the Message "other user is logged in, should he be disconncted)

Try restart service or reboot
OR
Try:

Download RDP Wrapper 1.6.2 and extract this to any directory.
Place rdpwrap.ini in the same directory.
Open CMD as administrator
Execute this commands

cd C:\path\to\directory\
rdpwinst -u -k
rdpwinst -i

Enjoy!

Original message: https://t.me/rdpwrap/49131

ver. <IP_ADDRESS>
ver. 10.0.22621.3527
[not supported]

ver. 10.0.22621.3527

This version is off-topic here.


SDEs with non-diagonal noise cause EnsembleGPU/CPUArray to throw an error or return an incorrect solution

Describe the bug 🐞

If EnsembleCPUArray or EnsembleGPUArray is provided with an SDE with non-diagonal noise and an in place noise function, then it crashes because the du array provided to the noise function does not match the dimensions of the noise_rate_prototype.
This error happens regardless of the choice of SDE algorithm.
If an out of place function is used for the noise process instead of an in place function, no error is thrown, but the noise process is not correctly applied. Specifically, the matrix returned for du has its first column interpreted as a diagonal noise vector.
If you don't specify any SDE algorithm, it will return the correct solution, but this because of a different bug which causes the solve function to ignore the EnsembleCPU/GPUArray() option when a SDE algorithm is not specified.

Expected behavior
The expected behavior is for the solver to finish without throwing an error and return an accurate solution.

     Those with ⌃ may be upgradable, but those with ⌅ are restricted by compatibility constraints from upgrading. To see why use `status --outdated -m`

Output of versioninfo()

julia> versioninfo()
Julia Version 1.10.2
Commit bd47eca2c8 (2024-03-01 10:14 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 8 × Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, skylake)
Threads: 1 default, 0 interactive, 1 GC (on 8 virtual cores)

Additional context
This error is caused by the assumption in the file src > ensemblegpuarray > kernels.jl that the time series for du can be written as a matrix (with one index for ODE coordinate and the next index for time).  When a problem has non-diagonal noise you need two coordinate indexes and a time index, so the du time series needs to be a three index tensor or include some flatten and resize adaptor when evaluating the noise function.

I made an attempt to add support for non-diagonal noise in a fork. Ultimately, I concluded that it would require refactoring other other packages, namely StochasticDiffEq.jl, which seems like too large a change for a pull request. https://github.com/henhen724/DiffEqGPU.jl/tree/non_diagonal_array_ensembles
Instead, I'll leave what I learned here.
The problem with implementing non-diagonal noise in ArrayEnsembles is that the solve functions expects to be able to matrix multiply the noise term by a vector of Wiener increments and add that to the solution, but in ArrayEnsembles the solution is a matrix and not a vector. Here is a link to an arbitrarily chosen SDE algorithm: https://github.com/SciML/StochasticDiffEq.jl/blob/0c03d8b6378f133a1f819ebc2be8f0bee5d69f06/src/perform_step/sra.jl#L144
integrator.g(g1,uprev,p,t+c11*dt)
integrator.f(k1,uprev,p,t)

if is_diagonal_noise(integrator.sol.prob)
    @.. H01 = uprev + dt*a21*k1 + chi2*b21*g1
else
    mul!(E₁,g1,chi2)
    @.. H01 = uprev + dt*a21*k1 + b21*E₁
end

integrator.g is the noise function. It's output is stored in g1 which is then matrix multiplied by chi2 which is the vector of Wiener increaments. This means the expression b21*E is a vector. This of course makes sense for single copies of the problem.
The problem is that H01 and k1 which would both be vectors for an individual problem are nxm matrices in the ArrayEnsembles where n is the dimension of the underlying problem and m is the number of trajectories.

There is then a second larger problem which is that StochasticDiffEq.jl assumes that noise_rate_prototype is a matrix and sets the dimensions of the g1 matrix handed to integrator.g according to the dimensions of noise_rate_prototype. If noise_rate_prototype is a 3 tensor instead of matrix, then the solve function in StochasticDiffEq.jl will throw an error when trying to find the dimension for the Wiener process: https://github.com/SciML/StochasticDiffEq.jl/blob/0c03d8b6378f133a1f819ebc2be8f0bee5d69f06/src/solve.jl#L302

rand_prototype = false .* noise_rate_prototype[1,:]

BoundsError: attempt to access 4×2×10 Array{Float32, 3} at index [1, 1:2]
As far as I can see, the solution would be to refactor StochasticDiffEq.jl to allow non-matrix "noise_rate_prototype"s, and then add a definition of mul! for 3 tensor to the KernelAbstractions.jl library, as well as the changes in my fork to DiffEqGPU.jl.


use --all-features

will fix #1525

WIP:

test runs now produce vega graphs -- If we don't want these as a part of every run, maybe use skip instead of feature gating?
Still need to handle tasks.json
Makevars* and rust_build.sh parameterize --features ... Maybe we still want the flexibility there?

I'm going to say this much is ready for review. There are more references to --features but I'll address that in a separate PR, to keep this much from getting muddled.
R/opendp/src/Makevars.in:
  30: 		@BEFORE_CARGO_BUILD@ cargo build --manifest-path rust/Cargo.toml --color always --release --jobs 2 --offline --features @RUST_FEATURES@; \

R/opendp/src/Makevars.win.in:
  34: 		@BEFORE_CARGO_BUILD@ cargo build --manifest-path rust/Cargo.toml --target=$(TARGET) --color always --release --jobs 2 --offline --features @RUST_FEATURES@; \

tools/rust_build.sh:
  86:   CMD+=(--manifest-path=rust/Cargo.toml --features="$FEATURES")

CI failure in r-tests: Also saw the same problem on main and filed an issue:

#1531

The last commit here only touched tasks.json, so the r-tests problem is non-deterministic, even though it seems to be related to the build. Exciting.


Export all content in one HTML Document

One point on the list of future features are other formats such as mobi, epub or PDF. For this, in my opinion, a single HTML page is a good basis. Maybe you like my beginning.

Hi Astrid, great, thank you for that contribution! I will check it asap next week when I am back.

Hi Astrid, I looked into it and it looks great, thank you! The use case is probably not ready for production yet, so I added your changes to another branch. As you said I want to use it as a starting point and maybe create individual plugins for that. So I will use the separate branch to work on it and when it is ready I will merge it to master :)

I'm glad you like my start. Do I understand you correctly: You want to convert all the code for the export as a plugin?

Hi Astrid, I want to investigate the best way, maybe only parts of it as a plugin and models in core, but I am not sure yet. The initial idea of Typemill was to provide the whole website in different formats (html, epub and more) either in frontend for all users or only for registered users, so authors can try to monetize their work (e.g. with export formats and pro content for registered users). But it is a long way to go and I want to take some time to think about it. Another idea was to optionally statify the whole website, so the html-export might also be a starting point for that. But I did not had the time to investigate details yet...


Send s.lobby.updated to all clients whenever any lobby updates

Server should send small updates about all battles when their status changes, so I can make the battle list update instantly instead of polling c.lobby.query on an interval. The updates would be best kept as small as possible as a lot of these will end up being sent out quite frequently.
Ideally, this would be subscribable, so I can subscribe to it for clients actively looking at the list of battles and then unsubscribe once they stop looking at it.

Does the c.lobby.watch command fulfill your requirements in this regard?


Allow blacklisting certain unicode from replace_unified

Usage:
emoji.unified_blacklist = {
'™': true,
'©': true,
'®': true
};

We're not using this anymore. Instead, we're just requiring the FE0F variation selector on the emoji that specify it.

we do this at slack on iOS only and I should probably update emoji.replace_unified() to (optionally) do the same thing


WebUI: Remove row and column labels from schema tables

The Cluster Admin section contains information about row and column labels. We should remove those since they are deprecated.

Let's also revisit the frame options; it seems that some of the newer frame options are not represented.

Created a separate ticket to address other frame options: https://github.com/pilosa/pilosa/issues/905


Bot disconnects from the Teams call when amount of users with enabled video more than 8

The issue
We are using Microsoft Calling Bot Framework based on the sample AudioVideoPlaybackBot. Bot handles the MS Teams call, retrieves audio and video streams and restream that data to external application for real-time processing. Everything was Ok while the moment we had tested our app with few users. When the amount of simultaneously connected to the same Teams call users with enabled video camera more than 8, then bot disconnects from the call. It seems that the problem related to video sockets because without video everything is ok.
We tried to subscribe only to current participant video when OnDominantSpeakerChanged notification is got and unsubscribe from previous speaker video and therefore using only 1 video socket but that didn’t help.
Code Snippet
private void OnDominantSpeakerChanged(object sender, DominantSpeakerChangedEventArgs e)
        {
            this.GraphLogger.Error($"[{this.Call.Id}:OnDominantSpeakerChanged(DominantSpeaker={e.CurrentDominantSpeaker}, LastSpeaker = {e.DominantSpeakerHistory.LastOrDefault()})]");

            if (e.CurrentDominantSpeaker != DominantSpeakerNone)
            {
                IParticipant participant = this.GetParticipantFromMSI(e.CurrentDominantSpeaker);
                var participantDetails = participant?.Resource?.Info?.Identity?.User;

                var oldParticipantMsi = e.DominantSpeakerHistory.LastOrDefault();
                IParticipant oldParticipant = this.GetParticipantFromMSI(oldParticipantMsi);

                GraphLogger.Log(TraceLevel.Info, $"OnDominantSpeakerChanged.  participant?.Resource?.Info?.Identity?.User?.Id is {participantDetails?.Id}. oldParticipantUserId is {oldParticipant?.Resource?.Info?.Identity?.User?.Id}");
                if (participantDetails != null && participantDetails?.Id != _currentUserId)
                {
                    _currentUserId = participant?.Resource?.Info?.Identity?.User?.Id;
                    // we want to force the video subscription on dominant speaker events
                    this.SubscribeToParticipantVideo(participant, forceSubscribe: true);
                    GraphLogger.Log(TraceLevel.Info, $"OnDominantSpeakerChanged. UnsubscribeFromParticipantVideo. oldParticipantMsi = {oldParticipantMsi}, e.CurrentDominantSpeaker = {e.CurrentDominantSpeaker}");

                    if (oldParticipant != default && oldParticipantMsi != e.CurrentDominantSpeaker)
                    {
                        GraphLogger.Log(TraceLevel.Info,$"OnDominantSpeakerChanged. UnsubscribeFromParticipantVideo. ");
                        this.UnsubscribeFromParticipantVideo(oldParticipant);
                    }
                }
            }
        }

Expected behavior
We are expecting that the bot will not disconnect from the call with more than 8 users with enabled video. Also, we need only one video stream from the current dominant speaker.
Graph SDK:

Microsoft.Graph.Communications.Calls.Media package version <IP_ADDRESS>0
Microsoft.Skype.Bots.Media package version <IP_ADDRESS>-alpha

Call ID
CallId: a61f0500-c11f-498c-af6e-f0e39d5511ae. UTC time when bot disconnected: 2020-10-14T15:48:44.9497385Z
Logs
Logs didn't show any errors or exceptions before bot disconnected.
Does the constraint of the 8 video streams relate to the Bot Framework? Or we did some mistakes in the code? It’s very important for us because that problem is stopping us from going to production. Please let me know if it needs more details.

We solved the issue. We need only 1 video socket as in HueBot sample. We tested under 80 users in meeting and it works.


Update exceptions doc from Connection to Connect

ConnectionException does not exist.

LGTM, thanks

Hello @yuuri111, i create a fork of this repo and release this marge request into the new version(6.4.0).
Namespace compatibility is 100%, and you can use my changes if you patch composer.json in your projects

replace "guzzlehttp/guzzle": "^6.3" to "someblackmagic/guzzle": "^6.4"
add "guzzlehttp/guzzle": "6.3.*" into replace block

Fork link: https://github.com/SomeBlackMagic/guzzle/


Implement improvements identified by static linting

Use "_" instead of names for unused function parameters
Use "_" instead of names for unused variables
Remove unused functions and variables
Replace fmt.Errorf with errors.New when error message contains no formatting

Should the static checker be part of the pull_request github action?

Should the static checker be part of the pull_request github action?

The static check is performed by VSCode in the background as one is coding. This static checker exists for go, it seems like a good idea to trigger this in a github action. I have added it to the agenda for discussion at the next  SIG-3 meeting.

/approve
/lgtm

/retest


ARROW-6685: [C++] Ignore trailing slashes in S3FS

@kszucs This should fix the issue, though I haven't tested on Python.

Do multiple trailing slashes ever happen? I note that RemoveTrailingSlash only removes a single slash

They certainly don't happen frequently. But they may happen if the user concatenates path fragments by adding slashes between them even though they are already slash-terminated.

Ok, I've fixed RemoveTrailingSlash.

Travis CI build https://travis-ci.org/pitrou/arrow/builds/591604282

Codecov Report

Merging #5546 into master will increase coverage by 0.6%.
The diff coverage is 100%.

@@            Coverage Diff            @@
##           master    #5546     +/-   ##
=========================================
+ Coverage    88.5%    89.1%   +0.6%
=========================================
  Files         863      773     -90
  Lines      121929   113103   -8826
=========================================
- Hits       107913   100784   -7129
+ Misses      13662    12319   -1343
+ Partials      354        0    -354

Impacted Files
Coverage Δ

cpp/src/arrow/filesystem/filesystem_test.cc
100% <100%> (ø)
:arrow_up:

cpp/src/arrow/filesystem/s3fs.cc
88.68% <100%> (+0.01%)
:arrow_up:

cpp/src/arrow/filesystem/path_util.cc
100% <100%> (ø)
:arrow_up:

cpp/src/arrow/filesystem/s3fs_test.cc
99.3% <100%> (+0.02%)
:arrow_up:

cpp/src/arrow/util/thread_pool_test.cc
97.66% <0%> (-0.94%)
:arrow_down:

go/arrow/math/uint64_amd64.go

go/arrow/memory/memory_avx2_amd64.go

go/arrow/ipc/file_reader.go

go/arrow/array/builder.go

go/arrow/type_traits_boolean.go

... and 87 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 58e1144...ae315af. Read the comment docs.


Update covidmobility.py

We were skipping the population node if the first row had had no value.
Now we always write it on the first iteration, then we check to see if there is a value.

@pradh I will do a separate pull request to update the unit test. Wanted to get this in asap.


Changing group names

Replacing "Group n" by the value of the node property used for creating the group.

I'm guessing this question actually relates to Gephi's sigma.js exporter plugin. This plugin uses a legacy version of Sigma and is maintained by the Oxford Internet Institute:
https://github.com/oxfordinternetinstitute/gephi-plugins/tree/sigmaexporter-plugin/modules/sigmaExporter


Merging JS-16.1.20-11 back to main

Why such a huge patch?

Over the last year we dropped master and worked of branches because we had several releases going on in parallel
Not the case for the next release , whole team will work on same version, so we 're pulling all the latest release changes back into master to work off

Merging to get everything to master.


[ui-shell] Small breakpoint issues

What package is this for?

[ ] React

Describe the bug
• On small screens, text wraps instead of ellipses
• Hamburger and other icons reduce in width

To Reproduce
Steps to reproduce the behavior:
Not reproducable at IoT storybook because there are not enough icons. But, with MAS fully hooked up, the number of icons cause issues. Example can be seen in Graphite which uses the full MAS set of icons

Go to 'https://pages.github.ibm.com/maximo-app-framework/graphite/reference-app/#/about'
Make screen small or go into responsive mode
See error

Expected behavior
While we don't necessarily support mobile in all apps, it is inevitable that a customer will report this as a bug. Clients and business partners may also choose to create their own simple Graphite/Maximo application for usage on the phone. The masthead should hide some of the less necessary text, or truncate down appropriately with the Carbon smaller breakpoints
Specific timeline issues / requests
Would be nice to fix this for MAS 8.3

@dianatran18 Could we take a look at this from a design perspective and define expectations for how/when/where the header items should collapse at smaller widths? I don't think there's much (any?) guidance for this right now.

@dianatran18 can you please take a look at this item in the March sprint so we can consider it in the next dev sprint?

This issue has reared it's head in Maximo Everyplace, after we consumed the MAS Header in Manage. Maximo Everyplace is a very old mobile framework, but still has heavy adoption in the field. This needs to be fixed by 8.5.


test: add test files for ICC modules

Description

Add test files for ICC modules.

Resolves: #810
Checklist

[x] Have you adhered to the repository's defined coding convention rules?
[ ] Have you updated the 'documentation.md' file with the method/function documentation?
[x] Have you sent a message along with the result or response?
[ ] Have you used the try-catch technique?
[ ] Has the method/class been added to the documentation (md file)?

Screenshots

I certify that I have carried out the relevant checks and provided the requisite screenshot for validation by submitting this pull request.
I appreciate your contribution.

Great work @akashpambhar !!
Do not forget to

Share your contribution on socials and tag Clueless 🫂
Give this repository a star ✨
Follow Clueless Community on GitHub ✅


[BUG] Parquet Output File Sizes Unbalanced Compared to CPU Implementation

Describe the bug
Parquet files written by GPU cluster are different than those written by CPU cluster.
Steps/Code to reproduce bug
Load parquet file directory with balanced data (same number of rows, columns, and row groups). Write data to disk immediately and check file size.
import os
import shutil

data_dir = '/FileStore/tables/telco_dat_small/parquet'
df = spark.read.parquet(data_dir)

num_files = len(os.listdir('/dbfs'+data_dir)) # Number of input files

# Write data to dbfs or other network storage location.
etl_output_dir = '/tmp/bt/test_output'

# WARNING: ENTIRE etl_output_dir WILL BE DELETED
# Remove directory if exists:
if os.path.exists('/dbfs'+etl_output_dir):
    shutil.rmtree('/dbfs'+etl_output_dir)

df.write.parquet(etl_output_dir)

%sh
ls -all /dbfs/tmp/bt/test_output

Expected behavior
Exported files should be the same in both implementations using default settings. For example, 5 parquet files with similar size are read into spark. CPU cluster wrote out 5 files with similar size, but GPU cluster wrote out 21 files of varying sizes. Applying .coalesce() can reduce the number of files with minimal performance impact, but the data remains unbalanced. It is desirable that each output file contains the corresponding rows from it's source input file.
Environment details (please complete the following information)

Environment location: Databricks 7.3 LTS ML on 2 worker cluster with either i3.4xlarge (CPU) or g4dn.4xlarge (GPU). Running spark-rapids 0.3 release.
Spark configuration settings related to the issue:
Default configuration for CPU cluster.
GPU cluster has the following options applied:
spark.task.resource.gpu.amount 0.0625
spark.plugins com.nvidia.spark.SQLPlugin
spark.locality.wait 0s
spark.rapids.memory.pinnedPool.size 2G
spark.sql.adaptive.enabled false
spark.databricks.delta.optimizeWrite.enabled false
spark.rapids.sql.concurrentGpuTasks 2

Additional context
Data is part of an ETL and feature engineering pipeline where it is being staged and exported to disk for subsequent consumption in an ML pipeline. Having output data that corresponds to the input file is desirable for record keeping, especially when we are only augmenting the data with more columns and exporting the results to disk. Maybe the issue is related to the input file having row groups within each file?

that is weird, can you confirm the number of tasks that ran during the write stage between CPU and GPU?  Did GPU have 5 tasks at the end but wrote 21 files?

that is weird, can you confirm the number of tasks that ran during the write stage between CPU and GPU?  Did GPU have 5 tasks at the end but wrote 21 files?

Also can you tell me the size of the 5 files read?

Also can you tell me the size of the 5 files read?

There were 24 tasks in the GPU cluster and 5 tasks on the CPU cluster in the main job. The input files were each 17.1MB on disk.

There were 24 tasks in the GPU cluster and 5 tasks on the CPU cluster in the main job. The input files were each 17.1MB on disk.

Yeah so in this case spark uses the default parallelism because there are no other shuffles.  I ran this on normal Apache Spark on the CPU and it does the same thing. Databricks must have some additional logic in it to reduce the number.   You can see this if you edit the gpu cluster config and add this: spark.default.parallelism 7, then you will get 7 files.
if you run any other queries that would do a shuffle - join, groupby, etc, then this wouldn't be an issue as it would use other configs.
if this a real use case where someone is just trying to change formats or something?

Yeah so in this case spark uses the default parallelism because there are no other shuffles.  I ran this on normal Apache Spark on the CPU and it does the same thing. Databricks must have some additional logic in it to reduce the number.   You can see this if you edit the gpu cluster config and add this: spark.default.parallelism 7, then you will get 7 files.
if you run any other queries that would do a shuffle - join, groupby, etc, then this wouldn't be an issue as it would use other configs.
if this a real use case where someone is just trying to change formats or something?

The example code provided is a toy model to show the unexpected behavior. The actual use case is: (1) read in flat file with class balanced categorical data; (2) perform feature engineering, data augmentation, encoding, etc. to add more columns; (3) output updated data that aligns with input to avoid unnecessary shuffling. The input data is balanced in terms of data distributions and it is desirable to keep it that way.

The example code provided is a toy model to show the unexpected behavior. The actual use case is: (1) read in flat file with class balanced categorical data; (2) perform feature engineering, data augmentation, encoding, etc. to add more columns; (3) output updated data that aligns with input to avoid unnecessary shuffling. The input data is balanced in terms of data distributions and it is desirable to keep it that way.

note that here we use the same logic Apache Spark does for the max split size: https://github.com/apache/spark/blob/branch-3.0/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FilePartition.scala#L86
in this case you have 32 cores but you only get 24 tasks, this is because the open cost in bytes ends up being the limit.
this is not a bug as we do the same as Apache Spark, if we wanted to try to do something smarter similar to Databricks that would be a feature request.

note that here we use the same logic Apache Spark does for the max split size: https://github.com/apache/spark/blob/branch-3.0/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FilePartition.scala#L86
in this case you have 32 cores but you only get 24 tasks, this is because the open cost in bytes ends up being the limit.
this is not a bug as we do the same as Apache Spark, if we wanted to try to do something smarter similar to Databricks that would be a feature request.


fast-multilingual-e5-large.tar.gz Access denied

Hello,
I want to use fast-multilingual-e5-large, but when the lib is trying to download it I get:
An error occurred: Error: TAR_BAD_ARCHIVE: Unrecognized archive format
    at Unpack.warn (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/warn-mixin.js:21:40)
    at Unpack.warn (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/unpack.js:236:18)
    at Unpack.<anonymous> (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:83:14)
    at Unpack.emit (node:events:526:35)
    at [emit] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:313:12)
    at [maybeEnd] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:468:17)
    at [consumeChunk] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:500:21)
    at Unpack.write (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:427:25)
    at Unpack.end (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:548:14)
    at Pipe.end (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/minipass/index.js:75:17) {
  recoverable: false,
  file: 'local_cache/fast-multilingual-e5-large.tar.gz',
  code: 'TAR_BAD_ARCHIVE',
  tarCode: 'TAR_BAD_ARCHIVE'
}

then when I click on fast-multilingual-e5-large.tar.gz I see the file with content:
<?xml version='1.0' encoding='UTF-8'?><Error>AccessDenied<Message>Access denied.</Message>Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. Permission 'storage.objects.get' denied on resource (or it may not exist).</Error>

I downloaded the model from Hugging Face but I am missing model_optimized.onnx

I think this model has a bad Google Cloud Storage source.
We definitely would need to move to HF. Like FastEmbed-py and FastEmbed-rs.

source: https://github.com/Anush008/fastembed-js/blob/main/src/fastembed.ts#L214
The model is getting a different link. https://storage.googleapis.com/qdrant-fastembed/intfloat-multilingual-e5-large.tar.gz
The model link should be: https://storage.googleapis.com/qdrant-fastembed/fast-multilingual-e5-large.tar.gz
You can download the link and put it in "local_cache" manualy


[dunfell] recipes-sdk: do not overwrite/clear PACKAGES variable

Clearing PACKAGES variable to only contain ${PN} is very bad and it's not clear
what the purpose is. It doesn't cause much trouble during the regular build for
the target, as do_populate_sysroot() is able to collect required artifacts. But
since there are no ${PN}-dev, ${PN}-dbg and ${PN}-staticdev packages produced,
it renders an SDK with AWS IoT components completely useless, especially since
majority of them only produce .a libraries.
This change removes overwriting/clearing of the PACKAGES variable to use the
default value. If it was done as a workaround for some other issue, a better
solution should be found and not this "sledgehammer approach".
Signed-off-by: Denys Dmytriyenko<EMAIL_ADDRESS>

Thank you for your contribution!


Spelling mistake

It aids recovery of the exFAT volume in the advent of the Main Boot region being in an inconsistent state.

advent -> event

@ghane : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thanks for your contribution! I've merged your changes and they should be live soon.


Implement From trait for u64 for U128 & U256

Description
Simple helper functions for easy conversion between big integers and u64.
Checklist

[ ] I have linked to any relevant issues.
[ ] I have commented my code, particularly in hard-to-understand areas.
[ ] I have updated the documentation where relevant (API docs, the reference, and the Sway book).
[ ] I have added tests that prove my fix is effective or that my feature works.
[ ] I have added (or requested a maintainer to add) the necessary Breaking* or New Feature labels where relevant.
[ ] I have done my best to ensure that my PR adheres to the Fuel Labs Code Review Standards.
[ ] I have requested a review from the relevant team or maintainers.

Superceded by #4829


add default cluster name for cases where no cluster spec is provided

Issue #, if available:
Description of changes:
A user supplied support-bundle config caused a nil pointer when we attempted to access the non-existent 'bundle' in the diagnostic bundle struct; adding a default name to prevent this.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/lgtm

/lgtm


qemu: apply patch for CVE-2019-13164 [19.09]

Motivation for this change
#70124 (security fix)
master is on 4.1.0 which already has this fixed.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @

@delroth Sorry that merging this PR somehow got stuck. Would you please be so kind a check two points:

In the meantime, we have an update to 4.0.1 in https://github.com/NixOS/nixpkgs/pull/72236/. Is the patch still relevant at all?
There are merge conflicts with current release-19.09. Could you resolve them?

Thank you!


Ctr+Tab menu is no longer ordered by most recently used

...and hence a quick tap of Ctrl+Tab no longer works to switch to the previous editor either.
This was implemented in #1025 and used to work, but the menu now seems to ordered by last opened.
Possibly caused either by lastUsed on each buffer not being updated properly, or the menu no longer being sorted by lastUsed. From a quick glance through the code I can't see definite evidence of either, but there has been a major refactor since #1025 with the BufferEnter action previously used to update it being replaced by several different mechanisms in Feature_Buffers.

This happened to me too when I upgraded on the 10th of October (nightly build). I remember the behaviour changed from most recently used to the order of files opened (?), and I thought it might have been a changed default setting, but I haven't done any custom configuration. I searched for issues/PRs related to this on the 10th, but found nothing - so I've just been living with it since. Would love this to revert back to most recently used, or at least a configuration option for how this should work. 👍

Can you recall when you last upgraded before the 10th, @sklirg? If so that would hopefully give us a relatively narrow time range to look for potential culprits in the source code. Unfortunately I have no clue myself, but I have experienced this for several weeks at least.

Can you recall when you last upgraded before the 10th, @sklirg? If so that would hopefully give us a relatively narrow time range to look for potential culprits in the source code. Unfortunately I have no clue myself, but I have experienced this for several weeks at least.

Sadly, no. I've been upgrading to latest nightly pretty much every morning (EU time), so I've gotten the freshest builds every day for quite some time. It's a manual process (brew upgrade with a custom/personal cask), so it might have slipped for some days.

No worries. Just knowing that it's on the order of days rather than weeks months is very helpful!
I don't update very often myself as I build it from scratch in a sandboxed environment, which renders my computer useless for half an hour or so every time. I'm very much looking forward to auto-update landing!


fix(ripple): disable ripple animations when using NoopAnimationsModule

Disables the ripples animations when the consumer is using the NoopAnimationsModule.

Just pushed them @josephperrott.

Continues work on #10590


Urgent: Unable to upload images onto Wordpress

I keep receiving an error when trying to upload new images into CC.org's media library (see screenshot).

I think we have exceeded our limits for images on the site. I'm not sure, but we'll need to get this sorted out rather quickly because we have blog posts coming up!

This is fixed.