find out how SEC, PEI & DXE components are loaded in memory

read TDVF docs again to find infos about memory locations (stack/heap etc.)
in which direction are components (SEC, PEI, DXE) loaded in memory? (hi->lo or lo->hi addresses?)
are components loaded sequentially in memory?

Yes: end of SEC = start of PEI
No: figure out size of SEC and add it to SEC start address

are components always loaded in same memory region no matter where TDVF was built?

At each Qemu session start, SEC is loaded statically at fixed offset (exact offset seems to depend on TDVF image).
Other Modules are loaded "dynamically" at TDVF runtime in Heap. Load order is not fixed (i.e. no fixed order is specified) but seems to be deterministic as long as same qemu start options & TDVF image is used.


Delete lib prior to compiling

I was getting annoyed by residual files in lib that are no longer in src.  So I changed the compile script to delete the lib dir first. I also removed a prepare script that was redundant with compile.

I added npm run prepare back in, because I see now why it's necessary: https://stackoverflow.com/questions/44499912/why-is-npm-running-prepare-script-after-npm-install-and-how-can-i-stop-it


connection is stagnant

Hello,
i just installed the balena sound project on my raspi and was very happy that i got it running. :-)
I use it with a raspi 3 and a justboom amp hat soundcard. I can connect via bluetooth, but the song is buffering or the connection is not stable. i don't know. in the logs there are these messages in multiple variations.  .
14.10.19 10:35:29 (+0200)  /usr/bin/bluealsa: Unsupported RTP payload type: 1
14.10.19 10:36:43 (+0200)  /usr/bin/bluealsa: Missing RTP packet: 1227 != 1222
14.10.19 10:36:51 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
14.10.19 10:37:24 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such process
i use balenaOS 2.43.0+rev1 in the developement version. For the use with the justboom amp i created a custom variable BALENA_HOST_CONFIG_dtoverlay with the value "justboom-amp". The entry of the value was pretty much a guess after in the manual was mentioned only the case with hifiberry-dac. Could this cause the problem?
Greetings Max

https://www.justboom.co/software/configure-justboom-with-raspbian/ has some maybe for you usefull information.

The page has this info:
dtoverlay=i2s-mmap dtoverlay=justboom-dac
I guess you tried it with justboom-amp but the page uses for the amp justboom-dac

The change to "justboom-dac" seems to have been the answer to the logs. After the change there are no more logs till now. Still i didn't enter the "is2-mmpa" part. What does it?
should i make the entry in that form in the value of the Costum Variable BALENA_HOST_CONFIG_dtoverlay
BALENA_HOST_CONFIG_dtoverlay    "justboom-dac", "i2s-mmpa"
But the stagnant connection is still there. The error appears with an android tablet and a windows laptop. with an ubuntu laptop there is a connection possible but no sound output.. I still try to figure out why.
Is it possible, that the bluetooth module from the raspi 3 is too weak or defect?

RTP means Real-time Transport Protocol (RTP). You can read more about it in Wikipedia: https://en.wikipedia.org/wiki/Real-time_Transport_Protocol .  And Bluealsa says it is Unsupported.
It is maybe a dtparam error. The web page says you need to set
dtparam=audio=off
Maybe can you then play sounds. Good Luck-
PS: BALENA_HOST_CONFIG_dtoverlay "justboom-dac", "i2s-mmpa" is should be right (I saw something like this before). I am not very informed in this.

Applying boot config: {"dtoverlay":["i2s-mmpa","justboom-dac"],"disable_splash":"1","dtparam":["i2c_arm=on","spi=on","audio=off"],"enable_uart":"1","gpu_mem":"16"}
15.10.19 16:41:20 (+0200)  bluetooth-audio  Setting output volume to 100%
15.10.19 16:41:20 (+0200)  bluetooth-audio  Connection notify volume is 75%
15.10.19 16:41:21 (+0200)  bluetooth-audio  amixer: Unable to find simple control 'PCM',0
15.10.19 16:41:21 (+0200)  bluetooth-audio
15.10.19 16:41:21 (+0200)  bluetooth-audio  Restarting bluetooth service
15.10.19 18:10:22 (+0200)  bluetooth-audio  Bluetooth agent registered
15.10.19 18:10:25 (+0200)  bluetooth-audio  Device is discoverable as "balenaSound 818b"
i followed your suggestions. but the stagnant connection is persistent. while the tablet still plays on the raspi has short breaks in the replay.
The logs with the SBC decoding error and the missing RTB packages still continue too.
Real-Time-Transport Protocol sounds for me like somethig that could cause this.
in the beginning:
15.10.19 17:49:22 (+0200)  /usr/bin/bluealsa: Unsupported RTP payload type: 1
for very many times in a row. and then...
15.10.19 18:13:13 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
15.10.19 18:13:13 (+0200)  /usr/bin/bluealsa: Missing RTP packet: 320 != 319
15.10.19 18:13:18 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
15.10.19 18:13:18 (+0200)  /usr/bin/bluealsa: Missing RTP packet: 652 != 651
15.10.19 18:13:33 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such process
15.10.19 18:13:38 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
15.10.19 18:13:38 (+0200)  /usr/bin/bluealsa: Missing RTP packet: 2030 != 2029
15.10.19 18:13:39 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
15.10.19 18:13:39 (+0200)  /usr/bin/bluealsa: Missing RTP packet: 2070 != 2069
15.10.19 18:13:52 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such process
15.10.19 18:13:54 (+0200)  /usr/bin/bluealsa: SBC decoding error: No such file or directory
.... and so on

What happens when you run:
apt-get update && apt-get install --reinstall alsa-utils
In the cloud dashboard terminal in the bluetooth-audio container.

No Change. :-(

I found this discussion of a similar problem, which points in the direction of weak bluetooth signal.
https://forums.balena.io/t/music-will-skip-and-or-pause-using-balena-sound/34260

could this fix it perhabs?

Configure /etc/asound.conf (or .asoundrc in your home directory)

pcm.justboom-dac {
type hw card 0
}
pcm.!default {
type plug
slave.pcm "dmixer"
}
pcm.dmixer {
type dmix
ipc_key 1024
slave {
pcm "justboom-dac"
channels 2
}
}
ctl.dmixer {
type hw
card 0
}

Try it.

Nope, didn't change anything regarding sbc decoding error and lost packages. the pauses and stops are still there. i ordered a bluetooth dongle, to give it a try.

Ok

@mabli It seems like you have the same problem like in #23 . This seems like a bluetooth problem. VoxelTek sayed me that the RPI has no external AMP or DAC.

Yeah, i tried also without the amp board an get the same result.

@mabli It could be a problem with your mobile phone. You have got the same hardware like everyone else and the problem appers only on your RPI and the one in #23 . It is really mysterious. I hope the bluetooth dongle will fix the problem.

i re-installed  balena OS. This time i choose balenaOS 2.38.0+rev1 production. It appears to function now without the package loss and sbc errors. i don't know why. For me it is really a mystery. ;-)

Oh great.  I will recommend your solution in #23 . Thanks.

i re-installed balena OS. This time i choose balenaOS 2.38.0+rev1 production. It appears to function now without the package loss and sbc errors. i don't know why. For me it is really a mystery. ;-)

Thank you! I was using version v2.47.0+rev1 (recommended) on a Raspberry Pi 3 and had the same problems. Installing version 2.38.0+rev1 fixed all the isues.


Expose ES6 modules

This PR puts some export statements around (and removes all references to module.exports in the src/ files). Combined with a module entry in package.json, that means that I can now import {crc32} from 'crc' and let rollup include only the needed code.
I'm aware this changes the API surface and, unfortunately the old const crc32 = require('crc/lib/crc32'); must become const crc32 = require('crc/lib/crc32').default;. IMHO proper modules are worth that potentially breaking change.

The TravisCI failure is due to mocha pulling supports-color at version ^4.0.0, which has a const declaration that makes nodejs 0.10/0.12 crash and burn.

Travis looking good again 😄

Thank you very much for the PR. I merged this and fixed the .default issue, so the old require() and the new import should work side by side the same.


Matlab Crash when running demo.m

Ubuntu 14.04
Matlab 2015b
OSG installed at /usr/local with version libosg.so.146

When run demo.m got
Error reading file Carpet.jpg: file not found
Warning: Cannot create texture Carpet.jpg
Error reading file Wood_Tri.jpg: file not found
Warning: Cannot create texture Wood_Tri.jpg
ViewerBase::configureAffinity() numProcessors=24
  databasePagers = 1
ViewerBase::configureAffinity() numProcessors=24
  databasePagers = 1
_forceVertexArrayObject = 0
_forceVertexBufferObject = 0
ObjectWrapperManager::addCompressor(): 'null' already exists.
ObjectWrapperManager::addCompressor(): 'zlib' already exists.

then Matlab carshed.

@weiweikong were you able to resolve this issue? I'm encountering the same problem.

@purirohan No. I tried several ways, but still failed. Also, there is no reply from the author. Any idea?

This seems to be the OSGRenderer-matlab interoperability problem. I'll look into this in the OSGRenderer repo.

Closing the thread for bug in the dependency.

Thanks. @chrischoy


Query

Hi didn't found space to ask query so asking you here, I am targeting oculus quest device and want to use XRIT package also with it. Shall I purchase 3d android webview with gecko engine or normal android webview? Please let me know, thanks in advance

Hi, @aman2627 👋. Thank you for your interest! For Oculus Quest, I recommend 3D WebView for Android with Gecko Engine.  This page describes the differences between the two Android packages. If you have other questions, please let me know through the Vuplex contact page.


Add the Alibaba Cloud DNS libdns Provider

This is a PR for #18 . Straightforward implemention using Alibaba Cloud DNS API(as is Alidns). Something about TTL in Alidns will be limit with subscription of one's Alibaba Cloud account.
I'm not a golang expert coder,so feel free to feedback.

This commit is change the method of getting the AccessKeyId and AccessKeySecret by 'os.Getenv'

@mholt Okay,I'll solve them later because I'm completing my Graduation Project.Thanks for your feedback.

No problem, good luck!

A lot of libdns users are also Caddy users; would you like to create a caddy module so that Caddy users can benefit from your implementation as well? Caddy modules are very simple, usually 1 file, which optionally supports Caddyfile parsing: https://github.com/caddy-dns/cloudflare/blob/master/cloudflare.go -- let me know, and I can also make you a repo in the caddy-dns org.

Yes,I'll try to make a caddy DNS provider module for alidns.Thanks for your feedback.


seeing build failures in gh actions builds that need this package

see https://github.com/cartazio/ralist/runs/1421746860?check_suite_focus=true
no clue why ...
Failed to build code-page-0.2.
Build log (
C:\Users\runneradmin\AppData\Roaming\cabal\logs\ghc-8.10.2\code-page-0.2-40b31d8410d325f256dc55ba2f1c5be0d24a6cd7.log
cabal.exe: Failed to build code-page-0.2 (which is required by
):
bench:benchmarking from ralist-<IP_ADDRESS>). See the build log above for details.
Preprocessing library for code-page-0.2..

Building library for code-page-0.2..
[1 of 3] Compiling System.Win32.CodePage ( dist\build\System\Win32\CodePage.hs, dist\build\System\Win32\CodePage.o )
ghc.exe: could not execute: C:/GitLabRunner/builds/2WeHDSFP/0/ghc/ghc/inplace/mingw/bin/ld.exe
Error: Process completed with exit code 1.

This is GHC#18550, an upstream GHC bug. This comment indicates that if you use GHC <IP_ADDRESS> or later from Chocolatey, then it will contain a workaround for that bug.

Grr.  Ok. So I guess Next step is poke the setup-Haskell gh actions repo
folks
On Thu, Nov 19, 2020 at 5:20 AM Ryan Scott<EMAIL_ADDRESS>wrote:

This is GHC#18550 https://gitlab.haskell.org/ghc/ghc/-/issues/18550, an
upstream GHC bug. This comment
https://gitlab.haskell.org/ghc/ghc/-/issues/18550#note_309996 indicates
that if you use GHC <IP_ADDRESS> or later from Chocolatey, then it will contain
a workaround for that bug.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/RyanGlScott/code-page/issues/4#issuecomment-730306015,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAABBQT4HATSBWM3JD3TGULSQT5QDANCNFSM4T2ZFL5A
.

Sounds good. In any case, this isn't an issue on code-page's side, so I'm going to close this issue. Please re-open if you disagree.


What's the recommended way to make image processing ?

Hi everyone !
I'm working on a React Native project and I wanted to process images downloaded from the network to obtain the vibrancy colors and improve the UI. More infos in Google's Doc
Unfortunately I could not find any informations on how to extract the downloaded Image buffer or local temporary file path of the Image component.
I could write a completely new component but I would loose the whole implementation of the Image component which could create side effects.
An other solution would be to download the image as a Node.JS buffer, make the analyse happen and then insert back the buffer inside the Image component. But other issues point that as a very bad solution for performances.
Anyone has a better idea ?
Thanks !

@facebook-github-bot stack-overflow


[C++][Parquet] remove dependency on getopt in parquet tools

Reporter: Renat Valiullin / @rip-nsk
Assignee: Renat<EMAIL_ADDRESS>/ @rip-nsk
PRs and other links:

GitHub Pull Request #3545

Note: This issue was originally created as PARQUET-1525. Please see the migration documentation for further details.

Wes McKinney / @wesm:
You can Move issues. I'll go ahead and move this

Wes McKinney / @wesm:
Issue resolved by pull request 3545
https://github.com/apache/arrow/pull/3545

Micah Kornfield / @emkornfield:
I created https://issues.apache.org/jira/browse/PARQUET-1524 to track this instead since it seems like it is a parquet issue.


MICROSOFT

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0080ea96-3ae5-49ee-d621-eb8ffbd14a4f
Version Independent ID: d17b7412-6993-4347-174c-9f20d045af00
Content: Policy CSP - ApplicationDefaults - Windows Client Management
Content Source: windows/client-management/mdm/policy-csp-applicationdefaults.md
Product: w10
Technology: windows
GitHub Login: @ManikaDhiman
Microsoft Alias: dansimp

This ticket does not appear to have any useful content. Unless we get any updates from the OP (Original Poster), it appears to be ready for closing.


the script don't execute

also this

Error - could not create config file
I see in the project name a Chinese / Kanji charcter - please, could you try to rename it with alphabet characters?
What operation system?

the file is saved, it only happends on hiragana folders, romaji folders are fine
this bug is only for hiragana folders

Error - could not create config file
I see in the project name a Chinese / Kanji charcter - please, could you try to rename it with alphabet characters? What operating system?
the file is saved, it only happends on hiragana folders, romaji folders are fine
this bug is only for hiragana folders
windows 10

It still not working on hiragana folders,but now Works freely of saving the
file ir having a more complex name on the file
Also ALL hiragana svp now Works 100%
I was testing and some did not Works ( more than 7 letters idk why)
Em sáb, 12 de fev de 2022 17:47, hataori-p @.***>
escreveu:

@KimeruReru https://github.com/KimeruReru hopefully it is now fixed,
can you try out the latest version?
—
Reply to this email directly, view it on GitHub
https://github.com/hataori-p/real-voice/issues/3#issuecomment-1037467339,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANYDYNWSDBJD4R36NRQPEZTU23BNJANCNFSM5OFKEHWA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>


roadmap 0.1.0 - out of beta!

WIP - I'm still editing and finishing this issue, more to come under State of Things sections
OVOS Pipeline

mycroft-core -> OpenVoiceOS
one common issue with mycroft-core was that you could not run a piece of the stack without importing everything else, in a server you would be forced to run the audio stack even if you are just powering a chatbot, worse, in docker setups this dragged a lot of bloat
initially we just organized imports internally to clean this up, but eventually all the pieces ended up working fully standalone and were split into their own packages

mycroft.api  + mycroft.identity  + mycroft.metrics -> ovos-backend-client
mycroft.skills.mycroft_skill -> ovos-workshop
mycroft.util -> ovos-utils
mycroft.lock -> ovos_utils.process_utils
mycroft.util.combo_lock -> combo_lock
mycroft.util.parse + mycroft.util.format -> lingua-franca -> ovos-lingua-franca
mycroft.client.text -> ovos-cli-client
mycroft.client.speech -> ovos-listener
mycroft.client.enclosure -> ovos-PHAL + ovos-gui
mycroft.audio -> ovos-audio-plugin-ocp + ovos-audio
mycroft.messagebus.client -> mycroft-bus-client
mycroft.messagebus.service -> ovos-messagebus
mycroft.session -> ovos-bus-client.session
mycroft.configuration -> ovos-config
mycroft.tts -> ovos-tts-plugin-XXX + ovos-plugin-manager
mycroft.stt -> ovos-stt-plugin-XXX + ovos-plugin-manager
mycroft.audio.services -> ovos-audio-plugin-XXX + ovos-plugin-manager
mycroft.client.speech.hotword_factory -> ovos-ww-plugin-XXX + ovos-plugin-manager
mycroft-skills-manager -> ovos-skills-manager

State of Things
mycroft.deprecated
as ovos-core evolved we deprecated functionality present in mycroft-core, old classes providing either dummy behavior or warning logs has been moved to mycroft.deprecated module, this is dead code that remains in core only to avoid syntax errors in downstream projects, anything that was a public api in mycroft-core remains available in ovos-core
one of the removed things was the integration with msm which forced default skills and locked core to Mycroft marketplace
OpenVoiceOS implements a standalone skill installer utility that supports several marketplaces
mycroft-skills-manager -> ovos-skills-manager
ovos-utils
at first ovos_utils provided generic utilities to interact with mycroft-core, over time more and more pieces from mycroft.util moved there as they started being needed across ovos ecosystem, ovos_utils is a shared library across most of our repositories and by itself is enough to write simple scripts to interact with OpenVoiceOS
currently ovos-core mostly contains unused utils under mycroft.util for legacy reasons, those should be fully deprecated or moved to ovos_utils
combo_lock was useful enough to become it's own package https://github.com/forslund/combo-lock

mycroft.util -> ovos_utils
mycroft.util.combo_lock -> combo_lock
mycroft.lock -> ovos_utils.process_utils

ovos-plugin-manager
mycroft-core initially hardcoded STT/TTS/WW options, a plugin mechanism was developed but the hardcoded plugins were never migrated, OpenVoiceOS created plugins for every "native" implementation and moved all base classes and plugin loading logic to ovos-plugin-manager

mycroft.tts -> ovos-tts-plugin-XXX + ovos-plugin-manager
mycroft.stt -> ovos-stt-plugin-XXX + ovos-plugin-manager
mycroft.audio.services -> ovos-audio-plugin-XXX + ovos-plugin-manager
mycroft.client.speech.hotword_factory -> ovos-ww-plugin-XXX + ovos-plugin-manager

ovos-backend-client
as alternative backends / no backend support was added to ovos-core the mycroft.api module ended up migrated to a more generic ovos-backend-client, nowadays with Selene in risk of going down at any time this packages is the defacto client library for several OVOS backends, it can be used in any project to interact with several backends or directly with web apis

mycroft.api  + mycroft.identity + mycroft.metrics -> ovos-backend-client

ovos-workshop
ovos-workshop is where skill base classes live, it started as a way to bring bug fixes and features to mycroft-core via monkey patching, it evolved to provide skill base classes and a mechanism to develop standalone applications that interact with ovos-core

mycroft.skills.mycroft_skill -> ovos-workshop

ovos-config
as configuration handling started being needed in more packages and stopped referring to a single file format or location it moved into it's own shared library, it became the key component for XDG standards adoption and downstream voice assistant compatibility and continues to expand to this day with a cli interface recently added
once we fully move mycroft.conf from ovos-core to ovos-config it will be a truly standalone package

mycroft.configuration -> ovos-config

mycroft.client
the mycroft.client was a target for removal from core since the early mycroft days, all components there lend themselves to replacement or can be considered fully optional
the debug cli utility built on curses was moved into ovos-cli-client, this component had a totally different release cycle from core and was the only one built on top of curses, some of the code in this module was among the code not touched for longer, this indicates this is a mature optional component
the mycroft.client.enclosure module was among the most controversial, as it directly tied to core to specific platforms recognized by MycroftOrg, it was very difficult to add platform support to core
today this module has been deprecated and the PHAL plugin framework is used across OpenVoiceOS instead
one of the things this module did was launch the ovos-gui service as part of the enclosure implementations, in OpenVoiceOS this was made it's own service and is the source of truth for the mycroft-gui protocol implementation, it has been extended to support platform specific gui extensions

mycroft.client.text -> ovos-cli-client
mycroft.client.enclosure -> ovos-PHAL +  mycroft.gui
mycroft.gui -> ovos-gui

ovos-listener
the speech client was one of the pieces OpenVoiceOS improved the most, it supports multiple wake words, VAD plugins and listening modes. It is a standalone component since core can be used via text only, such as in server setups

mycroft.client.speech -> mycroft.listener
mycroft.listener -> ovos-listener

ovos-bus
mycroft started migrating the mycroft bus client implementation to it's own repo, but never finished migrating mycroft-core to use it
the messagebus service is a simple websocket server, as proof of concept we developed an equivalent service in C++ to test performance, the reference python implementation is also available

mycroft.messagebus.service -> ovos-messagebus / ovos-bus-server (c++)
mycroft.messagebus.client -> mycroft-bus-client

ovos-bus-client
a central piece of ovos-core design is that the message.context is passed along the pipeline and can contain additional metadata, this is a key feature for supporting multiple users and things such as a different language per query
ovos-bus-client is an extension (not a replacement) of mycroft-bus-client, it adds utils to interact with bus messages and it's metadata, the mycroft.session module has been extended and migrated to this package. this is the main design conflict between ovos-core and mycroft-dinkum, where in core the session data comes from bus messages, in dinkum this is controlled by the intent manager

mycroft.session -> ovos-bus-client.session

ovos-audio
with a screen come video capabilities, the OCP framework was created to handle all kinds of playback, it uses the old mycroft audio service internally and replaces it and the mycroft common play framework

mycroft.audio -> ovos-audio-plugin-ocp + ovos-audio

ovos-core
ovos-core is now a minimal library providing the brains of OpenVoiceOS, it is the piece that understand utterances and triggers intents, it can load skills or interface with external applications
it only depends on the messagebus which can be replaced with FakeBus for test frameworks or even with something like HiveMind. OpenVoiceOS is now several independent frameworks
TODO

[ ] mycroft.gui -> ovos-gui
[ ] mycroft.listener -> ovos-listener
[ ] mycroft.audio -> ovos-audio
[ ] mycroft.messagebus.service -> ovos-messagebus
[ ] mycroft.metrics -> ovos-backend-client.metrics
[ ] move mycroft.conf from ovos-core to ovos-config
[ ] move remaining utils under mycroft.util either to ovos_utils (or more appropriate package) or mycroft.deprecated
[ ] remove mycroft.configuration in release 0.1.0
[ ] remove mycroft.skills.mycroft_skill in release 0.1.0
[ ] remove mycroft.util in release 0.1.0
[ ] remove mycroft.lock in release 0.1.0
[ ] remove mycroft.api in release 0.1.0
[ ] remove mycroft.client in release 0.1.0
[ ] remove mycroft.identity in release 0.1.0
[ ] remove mycroft.session in release 0.1.0
[ ] remove mycroft.metrics in release 0.1.0
[ ] remove mycroft.tts in release 0.1.0
[ ] remove mycroft.stt in release 0.1.0
[ ] remove mycroft.messagebus in release 0.1.0
[ ] remove mycroft.deprecated in release 0.1.0
[ ] https://github.com/OpenVoiceOS/ovos-ocp-audio-plugin/pull/75

this has been replaced by the adoption of a new release process and proper semver


XML parse failure with & input

I haven't been able to pull a fix together yet, but I noticed the re-work for HTML entities does not take into account the &amp, as it decodes it to just & which then breaks the :xmerl_scan.string
Braintree.XML.Decoder.load("First & Last")

Demonstrates the issues

Closed by #24


fix decimalv3 cast in fe produce wrong data (#29808)

case:
MySQL root@<IP_ADDRESS>:test> select cast(12 as decimalv3(2,1))
+-----------------------------+
| cast(12 as DECIMALV3(2, 1)) |
+-----------------------------+
| 12.0                        |
+-----------------------------+

decimalv2 literal will generate wrong result too. But it is not only bugs in planner, but also have bugs in executor. So we need fix executor bug in another PR.
pick from master #29808
commi id 88ef595e39a11be96c0b4338dcba1ed08c3a199e
Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


[live demo] dropdown bugs

The live demo for dropdown has the followings bugs:

Dropdown

[ ] missing inline variant prop
[ ] missing different size variants
[ ] missing direction prop to open bottom/top
[ ] missing warning state prop
[ ] missing invalid state prop
[ ] When the light prop is applied it is not showing the latest updates of the color changes we made with hover-light-ui token.
[ ] The dropdown size changes in width depending on the text length of the option you select from the menu. The dropdown should maintain the same width no matter how long the option text entry is.

Combo box

[ ] missing inline variant prop
[ ] missing different size variants
[ ] missing direction prop to open bottom/top
[ ] missing warning state prop
[ ] missing invalid state prop
[ ] the close icon should be icon-01
[ ] The field of combobox is showing up empty. The prompt text "Filter..." needs to be shown in the field asbody-short-01 and text-03.

[ ] The text sits too high and is not sitting in the center vertically within the field.

Multi-select/Filterable Multi-select

[ ] missing inline variant prop
[ ] missing different size variants
[ ] missing the direction prop to open bottom/top
[ ] missing warning state prop
[ ] missing invalid state prop
[ ] The option text in the open menu needs to be text-02 not text-01 by default. It changes to text-01 on hover or when selected.
[ ] The number in the tag sits too high. It needs to be center within the tag container.
[ ] the close icon should be icon-01  for the filterable multi-select.

Replaced with storybook demo https://github.com/carbon-design-system/carbon-website/pull/3716


Enhancement: Configure blank_line_before_statement fixer

This PR

[x] configures the blank_line_before_statement fixer
[x] runs make cs

Follows #593.
💁♂ The idea is to give a bit more breathing room before something important is happening.

Thank you, @BackEndTea!


Group refocus on deletion

Added functionality so the user can specify how the next object should be selected in a group when the currently focused object is deleted. The old reselection policy (next in group) is default.
See #474

Thank you very much!
I merged this new feature in dev-5.3.


Cleanup visualisation code prior to 0.1 release

I strongly suggest we make decisions on these points before releasing. I fear they'll haunt us otherwise!

[ ] to baseline_renormalize or not (a.k.a. postproc=What)
[ ] decide on and implement a principled way to handle units, esp. when plotting

On the first point, I propose changing to postproc=False (and modifying all tests to explicitly set it to True). I think this should be the case regardless of what the default behaviour of HNN GUI needs to be.
On the second, I like @jasmainak 's proposal to keep everything in fAm, and use scalings-arguments to plot in given units. @rythorpe also pointed out that legends can be used to indicate what amount of scaling has been applied.
These seem like two quite straightforward PRs to me, should we include them in 0.1?

I am okay with this but we might need a section in the documentation to explain how to get the "old behavior" and explaining to folks what has changed and why. It's partly there in the whats_new but maybe worth pulling it out into a separate document might be helpful. Mostly to get buy-in from folks who have been using HNN-GUI in the past.
For postproc, another option is to set postproc=True but have a deprecation warning that next cycle it will become postproc=False. But probably not worth the effort

I am okay with this but we might need a section in the documentation to explain how to get the "old behavior" and explaining to folks what has changed and why. It's partly there in the whats_new but maybe worth pulling it out into a separate document might be helpful. Mostly to get buy-in from folks who have been using HNN-GUI in the past.
For postproc, another option is to set postproc=True but have a deprecation warning that next cycle it will become postproc=False. But probably not worth the effort

This may not be worth taking the time to implement but the quantities package is definitely aimed at this exact issue of units.
I've seen it implemented in a few neuroscience specific toolkits (neo and elephant specifically), but at the moment it is tough to say how many headaches it would save.


Reportback ampersands

@mikefantini this fixes the caption & why_participated in the owner/non-owner permalink as well as the admin view of the permalink
Fixes #4286

:+1:

yeah let's check the gallery as well (both showcase gallery and step 4 gallery, although I assume they will output the same caption display)

@mikefantini @sergii-tkachenko  ok, added gallery stuffs here as well
@weerd will this take care of the JS loaded images/captions?


Can't delete superclass value

Related PR: https://github.com/wicketstuff/core/pull/454/files#r50507093

PR applied. Closing.


Review need for a rel='noopener noreferrer'

In particular for links with target='_blank'.
This would be a security concern. Enforcing all links have rel='noopener' might be a sane thing to do for added security.
This could also be mitigated by disown-opener in CSP headers (#1691), but that doesn't seem to be widely supported by browsers yet.
Regardless, so long as you can't login to the site this isn't critical yet, and so far most links I've seen don't have target='_blank', but it would be neat harden security around these edges.

I've checked and we are using target="_blank" only at the navigation menu layout, linking to flutter.io and www.dartlang.org, and one additional landing blurb. It will be a quick change to fix these.

@isoos, can we file a new issue for figuring out how to prevent any new introductions of target='_blank' without rel='noopener' ?
I imagine that changes in dartdoc or analysis, or README.md's or markdown rendering, etc. could accidentally introduce this in the future. It would be a problem if the target of the link was controlled as it would give access to the page. In a future where people are logging into the pub site, that is a security risk.
Again, I'm more concerned with how can we prevent this from happening in the future, I don't think there is an immediate pants-on-fire security issue with this at the moment.

I've added a test to the pending PR that checks the template outputs on our internal test cases. As far as I can tell the markdown package does not generate target="_blank" links, and I'm not sure if any markdown processor would do it. (We do not take user-provided HTML snippets.)
Anyway, we could create either a template validation that happens each time we serve a page (or maybe, at some random subset of that), or do an external crawler/parser that check pages randomly. I think it is not that pressing concern, and would just put it in the backlog.

I think it is not that pressing concern, and would just put it in the backlog

Absolutely, agree :)
But long term it might be something we could come back to and investigate. Like I said, I don't have solution to prevent this type of bug. Using disown-opener in CSP might be the best option, I assume browser will support that soon.


Update document for UPS modules

Hi @andreasbalsiger I created this pull request for the documentation step.
Could you help review this README.md file, it describes the purposes and functionality for the UPS connector.
Thanks!


Document/Expose "completion" command in ytt

Cobra 1.2.0 introduced a feature by which the library automatically includes a shell completion command (for bash, fish, powershell, and z-shell). docs
Dependabot generated a PR for the upgrade: #451
When that PR is merged, the feature is available: this new command (i.e. completion) is automatically added:
$ ./ytt --help
ytt performs YAML templating.

Docs: https://carvel.dev/ytt/docs/latest/
Docs for data values: https://carvel.dev/ytt/docs/latest/ytt-data-values/

Usage:
  ytt [flags]
  ytt [command]

Available Commands:
  completion  generate the autocompletion script for the specified shell
  fmt         Format YAML templates
  help        Help about any command
...

👍🏻
To maximize the value the feature provides, we need to do a little work to let users know it is there:

[ ] include this new feature in our own release notes.
[ ] where we describe how to install ytt, mention this feature (point users to the help text: ytt completion help)

Removed "carvel triage"; we're definitely doing this work.

Categorizing this as important-soon since we think that has a high ROI (little effort, high return).

One suggestion for the docs is to include that ytt completion zsh --help tell you the exact command to run. It was a bit  confusing to me at first where to send the output of the command.


Create AWS KMS new key issue

What happened?
Hello crossplane community,
An error occurs when a new AWS KMS key is created.
How can we reproduce it?
Crossplane installed as k8s operator as replicaset with crossplane pod, aws provider and rbac manager.
I am trying to create a new KMS key, empty one as described below:
file: newkms.yaml
apiVersion: kms.aws.crossplane.io/v1alpha1
kind: Key
metadata:
  name: eks-kms-key-crossplane
  namespace: infra
spec:
  forProvider:
    enabled: true
    customerMasterKeySpec: "SYMMETRIC_DEFAULT"
    description: ksm key for eksvault crossplane
    keyUsage: ENCRYPT_DECRYPT
    region: eu-central-1

Once I run kubectl apply -f newkms.yaml
I get Invalid keyID error.
Error description:
kubectl-output-kms-key.txt
What environment did it happen in?
AWS environment:
K8s v1.18.9-eks-d1db3c
Crossplane version: 1.2.1

Am I missing something or this looks like a bug, on slack channel there was a kind of similar issue but also with defining an external-name in annotations.
Any advice or help really appreciated. Thank you.

Hello @muvaf apologies for that, I've marked a template I've used for object creation and uploaded an output of kubectl for convience.

I am also getting an error while creating not exactly similar, "failed to describe Key: EmptyStaticCreds: static credentials are empty"
        apiVersion: kms.aws.crossplane.io/v1alpha1         kind: Key         metadata:           name: kms-key-test           namespace: crossplane-local         spec:           writeConnectionSecretToRef:             name: kms-key-test             namespace: crossplane-local           providerConfigRef:             name: crossplane-provider-aws-local           forProvider:             region: us-east-1             origin: "EXTERNAL"             enabled: true             customerMasterKeySpec: "SYMMETRIC_DEFAULT"             keyUsage: ENCRYPT_DECRYPT             tags:               - tagKey: KMS Key                 tagValue: ""

just to add created the sample key from the documentation, even this didn't work.
apiVersion: kms.aws.crossplane.io/v1alpha1kind: Keymetadata:  name: dev-keyspec:  providerConfigRef:    name: example  forProvider:    policy: |-      {        "Version": "2012-10-17",        "Statement": [          {            "Sid": "Enable IAM User Permissions",            "Effect": "Allow",            "Principal": {              "AWS": "arn:aws:iam::123456789012:root"            },            "Action": "kms:*",            "Resource": "*"          }        ]      }    region: eu-central-1    tags:    - tagKey: k1      tagValue: v1

a

what is the exception in crossplane when you create the example ?
on my side it is working:
➜  kms git:(master) ✗ kubectl get key.kms.aws.crossplane.io/dev-key
NAME      READY   SYNCED   EXTERNAL-NAME
dev-key   True    True     ea87e120-8417-4ade-8499-9e093d5664d7

thanks for commenting, are you using IRSA for credentials? or directly? .... I am using IRSA ..

I am similar getting an error when trying to create an AWS KMS key:
Message:               observe failed: failed to describe Key: NotFoundException: Invalid keyId efskey
Below is my example:
apiVersion: kms.aws.crossplane.io/v1alpha1
kind: Key
metadata:
  name: efskey
spec:
  deletionPolicy: Delete
  writeConnectionSecretToRef:
    name: efs-key
    namespace: default
  forProvider:
    description: Encryption key used to encrypt EFS resources
    region: ap-southeast-2
    policy: |-
      {
        "Version": "2012-10-17",
        "Statement": [
          {
            "Sid": "Allow access to EFS for all principals in the account that are authorized to use EFS",
            "Effect": "Allow",
            "Principal": {
                "AWS": "*"
            },
            "Action": [
                "kms:Encrypt",
                "kms:Decrypt",
                "kms:ReEncrypt*",
                "kms:GenerateDataKey*",
                "kms:CreateGrant",
                "kms:DescribeKey"
            ],
            "Resource": "*",
            "Condition": {
                "StringEquals": {
                    "kms:ViaService": "elasticfilesystem.ap-southeast-2.amazonaws.com",
                    "kms:CallerAccount": "YYYYYYYYYY"
                }
            }
          },
          {
            "Sid": "Allow direct access to key metadata to the account",
            "Effect": "Allow",
            "Principal": {
                "AWS": "arn:aws:iam::YYYYYYYYYY:root"
            },
            "Action": [
                "kms:Describe*",
                "kms:Get*",
                "kms:List*",
                "kms:RevokeGrant"
            ],
            "Resource": "*"
          }
        ]
      }

    tags:
    - tagKey: Name
      tagValue: EFS

today we also have one environment with this issue directly in eks... when we apply the same via a local kind cluster everything is working ...
looks like directly after applied the ressource in k8s - crossplane adds annotation for example:
crossplane.io/external-name: efs-key
but this is wrong because the external-name is
obj.KeyMetadata.KeyId

I have found the same issue still occurs.
I am running on the following versions:
crossplane/crossplane:v1.2.1
crossplane/provider-aws-controller:v0.18.1

manifest-1.yaml - Invalid keyId
apiVersion: kms.aws.crossplane.io/v1alpha1
kind: Key
metadata:
  name: "martin"
  labels:
    purpose: paas-orgs
    provider: aws
spec:
  deletionPolicy: "Delete"
  providerConfigRef:
    name: crossplane-provider-aws
  forProvider:
    bypassPolicyLockoutSafetyCheck: false
    customerMasterKeySpec: "SYMMETRIC_DEFAULT"
    enabled: true
    keyUsage: "ENCRYPT_DECRYPT"
    origin: "AWS_KMS"
    policy: "POLICY JSON"
    region: "eu-west-1"
    tags:
      - tagKey: author
        tagValue: crossplane-provider-aws
  writeConnectionSecretToRef:
    name: "martin-test-xplane-kms-key-secret"
    namespace: "crossplane-system"

Results:

The k8s object is created

NAME             READY       SYNCED        EXTERNAL-NAME
martin             False          martin

Getting the error: failed to describe Key: NotFoundException: Invalid keyId martin

manifest-2.yaml - keyId not found
Using a valid keyId but the key doesn't exist on the account, but my objective is to create a new key.
apiVersion: kms.aws.crossplane.io/v1alpha1
kind: Key
metadata:
  name: "martin"
  annotations:
    crossplane.io/external-name: "55555555-089b-4193-bf05-03f6a3e743c4"
  labels:
    purpose: paas-orgs
    provider: aws
spec:
  deletionPolicy: "Delete"
  providerConfigRef:
    name: crossplane-provider-aws
  forProvider:
    bypassPolicyLockoutSafetyCheck: false
    customerMasterKeySpec: "SYMMETRIC_DEFAULT"
    enabled: true
    keyUsage: "ENCRYPT_DECRYPT"
    origin: "AWS_KMS"
    policy: "... POLICY JSON ..."
    region: "eu-west-1"
    tags:
      - tagKey: author
        tagValue: crossplane-provider-aws
  writeConnectionSecretToRef:
    name: "martin-test-xplane-kms-key-secret"
    namespace: "crossplane-system"

Results:

The k8s object is created

NAME             READY       SYNCED        EXTERNAL-NAME
martin             False          martin            55555555-089b-4193-bf05-03f6a3e743c4

Getting the error: failed to describe Key: NotFoundException: Key 'arn:aws:kms:eu-west-1:**********:key/55555555-089b-4193-bf05-03f6a3e743c4' does not exist

Using an existing keyId it works as expected attaching the k8s resource to the existing AWS one.
NAME                                   READY   SYNCED   EXTERNAL-NAME
7*******-0b**-4ce4-####-7e3d1*******   True    True     7*******-0b**-4ce4-####-7e3d1*******

in my point of view the problem is that provider-aws directly after kubectl apply adds the k8s object also adds the annotation fir external-name
the following code-snip is never entered: https://github.com/crossplane/provider-aws/blob/master/pkg/controller/kms/key/zz_controller.go#L73 so the creation is not triggered
and the problem with failed to describe key is then from this code-snip: https://github.com/crossplane/provider-aws/blob/master/pkg/controller/kms/key/zz_controller.go#L82 because the Observer thoughts that he need to check if the key exists ...

Hey folks! So the issue with the external-name is due to the fact that the KMS key ID is non-deterministic I believe (correct me if I am wrong). What we would want to do in this case is override the default initializers, like we do here:
https://github.com/crossplane/provider-aws/blob/3f1b7187455f14c306b3037312a19a791ac9d9eb/pkg/controller/servicediscovery/httpnamespace/setup.go#L59
This is saying only use ProviderConfig defaulting and not the default NewNameAsExternalName() initializer, though we actually use OpenAPI default as well since this PR: https://github.com/crossplane/crossplane-runtime/pull/252, so you could actually just pass managed.WithInitializers().
The static credentials bug is a separate issue that needs to be addressed in authentication with the v1 API.

we have changed to managed.WithInitializers() in https://github.com/crossplane/provider-aws/pull/1050 - can someone check again ?


FIX: Determine uniqueness of packages by name.

I finally found what was causing the generation of a corrupt pods project "sometimes"!
If you have multiple targets in the Podfile that refer to the same SPM package, the target_definition_list in target_dep_resolver.rb contains this SPM package multiple times. They are all identical except for the UUID of the XCRemoteSwiftPackageReference. Because this UUID is unique for each, the .uniq filte keeps all of them. Then in 1.add_spm_pkgs.rb these are all put in a hash that somehow can contain duplicate keys. From there on, when looking up in the hash, it's hit or miss whether it will consistently return the same pkg_ref or not. If it takes the wrong one, then the project becomes corrupt.
It is fixed by uniqueing (is this a word?) the spm_pkgs by name. This should be fine as long as all SPM packages references with the same name in the Podfile are identical. But I think this is an acceptable constraint because Cocoapods also does not support different references for the same Pod.
I also noticed that the same SPM package was added to the .umbrella/Package.swift multiple times for the same reason. That's also fixed, though SPM did not complain about it.

/integration-test


Model profile for inference

Hi,
For inference how we can get op level timings in tensorflow
Thanks

Hi @akote123
To get operation-level timings or execution time of specific operations within a graph, you can use the TensorFlow Profiler tool. I attached a gist for your reference.
Thank you!

@Venkat6871 , can please provide access to gist

@akote123  Thanks for your response!
Could you check the gist now. I hope it will run.
Thank you!

Hi @Venkat6871 ,
I tired with gist , but I am not able to see data in tensorboard,.
`tf.profiler.experimental.start('logs')
Your TensorFlow operations here
...
Stop profiling
output = model.predict(encoded_input, verbose=False)[0]
tf.profiler.experimental.stop()`

This way I tried. Please let me know if I need to do change

Hi @akote123  Thanks for your response!
Actually I just send enable profiling. Here we need to follow some steps.
1.Enable profiling after this step.
2.Running Tensorboard:
After executing your Python script that includes the profiling code, you need to run TensorBoard to visualize the collected profiling data.
Open your terminal or command prompt and use the following command:
tensorboard --logdir=logs

3.Accessing Tensorboard:
After you run the command, open a web browser and go to the address shown in the terminal where TensorBoard is running.

@Venkat6871 , I actually followed all the steps and when teansorboard is opened in web , In the profile tab when click for op level , the page is showing empty.

@Venkat6871 , is there any other way I can get profile data for inference

@SuryanarayanaY , For the above code I get tensorboard as attached

Hi @akote123 ,
Please refer to this tutorial for profiling with tensorboard. Also check this tutorial to use Tesorboard in notebokks itself.

@akote123,
Could you please try to update to the latest tensorflow v2.17 and also take a look at the official document for reference. I tried to execute the same document and check the data. Kindly find the gist of it here.
Thank you!


Adding Water.css to CSS Frameworks

Hi,
I've been seeing Water.css start to pop up in a few places and have actually found it really smooth and easy to use (I converted one of my projects to it and it's been a breeze - timrossback/kira@59b716a826bf29a56acf3bde01f915917474ab91). It's super simple to set up since it uses native HTML elements for styling rather than classes and is responsive with both a light and dark theme off the shelf. I think it would be a nice addition to the others already here.
Thanks!

lgtm!


Complete unit test coverage of primary ndt7-js functionality

Initial release of the ndt7-js client is functional but does not yet include full javascript coverage.
Consider whether it would be helpful to use the ndt7test package with local testing. https://github.com/m-lab/ndt-server/tree/master/ndt7/ndt7test

I trust this was done by https://github.com/m-lab/ndt7-js/pull/13


The simulator might has a bug, my simulator is aways starts from (0,0) coor.

Hi there,
hope you are doing well. I have a horrible week using AWS DeepRacer to train my model. What my issue is that the simulator starts always at the (0,0) coordinate and not on the track I supposed to train. See the images below

and

After about 30 minutes, the car was still seeing only the grasses around. Is there something wrong with the simulator???
If there's a bug, please stop this gimmick, because we have to pay money for using the AWS!!!
Thanks,
Bill

I discovered that when you navigate to another menu item then return to the training job, it will restore the video.

The car resets to the track position once the training starts. Are you still seeing that the car doesn't move?


Fix Visual Shift On vexOpen

Fix #20 and keeps #18 fix
Uses the same method as bootstrap's modal

Closing because outdated...


[V1 Doc] use absolute link for meta image

right now the link is https://community.algolia.com/instantsearch.js/assets/instantsearch-cover-6630408f1e9eacd08a4209f803be3d43.png which is declared as /instantsearch.js/assets/instantsearch-cover-6630408f1e9eacd08a4209f803be3d43.png in the meta tag, but that doesn't work in discourse for example.
The meta tags should be changed to absolute links instead
cc @olance

#2239 was merged :)


fix(paragraph): Account for Block in Paragraphs line_width, and line_count methods.

Fixes: #1233
The line_width, and line_count methods for Paragraph would not take into account the Block if one was set. This will now correctly calculate the values including the Block's width/height.
The Blocks newly implemented horizontal_space, and vertical_space can also be used in Block::inner since its mostly duplicate logic. Can add it to this PR or a separate one later. This is also why I decided it would be better to return the results as (top, bottom), and (left, right) since it would allow for use in more areas.

I accidentally merged instead of rebasing and made a mess. There is also a missing semi-colon in one of the suggestions. Will clean up things locally and do a push.

Things should be fixed now. Applied the suggestions, and made a few syntax fixes. I think this is good to go.


pass options to frame processors on iOS

What

This PR allows iOS frame processors to access passed-in options.
Changes

This PR changes the frame processor callback arguments in FrameProcessorPluginHostObject.mm to pass in the options dictionary constructed prior instead of nil.
Tested on
iPhone Xs

Related issues
I didn't see any.

lol, very strange that this got into production

Ahh, thanks so much @rkmackinnon, nice catch! 🙏


[Bug] Table widget action - Error in evaluation trigger - Function statements require a function name

Description
In the table widget action, the following snippet does not work:
{{ function(){
...
}()
}}

The workaround to this is:
{{ (function(){
...
})()
}}

Steps to reproduce the behaviour:

Drag and drop and table widget
Change column type to button
Add an IIFE like above
See an error: Error occurred while evaluating trigger: Function statements require a function name

Important Details

Version: Cloud / Self-Hosted vx.x
Browser - chrome, safari

** reported by discord user

@riodeuno will we require some help from the actions pod here?

@riodeuno @vibhandikyash we need to triage this issue and move towards resolution here, Kindly look into this

@riodeuno need help triaging this

@somangshu I think this has now been fixed

My mistake I didn't realise this was a table specific problem

@somangshu Let me triage this and get back to this thread.

@sbalaji1192 kindly triage and reassign

@somangshu This is a javascript behavior. you need to convert the function into an expression by enclosing it in a bracket to execute it immediately. (you can also prefix the function with + or - to make it an expression).
https://www.loom.com/share/a33cadbdda544588a9b8417f0a8cc151


css prop support

Hi, very interesting project. I'm making a heavy use of styled-components's css prop.
E.g.

my content

```.

Is it supported ?

Hey @laem
Thank you for opening this issue. We don't support styled-components css prop yet, but it would definitely be doable.
Out of curiosity - How did you find out about this project?

Hi, good question. I don't remember how I found it. Maybe "linaria + next" in Kagi + some more links on github  ?

it might be a great addition for very simple layout components
e.g. instead of abstractions like this one:

Yes, I often use it for components that need just a bit of styling, do not justify creating a new ui component file, and also that are not used twiced in the app.

I found this repo via: https://www.joshwcomeau.com/react/css-in-rsc/#the-list-goes-on-10
When will https://github.com/jantimon/next-yak/pull/78 be merged in?
Thanks!

I'll discuss it with @Mad-Kat today and will give you an update

css prop has some complicated edge cases
however we discussed internally and decided to ship a first version which won't cover all edge cases soon

short update - #78 took some rounds to find the optimal solution but I believe it is getting really close to be released

Released in next-yak 0.2.0

Seems to be gone but soon reintroduced #169

Exactly. With the move from Babel to SWC, we lost the ability. Should be finished after my holidays

@laem we added it back to swc with next-yak 2.3.0

In my migration from styled-components here https://github.com/cartesapp/cartes/pull/704, it looks to me that the css prop is not working in lots of cases. I'm unable to isolate a failing one from a working one for now, but I'll try to provide an example. Maybe something to do with nesting inside the css template literal ? With css= props inside styled.x components ? To be investigated.
I'm converting lots of css props to styled.x proper components. Which is quite a heavy migration, and more verbose. Well at least I don't have to isolate them in "use client" files like it used to be with styled-components.

Hey @laem thank you for trying it out and starting the migration. I'm not quite sure what the problems are, as the PR changes quite a lot of things (especially formatting) that makes it hard to spot what actually changed with the migration to next-yak. Can you point me to a file where it doesn't work? I would love to have a look around and see how we can help you.

Yes the PR is massive, I'll try to isolate a component and show you.

I sorted out the PR problem : a sed command added a space to all the lines, making every tsx file change.
I've also isolated a "css prop" that was not working, changed to a styled.span https://github.com/cartesapp/cartes/pull/704/commits/50eb166886ebe8ef0d62711f589cadcb8ea7e9a0
It should help you see if there is a problem or if my expectations of your css prop is wrong.

This code should work:

I added it to your base page and it works correctly

Sometimes you forgot to import css maybe that's an issue?

Yes I'm progressively adding the missing imports, since with styled-components no import was needed. I added the css`` automatically with sed but couldn't add the import automatically by the same way.

I added it to your base page and it works correctly

Strange, it didn't work for me. Hence the rewrite to styled.span in the commit that I have linked.

In this file https://github.com/cartesapp/cartes/blob/21fc8f2a43b7d43b9ac9138030f89234e6831eeb/app/itinerary/ClickItineraryInstruction.tsx, the css prop does not work. The img is rendered with its full svg width.

Thanks for the reproduction. We saw that once you disable the react compiler it works as planned.
We didn't look into the react compiler yet, but now we definitely should. The assumption is that the compiler runs before our plugin has the chance to run and that doesn't work well with the non-transpiled code.
Can you verify that it works on your side without the react compiler?

Can you verify that it works on your side without the react compiler?

Yes ! It seems to resolve the missing css= props' css. But I was starting to rely quite seriously on the compiler, as it turns out that disabling it created infinite loops. It must have added useMemos that are needed for the app to work. Proving its interest by the way :)

Some more feedback on the matter.
When I try to use a .babelrc file*, the default proposed by the nextjs doc, I get new errors.
[ Server ] Error: Functions cannot be passed directly to Client Components unless you explicitly expose it by marking it with "use server". Or maybe you meant to call this function rather than return it.

           ^^^^^^^^^

* I'm trying to add a babel file to support the with {type: json} that is added by contentlayer2. It's unrelated to next-yak.

My guess is that the withYak function adds a swc parsing to the next-config, which cannot read the with import assertion produced by contentlayer2.

Hi @Mad-Kat, I'm wondering if support of React Compiler is planned, or not. Thanks !

could you please create a dedicated issue for that topic?
I guess we will have to reach out to the react compiler devsand ask them if we can do the compiling right before the jsx transformation


cannot import name 'segvae' in phiseg_generate_samples.py

Dear @baumgach,
Thank you very much for sharing such a brilliant project.
I was trying to run  phiseg_generate_samples.py to sample from the learned distribution.
Howevery, an error occured as shown below:
from phiseg.phiseg_model import segvae
ImportError: cannot import name 'segvae'

This error is caused by line 14   from phiseg.phiseg_model import segvae in phiseg_generate_samples.py.
Also, I have checked, there is no segvae in phiseg_model.py.
Could you please help me with this?
Many thanks!

Problem solved.

Hi Landwind-Xin,
I am also facing the same issue. Can you please tell me how did you solve the problem?
Thanks in advance.

Hello, there was an issues with same old names being used in the code. While developing the module was called 'segvae' before I refactored it to 'phiseg'. I fixed it now.
Note that I haven't had time yet to test the evaluation scripts after the refactoring. Let me know if you run into more problems.

Yeah Sure. Thanks for the reply.


on-device decisioning telemetry

https://wiki.corp.adobe.com/pages/viewpage.action?spaceKey=elm&title=Local+Decisioning%3A+SDK+telemetry

added telemetry for on-device decisioning
changed default artifact format to JSON

Example of telemetry sent...

Coverage decreased (-0.06%) to 93.192% when pulling d2c4cb2d99a0c3dfe0ee807c3d316bd3f5e2766b on telemetry into fbc6e8c99edcd33963f51c3f1c6684d833930d35 on master.

@jasonwaters in the WIKI related to telemetry in Phase 1, we have just:

request ID
timestamp
execution
fetaures - with just decisioningMethod

I would keep it this way, until we have clarity around Phase 2 etc.

@jasonwaters in the WIKI related to telemetry in Phase 1, we have just:

request ID
timestamp
execution
fetaures - with just decisioningMethod

I would keep it this way, until we have clarity around Phase 2 etc.

Ok, thanks for reviewing @artur-ciocanu .  I changed the flag to be telemetryEnabled and limited what is sent to just what is required for phase 1. 🍻


Fix incorrect implementation-only import for CMake build

This resolves a warning seen when building the project with CMake, since that style currently still requires @_implementationOnly import instead of private import or other access levels.
ABIEntryPoint.swift:12:16: warning: '_TestingInternals' inconsistently imported as implementation-only

Checklist:

[x] Code and documentation should follow the style of the Style Guide.
[x] If public symbols are renamed or modified, DocC references should be updated.

@swift-ci please test


getColumns()

Added some column operations docs

I guess I accidentally submitted something else... only meant to submit docs change, please ignore the other one.

Thanks!


snapshot/git/gitdb: begin implementing snapshot.DB

gitdb implements snapshot.DB using a git repo as its data storage.
For now, only implements IngestDir and Checkout.

Current coverage is 60.67% (diff: 53.08%)

No coverage report found for master at f02fb1c.

Powered by Codecov. Last update f02fb1c...a67b341


Add unsolicited sso request/binding validators

This issue is imported from pivotal - Originaly created at May 6, 2019 by Michiel Kodde
The SSO endpoint is kitted out with request validators for the binding and request parameters. These ensure we can identify problems with the request at an early stage of the atuthentication.
The unsolicited SSO action does not yet have those validations but could be very usefull to have.

Basically you call an URL via GET in this form:
https://engine.example.org/authentication/idp/unsolicited-single-sign-on/(key:nnnnnnnn/)8723a8fadcf112812d430766e7cedbb5?sp-entity-id=https://some-sp
If you leave off the sp-entity-id parameter you get in the log:
"engineblock.ERROR: Service Provider '' not found in database | Caught Unhandled generic exception". That could indeed be more specific that the mandatory parameter was not passed at all.
If you include the parameter you get in the logs the same message as above but with the specified string. That seems on par.
If you leave out any of the path components you get a 404, because the route is not matched, that is fine.
If the IdP hash is not found you get "Error - No connection between institution and service" and logged is app.NOTICE: Unable to map remote IdpMD5 "a" to a remote entity." Seems fine.
I'd propose:

Add validator to check if mandatory sp-entity-id parameter is present early on.

Others seem specific enough as it is (at least on the side of the logs). (Thijs Kinkhorst - May 6, 2019)

See also: #164924925 (Thijs Kinkhorst - May 7, 2019)

yes. the variant with the ordering as listed in my comment above is the only one of the two that actually works and hence the only one that is in use
(Thijs Kinkhorst - May 7, 2019)

My initial assumtion that unsolicited SSO was not behat tested was not grounded. There are three behat scenarios covering this feature. Why these tests did not error is one of the things I will investigate/fix here. (Michiel Kodde - May 8, 2019)

@thijskh what is the expected behaviour when using the unsolicited sso endpoint with a non registered sigining key?

For example:
https://engine.example.org/authentication/idp/unsolicited-single-sign-on/key:shes-not-there/8723a8fadcf112812d430766e7cedbb5?sp-entity-id=https://some-sp
Now yields the generic 500 error "OpenConext - Error - An error occurred".
I'm totally fine with keeping this behavior, but am open to trigger a custom exception, and add a new error page.
Logged message:
May  8 11:04:44 apps EBLOG[6047]: [2019-05-08 11:04:44] engineblock.ERROR: Unknown key id "does-not-exist" | Caught Unhandled EngineBlock_Exception
``` (Michiel Kodde - May 8, 2019)

Fine to keep it this way. It will generate an ART of course.
This is exactly the same as currently happens when you use a non existing ID on a regular sso url of EB. Just don't do that. (Thijs Kinkhorst - May 8, 2019)

Okay! keeping it like that, but covering it in test, in combination with unsolicited SSO. (Michiel Kodde - May 8, 2019)

And in case the sp-entity-id query param is missing, you wrote:

If you leave off the sp-entity-id parameter you get in the log:
"engineblock.ERROR: Service Provider '' not found in database | Caught Unhandled generic exception". That could indeed be more specific that the mandatory parameter was not passed at all.

In order to be more specific, do we want to create a new error page for this situation? If so, can you propose a suitable title and error text? (Michiel Kodde - May 8, 2019)

I'm fine with making the logged error more correct. (Thijs Kinkhorst - May 8, 2019)

That already helps us a lot (immediately clear to us what the user/request did wrong). Usage is not so large that this would warrant more investment in handling than this. (Thijs Kinkhorst - May 8, 2019)


Remove foced tile overlap for tilesources with tileoverlap=0

This should resolve openseadragon#1722. This same change was proposed in PR #1731
This is a fix for tiny visible stitching errors for tilesources with overlap=0, due to the forced overlap. The forced overlap appeared to be put in place for a time when the non-canvas renderer was more widely used due to browser support. With the non-canvas renderer, the forced overlap may have prevented visible seams between tiles. However, now that canvas is  almost universally supported, I'm not sure this workaround is still necessary?
I stumbled into this issue as a tiny "stitching errors" were surfaced in a commerical project leveraging OSD that I maintain. We were programatically comparing ROIs from our OSD based viewer to those from another viewer (based on openlayers), leveraing the same tilesource backend, which has zero tile overlap.
The comparisons revealed subtle differences at tile boundaries. In a few instances, we noticed tiny visible seams between tiles. We tracked that down to the issue discussed in #1722. Removing this code resolved the issue.
We'd love to get this change merged upstream. Perhaps we could conditionally disable this code for canvas renderers? Let me know how we can get this PR accepted! Thanks again!

@ConnerMan thank you for digging into this! Unfortunately this fix by itself is not enough. What browsers have you tested on? I've just now tested this on Mac Chrome, Firefox, and Safari. As far as I can tell it doesn't make any difference on Chrome (neither better nor worse). This patch does, however, introduce significant seams in both Firefox and Safari. I don't have easy access to Edge, so I've not tested there.
Where are you seeing the seams that you're trying to fix? Which browser? And are they PNG tiles? There's a good deal of discussion about that in https://github.com/openseadragon/openseadragon/issues/1683.
I'd definitely love to get this fixed, so I'm glad you're looking into it! We need a solution that works for all browsers, or at least doesn't make things worse on any of the browsers we support. It may be that we need to have a patch that just targets certain browsers. I'd like to be able to reproduce the issue you're seeing, as well.
Here are the 0 overlap files I'm testing with... one set with opaque JPG tiles:
overlap0.zip
...and one with semitransparent PNG tiles:
semitransparent-overlap0.zip
With my testing, here's what I'm seeing on master with the semitransparent tiles: no seams in Chrome, subtle seams in Firefox and Safari.
Master with opaque tiles: no seams on any browser.
Your branch with semitransparent tiles: no seams on Chrome, noticeable seams on Firefox and Safari.
Your branch with opaque tiles: no seams on Chrome, noticeable seams on Firefox and Safari.

Hey @iangilman, yes, was about to update this issue! Futher testing revealed seams in Firefox & Safari, obviously that's a no go.  Oversight on my part, sorry about that! It appears that different canvas implementations have different subpixel rounding issues that make exact positioning with no overlap introduce seams.
So the issue we're trying to fix is across all browsers, with both JPEG and PNG tiles (transparency & no transparency). Mabye I didn't describe it well, the seams I'm talking about aren't "gaps" but tiles not quite lining up at tile boundaries with zero overlap tilesources. This is due to the line in question here, where tiles are being drawn 1px larger than they are to force a bit of overlap. I assume this was added to address seams! Doesn't seem to be needed for Chrome, but still is for FF/Safari and possibly others.
For most users & use cases, it's probably not a big deal as the forced overlap is barely perceptible.
Trying to see if I can get permission to post an example with one of my employer's images. In the meantime, seeing if I can demonstrate with one of the public images.

I believe it's the same issue as demonstrated in this comment:
https://github.com/openseadragon/openseadragon/issues/1722#issuecomment-543888420
Here's a video that sort of highlights the issue, comparing the same region before and after changes in Chrome with one of our pathology images (custom tilesource, 0 overlap).
https://user-images.githubusercontent.com/597044/141199798-05e3215d-174d-403e-b285-22acc8972282.mov
Here's the screenshot of the ROI in question. I added some annotations to point at the tile boundaries.

This is at 100% zoom. You have to look very closely as it's 1px we're talking about here. This probably isn't an issue for most users, but for our application (medical imaging), the very minor misalingment is an issue. We'd like to find a way to reduce or eliminate that without having to migrate to a tilesource with overlap (which does avoid this issue).
Maybe we could conditionally enable the code to force some overlap for everything but Chrome. This would improve stitching alignment for Chrome, but seams kind of gross. I'd understand if you wouldn't want to mainline that!
Let me know if you have any thoughts, I'll keep experimenting to see if I can come up with a general solution. Hope this explains the issue better.

I see! Thank you for explaining. We certainly want to be able to provide medical-grade imagining!
I'm curious, why is migrating to tiles with overlap a problem?
I actually would be fine with taking this change as a Chrome-only fix (of course with proper commenting); at least it would be an improvement. Would that be helpful in your case? Can you limit your customers to using Chrome? BTW, have you tested on Edge?
Other possible fixes:

Forcing tile edges to be on even pixels (i.e. rounding their location to the nearest pixel). This can make the tiles line up perfectly, but it does have a noticeable effect on the smoothness of animation, and of course it does introduce a small amount of overall distortion. One possibility would be to not do it during animation but then snap to rounded locations when the viewer comes to a rest. As for the distortion, I would think it would be quite minor and might be better than the current overlap, but you would know better than I at least in this case.
Switch to using WebGL for rendering rather than canvas. With WebGL we should be able to control our subpixel rendering in a way that's consistent across all browsers. This is certainly something we've wanted to do but would be a large development project that so far no one has wanted to either take on or pay for. You can see some discussion here: https://github.com/openseadragon/openseadragon/issues/68

For some background, our application reads a bunch of proprietary microscopy imaging formats. Given the size of image repositories we are dealing  with, and the rate at which new files must be processed, we decided to avoid converting the proprietary formats to DZI or something similar. Instead we have a backend which provides an API that pulls the tiles from the native binary formats.  We have a custom tilesource which interacts with our BE and that has mostly served us well!
However, given most of these formats do not store the underlying tiles with any overlap, generating tiles with overlap on the fly would introduce significant overhead. So we were trying to avoid that path if possible.
After some further testing, even Chrome seems to run into issues with rotated viewports with this change. So this might be something of a dead end. I would understand if you wanted to close this PR, hopefully our situation is somewhat unique!
Thanks for the suggestions for alternative fixes! I can take a stab at prototyping rounding tile positions, can you point me in the right direction in terms of code? Is that in tiledimage or the drawer?
A WebGL renderer would be awesome but definitely seems like a big project! Maybe I'll try the above first.

@ConnerMan thank you for the update! If you want to try the rounding solution, here's a starting point: https://github.com/openseadragon/openseadragon/pull/1713
Any investigation you can do is appreciated!

We ended up leveraging tile overlap from our tilesource. Hopefully this thread can be helpful for others! Thanks again :)

@ConnerMan Thank you for the update! And yes, always good to have these discussions in case other people will be helped by them :)


Reduce overhead incurred by enabling debug output.

Setting proxy.config.diags.debug.enabled to 3 enables most core debug output (whose tag matches the debug
regex), and plugin debug output from the new API macro TSDbg().  Setting it to 1 enables all (matching) debug
output, but with the previous high overhead.

This commit could be merge into proprietary branches of trafficserver, without causing routine
merge conflicts when aligning with the open source branch.

This replaces:  https://github.com/apache/trafficserver/pull/7674

[approve ci autest]

This change is deployed in Yahoo Prod, no problems seen, has been found to be very helpful.

@cmcfarlen is going to take a look at this.


net_flow_graph: Data as throughput and a throughput filter.

Original push was messed up. This is now ready for review.


[Question] Are there console routes supported?

I would like to create an application which can be handled over http(s) and console.
Are there console Routes Supported in Klein?

Klein is basically a pure router, not a framework. This use case shouldn't be handled by the router, in my opinion.
A better pattern if you need to consistent handling of behavior between HTTP and console is to create a service layer between your controllers and the rest of your code that encapsulate all of the high-level business logic. Then you can use the Symfony console component (or another harness, but symfony\console is the best standalone component for my money) to create commands that can be run directly. Both commands and http requests end up calling the same set of services, the only difference is that in the first case, the Console command object handles mapping the command's parameters to services, while in the second, the Controller object handles mapping the HTTP request data to services.
This is, of course, the service layer pattern from PEAA, and not something I came up with on my own.

Great respone, thank you.


I got a quesion.

This library can't catch ANR ,  I regret to say.  Have you studied about it?

There is no easy way to detect ANR, but you can try using this library: https://github.com/SalomonBrys/ANR-WatchDog
It will work with CustomActivityOnCrash since it throws a runtime exception when an ANR is detected.
However, I have never used it and I don't know what are the implications of using it (possibly more CPU and battery usage?).
If at any time ANR become detectable by the framework itself, I will add support for that, of course.


Get video from other server

Hi,
Will be possible to adapt the code to get  the mp4 from other server?
Thanks!

Via what mechanism? File as http url?

yes, http url. The Video is not on my server but I can get it with a request to another server.

Added support in master, via this commit.
https://github.com/vlanard/videoscripts/commit/a3339719fe94e44a2ffebacb569ceea464786b70


how to keep img tag

I have allowed the  tag by seeting
Sanitizer({
    "tags": ("img","a", "h1", "h2", "h3", "strong", "em", "p", "ul", "ol","li", "br", "sub", "sup", "hr")
})

but the  tag is still being removed.

Hi @ohblue
I added a test which demonstrates how you can preserve the img tag. See https://github.com/matthiask/html-sanitizer/commit/74a7a595790bc974448124add8ba66630f663bd4

@matthiask  No, that should not work, because you have completely overwride exists setting

`
Make a copy
html_settings = dict(html_sanitizer.sanitizer.DEFAULT_SETTINGS)
Add your changes
html_settings['tags'].add('img')
html_settings['empty'].add('img')
html_settings['attributes'].update({'img': ('src', 'alt', 'title')})
sanitizer = Sanitizer(settings=html_settings)
`


bge small 继续预训练loss

用4GB数据继续预训练，loss从14降到7，算正常的吗？有什么方法可以提升呢

实验中我们一般会降到4-5左右，可以再多训练一下

实验中我们一般会降到4-5左右，可以再多训练一下

好的，我再加一个epoch试试，感谢答复

实验中我们一般会降到4-5左右，可以再多训练一下

Do you have any suggestions on the number of epochs in training bge-large-en? We are using a 200 GB dataset.
And is there an expected training loss in beg-large pre-training?
Thanks!

实验中我们一般会降到4-5左右，可以再多训练一下

好的，我再加一个epoch试试，感谢答复

抱歉，弄混了，我们small模型的loss到6左右，所以到7也还行。large才是4左右。

实验中我们一般会降到4-5左右，可以再多训练一下

Do you have any suggestions on the number of epochs in training bge-large-en? We are using a 200 GB dataset. And is there an expected training loss in beg-large pre-training?
Thanks!

Roughly 1 to 2 epochs should suffice, with the loss around 5


Not on jcenter?

README states maven central and jcenter, but I'm not finding it on jcenter.  Should I expect to see it there or has that changed?

Not showing up in when searching for package name but does work from gradle.


Systemd watchdog connector for thin edge

Discussed in https://github.com/thin-edge/thin-edge.io/discussions/933
Is your feature request related to a problem? Please describe.
Enable systemd watchdog for tedge daemon processes like tedge-agent, tedge-mapper etc.
Describe the solution you'd like
Provide integration with systemd watchdog using a "systemd watchdog connector" daemon that checks the liveness of tedge daemons via their MQTT health endpoints (tedge/health/<component-name>) and sends liveness notifications(systemd-notify signals) to the systemd service manager at regular intervals (configured as WatchdogSec in the monitored services systemd definition file).
Describe alternatives you've considered
Building systemd-notify mechanism directly into the tedge daemons was ruled out to avoid a hard dependency on systemd.
AC:

The watchdog should be a separate component
The health check interval for a service is derived from the WatchdogSec configuration value in their systemd service definition file (recommended to use half of that value)
Components should answer to that request within a "health check timeout"
The "health check timeout" should be configurable with a reasonable default used otherwise
Since the "systemd watchdog connector" itself is a daemon, it should also be installed as a systemd service configured to be restarted if the daemon crashes.

The "health check timeout" should be configurable with a reasonable default used otherwise

I do not understand what that "health check timeout" is.

Which component will consider that timeout? The monitored component? Or the Watchdog connector?
What happens when that timeout is gone?

I don't understand what the desired outcome here is. E.G. what happens if the "liveness" of a daemon is not as expected? Shouldn't the software be fixed to not get "unhealthy" (whatever that means) instead of trying to shift the problem to another entity (in this case systemd)?

I do not understand what that "health check timeout" is.

Which component will consider that timeout? The monitored component? Or the Watchdog connector?

The "health check timeout" was supposed to be used by the "watchdog connector" and defines the maximum time it will wait for a health update response from a daemon, after it sends the health check request.

What happens when that timeout is gone?

This question made me realise that this configuration parameter is indeed useless. When the connector doesn't get a response in time, it need not do anything. If it doesn't send the systemd-notify signal (or do nothing), it will result in the daemon getting restarted by systemd anyway. So, I guess I'll remove that useless config parameter.

I don't understand what the desired outcome here is. E.G. what happens if the "liveness" of a daemon is not as expected? Shouldn't the software be fixed to not get "unhealthy" (whatever that means) instead of trying to shift the problem to another entity (in this case systemd)?

The goal is not to solve/mask genuine bugs in our daemons with the help of systemd (by restarting the daemon),  but to prevent a daemon from getting blocked because of external issues that are out of its control (a plugin that it triggered took too long/never responded). As the agent, is designed to execute certain operations (like software update) only sequentially and not parallelly, we don't want just one operation blocking the agent forever. So, the "declared intent" is to use this watchdog mechanism to get the agent out of such "genuine" blocked states rather than masking the bugs.
But I agree to your point that this might lead to some rare bugs escaping without getting noticed, as a restart might "magically fix things" without anyone noticing. But, I'd still consider that as a good thing, as for the end-user, he'd rather have his system functioning smoothly rather than stalling because of a rare bug. I just hope that someone at some point might notice "too many" service restarts and report it and grab our attention.


Update GenericBinaryBuilder to use buffer builders directly.

Which issue does this PR close?

Closes #2104.
Rationale for this change
Don't build binary array from list builder to avoid bugs and extra memory occupation.
What changes are included in this PR?

Update the struct of GenericBinaryBuilder
Remove the method append_byte and append. (append_value and append_null can achieve all functionalities)
More tests to cover the all-null case and builder resetting.
Fix some docs

Are there any user-facing changes?
Yes, remove 2 pub methods append_byte and append.

Codecov Report

Merging #2117 (c3a9be3) into master (3096591) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #2117      +/-   ##
==========================================
+ Coverage   83.76%   83.78%   +0.01%
==========================================
  Files         225      225
  Lines       59457    59485      +28
==========================================
+ Hits        49806    49839      +33
+ Misses       9651     9646       -5

Impacted Files
Coverage Δ

arrow/src/array/builder/generic_binary_builder.rs
92.00% <100.00%> (+8.66%)
:arrow_up:

parquet_derive/src/parquet_field.rs
65.98% <0.00%> (-0.23%)
:arrow_down:

arrow/src/datatypes/datatype.rs
64.41% <0.00%> (+0.35%)
:arrow_up:

...row/src/array/builder/string_dictionary_builder.rs
91.36% <0.00%> (+0.71%)
:arrow_up:


Fix 'Trailing spaces' issue in .travis.yml

CodeFactor found an issue: Trailing spaces
It's currently on:
.travis.yml:58

fixed


docs: add DoorDash Developer to showcase

Pre-flight checklist

[ ] I have read the Contributing Guidelines on pull requests.
[ ] If this is a code change: I have written unit tests and/or added dogfooding pages to fully verify the new behavior.
[ ] If this is a new API or substantial change: the PR has an accompanying issue (closes #0000) and the maintainers have approved on my working plan.

Motivation
Sebastien Lorber suggested I add our site to the site showcase!
Test Plan

Test links

Deploy preview: https://deploy-preview-_____--docusaurus-2.netlify.app/
Related issues/PRs

I'm in touch on Twitter, we'll take over the PR if needed


Short solution needed: "How to limit bitrate" (ffmpeg)

Please help us write most modern and shortest code solution for this issue:
How to limit bitrate (technology: ffmpeg)
Fast way
Just write the code solution in the comments.
Prefered way

Create pull request with a new code file inside inbox folder.
Don't forget to use comments explain solution.
Link to this issue in comments of pull request.

How to limit bitrate of a video or stream


feat: add brackets for windows, priority, cjs esm support, logger, ty…

…pes for handler

I will review this and fix some formatting + code styling issues and then merge this into main.
Some minor things I already noticed:

Are you sure we need to get rid of rollup? I have no issues using the library with old require syntax.
Please don't remove the package-lock.json and also commit it.

please, i only use commonjs on server side

yes, but Rollup already compiles to CommonJS? Take a look at the rollup.config.js where it says format: "cjs". So I don't get the problem with the previous config.


Introduce keyboard scroll flag in Virtual Console

This is the second try to fix #1443, after a first attempt with pull request #1584 that covered only VCButtons.
The approach on this change is completely different: introduce a flag to choose whether or not to use arrow and PgUp/PgDown keys to scroll Virtual Console.
When the flag is disabled, all the keys are available as key combinations on the controls.
Side changes:

in assignhotkey.ui the former QLineEdit has been replaced by a QLabel to allow capture of (almost) all the keys (the QLineEdit consumes at least backspace, delete, home, end, left and right cursor keys)
the CTRL+key combinations are completely blocked

Closes #1443

coverage: 32.056% (+0.02%) from 32.034%
when pulling e0912e5a06d5b044bc1671c376b3441002206bf1 on Pac72:issue-1443-vc-settings
into c1f5846de11931e43213afbd49b7cbac1031e23d on mcallegari:master.

Hi @qfulmina , did you hava a chance to try this change?


[DO NOT MERGE] Migrate existing rule instances into rule_instances table

Depends on #3486
This PR adds a migration script to move all rule instances created before PR #3486 to the rule_instances table.
Summary
Provide a brief overview of the changes and the issue being addressed.
Explain the rationale and any background necessary for understanding the changes.
List dependencies required by this change, if any.
Fixes #(related issue)
Change Type
Mark the type of change your PR introduces:

[ ] Bug fix (resolves an issue without affecting existing features)
[x] Feature (adds new functionality without breaking changes)
[ ] Breaking change (may impact existing functionalities or require documentation updates)
[ ] Documentation (updates or additions to documentation)
[ ] Refactoring or test improvements (no bug fixes or new functionality)

Testing
Outline how the changes were tested, including steps to reproduce and any relevant configurations.
Attach screenshots if helpful.
Review Checklist:

[x] Reviewed my own code for quality and clarity.
[ ] Added comments to complex or tricky code sections.
[ ] Updated any affected documentation.
[ ] Included tests that validate the fix or feature.
[ ] Checked that related changes are merged.

coverage: 53.117% (-0.01%) from 53.127%
when pulling e6f0719f9a62920c5322caeaad162a3fc316cc9d on migrate-rule-instance-new-table
into 936892a2826579f5b2901507c9791ecd5675f4b6 on main.

coverage: 53.127%. remained the same
when pulling e6f0719f9a62920c5322caeaad162a3fc316cc9d on migrate-rule-instance-new-table
into 936892a2826579f5b2901507c9791ecd5675f4b6 on main.

coverage: 53.117% (-0.01%) from 53.127%
when pulling 004ca6a82e12e06bfe70fa16c92f3b69e74ccb70 on migrate-rule-instance-new-table
into 936892a2826579f5b2901507c9791ecd5675f4b6 on main.

coverage: 53.251% (+0.01%) from 53.241%
when pulling 5edf505347cd2111bec1465645f8f426a6bdc866 on migrate-rule-instance-new-table
into d986b0c575a6a3d79ed66e0bfbf6e6f9f9b22303 on main.

coverage: 53.241%. remained the same
when pulling 666e35c75e84d0baeb5899cd05735a14c1bc1c63 on migrate-rule-instance-new-table
into d986b0c575a6a3d79ed66e0bfbf6e6f9f9b22303 on main.

coverage: 53.256% (+0.02%) from 53.241%
when pulling 666e35c75e84d0baeb5899cd05735a14c1bc1c63 on migrate-rule-instance-new-table
into d986b0c575a6a3d79ed66e0bfbf6e6f9f9b22303 on main.

coverage: 53.256% (+0.02%) from 53.241%
when pulling 666e35c75e84d0baeb5899cd05735a14c1bc1c63 on migrate-rule-instance-new-table
into d986b0c575a6a3d79ed66e0bfbf6e6f9f9b22303 on main.


chore: use key in place of name if no name given for variables

Current dependencies on/for this PR:

main

PR #183   👈

This comment was auto-generated by Graphite.


Is it possible to highlight the selected preset Date in UI ?

They are marked properly when selected.


Add test/ to pylint and flake

Closes: #581

I've been reluctant to merge this because linting is supposed to make code better quality, and I feel that this merge makes it worse, with a bunch of hacks to just satisfy the linter. Either that code should be rewritten in a better style, or those linting rules should be disabled for test/.
Also, add the test lint to the precommit hooks.

I think the unnecessary lambdas were fine and cleaning up unnecessary imports, I agree that the var from loop hack was more for linter than better code, one of the rules to disable for test folder?

Want to create just a PR with the positive cleanups and no linter yet? I agree on the lambdas

yeah, will close this one and open a clean pr


Nested type registries

The goal of this PR is to add nested registries to hive in order to increase typeId limit for the models.
The original implementation has been written by @xal with https://github.com/hivedb/hive/pull/804.
The final design adds the following api to the hive TypeRegistry interface (which is accessible through Hive singleton value).
Hive.registerNestedAdapters((registry) {
  registry.registerAdapter<User>(UserAdapter());
}, parentTypeId: 3);

Basically put the registerNestedAdapters method lets users to allocate a single typeId and use it for a nested type registry which can be used for registering multiple types with a single id. The nested type registry has similar characteristics as the global type registry like 256 typeId space for each nested registry, typeIds should be unique and should not be changed after being written to the disk.

Please make this possible, we are struggling!

The feature is ready, but there's some issues with web builds needs to be fixed. I will take a look when I have some free time, but can't promise any ETA.

The feature is ready, but there's some issues with web builds needs to be fixed. I will take a look when I have some free time, but can't promise any ETA.

I will wait for it!
In our case, it takes so much effort to convert our super (multimodule) app to any other db option. We are dependent on Hive. All we can do is increase the typeId limit. I tried to get multiple instances from hive using HiveImpl() low-level API but it doesn't work. (says "Did you forget to use openBox)

+1, nested registries would still be a huge improvement


pipenv version not updated

Hi,
Upgraded to latest pipenv but pipenv --version shows the same old version

I am using Manjaro Linux.

might have to upgrade it the same way you installed it. only so much we can do here.


use native ResizeObserver when available

Hi there - great library, thank you!
Heads-up that there might be a ResizeObserver coming in spec eventually. Would be great if the library would use the native implementation when available.
See:

https://developers.google.com/web/updates/2016/10/resizeobserver
https://wicg.github.io/ResizeObserver/
https://github.com/WICG/ResizeObserver/issues/3

thanks!

Yeah, but I guess it will take ages until we have it available.

true, looks like it'll just be chrome for a while


CrowdFlower KeyError

Hi guys,
When following the instructions and generating the unified dataset the script throws a KeyError for 'sentiment' in CrowdFlower.

CrowdFlower became FigureEight, which became Appen. It appears at some point along the way the URL https://www.crowdflower.com/wp-content/uploads/2016/07/text_emotion.csv broke.

I see, thanks for the fast reply!


Write null byte when indexing numeric dimensions with Hadoop

I noticed a couple of comments that hadn't been addressed in the Hadoop Indexing project regarding serializing and deserializing null numeric values, so I figured I would try to tackle it. I'm not super familiar with the internals of Druid, so let me know if I need to change code elsewhere.
Also, I ran the existing tests in the Hadoop Indexing project with -Ddruid.generic.useDefaultValueForNull=false, and they still passed. Let me know if I need to add additional ones!

Thanks for taking a look at this!
I added a test to InputRowSerdeTest that just makes sure the default value or null byte are written in the expected positions in the serialized array.

This has two approvals -- merging it.


rebuild freelist when opening with FreelistSync after NoFreelistSync

Writes pgidNoFreelist to the meta freelist page to detect when freelists
haven't been synced down.
Fixes #5

/cc @jpbetz

lgtm


[4.2][SE-0206] Update CHANGELOG.md

Describe hashing improvements scheduled for release in 4.2.
(cherry picked from commit 1de9c4b6f6cc34767ef67073c7f5bfbc512275bd)

@swift-ci please test

@swift-ci please test

Build failed
Swift Test Linux Platform
Git Sha - 38dd0ed98a1f63a02df89f86ce2d550e883fabb5

Build failed
Swift Test OS X Platform
Git Sha - 38dd0ed98a1f63a02df89f86ce2d550e883fabb5


Fix LeakyReLU return dtype

LeakyReLU returns a tensor with float64 dtype.

The solution is to not cast the alpha to float32.
Furthermore I tighten the test_utils.layer_test. It is now
required that the layer's output dtype is equal to the input dtype.

This won't work for some layers, because by design they change their input type. Specifically, the Embedding layer.

I added a new parameter expected_output_dtype to test_layer, which is as default the same as the input dtype. For the Embedding Layer the expected_output_dtype  is set to K.floatX().
Can you rerun the tests? It seems they failed due to a wired raise condition during creating ~/.keras/backend.


reanimated-2.9.1 required for android and 0.69.5

Hello Doug, I don't see an issue template, so please let me know if you would prefer a better format?
With the latest react-native-tvos 0.69.5-x, I've noticed that Apple TV will only build with react-native-reanimated 2.8.0 or lower.  But Android will only run with react-native-reanimated 2.9.1 and higher.
When setting react-native-reanimated to 2.9.1 in the example, the app shows a RCT fatal crash, with a very generic "UNSUPPORTED".
I've spent a few days on this, and have not been able to understand where that UNSUPPORTED error is coming from. Would you have any ideas on debugging that?
thank you
Ash

It is happening because of a crash very early in the Reanimated setup. The real cause seems to be that somehow Reanimated thinks it should be running with Hermes, and Hermes does not exist on tvOS yet. (I'm working on that now.)
I seem to recall that I got Android working with 2.8.0, but I'll check again.
I'll have another look and update the repo with my best recommendations for using RNTV 0.69.5-x.

Thank you for the reply Doug, that helps; I will try and see if I can solve that problem here with a patch

hi @douglowder - is there an update to this issue? I need to figure out a solution. Thanks!

No update yet... Once we finish work on 0.71 for TV (which will include Hermes for tvOS) we will come back to this issue.
FYI @yusufyildirim

The fix looks good! I added others to the review. Assuming no issues with the fix, we will get this merged and released in 0.69.6-2

Merged a PR that brings in the fix as a patch -- closing.

Thank you to all involved in fixing this!


smarty won't conda install in py35

@jchodera - I just attempted to conda install smarty in py35 and I get an error that it is python3.5 is "in conflict" with smarty.

Looks like it explicitly isn't being build on py3 https://github.com/omnia-md/conda-recipes/blob/master/smarty/meta.yaml#L12

@jchodera - any comments on why you set it up this way? Presumably we should adjust it not to skip py3?

I suspect that's left over from when your students were checking in non-python-3 compliant code and we needed to cut a release.
I believe I fixed that and python 3.x tests are passing now. Can you submit a PR to remove the skip directive?

Done in #653


[11.0.x] ISPN-12490 CounterManager in HR docs

Backport for https://issues.redhat.com/browse/ISPN-12490

integrated! thanks @oraNod


Weather intensity and auroras not rendering when Stellar Sky is installed

Mod Version: 1.10.2 - <IP_ADDRESS>
Forge Version: <IP_ADDRESS>9
Short version: Weather intensity, sandstorms, and auroras don't work with Stellar Sky installed. They work fine when only Stellar API is installed.
Long version: I noticed this while testing a modpack and thought at first that auroras and sandstorms were uncommon and the variation in weather intensity weren't noticeable. Looked at the wiki and found out that I could use /ds status aurora to see if I should be seeing one. Made a new profile with just Dynamic Surroundings tested everything, added Stellar Sky and they stopped working. Tested again with just Stellar API and everything worked fine.

@OtterofDeath Can you post a link to your client log after you have loaded your world?

@OtterofDeath @Abastro It looks like Dynamic Surroundings hooks the weather renderer correctly during world load.  It appears that when Stellar Sky replaces the world provider my hook gets stomped.  Continuing to dig.

@OtterofDeath Check out the latest version of StellarSky (v<IP_ADDRESS>.9).  Abastro made a fix.  Please close this issue out once you had a chance to verify.  Thanks!

Looks like it is working perfectly. Thanks @OreCruncher and @Abastro


[KTO] model init when args are given

fix model init when args are given

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


[Feature Request]: Command Palette : line number shortcut allow relative traversal

Ran a search on issues and didn't see anything titled similar to what I was thinking of.
When using the palette CTRL + P and then the line number jump symbol : if Im on line 500 but i want to go to line 505 the feature i'd like to see is typing something into the line jump pallete akin to: :+5 to go 5 lines deeper into the code. a relative jump instead of being forced to hardcode the number i want to traverse to :505 depending on code lines this is less keystrokes and a similar mental model for vim users too who may use relative line number in VSCode and may want to switch off between vim mode and just using the palette

#65539