whereLike does not work with the MySQL utf8mb4 character set

Environment
Knex version: 1.0.7
Database + version: MariaDB 10.5.15
OS: Debian GNU/Linux 11
Bug

Expected behavior: whereLike should work on tables using the utf8mb4 charset
Actual behavior: it does not work on the tables because it forces utf8_bin collation

Error message:

Error: select `content` from `acb_books` where `id` = 1 and `type` = 'membership' and `content` like '1:%' COLLATE utf8_bin - COLLATION 'utf8_bin' is not valid for CHARACTER SET 'utf8mb4'
    at Packet.asError (.../node_modules/mysql2/lib/packets/packet.js:728:17)
    at Query.execute (.../node_modules/mysql2/lib/commands/command.js:29:26)
    at Connection.handlePacket (.../node_modules/mysql2/lib/connection.js:456:32)
    at PacketParser.onPacket (.../node_modules/mysql2/lib/connection.js:85:12)
    at PacketParser.executeStart (.../node_modules/mysql2/lib/packet_parser.js:75:16)
    at Socket.<anonymous> (.../node_modules/mysql2/lib/connection.js:92:25)
    at Socket.emit (node:events:520:28)
    at addChunk (node:internal/streams/readable:324:12)
    at readableAddChunk (node:internal/streams/readable:297:9)
    at Socket.Readable.push (node:internal/streams/readable:234:10) {
  code: 'ER_COLLATION_CHARSET_MISMATCH',
  errno: 1253,
  sqlState: '42000',
  sqlMessage: "COLLATION 'utf8_bin' is not valid for CHARACTER SET 'utf8mb4'",
  sql: "select `content` from `acb_books` where `id` = 1 and `type` = 'membership' and `content` like '1:%' COLLATE utf8_bin"
}

The table was created manually using:
CREATE TABLE acb_books (id INTEGER, type VARCHAR(30), content TEXT, hidden TEXT);

The default charset for the server is utf8mb4. Here is my select call:
knex
  .select('content')
  .from('acb_books')
  .where('id', id)
  .where('type', 'membership')
  .whereLike('content', '1:%')

There seems to be no option to change the collation since it is hardcoded in https://github.com/knex/knex/blob/master/lib/dialects/mysql/query/mysql-querycompiler.js#L163. Using whereILike instead of whereLike fixes the problem in my case, but will cause problems in other applications where the search must be case sensitive.

What about this:
whereLike(statement, collation = 'utf8_bin') {
    return `${this._columnClause(statement)} ${this._not(
      statement,
      'like '
    )}${this._valueClause(statement)} COLLATE ${collation}`;
  }

?

Why not make the default utf8mb4 as it is, I believe, the MySQL default as well?
The best would be to detect it automatically, but I guess this would not be easy.

Any news ? I have already this error


Images not Loading

The images in the "Our Global Campus Category" is not loading via the hosted Github Link(https://paulkendrick2126.github.io/Redesigned-Uni-Website/), but when I view directly from my IDE via live server in my local browser it opens just fine.

Hello,
I would love to contribute to this issue

Hello, I would love to contribute to this issue

Hi Zablon, thanks for responding. I'm new to Github in fact I'm a beginner programmer so pardon me.
So how do we go about it, first off can I ask if you understand the issue and have you checked the code and viewed it?

Yes, I have checked your code, I assume you're trying to build something similar to a certain college site, please correct me if I am wrong.
your style.css file , background-image:url() seem to be missing opening and closing mark
background-image: url('banner.jpg')
If not please expound more on how the image is not displaying, where in particular are you trying to render the image, kindly

Yeah, you're right. Just a Static Website. Oh my, thanks a lot. I've corrected it, thank you.
OK, I'd like you to open the link(https://paulkendrick2126.github.io/Redesigned-Uni-Website/). I have attached media files for you to understand better. The images in the "our global campus." section fail to render. I used the console dev tools to see what went wrong and realized the files ( London, Washington and New York) somehow are not rendered by the browser, but other images are.

Please let me know should you want any clarity, information, file or anything. Thank you.

Hi, I was able to solve it, thanks to SO. I removed the '/' at the beginning of the src  .  Apparently, GitHub is pretty sensitive.
Thanks a lot for reaching out and working with me. Do you have any social media for me to follow you on ?

Glad to hear that you were able to solve it, I checked the link you shared
and I am impressed the site looks amazing with all the animation and it's
responsive to smaller screens.
Good Work PaulYou can always get in touch in case you face another issue
or if you need clarity on certain topics.
You can follow me on GitHub check some of my latest work or LinkedIn at
https://www.linkedin.com/in/zablon-oigo-ba4268234/
Have a great day
On Fri, 3 Nov 2023 at 20:13, Paul Adeosun @.***> wrote:

Hi, I was able to solve it, thanks to SO. I removed the '/' at the
beginning of the src . Apparently, GitHub is pretty sensitive.
Thanks a lot for reaching out and working with me. Do you have any social
media for me to follow you on ?
—
Reply to this email directly, view it on GitHub
https://github.com/Paulkendrick2126/Redesigned-Uni-Website/issues/1#issuecomment-1792831076,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BCJLR3WVCCMNFVIBAXEFIW3YCUQ2FAVCNFSM6AAAAAA63Z4XUOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOJSHAZTCMBXGY
.
You are receiving this because you commented.Message ID:
@.***>


Color the product states green or red to make what's left clearer

Color the product states green or red to make what's left clearer
Turn the states green or red depending on if they contain:

red: "to be completed" or "to be uploaded" or "to be checked"
green: all other states

@PrajwalM2212 unassigning you, unless you still have an uncommited branch ;)

I would like to work on this.
Would creating two sections be better or just coloring the text would do the job?

I would like to work on this.
Would creating two sections be better or just coloring the text would do the job?

I would like to work on this.
@teolemon Would creating two sections be better or just coloring the text would do the job?

I think creating two sections would be better.

I would like to work on this.
@teolemon Would creating two sections be better or just coloring the text would do the job?

I think creating two sections would be better.

Do we have a mockup design for this ?

I would like to work on this.
@teolemon Would creating two sections be better or just coloring the text would do the job?

I think creating two sections would be better.

Do we have a mockup design for this?

Do we have a mockup design for this ?

I would like to work on this.
@teolemon Would creating two sections be better or just coloring the text would do the job?

I think creating two sections would be better.

Do we have a mockup design for this?


visual studio code for mac 1.46 crash at startup

Cannot start Visual studio code any more, it crash when I try to open it, I've tryed to uninstall and reinstall but the problem remain, even restarting the system. Visual studio code version is 1.46.1  was created 3 Jun 2020. and  OS is Catalina 10.15.5, I've also deleted .vscode and Code folder before reinstalling the product.
<EMAIL_ADDRESS>

Did you try disabling all the extensions and then running VSCode. Also https://github.com/microsoft/vscode/blob/master/CONTRIBUTING.md

I cannot disable the extensions because i cannot open visual studio code. When I open the application from the icon nothing happen. Only one time I've seen the screen that show the message "Code quit unexpectely" Process Electron [1056] Path: /Applications/Vsula Studio Code.app/Contents/MacOS/Electron Identifier: com.microsoft.VSCode Version: 1.46.0 Code Type: X86.0 (Native) Parent Process: ??? [1] Responsible: Electron [1056] User ID: 501

this is the site where I've downloaded the code: https://code.visualstudio.com/download

old version of visual studio code (1.45) works

From the terminal run the following to start without extension
code --disable-extensions

same result, nothing happen:
Marias-MBP-2:Contents mbaldass$ ./Resources/app/bin/code --disable-extensions
Marias-MBP-2:Contents mbaldass$ pwd
/Applications/Visual Studio Code.app/Contents

@mbaldasshcl can you provide the full console report from https://github.com/microsoft/vscode/issues/100532#issuecomment-646493067, you can follow the instructions from here https://github.com/microsoft/vscode/wiki/Native-Crash-Issues#macos

Process:               Code Helper (GPU) [9285]
Path:                  /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (GPU).app/Contents/MacOS/Code Helper (GPU)
Identifier:            Code Helper (GPU)
Version:               0
Code Type:             X86-64 (Native)
Parent Process:        Electron [9284]
Responsible:           Electron [9284]
User ID:               501
Date/Time:             2020-06-23 10:56:29.514 +0200
OS Version:            Mac OS X 10.15.5 (19F101)
Report Version:        12
Anonymous UUID:        16805AFC-9A8E-9F62-78CF-F7DE20C22C3F
Time Awake Since Boot: 4700 seconds
System Integrity Protection: enabled
Crashed Thread:        0
Exception Type:        EXC_CRASH (SIGABRT)
Exception Codes:       0x0000000000000000, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY
Termination Reason:    DYLD, [0x5] Code Signature
Application Specific Information:
dyld: launch, loading dependent libraries
Dyld Error Message:
Library not loaded: /usr/local/lib/libwep
Referenced from: /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (GPU).app/Contents/MacOS/Code Helper (GPU)
Reason: no suitable image found.  Did find:
/usr/local/lib/libwep: code signature in (/usr/local/lib/libwep) not valid for use in process using Library Validation: mapped file has no cdhash, completely unsigned? Code has to be at least ad-hoc signed.
/usr/local/lib/libwep: stat() failed with errno=1
Binary Images:
0x10fd1a000 -        0x10fd53fe7 +com.github.Electron.helper (0) <034AE9CC-344B-350D-A291-FD6F2F600FAD> /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (GPU).app/Contents/MacOS/Code Helper (GPU)
0x116296000 -        0x116327eff  dyld (750.5)  /usr/lib/dyld
0x11639b000 -        0x11c934fbf +com.github.Electron.framework (7.3.1) <4B5879C5-F2C3-3635-8074-283BFE0F6BC7> /Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework
0x7fff31222000 -     0x7fff316a1ffb  com.apple.CoreFoundation (6.9 - 1676.105) <6AF8B3CC-BC3F-3869-B9FB-1D881422364E> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x7fff35f90000 -     0x7fff36047ff7  com.apple.MediaPlayer (1.0 - 1.0) <0CE26562-5D87-31D2-A558-641E0822BC6F> /System/Library/Frameworks/MediaPlayer.framework/Versions/A/MediaPlayer
0x7fff68286000 -     0x7fff68287fff  libSystem.B.dylib (1281.100.1)  /usr/lib/libSystem.B.dylib
0x7fff6a207000 -     0x7fff6a24bff7  libsandbox.1.dylib (1217.120.7) <728BC15F-9A6C-3634-9427-60C01CB5A5D6> /usr/lib/libsandbox.1.dylib

Thanks that makes the issue clearer, we have restricted certain entitlements for the different helper executables and in this case for GPU helper it cannot load non-validated libraries. Not sure why webp library is trying to be loaded into the gpu process

Does this issue happen when opening any workspace ?
Can you try our insiders version https://code.visualstudio.com/insiders/
What does otool -L /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (GPU).app/Contents/MacOS/Code Helper (GPU) report ?

Marias-MBP-2:~ mbaldass$  otool -L /Applications/Visual Studio Code.app/Contents/Frameworks/Code
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
Marias-MBP-2:~ mbaldass$  otool -L /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
Marias-MBP-2:~ mbaldass$

now I will try with your insiders version

also insider version crash:
Process:               Code - Insiders Helper (GPU) [1576]
Path:                  /Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Code - Insiders Helper (GPU).app/Contents/MacOS/Code - Insiders Helper (GPU)
Identifier:            Code - Insiders Helper (GPU)
Version:               0
Code Type:             X86-64 (Native)
Parent Process:        Electron [1573]
Responsible:           Electron [1573]
User ID:               501
Date/Time:             2020-06-24 09:14:25.986 +0200
OS Version:            Mac OS X 10.15.5 (19F101)
Report Version:        12
Anonymous UUID:        16805AFC-9A8E-9F62-78CF-F7DE20C22C3F
Time Awake Since Boot: 700 seconds
System Integrity Protection: enabled
Crashed Thread:        0
Exception Type:        EXC_CRASH (SIGABRT)
Exception Codes:       0x0000000000000000, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY
Termination Reason:    DYLD, [0x5] Code Signature
Application Specific Information:
dyld: launch, loading dependent libraries
Dyld Error Message:
Library not loaded: /usr/local/lib/libwep
Referenced from: /Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Code - Insiders Helper (GPU).app/Contents/MacOS/Code - Insiders Helper (GPU)
Reason: no suitable image found.  Did find:
/usr/local/lib/libwep: code signature in (/usr/local/lib/libwep) not valid for use in process using Library Validation: mapped file has no cdhash, completely unsigned? Code has to be at least ad-hoc signed.
/usr/local/lib/libwep: stat() failed with errno=1
Binary Images:
0x10d0fb000 -        0x10d134fef +com.github.Electron.helper (0) <59C3FC83-C3DF-365B-AF17-2F522B2ADFC7> /Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Code - Insiders Helper (GPU).app/Contents/MacOS/Code - Insiders Helper (GPU)
0x10d14c000 -        0x113643f77 +com.github.Electron.framework (8.3.3) <99C86A44-DC48-3233-B8C2-3C5A2676B510> /Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework
0x11bb57000 -        0x11bbe8eff  dyld (750.5)  /usr/lib/dyld
0x7fff321ea000 -     0x7fff32669ffb  com.apple.CoreFoundation (6.9 - 1676.105) <6AF8B3CC-BC3F-3869-B9FB-1D881422364E> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x7fff36f58000 -     0x7fff3700fff7  com.apple.MediaPlayer (1.0 - 1.0) <0CE26562-5D87-31D2-A558-641E0822BC6F> /System/Library/Frameworks/MediaPlayer.framework/Versions/A/MediaPlayer
0x7fff6924e000 -     0x7fff6924ffff  libSystem.B.dylib (1281.100.1)  /usr/lib/libSystem.B.dylib
0x7fff6b1cf000 -     0x7fff6b213ff7  libsandbox.1.dylib (1217.120.7) <728BC15F-9A6C-3634-9427-60C01CB5A5D6> /usr/lib/libsandbox.1.dylib

and again I get:
Marias-MBP-2:~ mbaldass$  otool -L /Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
Marias-MBP-2:~ mbaldass$  otool -L /Applications/Visual Studio Code.app/Contents/Frameworks/Code
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

Thanks!
For running otool, the path to the helper executable is incorrect, the spaces must be escaped.
otool -L /Applications/Visual\ Studio\ Code.app/Contents/Frameworks/Code\ Helper\ \(GPU\).app/Contents/MacOS/Code\ Helper\ \(GPU\)

If I install april version 1.45 it works well, but every morning when I start the computer after shutdown, I find version 1.46 has covered version 1.45 and it crash of course. Is there a way to avoid automatic update so that until you have found a fix for this problem I can use 1.45 without reinstalling it every day ?

otool -L /Applications/Visual\ Studio\ Code.app/Contents/Frameworks/Code\ Helper\ (GPU).app/Contents/MacOS/Code\ Helper\ (GPU)
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

You can set "update.mode": "none" in your settings.json to disable updates.
The path is still incorrect, missing escape on \(
otool -L /Applications/Visual\ Studio\ Code\ -\ Insiders.app/Contents/Frameworks/Code\ -\ Insiders\ Helper\ \(GPU\).app/Contents/MacOS/Code\ -\ Insiders\ Helper\ \(GPU\)

otool -L /Applications/Visual\ Studio\ Code\ -\ Insiders.app/Contents/Frameworks/Code\ -\ Insiders\ Helper\ (GPU).app/Contents/MacOS/Code\ -\ Insiders\ Helper\ (GPU)
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

otool -L /Applications/Visual\ Studio\ Code\ -\ Insiders.app/Contents/Frameworks/Code\ -\ Insiders\ Helper\ (GPU).app/Contents/MacOS/Code\ -\ Insiders\ Helper\ (GPU)
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

the escape on the command line is correct, it get lost when I past it here

Do you have xcode installed ?

no

Okay that explains the error, you need to install the xcode command line tools for it to work xcode-select --install . Try the otool command after installing it. Thanks!

I get message " Can't install software because it is not currently available from Software Update server"

but you are no able to reproduce this issue on your mac ?

Nope I can't, /usr/local/lib/libwep is not something that should be loaded by the GPU helper executable.

/Applications/Visual Studio Code - Insiders.app/Contents/Frameworks/Code - Insiders Helper (GPU).app/Contents/MacOS/Code - Insiders Helper (GPU):
/System/Library/Frameworks/MediaPlayer.framework/Versions/A/MediaPlayer (compatibility version 1.0.0, current version 1.0.0, weak)
@rpath/Electron Framework.framework/Electron Framework (compatibility version 0.0.0, current version 0.0.0)
/usr/lib/libsandbox.1.dylib (compatibility version 1.0.0, current version 1.0.0)
/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1252.250.1)
/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation (compatibility version 150.0.0, current version 1575.17.0)

I've installed xcode. above the output of the command you asked

thanks for the details!
TIL that libwep is a library injected by websense in all running processes. Do you have Websense or Triton AP-Endpoint ? You will have to exclude vscode from being scanned by them otherwise this crash will happen. VSCode doesn't allow injecting arbitrary into certain processes as a part of macOS hardened runtime.

Closing as out of scope.

I have the same issue. When I open Vscode and connect to my remote windows 10 machine, after a few random minutes, my whole macOS crashes ad my system restarts. The vscode make the whole system to restart!!

VScode version: October 2020 (version 1.51)

This is still a real issue even for later versions of VSCode.

Any of you guys using mongoose. I had this one time, today got the same both times I've used mongoose, first it slowed my computer intellisense stopped working and then it crashed.


tiger-data cannot connect to mediaflux

As of 8:45 am Thursday August 1, neither tigerdata-qa.princeton.edu or tigerdata-prod.princeton.edu can connect to their mediaflux instances.
Chuck and Robert have been contacted via slack to ask if something changed.

No honeybadger errors
No errors in the rails log
td-meta1.princeton.edu:8443/aterm appears to be working

The alternate was turned on in prod.  We do not really have access to production mediaflux.  Once I went to https://tigerdata-prod.princeton.edu/features and cleared it the bubble turned green


Can't reach core nodes after api node restarts.

Core node does successfully connect to root namespace, but won't work until full reconnect (node restart)

Issue in socket.io ignoring previous event listeners after reconnect. Overhauling blitz-query right now.


Downport rtti_get_classes_impl_intf

Fix this dump on S/4 HANA 2022 SP02

uhh so much you have to take care about with these "ABAP Cloud" and "Standard ABAP" compatible snippets, thank you!


can I set multiple tooltip for different chart ( eg .line , bar)

i mean in the same echart instance

问题简述 (One-line summary)
版本及环境 (Version & Environment)

ECharts 版本 (ECharts version):
浏览器类型和版本 (Browser version):
操作系统类型和版本 (OS Version):

重现步骤 (Steps to reproduce)

期望结果 (Expected behaviour)
可能哪里有问题 (What went wrong)
ECharts配置项 (ECharts option)

option = {

}

其他信息 (Other comments)

It is able to give different settings for tooltip in different chart,
option = {
    tooltip: { ... } // setting in echartInstance level
    series: [
        {type: 'line', tooltip: { ... }},  // chart 1
        {type: 'pie', tooltip: { ... }},   // chart 2
        ...
    ]
}

But only one tooltip content can be shown at the same time.

@100pah The same quesiton, but your answer doesn't work.


Windows Subsystem for Linux support

It would be awesome if executing clip.exe was used as an additional fallback on Linux. That way, in WSL environments where xclip and xsel are not installed, text could be copied to the Windows clipboard. Specifically, I'm trying to use gopass (which uses this library) under WSL.
In cases where someone is running an X server on WSL, the situation gets complicated unfortunately.

not pretty but this is just an one minute hack
	var clipPath string
	if _, err := os.Stat("/c/Windows/system32/clip.exe"); !os.IsNotExist(err) {
		clipPath = "/c/Windows/system32/clip.exe"
	} else if _, err := os.Stat("/mnt/c/Windows/system32/clip.exe"); !os.IsNotExist(err) {
		clipPath = "/mnt/c/Windows/system32/clip.exe"
	} else

	p := fmt.Sprintf("Bearer %s\n", re.IdToken)
	if clipPath != "" {
		sh.Run("bash", "-c", fmt.Sprintf("echo '%s' | %s", p, clipPath))
	}
```

I'm tempted to take a stab at this; hub also uses this library.
@atotto Would a PR that looks for clip.exe on Linux be accepted (assuming code quality is OK etc, of course)?

This would also solve https://github.com/gopasspw/gopass/issues/1664 on our side 👍

This would also solve https://github.com/gopasspw/gopass/issues/1664 on our side 👍

This is what I've done in the past to get around this: https://github.com/e-zk/cpass/blob/master/main.go#L53
Checking the version string in /proc for "microsoft-standard"^1 may not be the most robust solution for checking whether the distro is WSL.

This is what I've done in the past to get around this: https://github.com/e-zk/cpass/blob/master/main.go#L53
Checking the version string in /proc for "microsoft-standard"^1 may not be the most robust solution for checking whether the distro is WSL.

This works better with WSL
https://github.com/golang-design/clipboard


Integer stream parsing

I have a long sequence of bytes encoding multiple messages, each message is encoded as its length (using leb128) and then the message body itself.
With the current API, I can not simply pass a too large array to the library to parse the first bytes as length, so I do it manually:
# returns a tuple of the message bytes and the number of bytes consumed (including the leb128 encoding and the message body)
def decode_length_and_message(bytes: bytes) -> tuple[bytes, int]:
    length_bytes_num = 1
    while bytes[length_bytes_num - 1] >= 0x80:
        if length_bytes_num >= len(bytes):
            raise Exception("length bytes num is too large")
        length_bytes_num += 1
    if length_bytes_num > 10:
        raise Exception("length bytes num is too large")

    msg_len = leb128.u.decode(bytes[:length_bytes_num])
    message_bytes = bytes[length_bytes_num : length_bytes_num + msg_len]

    return message_bytes, length_bytes_num + msg_len

It would be great if the library could provide a function the decode integer without consuming the whole buffer.
Such function will highly simplify my code. Possible implementation:
def decode_leb128(bytes: bytes) -> tuple[int, int]:
    length_bytes_num = 1
    while bytes[length_bytes_num - 1] >= 0x80:
        if length_bytes_num >= len(bytes):
            raise Exception("length bytes num is too large")
        length_bytes_num += 1
    if length_bytes_num > 10:
        raise Exception("length bytes num is too large")

    val = leb128.u.decode(bytes[:length_bytes_num])
    return val, length_bytes_num

I think this is fairly common use case, what do you think?
Thanks for the support! This library is awesome and useful :)

Stream parsing is already supported. You can use the following API:
leb128.u.decode_reader(stream)

thanks!

Is it possible to throw a unique exception in case the stream is empty? currently ord(r.read(1)) fails

I can't do that because I don't know what error will occur when the stream is empty. You should handle this exception yourself since you are the owner of the stream.

The strean itself doesnt raise an exeption when its empty, rather its returns an empty byte stream, and the convertion in the library will fail

I just released v1.0.8. When the reader returns an empty string it will now trigger an EOF error, which should help you.
https://github.com/mohanson/leb128/commit/d53bf789601d12ad9bf6c3dee9bda1c4cb38bff5

Thanks! I appreciate the help :)


When injecting,

This error comes up

Injector: Extreme Injector V3

Getting the same problem,
Steam version.


Google Plus Post bride returns entries without title and content

The bridge works and returns links, but no content and no titel for the entries.

Thanks for reporting @dsp76
Content and Title are commented out. Not sure why though. See https://github.com/RSS-Bridge/rss-bridge/blob/master/bridges/GooglePlusPostBridge.php#L46-L49
I'll take a look later today, maybe we just have to uncomment it.

Fixed via https://github.com/RSS-Bridge/rss-bridge/commit/3d984e876249b31ef011cc19bf9d144ea488152a
Please let me know if this works for you. Pictures are included twice because the original content contains multiple versions of the same image. Maybe we should strip 'img' tags and use attach them via enclosures?


Show features on map [In Progress]

Based on the feedback, I added features on the map.

Show error/warning message :


Exercise #6 Game of Life logic

Hi there,
I've been stuck on Level 4 for some time, so I decided to reach out for help.
generateRule() is fine. But I am not sure how I should solve gameOfLife(...). My overall idea was to start with an IntStream of length n, convert it to a Stream of List - by executing list = rule.apply(list) multiple times, and finally convert it to a Stream of String.
To generate the initial IntStream, I used .range(...). But for the latter parts, I'm really not sure how to approach the problem. I tried .iterate(...), but it doesn't allow me to perform assignment in the lambda function. I tried creating a new IntStream per generate then using .reduce(...), but it doesn't seem to work either.
Would appreciate some help/hints on how I should tackle Level 4.
Thanks in advance!

I use Stream.iterate(list, rule).limit(n).map(.....) . Within the map, I convert each number in the list to "." or "x".

But for the latter parts, I'm really not sure how to approach the problem. I tried .iterate(...), but it doesn't allow me to perform assignment in the lambda function.

Can I check what parameters are you passing in to iterate? You should be able to pass your rule to the second argument of iterate.

I tried creating a new IntStream per generate then using .reduce(...), but it doesn't seem to work either.

I am guessing you can't use reduce because reduce of IntStream takes in BinaryOperator but your rule is a UnaryOperator.

Solved it, thank you @kohlindy and @danqiye1 :)

Hi @kohlindy @axmszr @wjiayis. I am having issues with this implementation. How do you map the List into Strings. Thanks!

Hi @mersoncheong! After getting a Stream of Lists containing "x"s and "."s, I turned each of these Lists into a Stream of the elements (so, overall it's a Stream of Streams of Strings). Then, each of these inner Streams can be reduced into Strings. Hope that helps!

Hi @mersoncheong! After getting a Stream of Lists containing "x"s and "."s, I turned each of these Lists into a Stream of the elements (so, overall it's a Stream of Streams of Strings). Then, each of these inner Streams can be reduced into Strings. Hope that helps!

Thank you that was helpful!


Update to Java 21

Description
Has some nice language features

As an example for what will be possible: A common problem in the codebase is the null return value. When null is returned, it is easy to forget, which would result in a crash. Therefore, in most cases Optional is returned.
Optional is a pain to work with and it might take forever to be usable (https://mail.openjdk.org/pipermail/amber-spec-experts/2024-January/003976.html). In many parts of the code, you will therefore find a .orElse(null).
With Java 21 we can write a better Optional that is similar to what rust provides (Option<T>).
Here is the proof of concept implementation:

`Option.java`
import java.util.Iterator;
import java.util.function.Function;
import java.util.stream.Stream;

public sealed interface Option<T> extends Iterable<T> permits Some, None {
  static <T> Option<T> ofNullable(T value) {
      return value == null ? new None<>() : new Some<>(value);
  }

  default T unwrap() {
      return switch (this) {
          case Some<T> (var value) -> value;
          case None<T> ignored -> throw new IllegalStateException("Expected Some value, but got None.");
      };
  }

  default boolean isSome() {
      return this instanceof Some;
  }

  default <U> Option<U> map(Function<T, U> function) {
      return switch (this) {
          case Some<T>(var value) -> new Some<>(function.apply(value));
          case None<T> ignored -> new None<>();
      };
  }

  /**
   * Returns the value if it is present or null if it is not.
   *
   * @return the value or null
   */
  default T nullable() {
      return switch (this) {
          case Some<T>(var value) -> value;
          case None<T> ignored -> null;
      };
  }

  default Stream<T> stream() {
      return switch (this) {
          case Some<T>(var value) -> Stream.of(value);
          case None<T> ignored -> Stream.empty();
      };
  }

  @Override
  default Iterator<T> iterator() {
      return stream().iterator();
  }
}

`Some.java`
public record Some<T>(T value) implements Option<T> {
}

`None.java`
public record None<T>() implements Option<T> {
}


Open source rule server as an own project

I wonder about the status of this project given EOL from modsecurity (July 2024). I wonder if we could open source the rule server to be used with other projects like coraza-proxy-wasm.
Ping @ns-sundar

Hi @jcchavezs , the rule server  and its associated repo are already open source, under the Apache license. Please feel free to take the code you need for Coraza.


Version 0.1.20 TEST program says invalid email or password (but they're correct)

Describe the bug
Running the test program in the SRC directory; I'm getting a "username / email" incorrect error. I've confirmed via my phone app that my email / password is correct.
To Reproduce
Steps to reproduce the behavior:

PIP install pyeconet
Copied test program from SRC into new file in IDLE
Saved and ran program
Entered valid email / password
Error below (invalid credentials)

Expected behavior
I expected the username / password to work
Screenshots
DEBUG:pyeconet.api:{'options': {'message': 'Incorrect Email id or Password', 'success': False}, 'user_id': '<USER_ID>', 'user_token': '<AUTH_TOKEN>'}
Traceback (most recent call last):
  File "/usr/lib/python3.10/idlelib/run.py", line 578, in runcode
    exec(code, self.locals)
  File "/config/Nextcloud/Programming/Python/econet test.py", line 40, in <module>
    loop.run_until_complete(main())
  File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/config/Nextcloud/Programming/Python/econet test.py", line 17, in main
    api = await EcoNetApiInterface.login(email, password=password)
  File "/config/.local/lib/python3.10/site-packages/pyeconet/api.py", line 79, in login
    await this_class._authenticate({"email": email, "password": password})
  File "/config/.local/lib/python3.10/site-packages/pyeconet/api.py", line 244, in _authenticate
    raise InvalidCredentialsError(_json.get("options")["message"])
pyeconet.errors.InvalidCredentialsError: Incorrect Email id or Password

Additional context
I'm relatively new to python.
I'm running this on a Linux machine.

Please disregard. After another password reset round on the phone, the library is working now as expected.
Thank you!


NSubstitute Arg.Any not supported

ArguementMatcher.IsMatch supports Moq's It.Any.  It would be great if this also supported NSubstitute's Arg.Any.

Hello, thanks for the suggestion. This should be easy to add, so I will definitely consider this for a future version.


Fix Main.storyboard not opening in latest Xcode

fixes https://github.com/flutter/flutter/issues/93773
Please see #93773 for more information

Can I get some help on this please?

This PR only a changes a single example, we would need to change all the templates used to create new Flutter projects, a migration to update existing projects, and then run that migration on all the example apps checked into the repo.
It also changes far more than is necessary to work around the Xcode bug (even a malformed Storyboard shouldn't make the app SPOD, and certainly not one like this that isn't malformed and works correctly in Xcode 12.5).  A clean slate storyboard isn't a bad idea for the templates, but we would only want the minimum changed in the migration to minimize the risk of corrupting Storyboards that have been edited.
I'm going to close this and will open a more thorough fix.
Thanks for bringing this to our attention!


Compatibility with Poetry

Hi! I'm one of the reviewers of your JOSS submission openjournals/joss-reviews#5623.
I noticed that ethome-ml fails to install when using Poetry, a widely used and advanced Python package manager. I do not consider this as acceptance-blocking as the package can be installed successfully using PIP, but I thought you might want to know.
Steps to reproduce
OS: Ubuntu 22.04 (WSL)
$ poetry add ethome-ml
Using version ^0.6.0 for ethome-ml

Updating dependencies
Resolving dependencies... (5.3s)

Package operations: 74 installs, 1 update, 0 removals

  • Installing attrs (23.1.0)
  • Installing rpds-py (0.8.10)
  • Installing six (1.16.0)
  • Installing asttokens (2.2.1)
  • Installing executing (1.2.0)
  • Installing numpy (1.25.1)
  • Installing parso (0.8.3)
  • Installing platformdirs (3.8.1)
  • Installing ptyprocess (0.7.0)
  • Installing pure-eval (0.2.2)
  • Installing referencing (0.29.1)
  • Installing traitlets (5.9.0)
  • Installing wcwidth (0.2.6)
  • Installing backcall (0.2.0)
  • Installing decorator (5.1.1)
  • Installing jedi (0.18.2): Installing...
  • Installing joblib (1.3.1)
  • Installing jsonschema-specifications (2023.6.1)
  • Installing jupyter-core (5.3.1)
  • Installing llvmlite (0.34.0): Preparing...
  • Installing matplotlib-inline (0.1.6)
  • Installing pexpect (4.8.0)
  • Installing pickleshare (0.7.5): Pending...
  • Installing prompt-toolkit (3.0.39): Pending...
  • Installing llvmlite (0.34.0): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel

  running bdist_wheel
  /tmp/tmpp9_iampk/.venv/bin/python /tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py
  LLVM version... Traceback (most recent call last):
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 105, in main_posix
      out = subprocess.check_output([llvm_config, '--version'])
  • Installing joblib (1.3.1)
  • Installing jsonschema-specifications (2023.6.1)
  • Installing jupyter-core (5.3.1)
  • Installing llvmlite (0.34.0): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel

  running bdist_wheel
  /tmp/tmpp9_iampk/.venv/bin/python /tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py
  LLVM version... Traceback (most recent call last):
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 105, in main_posix
      out = subprocess.check_output([llvm_config, '--version'])
  • Installing jedi (0.18.2)
  • Installing joblib (1.3.1)
  • Installing jsonschema-specifications (2023.6.1)
  • Installing jupyter-core (5.3.1)
  • Installing llvmlite (0.34.0): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel

  running bdist_wheel
  /tmp/tmpp9_iampk/.venv/bin/python /tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py
  LLVM version... Traceback (most recent call last):
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 105, in main_posix
      out = subprocess.check_output([llvm_config, '--version'])
    File "/usr/lib/python3.10/subprocess.py", line 420, in check_output
      return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
    File "/usr/lib/python3.10/subprocess.py", line 501, in run
      with Popen(*popenargs, **kwargs) as process:
    File "/usr/lib/python3.10/subprocess.py", line 969, in __init__
      self._execute_child(args, executable, preexec_fn, close_fds,
    File "/usr/lib/python3.10/subprocess.py", line 1845, in _execute_child
      raise child_exception_type(errno_num, err_msg, err_filename)
  FileNotFoundError: [Errno 2] No such file or directory: 'llvm-config'

  During handling of the above exception, another exception occurred:

  Traceback (most recent call last):
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 191, in <module>
      main()
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 181, in main
      main_posix('linux', '.so')
    File "/tmp/tmpmpu1hn12/llvmlite-0.34.0/ffi/build.py", line 107, in main_posix
      raise RuntimeError("%s failed executing, please point LLVM_CONFIG "
  RuntimeError: llvm-config failed executing, please point LLVM_CONFIG to the path for llvm-config
  error: command '/tmp/tmpp9_iampk/.venv/bin/python' failed with exit code 1

  at ~/.local/share/pypoetry/venv/lib/python3.10/site-packages/poetry/installation/chef.py:147 in _prepare
      143│
      144│                 error = ChefBuildError("\n\n".join(message_parts))
      145│
      146│             if error is not None:
    → 147│                 raise error from None
      148│
      149│             return path
      150│
      151│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with llvmlite (0.34.0) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "llvmlite (==0.34.0)"'.

  • Installing matplotlib-inline (0.1.6)
  • Installing pexpect (4.8.0)
  • Installing pickleshare (0.7.5)
  • Installing prompt-toolkit (3.0.39)
  • Installing pygments (2.15.1)
  • Installing python-dateutil (2.8.2)
  • Installing pytz (2023.3)
  • Installing pyzmq (25.1.0)
  • Installing ruamel-yaml-clib (0.2.7)
  • Installing scipy (1.9.3)
  • Updating setuptools (67.8.0 -> 68.0.0)
  • Installing stack-data (0.6.2)
  • Installing threadpoolctl (3.1.0)
  • Installing tornado (6.3.2)
  • Installing tzdata (2023.3)

Hi @imcatta, thanks for bringing this to my attention. I will look into what's needed for poetry compatibility. I appreciate the feedback.


Wrong highlighting around 'a

Not sure what causing this.
/cc @MangelMaxime

look at updateRecords the prefix parameter has wrong color and the let! is also weird

Can you please provide a textual representation of your code?

The bug about prefix has been created by this fix: https://github.com/ionide/ionide-fsgrammar/pull/126

I have a fix ready for the bug about prefix
I am not able to repro the let! bug. I will wait for the textual representation of the code so I can copy/paste the whole block.

let inline updateRecords<'a> prefix chunkSize (webAccessF:Environment.AccessConfig -> Fable.Core.JS.Promise<'a []>) distinctF (config:Environment.AccessConfig) = promise {
    let! newRecords = webAccessF config
    if Array.isEmpty newRecords then
        return 0
    else
        let! oldRecords = getAllChunksForEnv<'a> prefix config
        let records =
            Array.append oldRecords newRecords
            |> Array.distinctBy distinctF

        do! saveInChunks<'a> prefix chunkSize config records
        return newRecords.Length - oldRecords.Length
}

smaller repro:
let inline updateRecords<'a> prefix = promise {
    let! newRecords = prefix
    return newRecords
}

I can confirm that the bug on prefix is fixed.
Before

After

However, I don't have problem with let! highlights I tried 10 themes to check and no problem even with current version of VSCode 1.36.0
Do you have the let! problem if you use your smaller repro? Do you have this problem, in an empty file?

This is a smaller repro from the first issue in that file:

let f  x y =
    promise {
        do! x

        let syncImages = new System.Collections.Generic.List<_>()

        do! x
        return ()
}

Thank you I can repro the bug for do! now. It's a problem with new I will take a look

It's already fixed in master branch of https://github.com/ionide/ionide-fsgrammar/

all fixed! even the let! issue. thanks!


Feature Request :)

Hi,
Would be cool to see some new events in tmijs library.
Like follow/subscriber events :)
Like same principle you already have:
client.on("follow", function (channel, userstate, message, self) {
// if somebody just followed the channel
});
Same with "subscribe" and "channel change".
"Notifies when a stream changes; e.g., stream goes online or offline, the stream title changes, or the game changes."
Got those from https://dev.twitch.tv/docs/api/webhooks-reference/.
Btw thank you for your work! Make life much easier with no need to setup IRC stuff :)

tmi.js is just for the IRC connection. The stuff in Webhooks is not IRC. tmi.js cannot handle your Webhooks or PubSub events. There's no follow, equivalent user/stream change, nor analytic events that come through IRC. Webhook requires an HTTP server (or some cloud function service) and PubSub is a separate connection from the IRC. These are out of scope for this library,
Check out twitch-pubsub-client for PubSub and maybe twitch-webhook for Webhook.


Hot Restart capability for ratelimit.

Enables Reuseport and signal handling to drain the grpc server.
This enables us to start two instances of ratelimit server and drain anyone gracefully when required.

PTAL @lyft/network-team


Post VM instance ID from the Agent as part of the "AgentCanSchedule" request

Implementing this work item will fix Azure throttling issues when OneFuzz iterates over scalesets in order to find matching Instance Id for a VM, based on a VM ID. Also implementing this removes need for caching Instance IDs in memory cache altogether.
When OneFuzz agent starts up it can get it's own Instance ID by performing following calculation:
Each VM in a scale set also gets a computer name assigned to it. This computer name is the hostname of the VM in the [Azure-provided DNS name resolution within the virtual network](https://learn.microsoft.com/en-us/azure/virtual-network/virtual-networks-name-resolution-for-vms-and-role-instances). This computer name is of the form "{computer-name-prefix}{base-36-instance-id}".

The {base-36-instance-id} is in [base 36](https://en.wikipedia.org/wiki/Base36) and is always six digits in length. If the base 36 representation of the number takes fewer than six digits, the {base-36-instance-id} is padded with zeros to make it six digits in length. For example, an instance with {computer-name-prefix} "nsgvmss" and instance ID 85 will have computer name "nsgvmss00002D".

source: https://learn.microsoft.com/en-us/azure/virtual-machine-scale-sets/virtual-machine-scale-sets-instance-ids
When calling AgentCanSchedule, agent includes instnace ID as part of the message - OneFuzz service saves Instance ID as part of the Node record in the Node Table.
Upgrade path:

When instance ID is needed to apply scale in protection (or to remove it) - first check the Node table for the instance id. If not there then it is older version of the node, and use current logic to iterate over the scaleset to find the instance id.
In about 8 days - it is safe to remove "current logic" i.e. caching and scaleset iteration to find the instance id, since all nodes will be upgraded by that time, and will be reporting instance IDs that will be persisted in Node table

AB#41893228

Sent a PR which implements this but including it as part of the AgentRegistration message instead, and the decoding of the computer name to instance ID happens in the server since it's a VMSS-specific thing, so I feel like the knowledge should be there instead of in the agent itself.


Tone.Loop with Tone.Draw stops when tab/window is blurred, Tone.Pattern continues playing

Hi, I'm building a drum machine, and I'm running into an issue when minimizing the window or changing tabs the audio just stops playing. I'm using Tone.Pattern on another feature and I don't have this issue. This tool serves as a practice tool for Bassists, it "needs" to be active while the player is checking other resources (like music score) in another tab.
How can I prevent a Loop from stopping when leaving the tab or minimizing the window?
Tone.Loop + Tone.Draw https://jsfiddle.net/zqcj5brg/ (tone@latest)
Tone.Pattern  https://jsfiddle.net/t04qkcyo/ (tone@latest)

Tone.Draw puts things into the draw loop with requestAnimationFrame, which won't work in a background tab. but this isn't a limitation of Tone.Loop.
You can schedule things in windows out of focus by removing Tone.Draw:
  new Tone.Loop((time) => {
    for(let j=0; j<arr.length; j++){
      synth.triggerAttackRelease("C4", "4n", time)
    }
  }, '4n').start(0);

Thank you @tambien!


PARQUET-2225:[C++][Parquet] Allow reading dense with RecordReader

Currently ReadRecords reads spaced by default. Some readers may need to read the values dense, and reading spaced is less efficient than reading dense. We need an option for reading dense.

Adding more clarification here.
The change proposed here is about the vector of values that is returned. Currently, we first come up with the location of the null values and then make a vector that has an empty space for the null values (reading spaced). When reading dense, we do not make space for the null values.
For example:
def_levels: [0, 1]
values: [10]
Reading spaced: [null, 10]
Reading dense: [10]
The change here is meaningful for nullable columns. The savings come when we have null values. The issue is that 1) it is inefficient to come up with the exact space of the nulls and move the values around to make space for null values and 2) Some readers may want to indeed read dense and so they have to move the null values out again.

In that case, I assume the caller does not care about the null values and will not be able to sync values of different columns (because they may have different null slots), am I right?

Yes, that is correct.

Is it better to add a new function to support this case?

I am open to suggestions regarding the API. I am inclined to pass this as a parameter when making the reader as suggested by @emkornfield.

Copying benchmark results here:
-------------------------------------------------------------
Benchmark                                Time
-------------------------------------------------------------
Optional BatchSize:1000/ReadDense:1    1006171 ns
Optional BatchSize:1000/ReadDense:0   13019233 ns

Copying the full benchmark result here for reference:
--------------------------------------------------------------------------------------------------------------------------
Benchmark                                                                Time             CPU   Iterations UserCounters...
--------------------------------------------------------------------------------------------------------------------------
ColumnReaderSkipInt32/Repetition:0/BatchSize:1000                   237521 ns       237769 ns         2951 bytes_per_second=20.0546G/s
ColumnReaderSkipInt32/Repetition:1/BatchSize:1000                  1617840 ns      1601169 ns          453 bytes_per_second=1.58552G/s
ColumnReaderSkipInt32/Repetition:2/BatchSize:1000                  2513241 ns      2499972 ns          279 bytes_per_second=1102.55M/s
ColumnReaderReadBatchInt32/Repetition:0/BatchSize:1000              249705 ns       249864 ns         2705 bytes_per_second=19.0839G/s
ColumnReaderReadBatchInt32/Repetition:1/BatchSize:1000             1604586 ns      1601909 ns          449 bytes_per_second=1.58478G/s
ColumnReaderReadBatchInt32/Repetition:2/BatchSize:1000             2597184 ns      2596807 ns          276 bytes_per_second=1061.44M/s
RecordReaderSkipRecords/Repetition:0/BatchSize:1000                 269624 ns       270945 ns         2547 bytes_per_second=17.5991G/s
RecordReaderSkipRecords/Repetition:1/BatchSize:1000                1627094 ns      1625718 ns          431 bytes_per_second=1.56157G/s
RecordReaderSkipRecords/Repetition:2/BatchSize:1000               12275821 ns     12246340 ns           57 bytes_per_second=225.075M/s
RecordReaderReadRecords/Repetition:0/BatchSize:1000/ReadDense:1     314982 ns       314958 ns         2163 bytes_per_second=15.1397G/s
RecordReaderReadRecords/Repetition:0/BatchSize:1000/ReadDense:0     314255 ns       313987 ns         2141 bytes_per_second=15.1865G/s
RecordReaderReadRecords/Repetition:1/BatchSize:1000/ReadDense:1    1122195 ns      1116475 ns          653 bytes_per_second=2.27383G/s
RecordReaderReadRecords/Repetition:1/BatchSize:1000/ReadDense:0    8818219 ns      8792272 ns           84 bytes_per_second=295.67M/s
RecordReaderReadRecords/Repetition:2/BatchSize:1000/ReadDense:1   11038168 ns     11003551 ns           66 bytes_per_second=250.496M/s
RecordReaderReadRecords/Repetition:2/BatchSize:1000/ReadDense:0   19544598 ns     19487114 ns           36 bytes_per_second=141.444M/s

I am open to suggestions regarding the API. I am inclined to pass this as a parameter when making the reader as suggested by @emkornfield.

Given the RecordReader API where the output buffer is allocated internally, I think this makes sense indeed.

@emkornfield could you take another look?

Updating the benchmark numbers. The 10X improvement above is not accurate, it was due to a bug in the code for reading optional fields. For the benchmark data, the improvement for optional fields is more like 10%, and for repeated fields 40%.
Nevertheless, we need this API since some readers may want to read dense.
--------------------------------------------------------------------------------------------------------------------------
Benchmark                                                                Time             CPU   Iterations UserCounters...
--------------------------------------------------------------------------------------------------------------------------
ColumnReaderSkipInt32/Repetition:0/BatchSize:1000                   234597 ns       233231 ns         2529 bytes_per_second=20.4448G/s
ColumnReaderSkipInt32/Repetition:1/BatchSize:1000                  1613926 ns      1608305 ns          442 bytes_per_second=1.57848G/s
ColumnReaderSkipInt32/Repetition:2/BatchSize:1000                  2469379 ns      2462899 ns          280 bytes_per_second=1119.15M/s
ColumnReaderReadBatchInt32/Repetition:0/BatchSize:1000              257132 ns       256459 ns         2457 bytes_per_second=18.5931G/s
ColumnReaderReadBatchInt32/Repetition:1/BatchSize:1000             1629986 ns      1625472 ns          442 bytes_per_second=1.56181G/s
ColumnReaderReadBatchInt32/Repetition:2/BatchSize:1000             2530858 ns      2514407 ns          282 bytes_per_second=1096.22M/s
RecordReaderSkipRecords/Repetition:0/BatchSize:1000                 267614 ns       267870 ns         2459 bytes_per_second=17.801G/s
RecordReaderSkipRecords/Repetition:1/BatchSize:1000                1615133 ns      1613831 ns          443 bytes_per_second=1.57308G/s
RecordReaderSkipRecords/Repetition:2/BatchSize:1000               11080021 ns     11021551 ns           66 bytes_per_second=250.087M/s
RecordReaderReadRecords/Repetition:0/BatchSize:1000/ReadDense:1     312089 ns       312874 ns         2143 bytes_per_second=15.2406G/s
RecordReaderReadRecords/Repetition:0/BatchSize:1000/ReadDense:0     320200 ns       320023 ns         2128 bytes_per_second=14.9001G/s
RecordReaderReadRecords/Repetition:1/BatchSize:1000/ReadDense:1    7913189 ns      7885560 ns           89 bytes_per_second=329.667M/s
RecordReaderReadRecords/Repetition:1/BatchSize:1000/ReadDense:0    8907880 ns      8879646 ns           77 bytes_per_second=292.76M/s
RecordReaderReadRecords/Repetition:2/BatchSize:1000/ReadDense:1   11947824 ns     11942741 ns           54 bytes_per_second=230.797M/s
RecordReaderReadRecords/Repetition:2/BatchSize:1000/ReadDense:0   20702187 ns     20626693 ns           32 bytes_per_second=133.63M/s

@fatemahp looks like build failures might be due to doc bugs:
/arrow/cpp/src/parquet/column_reader.h:306:6: error: '\param' command used in a comment that is not attached to a function declaration [-Werror,-Wdocumentation]
/// \param[in] column descriptor

@fatemehp seems like CI failures might be relevant here?

@emkornfield, @wjones127, I have fixed the issues, and all the tests appear to be passing. Could you take another look?
Note that I changed the contract so that when reading dense, the null_count is always 0. I have added more description here: https://github.com/apache/arrow/pull/17877#discussion_r1113542602

Generally looks OK to me, I think merging your other PR caused a merge conflict, could you rebase.  Also given the sensitivity of the code I'd like to do another pass tomorrow with fresh eyes.

I tried to merge, the conflicts from the other pull request were minor.

@wgtmac I have tried to address your comments. Please take a look. Thanks!

@emkornfield could you take another look and merge this?


novaclient.v1_1 deprecated

Hi all,
I'm seeing novaclient deprecation warnings, is pyrax work underway for using novaclient.v2?
pyrax==1.9.3
venv/lib/python2.7/site-packages/novaclient/v1_1/init.py:30: UserWarning: Module novaclient.v1_1 is deprecated (taken as a basis for novaclient.v2). The preferable way to get client class or object you can find in novaclient.client module.
warnings.warn("Module novaclient.v1_1 is deprecated (taken as a basis for "

novaclient 2.21.0 deprecated the v1.1 client, and is issuing that warning. In novaclient 2.21.0, the v1.1 client is now an alias to the v2 client.
We will need to test more to validate that there are no backwards incompatible changes, and if so, potentially, make novaclient 2.20.0 a pinned dependency in pyrax for the time being.

+1 on getting this resolved. I was setting up a new laptop and ran into this tonight.
for what it's worth, rackspace-novaclient brings in latest python-novaclient as well

I've started some investigation into what would be required to prevent the warning.
One of the rackspace-novaclient dependencies will still cause the warning regardless of the changes made in pyrax.  There is however an open PR for it:
https://github.com/rackerlabs/os_diskconfig_python_novaclient_ext/pull/5

So 1990's. I hope they fix it soon

@sivel is there any new development on this?

Since this is such a hoser, and since I don't really care, I have solved (hacked) this problem away with a bashscript:
#!/bin/bash

supernova $@ 2>&1 | grep -v "InsecureRequestWarning\|novaclient.v1_1\|keystoneclient\|Error Output"

Eventually, if these issues go away, i'll stop using it.

This is getting worse. Now it's not only annoying it breaks pyrax!
On 2015-12-18 python-novaclient 3.0 was released (now 3.1) which removed novaclient.1_1 and now breaks pyrax!
Output:
$ python run.py
Slave binds are misssing, adding Master as slave too.
Traceback (most recent call last):
  File "run.py", line 21, in <module>
    app = create_app()
  File "/Users/marvin/pybossa/pybossa/pybossa/core.py", line 42, in create_app
    setup_uploader(app)
  File "/Users/marvin/pybossa/pybossa/pybossa/core.py", line 120, in setup_uploader
    from pybossa.uploader.rackspace import RackspaceUploader
  File "/Users/marvin/pybossa/pybossa/pybossa/uploader/rackspace.py", line 26, in <module>
    import pyrax
  File "/Users/marvin/pybossa/pybossa/env/lib/python2.7/site-packages/pyrax/__init__.py", line 60, in <module>
    from novaclient.v1_1 import client as _cs_client
ImportError: No module named v1_1

The PR https://github.com/rackspace/pyrax/pull/547 needs to be merged or please do some other fixes. Thanks.

it's fixed in 1.9.6 - somehow the change didn't properly get merged into what got released as 1.9.5

Well, this ruined my day in a pretty bad way - I had 1.9.5 pinned, it used to work, and suddenly stopped working.  If this were an open source project I wouldn't complain, but this is commercially supported software!

PyRax seems to be more broken now. With the latest version of novaclient, I'm getting
novaclient.exceptions.Forbidden: 'novaclient.v2.client.Client' is not designed to be initialized directly. It is inner class of novaclient. You should use 'novaclient.client.Client' instead. Related lp bug-report: 1493576

python-novaclient is pinned at 2.27.0 for that reason


fix: quarantine C3 analog e2e tests

What this PR solves / how to test
This PR quarantines the C3 analog e2e tests, which started failing since yesterday. After thoroughly debugging together with Pete, we concluded that the breakage is not caused by one particular change in workers-sdk, but rather due to some changes in analog itself. Specifically, the breakage seems to come from the latest release of analog, aka v 1.9.0. Currently C3 has a dependency on analog ^1.8.0, which ends up pulling 1.9.0, and results in the failures we're seeing. We attempted to fix the version number of our dependency to 1.8.0, but unfortunately that still end up pulling  1.9.0, due to how analog internally declares its dependencies. This is something we don't have control over, which is why we ultimately decided to quarantine these tests.
We also attempted to fix forward, based off of https://github.com/cloudflare/workers-sdk/pull/6975, that bumps create-analog to 1.9.0, but unfortunately that broke other things, so here we are.
These tests should be quarantined until we are either able to successfully bump create-analog to 1.9.0, or until a downstream fix comes from the analog team <3
Fixes N/A.
Author has addressed the following

Tests

[ ] TODO (before merge)
[ ] Tests included
[x] Tests not necessary because: e2e test quarantine

E2E Tests CI Job required? (Use "e2e" label or ask maintainer to run separately)

[ ] I don't know
[x] Required
[ ] Not required because:

Changeset (Changeset guidelines)

[ ] TODO (before merge)
[ ] Changeset included
[x] Changeset not necessary because: e2e test quarantine

Public documentation

[ ] TODO (before merge)
[ ] Cloudflare docs PR(s):
[x] Documentation not necessary because: e2e test quarantine

cc// @brandonroberts FYI

Thanks for the heads up @CarmenPopoviciu. Is C3 using the latest template or still pinned to angular-v17? I think using the --template latest would fix in the install issues, but I will check and see what else can be done to resolve this.

thank you so much @brandonroberts ♥ !!! From what I could tell, we're still pinned to angular-v17. I think Pete tried to pin to latest but that didn't work? I'll have to check again.
Kepp me posted please if you find anything, or if I can action anything on our side


wireguard: Start some troubleshooting notes

Signed-off-by: Andy Doan<EMAIL_ADDRESS>

@dagriego - you might want to contribute to this once you've gotten a little further.
@mike-scott - any tips you'd like to add?

Docs for 84228258af0c0d78541fded005c238010945554f are browesable at: https://ci.foundries.io/projects/fio-docs/builds/503/docs/artifacts/html/index.html


VSCode complains about missingModuleReported.has and sourceCode.commentsExistBetween (was vscode#37404)

Issue migrated from https://github.com/Microsoft/vscode/issues/37404

VSCode Version: Code 1.17.2 (b813d12980308015bcd2b3a2f6efa5c810c33ba5, 2017-10-16T13:59:46.104Z)
OS Version: Windows_NT x64 10.0.15063
Extensions:

Extension
Author (truncated)
Version

vscode-eslint
dba
1.4.0

python
don
0.7.0

pgsql
dou
0.0.8

EditorConfig
Edi
0.11.1

vsc-material-theme
Equ
1.0.5

JSDocTagComplete
Hoo
0.0.2

vscode-esformatter
how
1.5.2

output-colorizer
IBM
0.1.2

vscode-puglint
mrm
2.3.0

debugger-for-chrome
msj
3.4.0

code-spell-checker
str
1.4.12

(3 theme extensions excluded)

Steps to Reproduce:
No idea what I did, but I'm flooded with errors I did not see last week.
ESLint log:
(node:9672) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 29): TypeError: missingModuleReported.has is not a function

I also keep getting one of those alert bars at the top showing sourceCode.commentsExistBetween is not a function. I have no idea why. When I close it, it just pops up again.
I installed Node 8.9.0 today and cleaned my globally installed npm modules. I would assume some relation to that.
Disabling ESLint integration resolves both issues.

@oliversalzburg can you prepare a example I could clone.
commentsExistBetween is found in the ESLint source code :-). Do you see some exceptions as well when executing eslint from a terminal directly.

Can't repro. Must have been something messed up while re-installing global packages.


My character editor is broken

Describe your problem here.

the cam behind the hud is black and Im not getting any error logs from the terminal
Are you modding a build from source or with Lua?
Source
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
No I didn't edit anything except FPS counter

Just had to update my libs


Winter Expand World Overspawn Bug

Hi, I just wanted to see if you were already aware of this conflict between Expand World and Seasons.
To replicate the issue:

Set day duration in main config file to 15 seconds
Start game with both EW and Seasons installed
Fly over to a mountain
Wait until season changes to winter
About midway through winter, NRE's start to pop up in console, and many creatures and pickable items start duplicating where they stand, causing lag

If this is not fixable within Seasons, please let me know.
Thank you,

Looks like it tied to moment ocean freezes. I've checked the ExpandWorldData code and my only guess it's some custom object spawning while ocean have unusual solid surface. I don't know if I can provide compatibility. I'll try to but I don't know if it will be possible.

ExpandWorldData itself have no reason of the error you get. It's the combination of factors.
Can you share your configs and settings? Maybe something will catch my sight.

https://file.io/04mZiEZ0FoMa

I've checked the code again and I guess it's ice floes feature.
You can try to disable it.
Frozen ocean should work but it's the next candidate to disable if the error still persists.
Otherwise I have no idea what could go wrong.

It seems to still be happening with floes and ocean-freeze disabled in configs.
From further testing, it appears to trigger when mountain caves load in.

Ok then it's not ocean and floes obviosly.
I have tried to get rid of some redundant code probably would causing the case. Pls check that version.
Seasons.zip

If that doesn't help you can try to add custom prefabs to "ignorePrefab" or "ignorePrefabPartialName" section of Materials.json in Cache settings.

Actually objects located in the mountain, deep north and ashlands are not recolored but if it was tied to that objects then the issue would persist in other seasons. So the issue should be somewhere else.

ExpandWorldData.zip
I've made a change which could be causing the error. Pls check if it helps. I've compiled it from mod's repo. If it helps then it's on EWD side to fix.

I've checked EWD repo and it already has the same issue from 2 weeks ago. It would be nice to find a way to fix that.

I've tried to recreate the issue using vanilla settings of EWD with no success.

I will test with the new dll file in about 6 hours and let you know. I will notate any additional replicable steps if issue persists, thank you.

When I had the error with ExpandWorld I had ice floes turned off and the ocean was not freezing. I think it has to do with the rocks that get coloured white, as sometimes I'd have one randomly spawn in front of me when walking around.

The method causing issue is rather small

There is so little room for NRE it's crazy.

In the version above I've tried to add some bulletproof for zdo check. But that's just a wild try.

Seasons prefab recoloring works without much interference with other mods or game behavior. Or at least I'm unaware of that.
On world load Seasons gets list of prefab names and textures set tied to that prefab.
The moment object is spawned in the world its prefab name is checked to be at that collection. And if it is found then basically the reference to that object is stored at another collection and textures and colors are stored within. Then when it's time to recolor then material block is applied to the selected material.
At first I saw Winter and ghostinit mentioned in error text and immediately thought of ice floes as they are ghost initialized. Second was frozen surface potentially breaking block check for another mod. It was an issue when the objects didn't spawn an winter. But the reason was obvious. And disabling frozen ocean and ice floes should be enough.
Last ZNetView objects are being modified at winter are Plant and Pickable. But there is no destructive behavior only callling SetPicked fpr Pickable and WrongBiome status for Plants.

@mdf25 pls check if the
Seasons.zip
and
ExpandWorldData.zip
have any effect in your case.

Did you test it with ice floes and frozen ocean enabled?
I've published 1.1.2 version with mentioned fix. I have no idea what else could be wrong.

OK, so tested anoter winter. The exact same issue is still occurring.
I was at Mistlands this time, and those large rock spires are flickering between the regular black colour and the winter snow covered texture whilst the red text is happening.
[Error  : Unity Log] NullReferenceException: Object reference not set to an instance of an object
Stack trace:
ExpandWorldData.DataManager.CleanGhostInit (ZNetView view) (at <a1c3077df485469aa35aab6d721a454d>:0)
ExpandWorldData.DataManager.CleanGhostInit (UnityEngine.GameObject obj) (at <a1c3077df485469aa35aab6d721a454d>:0)
ExpandWorldData.DataManager.Instantiate (UnityEngine.GameObject prefab, UnityEngine.Vector3 pos, UnityEngine.Quaternion rot, Service.ZDOData data) (at <a1c3077df485469aa35aab6d721a454d>:0)
ExpandWorldData.VegetationSpawning.Instantiate (UnityEngine.GameObject prefab, UnityEngine.Vector3 pos, UnityEngine.Quaternion rot, System.Collections.Generic.List`1[T] clearAreas) (at <a1c3077df485469aa35aab6d721a454d>:0)
(wrapper dynamic-method) ZoneSystem.DMD<ZoneSystem::PlaceVegetation>(ZoneSystem,Vector2i,UnityEngine.Vector3,UnityEngine.Transform,Heightmap,System.Collections.Generic.List`1<ZoneSystem/ClearArea>,ZoneSystem/SpawnMode,System.Collections.Generic.List`1<UnityEngine.GameObject>)
ZoneSystem.SpawnZone (Vector2i zoneID, ZoneSystem+SpawnMode mode, UnityEngine.GameObject& root) (at <dbd2a6fbcde9498cadcacfb37ef883e3>:0)
ZoneSystem.CreateGhostZones (UnityEngine.Vector3 refPoint) (at <dbd2a6fbcde9498cadcacfb37ef883e3>:0)
ZoneSystem.Update () (at <dbd2a6fbcde9498cadcacfb37ef883e3>:0)

I will try waiting here without Server Devcommands to make sure that isn't causing a weird issue too, but it shouldn't be as that mod only deals with the console.

And I think I need to reproduce it on my side using your custom settings bundle.
Or did you still use vanilla EWD settings?

Expand World Data was default settings, no changes at all. I just downlaoded the mod from Thunderstore and added it to a blank profile on Valheim latest version with your Seasons zip mod and hit go. I started a new world and just flew around and let it run :)
Here's a video of it, had to move to a new area to make it happen but last time it just happened from flying around. You can see the flicker start up a bit later into the vid, sorry for low quality but needed small file :D
Video.zip
Here's the JSONs I have from the mod after adjusting config settings.
Defaults.zip

I've meant \BepInEx\cache\shudnal.Seasons{some number}\cache.json file that should be there.
If there is none then run the game and do "resetseasonscache" command in terminal it will take about 30 seconds to build cache. Then you should have a folder with cache.json inside.
I've downloaded https://valheim.thunderstore.io/package/JereKuusela/Expand_World_Data/ and with current https://thunderstore.io/package/download/shudnal/Seasons/1.1.2/ installed I have no issue how much I tried to teleport and fly around both in singleplayer and on dedicated server.
I hadn't change anything in EWD and in Seasons I have everything enabled. Still everything works fine.

Flicker is most likely caused by just the engine can't handle the mess the error make to the game state. And as I see the flickering is there for any object not just rocks. So that's something more general than just wrong prefab application rules.

Think this is the right one?
cache.json

That's the right one. And it looks fine. No custom prefabs and no unusual materials.

Tested again on a new world and made sure I have the same packages just to be sure.
I noticed the problem only seems to happen in Mistlands now during winter. Still testing more, but I can get it to happen when I go there quite reliably. Teleporting there made it happen instantly from a new world, so going to fly in slowly and see if it still happens when I approach it normally or start winter within the biome.
... and results are in. Left myself in Mistlands and quit out, turned off ServerDevCommands and logged in again with -console parameter to wait for winter - and the issue still happens, at least after I move out of the starting area where I was standing.
If you like I can send another vid showing my whole install process just so you can be sure I've not messed something up, but I don't see how I could have done anything wrong with just 2 mods. But you never know.

I think video could be handy as I could just reproduce your actions step by step.

I've managed to reproduce. Tried to make that fix

Now I'm getting bunch of other errors

I don't know how that's actually possible but there is somehow objects like
cliff_mistlands1(Clone) with ZNetView component with view.GetZDO() == null
I've added Log string

and now I'm getting this

But you know what's even more funny. It's reproducable with Seasons disabled.

Weird, does that happen on a new world as well? I've never come across that red error before with just EWD. Wonder why Mistlands rocks have no ZDO data... I'll guess we'll have to wait to see if Jere can fix EWD to account for those nulls :D

It means ghost zone initialization is broken at some point. And its state persists.

It's only happening on a new world.

Also my test character ZDO was reset.

I disabled Seasons, deleted EWD configs, created a new world and still got the error.
Looks like something related to Dungeon or Location initialization. Or idk. Doesn't look like something tied to Seasons.
There is one suspicious line right after first wrong prefab init.
"Dungeon loaded with 0 rooms from old format in 1,9949 ms."
LogOutput.log

I have no idea what's going on. I've build ExpandWorldData.dll from repo. And that version causes the errors from the start of new world.
And Thunderstore version does not.
So Seasons 1.1.2 + Thunderstore ExpandWorldData works for me. There are still plenty of issues like not recoloring freshly spawned objects, wrong biome terrain color from time to time so idk if it's reasonable to try to make it fully compatible. There are so much changes Jere made to world building process.

Although it's probably more on EWD's side to check, I did manage to get that vid done from a new profile just to show you the errors from a fresh world. Probably not relevant now since you replicated it outside of seasons, but just in case it's in any way helpful.
Video2.zip

Seasons.zip
Pls check if the issue persists in that version

So far, so good. Tested two winters back to back, and no red text - so definitely looking good. Only thing I noticed now in mistlands is some trees are still green during winter, but I actually kinda like it! :D

I've fixed it already in the next version.

If terrain in Plains remains green in Summer and Fall there is some file in expand_world folder. I didn't seek but deleted them all.

Probably in expand_clutter.yml I think :) But seems better in this one, plains grass responded normally to season change and also found no green rocks in mistlands. Still no nullrefs either, so you might just have cracked it! :D

Looks like this. The fix will be included in the next version as well as some refinements and what's most valuable full EWD compatibility. Thanks for cooperation. You can close the issue on EWD repo as well.

I've also confirmed the NRE's are no more!
What was the cause?

The reason was the call of m_nview.Destroy(); at Pickable.Awake. That's still possible in vanilla game with some unusual circumstances.


tmt cannot be installed on centos-stream-9?

I have tried to spin up a centos-stream-9 container:
$ podman pull centos:stream9
Trying to pull quay.io/centos/centos:stream9

But it seems some dependencies are missing
# dnf install tmt
Error:
 Problem: conflicting requests
  - nothing provides python3.9dist(pygments) >= 2.7.4 needed by tmt-1.34.0-1.el9.noarch from epel

How is testing-farm not breaking? What I can see in the artifact installation (4-Install-packages.txt) it seems to use testing-farm-tag-repository:
 python3-pygments                     noarch  2.7.4-4.el9                                                testing-farm-tag-repository  1.8 M

You need CRB, according to https://tmt.readthedocs.io/en/stable/overview.html#install: dnf config-manager --enable crb

Oh, I thought I've enabled it when going through https://www.redhat.com/sysadmin/install-epel-linux. Indeed I tried it again and it works now :shrug:


Data for testing

Publish a couple of pre prepared batches (per modality) in a new GCP bucket.
Write a simple function power_perceiver.testing.get_test_data_filename which checks if testing data already exists locally (in a temporary directory) and if not downloads  it.

@jacobbieker @peterdudfield just FYI, my plan is to upload two pre-prepared batches for each modality to a publicly-accessible Google Cloud storage bucket: gs://ocf-public/data_for_unit_tests/prepared_ML_training_data.  Then I'll write a little utility function described above.

copied data using 1-line bash loop:
for dir in gsp nwp opticalflow pv satellite sun topographic; do gsutil -m cp -J gs://solar-pv-nowcasting-data/prepared_ML_training_data/v15/test/$dir/00000[01].nc gs://ocf-public/data_for_unit_tests/prepared_ML_training_data/$dir; done

Sounds good,
Give it a go, the way ive done it before was to use
from nowcasting_dataset.dataset.batch import Batch
from nowcasting_dataset.config.model import Configuration

configuration=Configuration()
configuration.input_data = configuration
configuration=Configuration()
configuration.input_data = configuration.input_data.set_all_to_defaults()
Batch.fake(configuration=configuration)

batch = Batch.fake()

I think there are just two different ways of tackling the same problem. Both have advantages and disadvantages
GCP files:
Advantages:

It's real data.
easy to access
Cons:
Might need updating with a new version
data is the same each time

Fake:
Advantage:

creates random data,
can adjust depending on configruation
Cons:
Needs updating, / alinging with dataset
not real daya
can be slow with large (batch > 128)

Probably best to try it out, and make both approaches are good in there different ways

Yeah, good point, I do like the fake batches... but, for this, I'm also keen to use the "real" data to help benchmark loading speed. So it feels like "real" data is probably a good option here.
To help connect the dots, I should link to a highly related discussion: https://github.com/openclimatefix/nowcasting_dataset/issues/512

Nice one - good luck with it


Update dac_sdc.ipynb

Addressed this issue:
/usr/lib/python3/dist-packages/ipykernel_launcher.py:1: DeprecationWarning: pynq.Xlnk is deprecated and will be removed in 2.7 - use pynq.allocate instead
"""Entry point for launching an IPython kernel.

Thanks @npurusho !


SoftAdapt.git not found

Hi,
When running 'pip install -r requirements.txt', I am receiving the message:
fatal: repository 'https://github.com/dr-aheydari/SoftAdapt.git/' not found

Is this still available?
Kind regards,
Richard

Just to not, when using the links below:

We get the error:

So switch to the method:

In order to connect.

Hi Richard (@KOD1S),
Sorry about this issue! The support for SoftAdapt was recently ended (due to it being a bit outdated with the current torch developments). However, SoftAdapt is only used for adaptive weighting of the loss components, which was not used in the paper (but it can be used to automize the loss scaling). SoftAdapt is fairly straightforward to implement, here's a preprint of the algorithm here: https://arxiv.org/pdf/1912.12355.pdf.
Thank you for bringing this to my attention! I will update the requirements.txt. to remove SoftAdapt as a requirement : )

Hi @dr-aheydari, thanks for your quick response, however the ACTIVA.py file still calls for SoftAdapt, which is not available.


Why are first name in a place taking more than 100 seconds?

There were 6 first name searches on 18 Feb that took more than 100 sec. Why?

I have a report of timeouts when a Place Name is being Disabled in the Gazetteer. This is affecting the Yorkshire linking in particular.
Geoff

@geoffj-FUG what you refer to is a different issue although it appears to be similar. [production][freecen2_places#destroy] Errno::ETIMEDOUT: Operation timed out - Took more than 100 seconds to receive data (for 136.243.1...#1153. That story has had a fix applied  and Ali confirms it is now working

Thanks Kirk
Geoff
From: Kirk Dawson<EMAIL_ADDRESS>Sent: Thursday, February 25, 2021 1:39 AM
To: FreeUKGen/FreeCENMigration<EMAIL_ADDRESS>Cc: geoffj-FUG<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [FreeUKGen/FreeCENMigration] Why are first name in a place taking more than 100 seconds? (#1158)
@geoffj-FUG https://github.com/geoffj-FUG  what you refer to is a different issue although it appears to be similar. [production][freecen2_places#destroy] Errno::ETIMEDOUT: Operation timed out - Took more than 100 seconds to receive data (for 136.243.1...#1153 https://github.com/FreeUKGen/FreeCENMigration/issues/1153 . That story has had a fix applied and Ali confirms it is now working
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/FreeUKGen/FreeCENMigration/issues/1158#issuecomment-785164276 , or unsubscribe https://github.com/notifications/unsubscribe-auth/AKCPIFJOHWYP7YZRLUAXBNDTAUMSHANCNFSM4X2RLPIA .  https://github.com/notifications/beacon/AKCPIFM3OCAES3SXNCP4DYLTAUMSHA5CNFSM4X2RLPIKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOF3GKP5A.gif

Resolved by index restructuring


Fix navigation

Code Coverage

File
Coverage [0.00%]
:x:

composeApp/src/commonMain/kotlin/recipes/presentation/RecipeScreen.kt
0.00%
:x:

Total Project Coverage
0.00%
:x:


ARROW-15604: [C++][CI] Sporadic ThreadSanitizer failure with OpenTracing

The particular cause of the failure was:
  void InputReceived(ExecNode* input, ExecBatch batch) override {
    EVENT(span_, "InputReceived", {{"batch.length", batch.length}});
    util::tracing::Span span;
    START_SPAN_WITH_PARENT(span, span_, "InputReceived",
                           {{"node.label", label()}, {"batch.length", batch.length}});

    DCHECK_EQ(input, inputs_[0]);

    bool did_push = producer_.Push(std::move(batch));
    if (!did_push) return;  // producer_ was Closed already

    if (input_counter_.Increment()) {
      // This will mark the exec plan finished
      Finish();
      // At this point the main thread is generally free to exit but span hasn't been destructed yet
    }
  }

It could be fixed with scoping:
  void InputReceived(ExecNode* input, ExecBatch batch) override {
    EVENT(span_, "InputReceived", {{"batch.length", batch.length}});
    {
      util::tracing::Span span;
      START_SPAN_WITH_PARENT(span, span_, "InputReceived",
                             {{"node.label", label()}, {"batch.length", batch.length}});

      DCHECK_EQ(input, inputs_[0]);

      bool did_push = producer_.Push(std::move(batch));
      if (!did_push) return;  // producer_ was Closed already
    }
    if (input_counter_.Increment()) {
      // This will mark the exec plan finished
      Finish();
    }
  }

However, I suspect this would quickly get tedious.  Instead it seems we can control the lifetime of the OT runtime storage and bind it to our worker threads.  In the future we may want to consider doing similar tricks to keep alive the memory pool, global thread pools, etc.

I've made an attempt at addressing the PR feedback in preparation for the OT release.  This should be pretty close to what we will use (I think only two lines will change once we can use their new API).
The unit test is a little unreliable.  If I run it on repeat I can trigger the failure much more reliably than running it a single time.  I played around with a few different approaches but couldn't come up with a variation that failed very reliably.  I'm not sure if we want to leave it in or just get rid of it and rely on catching this via TSAN were there to be a regression.

We can keep the test, I think. Even if we plan to catch regressions via TSAN, presumably this will trigger it more reliably?

What is the status of this?

OpenTelemetry v1.3.0 just released with the necessary fix, so we should be able to update it and get this properly fixed now.

@github-actions crossbow submit test-fedora-35-cpp test-ubuntu-20.04-cpp-* test-r-ubuntu-22.04

I'm pretty sure the TSAN failure is unrelated.  Just to be sure I ran this via TSAN locally and it passes fine.  I'm going to proceed with merge.


Add files via upload

Apologies, but it looks like the format of the submission was modified incorrectly while trying to split up the validators. If you can install "jq" we have instructions in the README.md that can help do this automatically, or you may manually fix each file: the { bracket is incorrectly positioned.


Odd WLT on teram pages?

https://theorangealliance.org/teams/12518
Look at overall WLT and compare with only 1 event shown. Where are the other Ws and Ls coming from and why don't they show up on this team page?

The Overall season WLT counts elim matches.  If you think it shouldn't, we can change it.

That page shows an overall season WLT of 8-9-0 (17 matches) and 3 awards won, but only shows 1 event played with 5 qual matches and 2 elim matches (7 matches total) and no awards won. Where are the other 10 matches and the 3 awards from? Even with elim matches, the numbers don't add up.

Ah yes, thanks for letting me know.  There were some events in the MD with wonkey IDs, so I renamed them and must've missed their MatchParticipant records.  I'll update soon.  Thanks for pointing this out.

Should be good now.


Unable to forward a public channel post

Bots not forward public channels posts with forwardMessage method. It was easy to do this before and it was just needed to call forwardMessage method and pass the channel username, post id and receiver id. But now it gives :
{"ok":false,"error_code":400,"description":"Bad Request: message to forward not found"}
It seems telegram has changed something on their side and does not allow bots to forward posts from channels that they are not in.
Any thought/solution on this?

ask @BotSupport

I have this problem!
Does it have a solution?

Have you found the solution by any chance? :)
Please, respond if you have

This was a Telegram internal problem, nothing to do with the library here, sorry!
Get in touch with https://t.me/BotSupport


"Bluish" block & liquid rendering issues

I read through the open issues and was surprised to see nothing directly addressing this.  I know you're painfully aware of this issue too, Cpt.  I made this topic to help consolidate findings on different aspects of this issue.  I apologize if it's redundant.
Some modded models, liquids & particle effects have a bluish render when exposed to Colored Light.  This issue is most prevalent in enclosed spaces away from natural sunlight, but some mods like ChickenBones' Microblocks render a noticeable blue even under the sun, under colored or vanilla light sources.  GardenStuff's Flower Pots have a blue sheen on some of their faces.  Tinkers' Construct liquid metals render a dark blue when closed off from sunlight and lit by any other source.  Vanilla torches' particles are blue when sunlight is cut off (caving is the easiest means of verifying this).  There are several more instances, but these are prime examples.
http://imgur.com/a/nMaJw#0 - here is a small album I compiled to demonstrate some of the quirks of the bug.  I'll be posting more albums as I test things out.

Some documentation:
https://gist.github.com/CptSpaceToaster/8b6dbd107e5fe44ab7b7

some mods like ChickenBones' Microblocks render a noticeable blue even under the sun

Actually, this seems to happen with any block that uses CodeChickenLib.

Interesting

(By the way, I mean the CCL render code. Blocks that only use the Minecraft render code work fine, even if other blocks are messed up.)

Odd.  EnderStorage and Chicken Chunks render fine, so I'd never thought CCL was the culprit (I never tested Translocators).  I also notice that if a modmaker has multiple mods, and if one mod has blue tinting, all their mods tend to as well.  Jaquadro is a good example with Garden Stuff and Storage Drawers.  MrTJP is an exception with Project:Red, where only a couple modules have blue tint issues but somehow the multiparts like wires and gates render fine.

I've often had problems myself when working with packed color values - because ints in Java are signed by default, the very first bit tends to get corrupted when doing bitwise operations. Working with long values and downcasting the result to an int did the trick.
Maybe something similar is going on here?

I don't think you should have bits near the signed portion of the integer.  What kind of calculations are performing, that make that a problem?

I had problems in this loop when &-ing the alpha channel from texture 1 onto texture 2.
Similarly, someone may be doing some bitwise stuff to a packed color value so that the sign bit - because of the different format used by CLC - could fall somewhere into blue.
It's just an idea that popped into my mind, could be stupid, could be worth investigating.

Those are openGL values... You shouldn't be sending those to the tessellator... (I don't think you are)
Most of the issues come from "format 2" in the write up I posted a while ago.  Note that these values are NOT synonymous with OpenGL's bit-packed color representations.
Vanilla:
0000 0000 SSSS 0000 0000 0000 LLLL 0000
CLC:
0000 0000 SSSS BBBB GGGG RRRR LLLL 0000

So.... the top bit shouldn't have ANY data in it at all... there is a very VERY small chance (but not zero) that extra bits inbetween SSSS and LLLL are being shifted to the signed bit position... but that seems incredibly unlikely.


failed to cherry pick PR 3732 from cyclinder, to branch release-v0.9

commits 22b64d0e07ef03619788c92475019edb804a342a of cyclinder conflict when merging to branch release-v0.9, please manually cherry pick it by yourself.
PR https://github.com/spidernet-io/spiderpool/pull/3732 ,  action https://github.com/spidernet-io/spiderpool/actions/runs/10141288006
Auto-merging charts/spiderpool/README.md
Auto-merging charts/spiderpool/templates/pod.yaml
CONFLICT (content): Merge conflict in charts/spiderpool/templates/pod.yaml
Auto-merging charts/spiderpool/values.yaml
Auto-merging test/scripts/debugEnv.sh
error: could not apply 22b64d0e... Merge pull request #3732 from cyclinder/init_pod/fix_block
hint: After resolving the conflicts, mark them with
hint: "git add/rm <pathspec>", then run
hint: "git cherry-pick --continue".
hint: You can instead skip this commit with "git cherry-pick --skip".
hint: To abort and get back to the state before "git cherry-pick",
hint: run "git cherry-pick --abort".
hint: Disable this message with "git config advice.mergeConflict false"

https://github.com/spidernet-io/spiderpool/pull/3811


Fix degree

Must be: 315
https://github.com/neighborhood999/telegram-weather-bot/blob/master/src/utils/windDirection.js#L9

via #4


A fatal error has been detected by the Java Runtime Environment:

Please provide a brief summary of the bug

A fatal error has been detected by the Java Runtime Environment:

SIGSEGV (0xb) at pc=0x00007fd0d7534fb4, pid=2465958, tid=2493448

JRE version: OpenJDK Runtime Environment Temurin-<IP_ADDRESS>+1 (<IP_ADDRESS>+1) (build <IP_ADDRESS>+1)
Java VM: OpenJDK 64-Bit Server VM Temurin-<IP_ADDRESS>+1 (<IP_ADDRESS>+1, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)
Problematic frame:
C  [libc.so.6+0x4ffb4]  _IO_vfprintf+0x44

Core dump will be written. Default location: Core dumps may be processed with "/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e" (or dumping to /home/username/core.2465958)

If you would like to submit a bug report, please visit:
https://github.com/adoptium/adoptium-support/issues
The crash happened outside the Java Virtual Machine in native code.
See problematic frame for where to report the bug.
This happens to crash the service very randomly without any proper errors. I tried to find the possible reasons behind this but no clue. Can someone please suggest some possible reasons and debugging that can be done to resolve this ?
Please provide steps to reproduce where possible
I am not very sure how this error pops up. We have hs2 service which crashes very randomly.
Expected Results
The service should be working fine without this error
Actual Results
The service is crashing very randomly leaving this log in users home directory.
What Java Version are you using?
openjdk <IP_ADDRESS> 2022-02-08 OpenJDK Runtime Environment Temurin-<IP_ADDRESS>+1 (build <IP_ADDRESS>+1) OpenJDK 64-Bit Server VM Temurin-<IP_ADDRESS>+1 (build <IP_ADDRESS>+1, mixed mode)
What is your operating system and platform?
Red Hat Enterprise Linux release 8.5 (Ootpa)
How did you install Java?
tar.gz file was used to install java
Did it work before?
Yes, it was working fine till JAVA 8 but after upgrading to java 11 this started popping up

Did you test with other Java versions?
openjdk version "1.8.0_242"
OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_242-b08)
OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.242-b08, mixed mode)

Relevant log output
Stack: [0x00007fd0796f7000,0x00007fd0797f8000],  sp=0x00007fd0797f2ad0,  free space=1006k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [libc.so.6+0x4ffb4]  _IO_vfprintf+0x44
C  [libc.so.6+0x58dc8]  _IO_fprintf+0x98
C  [libjpam.so+0x15c4]  Java_net_sf_jpam_Pam_authenticate+0x3c7
j  net.sf.jpam.Pam.authenticate(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;Z)I+0
j  net.sf.jpam.Pam.authenticate(Ljava/lang/String;Ljava/lang/String;)Lnet/sf/jpam/PamReturnValue;+97
j  net.sf.jpam.jaas.JpamLoginModule.login()Z+183
j  javax.security.auth.login.LoginContext.invoke(Ljava/lang/String;)V+617<EMAIL_ADDRESS>j  javax.security.auth.login.LoginContext$4.run()Ljava/lang/Void;+8<EMAIL_ADDRESS>j  javax.security.auth.login.LoginContext$4.run()Ljava/lang/Object;+1<EMAIL_ADDRESS>v  ~StubRoutines::call_stub
V  [libjvm.so+0x8d592b]  JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, Thread*)+0x39b
V  [libjvm.so+0x98cbd4]  JVM_DoPrivileged+0x534
J 421  java.security.AccessController.doPrivileged(Ljava/security/PrivilegedExceptionAction;Ljava/security/AccessControlContext;)Ljava/lang/Object<EMAIL_ADDRESS>(0 bytes) @ 0x00007fd0c0321028 [0x00007fd0c0320f40+0x00000000000000e8]
j  javax.security.auth.login.LoginContext.invokePriv(Ljava/lang/String;)V+13<EMAIL_ADDRESS>j  javax.security.auth.login.LoginContext.login()V+26<EMAIL_ADDRESS>j  com.mapr.login.PasswordAuthentication.authenticate(Ljava/lang/String;Ljava/lang/String;)Z+20
j  org.apache.hive.service.auth.PamAuthenticationProviderImpl.Authenticate(Ljava/lang/String;Ljava/lang/String;)V+12
j  org.apache.hive.service.auth.PlainSaslHelper$PlainServerCallbackHandler.handle([Ljavax/security/auth/callback/Callback;)V+134
j  org.apache.hive.service.auth.PlainSaslServer.evaluateResponse([B)[B+308

@amuchoudhary can you try the most recent 11.0.16 and report back here?

Hi Matijn,
Same response with Java 11.0.16+8.
Crashes with exactly same issue.
On Mon, 1 Aug 2022, 9:24 pm Martijn Verburg, @.***>
wrote:

@amuchoudhary https://github.com/amuchoudhary can you try the most
recent 11.0.16 and report back here?
—
Reply to this email directly, view it on GitHub
https://github.com/adoptium/adoptium-support/issues/552#issuecomment-1201386309,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AGLSRZZ75ST55RTBOAW72HTVW7XLXANCNFSM55CWC5UQ
.
You are receiving this because you were mentioned.Message ID:
@.***>


Is there any possible script/instruction to look at for fine-tuning?

Hi! First of all thanks a lot for such amazing project.
I wonder if there is a valid way to fine-tune the model for specific tasks using customized datasets? I am trying to adapt the model to improve the performance and the source data structure I have is also for classification. It has below content:

Source audio
Text prompt
The event ID

I found that this script looks promising, but I do not know how to configure my data in order to replicate the process on my datasets since I found in the options, the sccipt has many setting very specific to ESC50. Do we have any gist on this problem? Thanks in advance!

And for how to finetune our model, I think eval_linear_probe code should definitely be the sample code for your reference.

Hi Xuechen,
I saw you have done some work in CLAP fine-tuning, and I wonder if you have performed the fine-tuning job in MSFT_CLAP/example for an ASR task? How does it work? Since I also want to fine-tune CLAP and perform some downstream tasks, I would appreciate it if you could provide me with an answer.

@Kinetic-shaun Thanks for your message and reading my recent paper! Yes actually I have scripts with fine-tuning the Microsoft CLAP model. But it is not fully ready for contributing since it is very specific to the datasets described in the paper, instead of the one that has been used in the original repo - they are very different tasks and scenarios, as you may have read.
Recently I've been busy. I believe after the paper's status has been updated, I will have a chance to clean up the code and make it online to the repo.
BTW, @RetroCirce sorry that for the LAION AI case, I did not have time to make the fine-tuning work for my dataset.

Hello @underdogliu , I also am very interested in fine-tuning CLAP for some specific use cases, and would love some insight on how you prepared your data!


[Bug] deploy flink on k8s get status bug fixed2

Problem Summary:
What is changed and how it works?
Proposal: xxx
Feel free to ping committers for the review!
Contribution Checklist

Make sure that the pull request corresponds to a GITHUB issue.

Name the pull request in the form "[Feature] [component] Title of the pull request", where Feature can be replaced by Hotfix, Bug, etc.

Minor fixes should be named following this pattern: [hotfix] [docs] Fix typo in README.md doc.

Purpose of this pull request

LGTM


Mouse events does not pass to application when ImGUI dialog is open

Unable to make a pull request because of the access rights to the current repo.
This bug can be fixed following way:-
void mouse_button_callback(GLFWwindow *window, int button, int action, int mods)
{
    if (s_showImgui)
	{
		ImGuiIO& io = ImGui::GetIO();
		io.AddMouseButtonEvent(button, action);
		if (io.WantCaptureMouse)
			return;
	}
        // . . . .more code goes here
}

Added suggestion.

@giraphics , I don't send mouse events to babylon.js when ImGUI is open so they don't change te Babylon Scene, it by design. To change that behavior one can just remove the if (s_showImgui) check from the mouse event callback.


Bug-fix: Update test action

What
The new ruby runner should read the value from
.ruby-version rather than guessing the latest
ruby version
Checklist
Before you ask people to review this PR:

[x] Tests and rubocop should be passing: bundle exec rake
[x] Github should not be reporting conflicts; you should have recently run git rebase master.
[x] There should be no unnecessary whitespace changes. These make diffs harder to read and conflicts more likely.
[x] The PR description should say what you changed and why, with a link to the JIRA story.
[x] You should have looked at the diff against master and ensured that nothing unexpected is included in your changes.
[x] You should have checked that the commit messages say why the change was made.

Thanks for the review @AbdirizakObsiye2018, i"m just removing the temp commit before merging :+1: