Webengage not building on M1 Silicon MacBooks

Hi, so i've been trying to add webengage to my iOS part of application but, I get an error that webengage package cannot build on arm64 simulators. I was hoping to get a resolution to this.
Thank You
webengage_flutter = 1.0.3
flutter = 2.10.4
XCode = 13.3
MacOS = 12.3.1

Error (Xcode): Building for iOS Simulator, but linking in dylib built for iOS, file '/Users/imac/Desktop/gcc-app/ios/Pods/WebEngage/xc11/WebEngage.framework/WebEngage' for architecture arm64

@SarthakWebEngage @ashwindmk
Can you check this on priority.
Flutter version 2.10 and above

WebEngage pod is included in the podspec provided with the Flutter plugin as dependacy.
Our WebEngage pod incorporates universal binaries by default, and we have introduced support for XCFramework through a subspec (by using WebEngage/XCFramework in podfile).
When you are using M1 machine, we propose that they use the XCFramework subspec.
The customer would not need to take any further steps if we changed the default subspec of WebEngage podspec to include XCFramework. But, until then, you have manually do the changes in WebEngage Flutter plugin podspec
In order to work with XCFramework
Open and update webengage_flutter plugin (Project-> External Libraries -> Flutter plugin -> WebEngage plugin -> iOS → webengage_flutter.podspec)
Replace WebEngage dependency
update s.dependency ‘WebEngage' to s.dependency 'WebEngage/XCFramework'
And run 'pod install’


[Web] App becomes unresponsive after canceling a scheduled giving transaction

Steps to reproduce:

Schedule a giving amount to complete for the following day.
Head to dashboard and cancel scheduled giving transaction
Press the back button
The App will then become unresponsive

There are no console errors nor sentry errors for this issue.

I'm having difficulties reproducing on latest alpha. Can you perhaps record your interaction? or give more detail to reproduce?

Steps To Reproduce
On beta.apollos.newspring.cc:
Go to give now
Enter an amount to give.
Schedule that amount for tomorrow.
Finish the give process so that the schedule is active and shows on your dashboard.
View the schedule details
Click to cancel the schedule.
Click either the built-in back button or the browser back button.
The screen will be frozen.


Gh 288 deduplicate results

Could de-duplication be done as a separate step in an Operation Chain? It could be implemented in the general operations rather than being Accumulo specific.

I'll make the suggested chain and then reopen the pull request.

I've now created a Deduplicate operation. There is now a deduplicate flag on GetOperation that will automatically add a deduplicate operation into your operation chain for you.


Itemset from previous answers - select one from ${node}

Triggered by this question
It exposes the so-far-untapped XForm capability to create a choice list from previous answers (in a repeat).
It could have a wider implication by avoiding the more difficult indexed-repeat() or a combination of concat() and selected-at().
After discussion with @dorey we came up with the following initial syntax suggestion:

type
name
label
choice_filter

begin repeat
rep

text
name
Enter name

end repeat

select one from ${name}
choice
Choose
string-length(./name) > 0

<select1 ref="/data/choice">
   <label>Choose name</label>
   <itemset nodeset="/data/rep[string-length(./name) > 0]">
       <label ref="name"/>
       <value ref="name"/>
   </itemset>
</select1>

The ref attribute is the nodename of ${name} and the nodeset attribute is the parent of  ${name} with an optional choice filter.

select multiple support might be difficult because we cannot allow spaces in the answers...

I like the idea of adding the ability to reference previous repeats. After thinking about the syntax a little more, I'm wondering if we could come up with a better way to specify it in the xlsform. Main reasons--

select one from ${name} could require new regex changes for parsing the type field. Even if we went with select_one ${name} there's a high probability that parsers in pyxform and various xlsform form-builders and parsers () would need their regex fixed. And though we could do it on individual cases, it'd be cleaner if we could settle on a way of extending functionality that doesn't involve changing the regex.
I vaguely remember people wanting to move away from { "type": "select_one listname" } towards something like { "type": "select_one", "list_name": "listname" }. Which would make parsing and validation of the form easier and more precise. (Note: I may have imagined this conversation)

How about:

type

select_one ${prev_name}

* still might need regex changes
or

type

list name

select_one

${prev_name}

I can see that would make sense from a developer perspective. Maybe move that discussion to a different issue, since it relates to all select type questions?

I took the approach of using select one ${prev_name} in #381, it seemed the easiest way to implement without adding any additional syntax other than a reference to a previous field.
Any thoughts on the implementation?

Just happy thoughts about the feature from me and that test looks looks good.

@MartijnR you may want to check out @DavisRayM's progress at #472 and some of my comments to see whether you agree. I now see that in your initial example you weren't using ${} syntax in the choice_filter. Was that intentional? I initially thought it would be easier to let users use ${} but maybe it's reasonable to explain that fields within the target repeat are written as ./<field name>.

Thanks! I will do that. I believe that not using ${} syntax in the choice_filter was not intentional or maybe it was because we weren't producing relative paths at that time. Seems better to use the ${}syntax in examples (and support it).


Submitting molecule doesn't work with forgi 1.1.0 while running locally

HelIo !
I succeeded to run Forna locally with the latest release of the Forgi library (1.1.0), but while trying to submit the default RNA sequence, I am facing an error that seems to be due to incompatibility between both (see attached picture).

I finally managed to solve it, by modifying the fasta_to_position() function in the forna.py class.
I have suppressed the line "bg=fgb.BulgeGraph()" and changed the line "fgb.from_fasta_text(fasta_text, False)" to "bg = fgb.from_fasta_text(fasta_text)".

Oh great! If you want to submit a PR, that would be greatly appreciated!

I'm definitely ok with pushing these modifications ! Yet, this requires you to give me the permission for this.


GTFS: SQLAlchemy errors

Feature requests should go in the forum: https://community.home-assistant.io/c/feature-requests
Home Assistant release (hass --version):
0.18.2
Python release (python3 --version):
3.5.1
Component/platform:
sensor.gtfs
Description of problem:
I don't see any actual issue here, but since I enabled the GTFS sensor, I often see in my logs a huge quantity of SQLAlchemy related errors. The component seems to be working fine (both in frontend and from automation rules), but…
Expected:
No error in logs
Problem-relevant configuration.yaml entries and steps to reproduce:
- platform: gtfs
  origin:<PHONE_NUMBER>881315
  destination:<PHONE_NUMBER>888336
  data: tisseo_gtfs.zip

- platform: gtfs
  origin:<PHONE_NUMBER>888336
  destination:<PHONE_NUMBER>881315
  data: tisseo_gtfs.zip

Traceback (if applicable):
16-04-24 17:03:35 ERROR (Thread-11) [sqlalchemy.pool.NullPool] Exception during reset or similar
Traceback (most recent call last):
  File "/home/kernald/.homeassistant/deps/sqlalchemy/pool.py", line 636, in _finalize_fairy
    fairy._reset(pool)
  File "/home/kernald/.homeassistant/deps/sqlalchemy/pool.py", line 776, in _reset
    pool._dialect.do_rollback(self)
  File "/home/kernald/.homeassistant/deps/sqlalchemy/engine/default.py", line 420, in do_rollback
    dbapi_connection.rollback()
sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread.The object was created in thread id<PHONE_NUMBER>86112 and this is thread id<PHONE_NUMBER>18272
16-04-24 17:03:35 ERROR (Thread-11) [sqlalchemy.pool.NullPool] Exception closing connection <sqlite3.Connection object at 0x7f2441952c70>
Traceback (most recent call last):
  File "/home/kernald/.homeassistant/deps/sqlalchemy/pool.py", line 636, in _finalize_fairy
    fairy._reset(pool)
  File "/home/kernald/.homeassistant/deps/sqlalchemy/pool.py", line 776, in _reset
    pool._dialect.do_rollback(self)
  File "/home/kernald/.homeassistant/deps/sqlalchemy/engine/default.py", line 420, in do_rollback
    dbapi_connection.rollback()
sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread.The object was created in thread id<PHONE_NUMBER>86112 and this is thread id<PHONE_NUMBER>18272

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/kernald/.homeassistant/deps/sqlalchemy/pool.py", line 290, in _close_connection
    self._dialect.do_close(connection)
  File "/home/kernald/.homeassistant/deps/sqlalchemy/engine/default.py", line 426, in do_close
    dbapi_connection.close()
sqlite3.ProgrammingError: SQLite objects created in a thread can only be used in that same thread.The object was created in thread id<PHONE_NUMBER>86112 and this is thread id<PHONE_NUMBER>18272

Additional info:

If I remove one of the two sensors, I have no errors.
On a side note: this GTFS sensor is generating insane CPU usage spikes every ~1 minute… It would be nice to extract only the needed data in a "cache" database (or at least some specific tables in the existing database).

Well, I talked too soon: I also have those errors with only one GTFS sensor. Just not as quickly as with two.

This will be fixed in 0.20 by #2119.


Oracle install command

Problem description
Incorrect shell command:
https://docs.docker.com/engine/installation/linux/oracle/#uninstall-old-versions
Problem location
missing slashes
Project version(s) affected
latest version
Suggestions for a fix
Fix CLI command structure

Additionally some dependencies are missed:
Error: Package: docker-ce-17.06.0.ce-0.3.rc3.el7.centos.x86_64 (docker-ce-test)
           Requires: container-selinux >= 2.9
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest


Add compiled files and Cargo.lock to ignore list

Add .o, .so, .rlib, .dll and Cargo.lock to vcs ignore list

Thanks for the pull request, and welcome! The Rust team is excited to review your changes, and you should hear from @huonw (or someone else) soon.
If any changes to this PR are deemed necessary, please add them as extra commits. This ensures that the reviewer can see what has changed since they last reviewed the code. Due to the way GitHub handles out-of-date commits, this should also make it reasonably obvious what issues have or haven't been addressed. Large or tricky changes may require several passes of review and changes.
Please see the contribution instructions for more information.

Thanks for the PR! The Cargo.lock is actually added below if it's a library (we don't want to ignore Cargo.lock for binaries), and the others aren't generated by Cargo by default, so I'd prefer to not add them in for now. They can always be added locally if build system modifications are made or globally if you do lots of assorted development locally.


Issue when exporting to FMU

Hi,
First of all, many thanks for such a great software.  I am experiencing trouble exporting a Hopsan hmf file to FMU, e.g., FMU 2 when updating to the latest release of Hopsan 2.21.1,  It works fine till Hopsan 2.20.  Here are attached the zipped hmf file and the error message.  Your help will be highly appreciated.
Best
Isheng
--------- hmf file --------
case23_hopsan.zip
-------- error message -------
Loaded hopsangenerator
Copying HopsanCore source, header and dependencies...
Copying C:/Program Files/Hopsan/HopsanCore
Copying default component library...
Copying C:/Program Files/Hopsan/componentLibraries/defaultLibrary
Generating C:/Users/iyeh/FMU/FMU_Manager_5.2_031724/dyna_key/case23_inv_pend_hopsan/fmu-build/fmu2_model.c
Generating C:/Users/iyeh/FMU/FMU_Manager_5.2_031724/dyna_key/case23_inv_pend_hopsan/fmu-build/model.hpp
Replacing namespace
Compiling FMU source code
Generating Makefile
Generating compilation script
Calling compilation script
g++ -c -std=c++14 -DHOPSAN_INTERNALDEFAULTCOMPONENTS -DHOPSAN_INTERNAL_EXTRACOMPONENTS -DHOPSANCORE_NOMULTITHREADING -I"HopsanCore/include" -I"componentLibraries/defaultLibrary" -I"HopsanCore/dependencies/rapidxml" -I"HopsanCore/dependencies/indexingcsvparser/include" -I"HopsanCore/dependencies/libnumhop/include" -I"HopsanCore/dependencies/sundials-extra/include" -I"HopsanCore/dependencies/sundials/include" -IC:/Program Files/Hopsan/dependencies/fmi4c/include -c fmu2_model.c -o fmu2_model.o
g++ -c -std=c++14 -DHOPSAN_INTERNALDEFAULTCOMPONENTS -DHOPSAN_INTERNAL_EXTRACOMPONENTS -DHOPSANCORE_NOMULTITHREADING -I"HopsanCore/include" -I"componentLibraries/defaultLibrary" -I"HopsanCore/dependencies/rapidxml" -I"HopsanCore/dependencies/indexingcsvparser/include" -I"HopsanCore/dependencies/libnumhop/include" -I"HopsanCore/dependencies/sundials-extra/include" -I"HopsanCore/dependencies/sundials/include" -IC:/Program Files/Hopsan/dependencies/fmi4c/include -c HopsanCore/src/Component.cpp -o Component.o
Makefile:21: recipe for target 'fmu2_model.o' failed
Makefile:18: recipe for target 'Component.o' failed
g++: error: Files/Hopsan/dependencies/fmi4c/include: No such file or directory
bin\mingw32-make.exe: *** [fmu2_model.o] Error 1
bin\mingw32-make.exe: *** Waiting for unfinished jobs....
g++: error: Files/Hopsan/dependencies/fmi4c/include: No such file or directory
bin\mingw32-make.exe: *** [Component.o] Error 1
File 'C:/Users/iyeh/FMU/FMU_Manager_5.2_031724/dyna_key/case23_inv_pend_hopsan/fmu-stage/binaries/win64/case23_hopsan.dll' not found in directory ''

This is already fixed by #2202 and will work in the next release, which is expected quite soon.
You may also fix it yourself by editing the Makefile and addint quotation marks around the path to fmi4c. It is located in the "fmu-build" directory in the export folder. Then call "compile.ps1". If everything works you can then manually zip the contents of the fmu-stage folder and rename the file to extention ".fmu".

@robbr48 : I failed to locate this file: HopsanGenerator/src/generators/HopsanFMIGenerator.cpp in "program files/hopsan" and make the change as suggested in #2202 .   Could you please let m w know where exactly it is?  Thanks.

@robbr48 , please ignore my last question.  I know what you mean now.  Thanks.


remove sinon-timers

Fix for https://github.com/kmees/karma-sinon-chai/issues/34

Great!

@kmees what do you think about this MR?

Would like to see this merged. I've posted an issue concerning the state of this project.

thanks a lot @adambrunner  for 42818f5


Why not GNU

Linus would be proud

you know what else linus would be proud of?
if you used linux instead of windows


Flexible Project Layout preliminary PR

Contributions: We are not currently taking public contributions - see our contributions policy. However, we are accepting issues and we do want your feedback.

Description
The folder structure changed quite a bit:
Configs now live in SpatialConfig, generated schema, descriptor, worker packages and logs go into SpatialArtifacts. The snapshot is generated directly into the game's Content\Spatial\Snapshots, while the built out workers go into game's Intermediate\SpatialWorkers (I originally wanted them to be in SpatialArtifacts but then UBT thinks there are multiple plugins with the same name).
There are some missing features and bugs that WF have tickets for:

Uploading the client (jira)
Worker logs don't go in the right folder (jira)
Error for not having built out a worker even if we're not running any managed workers (jira)

Tests
Tested the workflow, ran local and cloud deployments.
Documentation
TODO
Primary reviewers
@Vatyx @danielimprobable

Closing this for now since it doesn't need to be a PR in the state it is in.


Update consume-apis-pos.md

:x: Organization membership check failed
Members of the MicrosoftDocs organization should use the private repo. Please move your changes to https://github.com/MicrosoftDocs/Dynamics-365-Operations, and close this pull request.


Warning: Task "sass" not found. Use --force to continue.

I generated a new Keystone project using Sass but received this error after I ran grunt serve and re-saved _variables.scss
>> File "public/styles/site/_variables.scss" changed.
Warning: Task "sass" not found. Use --force to continue.

Aborted due to warnings.

Everything, to me, looks normal and Grunt should be running fine. And I couldn't find any other related issues here. Any ideas?

Both the sass and watch tasks are missing. https://github.com/keystonejs/generator-keystone/blob/master/app/templates/Gruntfile.js#L33 Must've been an oversight. @hatzipanis if you implement the missing tasks please push them upstream.

Hmm, still getting my head around Grunt. Aren't the sass and watch tasks being called in from sass.js and watch.js respectively? watch is working fine too. I feel like we're missing the Grunt plugin? What should we be using here to compile our Sass?

take a look at https://github.com/keystonejs/generator-keystone/blob/master/app/templates/_package.json which task runner did you choose during the generator process? also https://www.npmjs.com/package/load-grunt-tasks
I didn't realize the tasks were in the grunt directory. And you're sure the watch task runs fine? perhaps grunt-load-tasks can't find sass.js

perhaps grunt-load-tasks can't find sass.js

That's what I thought but that wouldn't be consistent with the the other files which seem to be working fine.
In the generator _package.json we don't include any Grunt x Sass plugin to match sass to. Installing sass-grunt fixes the errors and compiles correctly.
Not sure if I've gone about this the right way so maybe yourself and others can weigh in if this is the right solution.

Closed by #132

Fatal error: The implementation option must be passed to the Sass task
SOLVED:
npm install grunt-sass

i have the same problem when i work on a big website , please if any one know what is exactly the problem mean because the error doesnt have that much info


GoFr Framework Support

Like Gin currently supported (https://docs.bugsnag.com/platforms/go/gin/), it would nice to support the well-known gofr framework: https://gofr.dev (https://github.com/gofr-dev/gofr)

Hi @aryanmehrotra,
We have passed your request for Go Fr support on to our Product team, who have added an item to their backlog to look into supporting this. While we don’t have an ETA for when this will be looked into, we will be sure to let you know of any updates.

We can also try to work and add support to it.


Added more functionality to plugin

Added channels, config, demote, search, exec, and binlink commands to the plugin
Builds passed using maven, but no testing has been done on the plugin as of yet

I'm going to deploy the artifact from this build to our Dev Jenkins cluster on Monday, please don't merge this until I've tested the new code

I do usually do some testing, if you do mvn hpi:run it will spin up jenkins locally with the plugin installed and you can do some basic local testing.

This is an awesome contribution, I'd love to see some usage documentation.

Awesome, thanks for the tip! I'll do some of that here in a few minutes.
I was also thinking about what I could do for documentation, not sure if you want to do all the documentation in SCM or if you'd rather switch to GitHub's build-in wiki. The documentation on the plugin is pretty sparse, and I think I could greatly improve it for established and new features.

Commits incoming...

Made a few updates to the readme, should be set to pull now


Have problems with memory usage in Camera2BasicKotlin.

When the app from Camera2BasicKotlin repository is running, I am facing with continually increasing memory usage.
GIF describing the issue is attached.

Steps to reproduce:

Clone and build Camera2BasicKotlin
Deploy it to device
Run and give permissions for Camera
Just leave the app opened and do nothing with it
Open profiler
Observe memory graph

Actual result: memory usage is continually increasing.
Is it a problem? What should I do with it?

Thank you for opening this issue!

Is it a problem?

I will have to take a deeper look, but it definitely looks like a problem to me...

What should I do with it?

Does it happen in the Java version of this sample as well? Another thing you can do is try to help us root cause the memory leak :)

Also, thank you for attaching the GIF. It makes it so much easier to understand bug reports like this one!

Thank you for your reply!

Does it happen in the Java version of this sample as well?

Yes, the Java version has the same problem.
Also, I have checked other camera samples: CameraX and NDK sample, and got interesting results.
It seems like CameraX forces invoke of garbage collector under the hood, pay attention to the trash box icon:

And NDK sample, perfect straight line :)

Hey @AntipovAlexander sorry for the late reply. What specific device are you seeing this in? I spent some time investigating this issue, here is what I think is happening:
Memory usage growth is only happening from the native allocations. I'm 99% sure this means that the issue comes from the HAL (i.e. the device drivers) since we are not calling any native code and we are not creating objects in these samples while the preview is just running.
Further, on my Pixel 3 XL device, I see the garbage collector kicking in and reducing that memory usage. So it's likely that, if memory in your device runs low, the garbage collector will kick in as well. You can test this out by forcing GC in the profiler (right click > Force garbage collection) or potentially even by calling System.gc() in your code -- although I do not recommend that approach in a production app.
I have also tried one of our new samples, Camera2SlowMotion and the GC kicks in at more regular intervals, with native memory usage ranging pretty stable between 10MB and 20MB:

Samsung Galaxy J2 Prime

Hi @owahltinez
I have tested this issue on two physical devices: Huawei P30 Pro (8gb ram), OnePlus 5 (6gb ram) and one emulator (built-in AS, API 28). I was always running into this issue on all my devices.
Unfortunately, I don't have any Pixel devices, so I can't test it like you.
I have already tried forcing GC - it works, but it's not a solution for us :) And as I said, this issue happens only Camera2Basic(Kotlin/Java) samples, but on CameraX sample GC works the same way, as you described.

I think forcing GC is not a solution to the problem, it simply indicates that, if there's memory pressure, the system will be able to free up that memory. The way CameraX operates might be triggering the GC because of some other condition.
What is the problem that you are having, exactly? High memory usage shouldn't affect your app users, since memory will be freed from the native camera stack whenever other processes need that memory.

Closing due to inactivity. Please reopen if you are still experiencing issues with this. You can also start a thread on the developer forums if you wish!

Hi @owahltinez
I have tested this issue on two physical devices: Huawei P30 Pro (8gb ram), OnePlus 5 (6gb ram) and one emulator (built-in AS, API 28). I was always running into this issue on all my devices.
Unfortunately, I don't have any Pixel devices, so I can't test it like you.
I have already tried forcing GC - it works, but it's not a solution for us :) And as I said, this issue happens only Camera2Basic(Kotlin/Java) samples, but on CameraX sample GC works the same way, as you described.

Hi @AntipovAlexander
You're right! I tried many solutions, the only solution is forcing GC, but not call System.gc()
    private byte [] fuckingData = null;
    private void fixFuckingCam2OOM() {
        if (fuckingData == null) {
            fuckingData = new byte[1024 * 1024];
        } else {
            fuckingData = null;
        }
    }

I call this method every camera frame! this will cause system gc per second!
My devices is Nokia x7 / 9.0

i have the same question


Add osu!lazer

This adds the Game osu!lazer the open source popular rythm game to the community store. It doesn’t seem to change ipa versions so might have to figure how to update later on.

This can be tested by using this source link https://raw.githubusercontent.com/SideStore/Community-Source/Add-Osu!laser/sidecommunity.json

Please remove this immediately.

Please remove this immediately.

Was removed thanks.


[Proposal] Discord Statistics Bot

This is an idea for a discord bot which:

shows the users messages in the last 7 days (and uses that to predict their future message count)
can make a wordcloud of the messages in a channel or by a user or both

This will provide an informative and interesting visualization of the activity in a discord server or a discord user

@Shubhanshu156 could you please review this


Error after closing Mode Shape Animation

Resulting error:
"""
ERROR:root:Shader object was not initialized, cannot attach it (repeated 3 times)
ERROR:root:#version 120
WARNING:root:ERROR: in C:\...\VTK-source\Rendering\OpenGL2\vtkShaderProgram.cxx, line 431
vtkShaderProgram (000001FAF5D91250)
"""
This then repeats until I restart the kernel.

Windows 10
pyansys 0.37.2
pyvista 0.20.3
vtk 8.1.2

Can't reproduce this error.  Does this still occur with the latest pyvista and pyansys?

This was the code I tested on Windows using the latest pyansys and pyvista.  Does it work on your end?
import pyansys
from pyansys import examples

rst = pyansys.read_binary(examples.rstfile)
rst.animate_nodal_solution(0, show_edges=True)

I don't think this is still an issue due to upstream changes in pyvista.
@emhen, could you please check this with the latest pyvista and pyansys?  There's been some changes in pyvista and the issue may have been solved.
Closing due to inactivity soon.


Add area for 3rd party plugins

Let's add the Gulp one too: https://github.com/prateekbh/gulp-optimize-js

Thanks for the PR; merging!

:(  @nolanlawson https://github.com/vigneshshanmugam/optimize-js-plugin

@vigneshshanmugam PRs welcome! :)


Replacement for _safeTransfer / ability to transfer tokens that don't belong to msg.sender?

In earlier versions, _safeTransfer allowed for transferring tokens without a check that the token was owned by the msg.sender.
This allowed for useful functionality in a number of cases - specifically, there are two cases we've used this functionality for:

When implementing loan functionality (see MetaAngels https://etherscan.io/address/0xad265ab9b99296364f13ce5b8b3e8d0998778bfb#code) where an owner could lend a token to someone else via a safeTransferFrom and then reclaim it back via a _safeTransfer

When creating SBTs and having an override functionality for an owner or a group of delegates to transfer a token from a compromised or old wallet to a new wallet for a given end user

Is there a way to implement functionality along these lines with 4.2 of ERC721A? I see ERC721A now supports ERC4907, which is great, but given that ERC4907 support isn't widely supported just yet for NFT rentals/loans, it would still be nice to specifically be able to support the first use case presented above where a user can actually initiate a real transfer of a token to another user and then reclaim it back themselves without having to rely on the borrower doing so.
If there is no way to implement functionality like this - any ideas on what might be the easiest way to override the existing functionality in ERC721A to support a transfer function without an ownership check?
Thank you!

If you are using the main non-upgradeable ERC721A,
use this function to directly approve the token for transfers by the current message sender:
Make sure ERC721A is the first class in the inheritance, or else this may not work.
contract Bypass is ERC721A {

    constructor() ERC721A("A", "A") {}

    function _directApproveMsgSenderFor(uint256 tokenId) internal {
        assembly {
            mstore(0x00, tokenId)
            mstore(0x20, 6) // `_tokenApprovals` is at slot 6.
            sstore(keccak256(0x00, 0x40), caller())
        }
    }
}

Whoah - thank you SO much for taking the time to write all of that out @Vectorized! Seriously - you're the best repo maintainer I've ever seen - really appreciate how hands on you are with helping everyone with this repo. Definitely wouldn't have come up with this on my own lol.
So if I'm understanding this correctly, I could just call this function directly ahead of any safeTransferFrom/transferFrom call and it would directly approve the msg.sender()/caller() so that _getApprovedSlotAndAddress(tokenId) would return the msg.sender() as the approvedAddress, thereby passing the _isSenderApprovedOrOwner() call?
So I'd just write something like this:
function retrieveLoanedToken(uint256 tokenId) public {
    if (msg.sender() != originalOwnerOfToken(tokenId)) revert NotOriginalOwner();
    _directApproveMsgSenderFor(tokenId);
    safeTransferFrom(ownerOf(tokenId), msg.sender(), tokenId);
}

And that would just work?
THANK YOU!!! Literal godsend - so insanely helpful. Really appreciate it!

You are the best. THANK YOU!!!


Failed at the node-sass

I used npm rebuild, but it's not working.  What's the problem?

4933 error Windows_NT 5.1.2600
4934 error argv "C:\Program Files\nodejs\node.exe" "C:\Program Files\nodejs\node_modules\npm\bin\npm-cli.js" "install" "node-sass"
4935 error node v5.6.0
4936 error npm  v3.6.0
4937 error code ELIFECYCLE
4938 error<EMAIL_ADDRESS>postinstall: node scripts/build.js
4938 error Exit status<PHONE_NUMBER>
4939 error Failed at the<EMAIL_ADDRESS>postinstall script 'node scripts/build.js'.
4939 error Make sure you have the latest version of node.js and npm installed.
4939 error If you do, this is most likely a problem with the node-sass package,
4939 error not with npm itself.
4939 error Tell the author that this fails on your system:
4939 error     node scripts/build.js
4939 error You can get information on how to open an issue for this project with:
4939 error     npm bugs node-sass
4939 error Or if that isn't available, you can get their info via:
4939 error     npm owner ls node-sass
4939 error There is likely additional logging output above.
4940 verbose exit [ 1, true ]

Thanks a lot.

4938 error Exit status<PHONE_NUMBER>

Duplicate of https://github.com/sass/node-sass/issues/1283


fix: ensure shared configs are merged

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 63.11%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1306

Relevant Lines:
1802

💛  - Coveralls


HV-1434 Make order of  and  consistent

https://hibernate.atlassian.net/browse/HV-1434

Merged; thanks, @gsmet!


"Attempting to resetState while current state is destroyed"

Describe your problem here.
I dont know what happened
Version: 0.5.1

Are you modding a build from source or with Lua?
Source
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
Everything

0.5.1 is not supported but you need to downgrade your flixel to 5.5.0 or update the code to work with latest

0.5.1 is not supported but you need to downgrade your flixel to 5.5.0 or update the code to work with latest

How do i downgrade?

0.5.1 is not supported

^

0.5.1 is not supported

^

Actually i figured it out i just uh updated haxeflixel and all others to their latest version


[MINOR] Fix import in NettyStreamManager.scala

What changes were proposed in this pull request?
Fix import in NettyStreamManager.scala
How was this patch tested?
straight forward

Can one of the admins verify this patch?

Can one of the admins verify this patch?

Can one of the admins verify this patch?

It's virtually same before/after and I wouldn't fix the styles alone in a PR but rather help review other PRs.

Thanks for your reviews @HyukjinKwon @srowen .


Bugged when using Airpods

The visualiser bugs when I’m using my AirPods Max. I don’t have any other headphones to test

https://github.com/ryannair05/libmitsuha6/blob/12977281f7ceaecaea70bb623d4f19734cba4631/MSHFView.m#L120 is the cause of the issue. This was my best attempt at mitigating it, but a new solution is needed

Sorry about the tags, more than happy to test anything if needed. I do only have AirPods Max to test though

Would this work? I don’t have a way to test it.
// Instead of checking for a fixed length, calculate a factor based on length float lengthFactor = (float)length / 480.0; // Adjust this baseline as needed float meanLevel = 0.0; vDSP_measqv(data, 1, &meanLevel, _numberOfPoints); gainAdjusted *= 256 * (meanLevel + lengthFactor);


Accessing supplementary request/response objects

Is it possible to access all of the data and metadata for additional requests/responses downloaded as part of a Splash request?  To be clear, if I grab a webpage (say github.com), many additional requests are made as part of that fetch (such as background images and extra CSS/JS files), with these images and texts coming back as additional responses.  The requests and responses made for these supplementary items is what I'm after.
Currently, as a work-around, I can use the HAR results to get most of the Request/Response metadata, such as headers.  However, there doesn't seem to be any method of actually retrieving the core data returned for these responses.
Edit: This is a question, however I cannot assign the Question label to this issue.  My apologies.

Hi @Deggor,
No, unfortunately this is not possible yet. There is some info in gitter chat logs; it is kind of tricky to implement. @AlexIzydorczyk had a hack-ish implementation in his branch.
A good point about labels, they can be assigned only by repo owners. We should change the README, sorry for the confusion.

So, from preliminary review, it looks like proxy/wrapper is needed for the QNetworkReply to hold the data usually discarded after being consumed by the QWebPage.  The repo link has been down since before August 21.  For you and @AlexIzydorczyk, I found an archive link to the discussed repo on archive.org.  Looks like I've got a lot of review, research, and busy weekends ahead.  Thanks for the reply, @kmike!

Yeah, it looks like it, we need a QNetworkReply wrapper. Maybe we can steal something from https://github.com/lorien/wkit/blob/master/wkit/reply.py.

This will be possible in upcoming Splash 2.2: there is now splash.response_enabled flag, request:enable_response_body method and response_body HTTP argument.


added status icons and feedback variable

Problem
As a user,
I would like to see graphical icons when I submit my email
to give me a better understanding of how my request was handled!
Solution
Added react-spinners and used https://www.icongr.am/ to source success/failure icons for the email subscription component.
Change summary:

added status icons and feedback variable 9b93638

Steps to Verify:

Checkout branch using git checkout enhancement/email-icons
Start local development server using yarn start
Submit email in form to verify that appropriate response message and loading/static icons are returned

@mocklee We don't need those dependencies!! All the dependencies that we have and need are already there in the repo. I had this same issue. Just clear your yarn cache and reinstall your dependencies. Delete node modules, yarn lock file, and clear yarn cache. Please delete those dependencies!

@mocklee We don't need those dependencies!! All the dependencies that we have and need are already there in the repo. I had this same issue. Just clear your yarn cache and reinstall your dependencies. Delete node modules, yarn lock file, and clear yarn cache. Please delete those dependencies!

alright, I'll revert that commit. please mention any dependency issues that are unable to be resolved on remote so the rest of the team can be on the same page.

@mocklee Will do! My apologies. Since we upgraded to several major versions, it seems like what yarn had cached + what was in the node_modules was out of date. I'll drop a link in the slack channel.


Nested split dropdown in navbar

I've tried to make split dropdown button menu (button action and dropdown actions has their own links). I'm strucked at nested part.
There's example: http://www.bootply.com/VrDVKZAaDY
When you open dropwdown and then try to open 2nd one it collapse 1st one instead.
Does anyone faced with that problem (similar issues was found, but there's simple dropdowns, not a split) and is there solution?

Sorry, but we cannot help with how-to or general troubleshooting issues here; only bug reports and feature requests. You'll want to ask around in the official Slack team or Stack Overflow. See our readme for more details.

This is a saved reply.


After upgrade to 1.2.4, Window menu no longer lists open windows

Running Atom on a MacBook Air running Yosemite 10.10.5.
After upgrading the core package to 1.2.4, the Window menu no longer contains a list of the open windows.  The list of open windows also no longer appears when selecting the Atom icon from the Dock.  If a window is minimized to the Dock, it is no longer accessible.
I've taken the following screenshots with 4 Atom windows open:
Missing list of open windows from the Window menu:

Missing list of open windows from the Dock icon:

This has already been fixed in the 1.3.0 betas.

Confirmed that this works in 1.3.0 beta.  Thanks.


Vc/docker dataengineering sqlmesh

This PR adds a new git submodule for a repo for a custom docker image for data engineering. The image has been tested locally and has built/pushed successfully to https://hub.docker.com/r/lscsde/dataengineering-sqlmesh-notebook/tags.
However, an earlier attempt where this repo was forked from https://github.com/lsc-sde/docker-datascience-notebook-default resulted in wrong version number being assigned to the docker image that was built and pushed (0.1.23) - could this be deleted please?

I have merged the PR and I have deleted tag 0.1.23 from the image repo


names.json had a reserved keyword in it, "catch"

Thanks

Found a few more keywords and removed them from names.json in https://github.com/ben-sb/javascript-deobfuscator/commit/25aebd71a5b67abbd951a801fa929f0bd25f2d4a

What's your discord username? I have some questions about control flow flattening whenever you aren't busy.


Update navigator layers

Description of what has changed
The layer files for both NIST 800-53 R4 and R5 have been updated with the newest attack-navigator release 4.3. It should resolve the prompt received when using layer files from this repository. @isaisabel
Issues addressed by pull request
Closes #65

I did not update the ATT&CK version to "9" since I was not sure if that would affect the current mappings. When testing this change you would get the following dialog box when loading a layer from this repo.

I did not update the ATT&CK version to "9" since I was not sure if that would affect the current mappings. When testing this change you would get the following dialog box when loading a layer from this repo.

We've not upgraded to ATT&CK version 9 in these mappings (they still map to v8) so the ATT&CK version referenced in the layer should not change.

We've not upgraded to ATT&CK version 9 in these mappings (they still map to v8) so the ATT&CK version referenced in the layer should not change.

Perfect, Good to know!


Add GPU kernel for ApplyProximalAdagrad

First PR from splitting https://github.com/tensorflow/tensorflow/pull/43299 up into multiple PRs.
I'm not sure if the relevant tests need to be told to run on the GPU.
cc @nluehr @sanjoy

I'm not sure if the relevant tests need to be told to run on the GPU.

I suspect not, but you can verify by intentionally introducing a bug and re-running.  :)


Support configuring RESTAPI to GRPC via HTTPFilterPolicy

add grpcJsonTranscoder plugin
fix #605

i will add e2e test later

@spacewander After using the grpc_json_transcoder, it appears to load by default
htnn/gateway:e2e error info:
2024-06-30T00:30:00.840780Z warning envoy config external/envoy/source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:138 gRPC config for type.googleapis.com/envoy.config.listener.v3.Listener rejected: Error adding/updating listener(s) <IP_ADDRESS>_10000: Proto constraint validation failed (field: "descriptor_set", reason: is required):
thread=18
2024-06-30T00:30:01.899953Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:02.898713Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:03.899237Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected

istiod error info:
2024-06-30T00:32:44.401660Z info ads ADS: "<IP_ADDRESS>:48202" default-istio-7b5bfb6c49-d6nn8.e2e-another-35 terminated
2024-06-30T00:33:48.712678Z info delta ADS: "<IP_ADDRESS>:51874" istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-1 terminated
2024-06-30T00:33:49.104493Z info delta ADS: new delta connection for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36
2024-06-30T00:33:49.107514Z info delta CDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:21 removed:0 size:21.7kB cached:0/20 filtered:0
2024-06-30T00:33:49.110402Z info delta EDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:20 removed:0 size:3.2kB empty:4 cached:0/20 filtered:0
2024-06-30T00:33:49.110919Z info delta LDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:1 removed:0 size:5.0kB
2024-06-30T00:33:49.165421Z warn delta ADS:LDS: ACK ERROR istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36 Internal:Error adding/updating listener(s) <IP_ADDRESS>_18000: Proto constraint validation failed (field: "descriptor_set", reason: is required):

@spacewander After using the grpc_json_transcoder, it appears to load by default htnn/gateway:e2e error info:
2024-06-30T00:30:00.840780Z warning envoy config external/envoy/source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:138 gRPC config for type.googleapis.com/envoy.config.listener.v3.Listener rejected: Error adding/updating listener(s) <IP_ADDRESS>_10000: Proto constraint validation failed (field: "descriptor_set", reason: is required):
thread=18
2024-06-30T00:30:01.899953Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:02.898713Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:03.899237Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected

istiod error info:
2024-06-30T00:32:44.401660Z info ads ADS: "<IP_ADDRESS>:48202" default-istio-7b5bfb6c49-d6nn8.e2e-another-35 terminated
2024-06-30T00:33:48.712678Z info delta ADS: "<IP_ADDRESS>:51874" istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-1 terminated
2024-06-30T00:33:49.104493Z info delta ADS: new delta connection for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36
2024-06-30T00:33:49.107514Z info delta CDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:21 removed:0 size:21.7kB cached:0/20 filtered:0
2024-06-30T00:33:49.110402Z info delta EDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:20 removed:0 size:3.2kB empty:4 cached:0/20 filtered:0
2024-06-30T00:33:49.110919Z info delta LDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:1 removed:0 size:5.0kB
2024-06-30T00:33:49.165421Z warn delta ADS:LDS: ACK ERROR istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36 Internal:Error adding/updating listener(s) <IP_ADDRESS>_18000: Proto constraint validation failed (field: "descriptor_set", reason: is required):

We need to provide a placeholder config for http filter in HTTPFilterConfigPlaceholder. The placeholder config will be validated but won't be used.
I am not sure how deep Envoy will validate the config in https://www.envoyproxy.io/docs/envoy/latest/api-v3/extensions/filters/http/grpc_json_transcoder/v3/transcoder.proto#extensions-filters-http-grpc-json-transcoder-v3-grpcjsontranscoder, maybe we can pass a fake pb filename if it doesn't validate the content.

HTTPFilterConfigPlaceholder

Thank you for your help. I've seen similar examples in other code sections, and I will give it a try following your suggestions.

@spacewander使用grpc_json_transcoder后，似乎默认加载htnn/gateway:e2e错误信息：
2024-06-30T00:30:00.840780Z warning envoy config external/envoy/source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:138 gRPC config for type.googleapis.com/envoy.config.listener.v3.Listener rejected: Error adding/updating listener(s) <IP_ADDRESS>_10000: Proto constraint validation failed (field: "descriptor_set", reason: is required):
thread=18
2024-06-30T00:30:01.899953Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:02.898713Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected
2024-06-30T00:30:03.899237Z warn Envoy proxy is NOT ready: config received from XDS server, but was rejected: cds updates: 1 successful, 0 rejected; lds updates: 0 successful, 1 rejected

istiod 错误信息：
2024-06-30T00:32:44.401660Z info ads ADS: "<IP_ADDRESS>:48202" default-istio-7b5bfb6c49-d6nn8.e2e-another-35 terminated
2024-06-30T00:33:48.712678Z info delta ADS: "<IP_ADDRESS>:51874" istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-1 terminated
2024-06-30T00:33:49.104493Z info delta ADS: new delta connection for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36
2024-06-30T00:33:49.107514Z info delta CDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:21 removed:0 size:21.7kB cached:0/20 filtered:0
2024-06-30T00:33:49.110402Z info delta EDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:20 removed:0 size:3.2kB empty:4 cached:0/20 filtered:0
2024-06-30T00:33:49.110919Z info delta LDS: PUSH request for node:istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system resources:1 removed:0 size:5.0kB
2024-06-30T00:33:49.165421Z warn delta ADS:LDS: ACK ERROR istio-ingressgateway-56d5bdc4f5-5kjqx.istio-system-36 Internal:Error adding/updating listener(s) <IP_ADDRESS>_18000: Proto constraint validation failed (field: "descriptor_set", reason: is required):

我们需要在 HTTPFilterConfigPlaceholder 中为 http 过滤器提供占位符配置。该占位符配置将被验证但不会被使用。
我不确定 Envoy 将如何深入验证https://www.envoyproxy.io/docs/envoy/latest/api-v3/extensions/filters/http/grpc_json_transcoder/v3/transcoder.proto#extensions-filters-http-grpc-json-transcoder-v3-grpcjsontranscoder中的配置，如果它不验证内容，也许我们可以传递一个假的 pb 文件名。

Thank you for your help. I've seen similar examples in other code sections, and I will give it a try following your suggestions.


[main] TAB-9521:remove unused main methods from codebase

Looks good other than the / you noted in chat.
This commit stream needs to go into main, 4.4.1, 4.4.0, and possibly 4.3.10. Is this commit stream properly daggy?

this commit is daggy, I'll raise PR's for other branches as well.


#382 implement authentication

Please resolve conflicts before requesting a review 🙏
Also it is a good practice to run npm run build-dev to catch the errors that can occur during vercel deployment
This is the Error:

The checks pass now. Some unused components which were committed couple of days ago, I forgot to remove with the latest final changes yesterday.

we are also missing the refresh token mechanism implemented

@MarijaTrajkoska @stefanatanasovmk please resolve conflicts and tag me so we can merge this as soon as possible 🙏


Loading big dataset raises pyarrow.lib.ArrowNotImplementedError

Describe the bug
Calling datasets.load_dataset to load the (publicly available) dataset theodor1289/wit fails with pyarrow.lib.ArrowNotImplementedError.
Steps to reproduce the bug
Steps to reproduce this behavior:

!pip install datasets
!huggingface-cli login
This step will throw the error (it might take a while as the dataset has ~170GB):

from datasets import load_dataset
dataset = load_dataset("theodor1289/wit", "train", use_auth_token=True)

Stack trace:
(torch-multimodal) bash-4.2$ python test.py
Downloading and preparing dataset None/None to /cluster/work/cotterell/tamariucai/HuggingfaceDatasets/theodor1289___parquet/theodor1289--wit-7a3e984414a86a0f/0.0.0/2a3b91fbd88a2c90d1dbbb32b460cf621d31bd5b05b934492fdef7d8d6f236ec...
Downloading data files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 491.68it/s]
Extracting data files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 16.93it/s]
Traceback (most recent call last):
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 1860, in _prepare_split_single
    for _, table in generator:
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/packaged_modules/parquet/parquet.py", line 69, in _generate_tables
    for batch_idx, record_batch in enumerate(
  File "pyarrow/_parquet.pyx", line 1323, in iter_batches
  File "pyarrow/error.pxi", line 121, in pyarrow.lib.check_status
pyarrow.lib.ArrowNotImplementedError: Nested data conversions not implemented for chunked array outputs

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/cluster/work/cotterell/tamariucai/multimodal-mirror/examples/test.py", line 2, in <module>
    dataset = load_dataset("theodor1289/wit", "train", use_auth_token=True)
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/load.py", line 1791, in load_dataset
    builder_instance.download_and_prepare(
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 891, in download_and_prepare
    self._download_and_prepare(
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 986, in _download_and_prepare
    self._prepare_split(split_generator, **prepare_split_kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 1748, in _prepare_split
    for job_id, done, content in self._prepare_split_single(
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 1893, in _prepare_split_single
    raise DatasetGenerationError("An error occurred while generating the dataset") from e
datasets.builder.DatasetGenerationError: An error occurred while generating the dataset

Expected behavior
The dataset is loaded in variable dataset.
Environment info

datasets version: 2.11.0
Platform: Linux-3.10.0-1160.80.1.el7.x86_64-x86_64-with-glibc2.17
Python version: 3.10.4
Huggingface_hub version: 0.13.3
PyArrow version: 11.0.0
Pandas version: 1.5.3

Hey, thanks for the reply! I've since switched to working with the locally-saved dataset (which works).
Maybe it makes sense to show a warning for uploads with large shard sizes? Since the functionality completely breaks (due to the PyArrow bug).

Just tried uploading the same dataset with 500MB shards, I get an errors 4 hours in:
Pushing dataset shards to the dataset hub:  25%|██▍       | 358/1453 [4:40:31<14:18:00, 47.01s/it]
Traceback (most recent call last):
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/_commit_api.py", line 344, in _inner_upload_lfs_object
    return _upload_lfs_object(operation=operation, lfs_batch_action=batch_action, token=token)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/_commit_api.py", line 391, in _upload_lfs_object
    lfs_upload(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/lfs.py", line 254, in lfs_upload
    _upload_multi_part(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/lfs.py", line 374, in _upload_multi_part
    hf_raise_for_status(part_upload_res)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/utils/_errors.py", line 301, in hf_raise_for_status
    raise HfHubHTTPError(str(e), response=response) from e
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/utils/_errors.py", line 46, in __init__
    server_data = response.json()
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/requests/models.py", line 899, in json
    return complexjson.loads(
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/json/__init__.py", line 357, in loads
    return _default_decoder.decode(s)
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "process_wit.py", line 146, in <module>
    dataset.push_to_hub(FINAL_PATH, max_shard_size="500MB", private=False)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/datasets/dataset_dict.py", line 1534, in push_to_hub
    repo_id, split, uploaded_size, dataset_nbytes, _, _ = self[split]._push_parquet_shards_to_hub(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 4804, in _push_parquet_shards_to_hub
    _retry(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/datasets/utils/file_utils.py", line 281, in _retry
    return func(*func_args, **func_kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 120, in _inner_fn
    return fn(*args, **kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/hf_api.py", line 2593, in upload_file
    commit_info = self.create_commit(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 120, in _inner_fn
    return fn(*args, **kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/hf_api.py", line 2411, in create_commit
    upload_lfs_files(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 120, in _inner_fn
    return fn(*args, **kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/_commit_api.py", line 351, in upload_lfs_files
    thread_map(
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/tqdm/contrib/concurrent.py", line 69, in thread_map
    return _executor_map(ThreadPoolExecutor, fn, *iterables, **tqdm_kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/tqdm/contrib/concurrent.py", line 51, in _executor_map
    return list(tqdm_class(ex.map(fn, *iterables, chunksize=chunksize), **kwargs))
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/tqdm/std.py", line 1178, in __iter__
    for obj in iterable:
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/concurrent/futures/_base.py", line 619, in result_iterator
    yield fs.pop().result()
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/concurrent/futures/_base.py", line 444, in result
    return self.__get_result()
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/cluster/work/cotterell/tamariucai/miniconda3/envs/torch-multimodal/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/cluster/home/tamariucai/.local/lib/python3.8/site-packages/huggingface_hub/_commit_api.py", line 346, in _inner_upload_lfs_object
    raise RuntimeError(f"Error while uploading '{operation.path_in_repo}' to the Hub.") from exc
RuntimeError: Error while uploading 'data/train-00358-of-01453-22a5cc8b3eb12be3.parquet' to the Hub.

Local saves do work, however.

Hmmm that was probably an intermitent bug, you can resume the upload by re-running push_to_hub

Leaving this other error here for the record, which occurs when I load the +700GB dataset from the hub with shard sizes of 500MB:
 Traceback (most recent call last):
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/builder.py", line 1860, in _prepare_split_single
    for _, table in generator:
  File "/cluster/home/tamariucai/.local/lib/python3.10/site-packages/datasets/packaged_modules/parquet/parquet.py", line 69, in _generate_tables
    for batch_idx, record_batch in enumerate(
  File "pyarrow/_parquet.pyx", line 1323, in iter_batches
  File "pyarrow/error.pxi", line 115, in pyarrow.lib.check_status
OSError: Corrupt snappy compressed data.

I will probably switch back to the local big dataset or shrink it.

push_to_hub has a fast resuming, though for audio/image there is this PR to fix a speed issue: https://github.com/huggingface/datasets/pull/6056


Use Engine Environment variables when provisioning a node

What kind of request is this (question/bug/enhancement/feature request):
enhancement
Steps to reproduce (least amount of steps as possible):
Have Rancher and a downstream nodedriver cluster in an environment where proxy is required to access the internet.
Deploy node in the downstream cluster using a node template that defines proxy environment variables via Engine Environment
Result:
The environment variables defined in the template are not used when Rancher attempts to install docker on the node with sh -c 'if ! type docker; then curl -sSL https://releases.rancher.com/install-docker/19.03.sh | sh -; fi.
This can cause the install to hang and provisioning to timeout unless these environment variables are defined in /etc/environment, either via cloud-config, or baked into an image.
Other details that may be helpful:
These environment variables are added to a service override for docker. It would be ideal if they were used in the initial deployment, and perhaps an optional checkbox to add these variables to /etc/environment at provisioning. This would allow operators to deploy a node entirely from Rancher using standard images, without any image building process
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): v2.4.x -> v2.5.3
Installation option (single install/HA):

gz#13697

Sounds the same as https://github.com/rancher/rancher/issues/13206

I was able to reproduce this on 2.6-head (931a0f0) by doing the following:

deploy a proxied rancher setup (rancher only has internet access through proxy)
define proxy in node template -> engine options -> engine environment for http_proxy, https_proxy, no_proxy
deploy the cluster

even if you define proxy env. vars in the cluster (under advanced options), the cluster fails to come to an active state.

a potential workaround; for custom nodes, you can login to the node and define the docker proxy settings, which allows the node to provision with the proxied rancher cluster.

Engineering will never update to make this enhancement due to the varying OSes that would need to be supported for this use case.
Recommendation would be to use either cloud config or a built-in image that has the proxy environment variables configured on the host.


Add sqlite feature flag

Add "sqlite" feature flag to maplibre-build-tools.
However the maplibre still needs sqlite dependency, therefore the "sqlite" feature is still needed to be enabled in maplibre. Not sure if we need another flag in maplibre?
💻 Examples

🚨 Test instructions

✔ PR Todo

[x] Included links to related issues/PRs
#107

I updated the branch because of major refactorings on main.

So, I have moved the sqlite flag from each function to the lib mod and added conditional flags in the build.rs file.

After buids finish I'd merge this :) thank you!


Incorrect posts representation

Minimal Mistakes version: using remote flag remote_theme: "mmistakes/minimal-mistakes"
Ruby gem or remote theme version: freshly install ruby v2.7
Jekyll version: 3.8.5
Git repository URL: not published. testing locally. target url i want to publish is github.com/donalora/donalora.github.io
GitHub Pages hosted (if yes provide URL to site): www.donalora.com
Operating system: linux, fedora 32

Expected behavior
each post represents its' contents + sorts out in "list of posts" correctly
Steps to reproduce the behavior
assume you have
2020-03-03-some-name.md
2020-04-04-some-name.md

notice name is same but date is different.
expected behaviour is each post link should open to /2020/03/03/some-name and /2020/04/04/some-name respectively (don't mind he prefixes). also general posts should be sorted by date not by title (i hacked by providing permalink).
Other

sample ^. new e-shop is created mid March, updated photos is created just now - mid May. and both point to the earliest (which is March) post

What's your global permalink setting? (The one in _config.yml)
If you set it to just /:title/, Jekyll may be confused by that. I don't think it's this theme's fault.

i have this:
collections:
  posts:
    output: true
    permalink: /post/:year/:month/:day/:slug

oh no. sorry, got very premature here. i still had permalinks in my markdown. so after removing them it doesn't work with just :title. it's the same one (and earliest). no matter what title i would expect to be sorted by date and title if not possible by time within the post.
each post should make sure it opens what it represents. after the change you suggested it just got worse results: same url (without date) for both posts. previously at least i had diferent url (date part: 2020/04/04 and 2020/03/03)

As usual - classic mistake of copy/paste. Apologies for the alert.
Let me explain myself:

I copied existing post and only replaced title and contents
went to bed as it was pretty late
forgot about all this and after a week attempted to come back to this

lesson to myself - attention to detail


feat: add worktop/cfw.r2 module

Even though R2 is in beta, getting this module out early for use. As R2 continues development, more will be handled by the platform itself; eg:

Range request header parsing
parse if-range header (hopefully)
auto-detect content-type value form values (hopefully)
more response headers written by R2.Object.writeHttpMetadata automatically:

etag
accept-ranges
content-range
etc

@lukeed
ser, thank you for the wonderful repo.
do you have a timeline for when this will be merged?
would love it to try it out on our backend haha

Hey @lukeed,
Was wondering if there is a timeline for the release of the r2 features.
Thank you!

R2 has be generally available since end of September 2022.
Anything I can do to move this along?


Faulty (extra) marker in chart two datasets?

Hi,
I got a simple chart with two time-datasets. In time the second one follows the first one and visually all is good. But when I hover over one serie I get a marker on both series and the tooltip display values from both.  What have I done wrong?
https://jsfiddle.net/21sovd6w/6/

IMO this is a feature. You tooltips and hover are set to index. The functionality is as expected. You can use x or nearest mode instead. See Modes


Transition stuttering on keyboard open / close

Bug report
Describe the bug
The page transition stutters inconsistently while the keyboard is opened and the sheet is resized during the transition.
Sometimes the performance hit won't happen at all but certain times it is very consistent.
I have suspicions that playing youtube videos on the background increases this lag effect.
Steps to reproduce
Steps to reproduce the behaviour:

Open a main sheet (found currently only on ios not sure of android)
Navigate to a sheet with a autofocus TextField
Stutter happens once in a while (In the demo it is clearly visible).

Expected behaviour
Smooth consistent transition.

Additional context
Demo video of the issue and normal behaviour at the end of the clip
https://github.com/woltapp/wolt_modal_sheet/assets/97504729/976dac79-435e-4463-984f-22438ad4dcec

Unfortunately the worst part of this package is handling the keyboard animation smoothly. Flutter does not provide a keyboard animation listener. If anyone in the community knows a way to get soft keyboard visibility animation callbacks, I am more than happy to listen :(

Unfortunately the worst part of this package is handling the keyboard animation smoothly. Flutter does not provide a soft keyboard animation listener. If anyone in the community knows a way to get soft keyboard visibility animation callbacks, I am more than happy to listen :(

Thanks for the reply, I'll keep an eye out for if something comes up. i'll make sure to report it here. Atleast it's a nice thing to know that it's something that can occure for other people as well and not just some weird quirk that i've caused myself.

@kkoskenvirta Also this one: https://github.com/woltapp/wolt_modal_sheet/issues/210
If you can find a solution that removes the dependency to keyboard_visibility_listener it would be amazing!

@ulusoyca
Could we just use viewInsets from MediaQuery to get keyboard height?
E.g
class Test extends StatelessWidget {
  const Test({super.key});

  @override
  Widget build(BuildContext context) {
    final height = MediaQuery.viewInsetsOf(context).bottom;

    return SafeArea(
      child: Material(
        child: Column(
          mainAxisAlignment: MainAxisAlignment.end,
          children: [
            const TextField(),
            const Text('This is above Keyboard'),
            SizedBox(height: height),
          ],
        ),
      ),
    );

@KlausJokisuo I tried it a lot and for some reason, in this setup it is always 0 regardless of the visibility. I would appreciate if you can also try.

Some stuff that I tried out was switching the clipBehaviour settings for the WoltModalSheet with WoltModalSheetTheme, as Clip.antiAliasWithSaveLayer is said to be demanding, as for my own usecase I think I don't require this because i'm not swapping any pages with images in them. Will see if this gives some results.. Anyway the rabbit hole with the TextField and keyboard performance stuff seems to go very deep that is very much out of the scope of this package 😅

Some stuff that I tried out was switching the clipBehaviour settings for the WoltModalSheet with WoltModalSheetTheme, as Clip.antiAliasWithSaveLayer is said to be demanding, as for my own usecase I think I don't require this because i'm not swapping any pages with images in them. Will see if this gives some results..  I hope Flutter team improves this but it looks like low prio. I will bring this up and give feedback in our meetings with the Flutter team.

I happened to find the root cause for this issue. When closing WoltModalSheet with .pop(), GoRouter rebuilt the whole StatefulShellRoute and even the other hidden branches, leading to the animation lag. Not sure if there is anything this package can do to fix the rebuild issue. Though I found that if I push new pages with Navigator.of(context).push() instead of GoRouter.of(context).push() it wont rebuild the underlying pages.


osd: fix collocation spelling and declare dmcrypt variables

changed s/colocation/collocation/
declare dmcrypt variable in ceph-common so the variables check does
not fail

Signed-off-by: Sébastien Han<EMAIL_ADDRESS>

test this please

test this please

test this please


Allow 1.8.7 to fail, test RubyGems 2.6.6

@segiddins I propose that there are not enough hours in the universe to retry desired mergers until they will have no segfaults. If we manage break 1.8.7 compatibility, we will fix it and release a bugfix version ASAP, but we need to be able to ship 1.14 ASAP first.

😭 I guess we have no choice unless travis fixes this on their end. My only stipulation is that we manually check those allowed 1.8.7 failures (on the latest master/stable CI run) before release

@homu r+

:pushpin: Commit 1f95722 has been approved by segiddins

:hourglass: Testing commit 1f95722 with merge fb3a2c9...

:sunny: Test successful - status


2250Khz throughput unreproducible

Setup

pytorch 1.0
APEX level 03
V100
torch.backends.cudnn.benchmark = True ( we ran multiple runs with exactly the same input, and turning this on improved throughput for all runs except for the very first run )
mel frame 880
checked tensor cores are being utilized ( hand-checked by looking at operation names using Nsight Compute)

Method of measuring throughput
we used exactly the same code as inference.py except we added a single line --
torch.cuda.synchronize() -- to synchronize GPU & CPU:
# code snippet from inference.py
start_time = time.time()
audio = waveglow.infer(mel, sigma=sigma)
torch.cuda.synchronize() # this line is the only modification
end_time = time.time() - start_time

Throughput
we achieved 920Khz which is significantly slower than 1500Khz and 2750Khz proposed in the paper.
When we measure the time without torch.cuda.synchronize() we get close to 2750Khz, but this is because inference is being done asynchronously -- CPU doesn't wait for wavglow's inference to complete.

ping!

Maximize the GPU's memory footprint, e.g. zero padding, to get the throughput described in the paper.

Closing due to inactivity.


Add Enkrypt extension connector

Description
Adds a connector for the new Enkrypt extension.
Additional Information

[x] I read the contributing docs (if this is your first contribution)

We can discuss adding this to the core in the future, but I'm going to close this for the moment. Adding new built-in connectors right now adds more surface area for the core team (me and @jxom) to manage. If anything changes in the future, we can re-open this PR.
In the meantime, feel free to share this code in the GitHub Discussion area or package it up as a standalone package.


Improve tileset editor view performance

As reported in #72405 and #84963 the tileset editor becomes unusable when editing large tileset atlases due to repeated calls to CanvasItem::draw_rect to draw the tile grid:
https://github.com/godotengine/godot/assets/57678460/73659b04-0bdf-48e1-8670-25c147450282
This pull request is a workaround which replaces CanvasItem::draw_rect with TileSet::draw_tile_shape which does not seem to display the same performance issues.
Unlike #84963 this workaround works with tileset setups with non-zero tile separation and non-square texture regions.
Tested both on forward+ and compatibility on Mesa 23.2.1 on AMD Radeon RX 6700 XT (navi22, LLVM 15.0.7, DRM 3.54, 6.5.0-35-generic) (0x73df) under Ubuntu 23.10:
https://github.com/godotengine/godot/assets/57678460/40a72045-b4a9-4d59-b738-f6cc4b6db5d7
Example project: example.zip

This replaces rect draw with texture draw. Does it look good on all zoom levels? Using textures for grid is prone to causing visual artifacts (though I don't see them in your video).
Another option is moving the grid to a separate CanvasItem to avoid redraws, because it doesn't change.

This pull request is a workaround which replaces CanvasItem::draw_rect with TileSet::draw_tile_shape which does not seem to display the same performance issues.

Thanks for the contribution.
Sadly, this change cannot work. draw_tile_shape does draw the tile shape (which mean a diamond in the isometric mode, or even hexagons in the hexagonal mode). draw_rect does instead draw a rect, that is scale-independent, and covers the sampled texture region for each tile instead.

Sadly, this change cannot work. draw_tile_shape does draw the tile shape (which mean a diamond in the isometric mode, or even hexagons in the hexagonal mode). draw_rect does instead draw a rect, that is scale-independent, and covers the sampled texture region for each tile instead.

Ah indeed this doesn't work with non-rectangular tiles:

I suppose that the general idea of avoiding draw_rect in favor of updating the tileset's array meshes as TileSet:draw_tile_shape does, but with the right shape this time, could still work. I don't have enough understanding of these things to judge if that's a good idea though or if other solution such as what @KoBeWi proposed should be preferred.


Complete all elements of CSS editing

[x] design buttons
[x] add colouring and imgs
[x] organise spacing

Also added animations for h tags. Changed the hr element to 'separate' and added text to indicate search history - not in requirements


Works on Linux Now

I have added the linux part for the code. Works perfectly on Linux :)
#6

Perfect, I will go ahead and check it out. Thanks Arnav :+1:


Verbose output of directory creation?

I've used W&B a lot without many issues, but something that has recently popped up is all of these verbose logging messages about attempting to create a directory:
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
wandb: Currently logged in as: djones. Use `wandb login --relogin` to force relogin
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2/logs
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2/logs
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2/files
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2/tmp/code
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/proj/.../wandb/run-20230124_110444-5tfyrdo2/files
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
...

This goes on and on, and it continues during my training processes.  I've tried os.environ['WANDB_SILENT'] = "true", but these messages remain. These messages do go away if I don't call wandb.init(). I'm wondering if I've accidentally enabled some sort of setting that is causing this. Any support on suppressing these messages would be very appreciated.

I'm also noticing this behavior when just calling wandb from the command line:
> wandb status
Current Settings
attempting to make dir:  /home/djones/.config/wandb
attempting to make dir:  /home/djones/proj/.../wandb/
{
  "api_key": null,
  "base_url": "https://api.wandb.ai",
  "entity": "...",
  "git_remote": "origin",
  "ignore_globs": [],
  "mode": "online",
  "project": "...",
  "root_dir": null,
  "section": "default"
}


split: use std::io::copy() with new writer implementation to improve maintainability and speed

Previously, the ByteSplitter and LineSplitter structs were responsible for both reading the input and writing it to the current output file. The responsibility of creating a new output file for each chunk lived outside of these structs. By removing the responsibility of reading and only focusing on writing, we can simplify the implementation, minimize the responsibilities of these structs, and see a speed improvement.
This pull request replaces the ByteSplitter and LineSplitter structs with ByteChunkWriter and LineChunkWriter structs, respectively. The latter implement Write, which allows them to be used with std::io::copy(). Conceptually, bytes from the input file are now repeatedly read and sent to the writer, and the writer is responsible for deciding when a new output file needs to be created (and creating that file).
This change has no significant change in the speed of the program in the "split by bytes" mode of operation. I tested this by first creating a file with ten million null bytes:
$ printf "%0.s\0" {1..10000000} > testfile.txt

and then testing the GNU split, the master branch version (at commit cb051e7416f2406a2ebc1d7a58f6e263f5cfcaf2) of uu_split, and the new version of uu_split in this branch:
$ hyperfine --warmup 10 --prepare 'rm x* || true' "split -b 1000 testfile.txt" "./uusplit-master -b 1000 testfile.txt" "./uusplit-new -b 1000 testfile.txt"
Benchmark 1: split -b 1000 testfile.txt
  Time (mean ± σ):     266.1 ms ±  14.6 ms    [User: 4.9 ms, System: 257.2 ms]
  Range (min … max):   253.4 ms … 302.3 ms    10 runs

Benchmark 2: ./uusplit-master -b 1000 testfile.txt
  Time (mean ± σ):     117.8 ms ±   3.0 ms    [User: 9.9 ms, System: 106.8 ms]
  Range (min … max):   112.6 ms … 123.8 ms    15 runs

Benchmark 3: ./uusplit-new -b 1000 testfile.txt
  Time (mean ± σ):     116.3 ms ±   3.1 ms    [User: 11.1 ms, System: 104.2 ms]
  Range (min … max):   111.0 ms … 121.1 ms    14 runs

Summary
  './uusplit-new -b 1000 testfile.txt' ran
    1.01 ± 0.04 times faster than './uusplit-master -b 1000 testfile.txt'
    2.29 ± 0.14 times faster than 'split -b 1000 testfile.txt'

This change does however produce about a 1.4 times improvement in speed in the "split by lines" mode of operation. I tested this by getting the first ten million lines of a Wikidata database dump XML file:
$ wget -O - https://dumps.wikimedia.org/wikidatawiki/20211001/wikidatawiki-20211001-pages-logging.xml.gz | gunzip | head -n 10000000 > wikidata_10000000.xml

and then testing as before (the default mode of operation is "split by lines in chunks of one thousand lines each"):
$ hyperfine --warmup 10 --prepare 'rm x* || true' "split wikidata_10000000.xml" "./uusplit-master wikidata_10000000.xml" "./uusplit-new wikidata_10000000.xml"
Benchmark 1: split wikidata_10000000.xml
  Time (mean ± σ):      1.523 s ±  0.628 s    [User: 0.095 s, System: 0.529 s]
  Range (min … max):    0.628 s …  2.414 s    10 runs

Benchmark 2: ./uusplit-master wikidata_10000000.xml
  Time (mean ± σ):     654.4 ms ±   7.9 ms    [User: 308.5 ms, System: 345.1 ms]
  Range (min … max):   645.2 ms … 673.0 ms    10 runs

Benchmark 3: ./uusplit-new wikidata_10000000.xml
  Time (mean ± σ):     463.1 ms ±  16.8 ms    [User: 114.3 ms, System: 344.1 ms]
  Range (min … max):   450.0 ms … 507.3 ms    10 runs

Summary
  './uusplit-new wikidata_10000000.xml' ran
    1.41 ± 0.05 times faster than './uusplit-master wikidata_10000000.xml'
    3.29 ± 1.36 times faster than 'split wikidata_10000000.xml'

I have added a brief BENCHMARKING.md file describing the general procedure I followed for benchmarking this program.

Can someone advise how to ignore the spellchecker on the BENCHMARKING.md file?

Impressive results!

Can someone advise how to ignore the spellchecker on the BENCHMARKING.md file?

The wc benchmarking file does it with an HTML comment:
<!-- spell-checker:ignore (words) uuwc uucat largefile somefile Mshortlines moby lwcm cmds tablefmt -->

Impressive results!

Can someone advise how to ignore the spellchecker on the BENCHMARKING.md file?

The wc benchmarking file does it with an HTML comment:
<!-- spell-checker:ignore (words) uuwc uucat largefile somefile Mshortlines moby lwcm cmds tablefmt -->

Can someone advise how to ignore the spellchecker on the BENCHMARKING.md file?

We're using [cspell](https://cspell.org; see in-document configuration).
Don't turn it off for the document. Instead, use something like <!-- spell-checker:ignore (words) testfile -->, preferably near the top of the file, or rename testfile to something acceptable to the spell checker (eg, using snake [test_file] or camel [testFile] casing).
testfile with the noted spell-checker exception is fine IMO.

Can someone advise how to ignore the spellchecker on the BENCHMARKING.md file?

We're using [cspell](https://cspell.org; see in-document configuration).
Don't turn it off for the document. Instead, use something like <!-- spell-checker:ignore (words) testfile -->, preferably near the top of the file, or rename testfile to something acceptable to the spell checker (eg, using snake [test_file] or camel [testFile] casing).
testfile with the noted spell-checker exception is fine IMO.

Thanks, I'll take a look at the GNU test failures and add some corresponding unit tests to test_split.rs.

Thanks, I'll take a look at the GNU test failures and add some corresponding unit tests to test_split.rs.

I've added a fixup commit that should resolve the line ending issue and I added a unit test with a more detailed test for the contents of the output files to prevent any future regression. (It was an off-by-one issue: I was only writing the bytes up to the newline character but not including the newline character.)

I've added a fixup commit that should resolve the line ending issue and I added a unit test with a more detailed test for the contents of the output files to prevent any future regression. (It was an off-by-one issue: I was only writing the bytes up to the newline character but not including the newline character.)

Sorry, we have a conflict, could you please have a look?
thanks

Okay, I have resolved the conflicts and rebased the branch on master.

needs a merge too :)

sorry :(

No problem, I produce a lot of self-contained pull requests so I expect to resolve merge conflicts sometimes. I'll focus on this next.


GH-39574: [Go] Enable PollFlightInfo in Flight RPC

Rationale for this change
It's impossible to use the current bindings with PollFlightInfo. Required for apache/arrow-adbc#1457.
What changes are included in this PR?
Add new methods that expose PollFlightInfo.
Are these changes tested?
Yes
Are there any user-facing changes?
Adds new methods.

Closes: #39574

CC @zeroshade

@github-actions crossbow submit verify-rc-source-integration-linux-*

I am verifying if this caused: https://github.com/apache/arrow/issues/41201


Open redirection vulnerability

Hi @clems4ever,
Authelia is vulnerable to open redirection, which can aid an attacker in conducting a phishing attack.
To prevent this issue, I would suggest to add a parameter in Authelia configuration file allowed_rd which value would be a regex matching URLs determined as safe by the administrator. Then, the rd URL parameter would always be checked against this allowed_rd regex before actually allowing or not the redirection upon successful login.

Nice catch!

@n4kre , instead of introducing a new parameter we could simply verify the redirection URL is within the domain. What do you think?

Simple, yet effective: sounds good!


LocalStorage Module

issue #27

After conducting regression and unit testing, I can confirm that the changes successfully address the issue outlined in Issue #27 regarding the implementation of persistent storage for authentication tokens.
Regression Testing:

Passes all test cases.
https://docs.google.com/document/d/1jNWCkND7PZ6qDMYId3V555REfFaWIU1T/edit?usp=sharing&ouid=114415295023973896229&rtpof=true&sd=true

userReducer Unit Testing:
√ should return the initial state (3 ms)
√ should handle LOGIN_WITH_EMAIL (158 ms)
√ should handle SIGNUP_WITH_EMAIL (1 ms)
√ should handle LOGOUT (1 ms)
√ should handle UPDATE_PROFILE (1 ms)
√ should handle UPDATE_USER_METRICS_DATA (1 ms)
√ should handle UPDATE_EMAIL_SUCCESS
localStorage Unit Testing:
AsyncStorage
storeUID
√ should store the UID successfully (46 ms)
√ should handle the error if storing fails (1 ms)
getUID
√ should return the UID if it exists (1 ms)
√ should handle the error if retrieving fails (1 ms)
These tests confirm that the LocalStorage module works as intended and ensures that authentication tokens can be stored and retrieved securely and efficiently.
Ready for launch 🚀


GoRun - asyncmake errors in message window

I have a very hello world example and after trying to run it with GoRun command I see some errors in my messages:
package main

import "fmt"

func main() {
	fmt.Println("Hello world")
}

Errors:
...nvim/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:211: attempt to concatenate a nil value
stack traceback:
^I...nvim/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:211: in function <...nvim/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:194> function: builtin#18 ...nv
im/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:211: attempt to concatenate a nil value
stack traceback:
^I...nvim/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:211: in function <...nvim/site/pack/packer/start/go.nvim/lua/go/asyncmake.lua:194>

I'm on nightly neovim build.

Is that go.nvim latest version? The stacktrace seems odd.

After updating there are no errors anymore. Didn't realize I should update since I had the plugin for like 1 day. Cheers


[Dynamic Regions] limit the memory quota in snapshot send/recv

Bug Report

What version of TiKV are you using?

What operating system and CPU are you using?

Steps to reproduce

What did you expect?
Snapshot send and receive should not lead to TiKV OOM.
What did happened?
Default value of snapshot send/receive limit can make TiKV OOM when total memory is 16GB or smaller.

The issue is resolved by eliminating the memory jitter by ribbon filter


Docs needs updating to match current state of D365 Commerce

Under the Checklist section of this Doc, steps 12 and 13 say to check RTS setup.    These steps only apply to 2012 N-1 as RTS setup is all hidden/automated with the Deployment of HQ now.      Additionally, this doc should be reviewed to ensure it links/fits in with our other documents about POS activation.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: dfe62687-b97a-369a-8b3f-80c712a5aca3
Version Independent ID: bfc751c1-3f68-be7d-04e8-99c5575fdec9
Content: Point of sale (POS) device activation - Commerce | Dynamics 365
Content Source: articles/commerce/dev-itpro/retail-device-activation.md
Service: dynamics-365-commerce
Product: ****
Technology: ****
GitHub Login: @athinesh99
Microsoft Alias: athinesh

@bstorie - Thank you for the feedback.
@athinesh99 - Can you please take a look at this and update the topic as necessary? Thanks!

@bicyclingfool can you please review this feedback?

Fixed.


XmlParsingException: mismatched input '' expecting '<'. with file endoded in UTF-8 with BOM

org.openrewrite.xml.XmlParsingException: Syntax error in logback-test.xml at line 1:0 mismatched input '' expecting '<'.

Content of logback-test.xml is attached: logback-test.xml.gz
I suspect that this is because the xml file is encoded in UTF-8 with BOM:

$file logback-test.xml
logback-test.xml: XML 1.0 document, Unicode text, UTF-8 (with BOM) text

Hi @murdos, happy holidays! Thanks, for reporting the issue, we'll take a look!


SystemPrep Not Compatible With FIPS-Mode Instances

SystemPrep script dies in the awscli section if system is running in FIPS-mode.
Running cmd: /usr/bin/python virtualenv.py --python /usr/bin/python /opt/awscli
Traceback (most recent call last):
  File "/usr/tmp/systemprep/awscli-bundle/install", line 138, in <module>
    main()
  File "/usr/tmp/systemprep/awscli-bundle/install", line 128, in main
    create_install_structure(working_dir, opts.install_dir)
  File "/usr/tmp/systemprep/awscli-bundle/install", line 64, in create_install_structure
    _create_virtualenv(location=install_dir, working_dir=working_dir)
  File "/usr/tmp/systemprep/awscli-bundle/install", line 81, in _create_virtualenv
    location))
  File "/usr/tmp/systemprep/awscli-bundle/install", line 44, in run
    p.returncode, cmd, stdout + stderr))
__main__.BadRCError: Bad rc (1) for cmd '/usr/bin/python virtualenv.py --python /usr/bin/python /opt/awscli': Already using interpreter /usr/bin/python
New python executable in /opt/awscli/bin/python
Installing setuptools, pip, wheel...
  Complete output from command /opt/awscli/bin/python - setuptools pip wheel:
  Collecting setuptools
  Downloading setuptools-31.0.1-py2.py3-none-any.whl (477kB)
Unknown hash name: md5
----------------------------------------
...Installing setuptools, pip, wheel...done.
Traceback (most recent call last):
  File "virtualenv.py", line 2328, in <module>
    main()
  File "virtualenv.py", line 713, in main
    symlink=options.symlink)
  File "virtualenv.py", line 945, in create_environment
    download=download,
  File "virtualenv.py", line 901, in install_wheel
    call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT)
  File "virtualenv.py", line 797, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /opt/awscli/bin/python - setuptools pip wheel failed with error code 1

Could not install awscli. Quitting...

Due to MD5 being disabled.

If you know the workaround, are you submitting a patch? Or at least gonna post the workaround? ;)

The "workaround" is to not attempt to install the awscli at all. Not much of a workaround as much as "avoid the problem altogether". :stuck_out_tongue_winking_eye:

This comment is interesting to me. It seems to indicate that the issue is caused by the utterly ancient version of pip distributed by rhel/centos. Did you try upgrading the pip version, and then running the framework?
curl https://bootstrap.pypa.io/get-pip.py | python
Sidenote: you may also want to doublecheck the version of the bootstrapper you are referring to, as the current version installs the awscli to /opt/aws/cli, not /opt/awscli as indicated by the log... It may also just be that the S3 bucket hasn't been updated with the current version...

pip isn't distributed with EL - it's provided via EPEL. That said, I only reported the bug after having already upgraded pip and still encountering the error.

Try running this before the bootstrapper: export PIP_INDEX_URL=https://pypi.org/simple/

So I don't have to research it later...
To get sysprep to work on RHEL 7 (when the AMI has been customized to launch instances in FIPS-mode), need to:

Ensure that the epel repo is active:

The python-boto package included in the rhui-REGION-rhel-server-rh-common does not seem to be importable and will cause the bootstrap.py to fail
Need it active so the python-pip RPM is installable (so that any pip-related tasks won't fail)

Once the python-pip RPM is installed, probably want to run PIP_INDEX_URL=https://pypi.org/simple/ ; pip install --upgrade pip to ensure that pip is a good/recent version and pointed to the FIPS-compatible index (upgrading pip fixes the index-URL, but, to install it, you have to temp-set the env)

With pending deprecation of systemprep (in favor of Watchmaker) — and decision to declare systemprep not supported for EL7 — am closing this issue.


Responsive Square

Natural mode is responsive but Square mode is not. Square thumbnails per row is set to a single value (default 4).  Can the Square mode start from a max value then reduce to 1/row at small screen sizes?

Hello, thank you for your suggestion,
I'll investigate what can be done for a better responsive.

I've updated the gallery and the typo3 extension.
In typo3, you can now leave the field "Pictures per row" empty. The field "Maximum row height" will become applicable. This way, natural and square format work on same approach with same logic.
You can find a demo here : https://ecodev.ch/natural-gallery/demo/square-responsive.html
Enjoy :)


无法修改 HTTPS 的请求目标地址

Which platform are you running AnyProxy
Mac
The version of the AnyProxy
4.1.3
Your expected behavior of AnyProxy
修改 HTTPS 的请求 host
async beforeSendRequest(requestDetail: RequestDetail) {
  const newRequestOptions = requestDetail.requestOptions;
  requestDetail.protocol = 'https';
  newRequestOptions.host = 'www.baidu.com';
  newRequestOptions.port = 443;
  newRequestOptions.path = '/';
  newRequestOptions.method = 'GET';
  return requestDetail;
}

The actual behavior of AnyProxy
并未成功修改目标地址，页面和之前请求一样
The log of the error
/usr/local/bin/node /usr/local/lib/node_modules/npm/bin/npm-cli.js run start --scripts-prepend-node-path=auto
Debugger listening on ws://<IP_ADDRESS>:58400/e7bb5194-1b86-4949-9266-8242c2e7a2ce
For help, see: https://nodejs.org/en/docs/inspector
Debugger attached.

<EMAIL_ADDRESS>start /Users/smaldragonluo/code/personal/proxy-rules
anyproxy --intercept --ws-intercept --port 1080 --rule ./lib/rules.js

Debugger listening on ws://<IP_ADDRESS>:58407/6ec69c29-c8b6-434a-9ac4-1c1422dc20bb
For help, see: https://nodejs.org/en/docs/inspector
Debugger attached.
[AnyProxy Log][2021-06-25 11:24:16]: Http proxy started on port 1080
[AnyProxy Log][2021-06-25 11:24:16]: web interface started on port 8002
[AnyProxy Log][2021-06-25 11:24:16]: Active rule is: custom rules
[AnyProxy Log][2021-06-25 11:24:16]: received https CONNECT request anyproxy.io
[AnyProxy Log][2021-06-25 11:24:16]: will forward to local https server
[AnyProxy Log][2021-06-25 11:24:16]: [internal https]proxy server for anyproxy.io established
[AnyProxy Log][2021-06-25 11:24:16]: received request to: GET anyproxy.io/cn/
[AnyProxy Log][2021-06-25 11:24:17]: received request to: GET anyproxy.io/cn/gitbook/style.css
[AnyProxy Log][2021-06-25 11:24:17]: received https CONNECT request anyproxy.io
[AnyProxy Log][2021-06-25 11:24:17]: will forward to local https server
[AnyProxy Log][2021-06-25 11:24:17]: received request to: GET anyproxy.io/assets/auto-lang.js
[AnyProxy Log][2021-06-25 11:24:18]: received request to: GET anyproxy.io/cn/gitbook/images/favicon.ico
[AnyProxy Log][2021-06-25 11:24:19]: received https CONNECT request github.com
[AnyProxy Log][2021-06-25 11:24:19]: will forward to local https server

还需要修改headers里的Host


Debian package dvipng is needed to use LaTeX in matplotlib in notebooks

If the dvipng binary is not present, the matplotlib plots raise errors while using:
plt.rcParams['text.usetex'] = True # use latex for all text handling
Can it be installed through environment.yml or should we put a warning in the notebooks?

Fixed by a8210239f08acdd9c1c0b10c85f27604515c490d.


Make image name configurable, use golang-builder, compress bin

This switches this to use golang-builder to make it a bit easier for switching between OSX and Linux.
I also added some commands to the Makefile to make some things more configurable, made /config/config.yml the default location to look for configs.

neat, thanks!
please squash all the commits into one.

Review status: 0 of 5 files reviewed at latest revision, 1 unresolved discussion.

auth_server/Makefile, line 1 [r1] (raw file):
capitalize var names, please

Comments from the review on Reviewable.io

Review status: 0 of 5 files reviewed at latest revision, 2 unresolved discussions.

auth_server/Makefile, line 3 [r1] (raw file):
actually, flip this to false. i don't see the need, not really. change to ?= to make it easily overrideable from cmdline (same for image above)

Comments from the review on Reviewable.io

Done.

Also squashed.

I had enabled compression by default as it lowers the binary size to 3mB vs >10mB .
Not that it really matters, but it was such an easy option to turn on.

yeah, i get it. but my thinking is - (1) it doesn't matter in all but the most extreme of cases, and (2) what do i know about the state of binary compressors under linux? absolutely nothing. i mean, i know upx has been around for a while, but have never used it under linux. do i want to be exposing myself to bugs in it? given (1), the answer is clear no.

Review status: 0 of 5 files reviewed at latest revision, all discussions resolved.

Comments from the review on Reviewable.io

Reviewed 4 of 5 files at r1, 1 of 1 files at r2.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from the review on Reviewable.io

thanks again, merging.


Update README.md - added "/event' to the HEC endpoints

Added "/event" to the HEC collector endpoints as without it you'll get invalid URL errors
Description:

Link to Splunk idea: <Link to Splunk idea, see https://ideas.splunk.com>
Testing:
Documentation:

I have read the CLA Document and I hereby sign the CLA

After more testing, it seems the bundles metrics logs require the "/raw" endpoint, so this won't fix the issue.


feat(relay): drastically improve usefulness of spans

@thomaseizinger can you please fix the conflicts?

@thomaseizinger can you please fix the conflicts?

Done!

Thanks for the review @conectado !
Mind if I address them in a follow-up PR? I'd like to see them on Google Cloud first. So far I've only looked at them in a local Jaeger instance.


Add information about how combining schemas using "oneOf", "anyOf", "allOf" and "not" in cloudformation resource provider schemas diverge from the JSON schema specification

We should add information on this topic under the heading “Divergence From JSON Schema” with some examples.

+1, we should be clear of what's supported. Maybe references to resource schemas would be good enough?


⚠ Bofrost.be has degraded performance

In cfe84dc, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1047 ms

Resolved: Bofrost.be performance has improved in 7def7f0.


Manuals are incorrectly linked.

The Student's / Mentor's manual leads to localhost/faq which does not exist.

This will be fixed as soon as @sangeet259 's PR is merged after making a few changes.

Ohh i didn't see that. @sangeet259 Can you please reference this issue in your PR.

@harishnandan @dibyadas
Yeah Sure, I had fixed this but a force push reverted it. I am sending a PR soon cherry picking all those commits. Hang On!

@harishnandan  You may close this!