vpack error caused by ARANGOIMP

my environment running ArangoDB
I'm using the latest ArangoDB of the respective release series:

[x] 3.1.8

On this operating system:

[ ] DCOS on

[ ] AWS
[ ] Azure
[ ] own infrastructure

[ ] Linux

[ ] Debian .deb
[x] Ubuntu .deb
[ ] SUSE   .rpm
[ ] RedHat .rpm
[ ] Fedora .rpm
[ ] Gentoo
[ ] docker - official docker library
[ ] other:

[ ] Windows, version:
[ ] MacOS, version:

this is an using-related issue(arangoimp):
I'm trying import data from csv(266 million records) with arangoimp:
arangoimp --file "file" --type csv --collection "collection" --create-collection true
Resources of system: RAM(4GB).
ERROR error message:    got invalid vpack value on lookup (exception location: /var/lib/jenkins/workspace/RELEASE__BuildPackages/arangod/StorageEngine/MMFilesCollection.cpp:1140). Please report this error to arangodb.com

I assume this happened in a single server instance and not in a cluster setup?

Yes

Have there been any errors in the log files of arangod?

@jsteemann Last messages in arangod.log:
INFO JavaScript using startup '/usr/share/arangodb3/js', application '/var/lib/arangodb3-apps'
INFO ArangoDB 3.1.8 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 <IP_ADDRESS>, OpenSSL 1.0.1f 6 Jan 2014
INFO using SSL options: SSL_OP_CIPHER_SERVER_PREFERENCE, SSL_OP_TLS_ROLLBACK_BUG
INFO Authentication is turned on
INFO Authentication system only
INFO Authentication for unix sockets is turned on
INFO file-descriptors (nofiles) hard limit is 131072, soft limit is 131072
INFO running WAL recovery (3 logfiles)
INFO replaying WAL logfile '/var/lib/arangodb3/journals/logfile-227293052.db' (1 of 3)
INFO replaying WAL logfile '/var/lib/arangodb3/journals/logfile-228075227.db' (2 of 3)
INFO replaying WAL logfile '/var/lib/arangodb3/journals/logfile-230312173.db' (3 of 3)
INFO WAL recovery finished successfully
INFO JavaScript using startup '/usr/share/arangodb3/js', application '/var/lib/arangodb3-apps'
INFO In database '_system': Database is up-to-date (30108/standalone/existing)
INFO using endpoint 'http+tcp://<IP_ADDRESS>:8529' for non-encrypted requests
INFO ArangoDB (version 3.1.8 [linux]) is ready for business. Have fun!

@jsteemann

screenshot error

Hi,
We have fixed similar issues with ArangoDB 3.2.9. If the issue re-occours, feel free to comment & we will re-open this.
Will close it as solved for now.


Cannot cache Alamofire: Cannot initialize Kind from invalid String value remoteSourceControl

I'm currently working on porting my project to use Scipio, however even the most basic config file cannot be used.
Example
name: Contrib

deploymentTarget:
  iOS: "11.0"

cache:
  local:
    path: Contrib

packages:
  - name: Alamofire
    url: https://github.com/Alamofire/Alamofire
    branch: 5.4.1

Result:
scipio
No "base" settings found
No "debug config" settings found
No "release config" settings found
[17:16:16]: 📦  Resolving package dependencies...
[17:16:16]: Resolve Package Graph

[17:16:16]: 🧮  Loading Swift packages...
Error: dataCorrupted(Swift.DecodingError.Context(codingPath: [CodingKeys(stringValue: "object", intValue: nil), CodingKeys(stringValue: "dependencies", intValue: nil), _JSONKey(stringValue: "Index 0", intValue: 0), CodingKeys(stringValue: "packageRef", intValue: nil), CodingKeys(stringValue: "kind", intValue: nil)], debugDescription: "Cannot initialize Kind from invalid String value remoteSourceControl", underlyingError: nil))

Additional information

Apple Silicon
macOS 13.0
Xcode 14.1
scipio 0.2.8 (tool reporting 0.2.5)

@evandcoleman if you have an idea, would be great. Otherwise, please point in the right direction so I can investigate the issue myself.

This is a known issue. It's due to changes in the Swift package spec that Scipio doesn't yet understand. Unfortunately, life hasn't given me much opportunity to work on this lately, but I'll try to prioritize getting an update pushed!


Update package to work with python 3.10

How difficult would this be? Not necessary for the review but potentially helpful for future compatibility.

Closing because the new version is compatible with python 3.10 and it has been released to PyPI.


Screen sharing Windows Terminal client with MS Team kills Windows Terminal client after a few minutes

Environment
Windows build number:  Win32NT 10.0.18363.0 Microsoft Windows NT 10.0.18363.0
Windows Terminal version (if applicable): 1.0.1401.0
Any other software?
Microsoft Teams Version <IP_ADDRESS>65 (64 bit)
Steps to reproduce
Open a windows terminal session.
Screenshare only the Windows Terminal window with MS Teams.
wait for a while.
Expected behavior
Screenshare the terminal window with MS teams to colleagues.
Actual behavior
Screen share works fine until MS terminal suddenly closes with no error. Only happens when screen sharing, tested with WSL1 ubuntu subsystem and PowerShell.

/feedback


Critical dependency: the request of a dependency is an expression

Hi there,
Thanks for the great library! I'm currently encountering the attached issue when building using NextJS 13 on CloudFlare Pages. The build completes, but this is currently breaking my local development environment. Do you know what might be causing the issue and if there's anything that can be done to work around it?

Interesting! If I'm reading this right, this might actually be coming from the Kysely package itself, rather than this adapter. Given that we don't provision a strong version and it's just a peer dependency, I don't (think) this is on us. Would you mind cutting an issue to Kysely directly about this?
More than happy to keep this open or chip in if this ends up not being the case!


chromium-freeworld not loading widevine

Upgraded to Fedora 28 today and sites like Netflix stopped playing video.
Widevine not listed on chrome://components
$ rpm -qa | grep chromium
chromium-freeworld-libs-66.0.3359.181-2.fc28.x86_64
chromium-freeworld-66.0.3359.181-2.fc28.x86_64
chromium-pepper-flash-<IP_ADDRESS>-1.fc28.x86_64
chromium-widevine-<IP_ADDRESS>8-1.fc28.x86_64

@avibrazil We are working about it; Chromium dropped the support widevine by some drastic changes in linux for the moment. Thanks for the report.

Thanks for the reply.
Any old version of chromium I can easily go with dnf on F28 that will make things work again ?

Plain Firefox (with some rpmfusion packages) is fully capable of playing DRM content.
Tested on Netflix and Spotify.

We need to test widevine; the patches was applied;  can you test if the current chromium-freeworld (67.0.3396.87) version solved the problem? I can't  pay my netflix account in these moment...

Well, I can't close yet... We need people testing the update...

Widevine not listed on chrome://components
$ rpm -qa | grep chromium
chromium-freeworld-libs-69.0.3497.100-7.fc28.x86_64
chromium-common-69.0.3497.92-1.fc28.x86_64
chromium-69.0.3497.92-1.fc28.x86_64
chromium-freeworld-69.0.3497.100-7.fc28.x86_64
chromium-libs-media-freeworld-69.0.3497.92-1.fc28.x86_64
chromium-libs-media-69.0.3497.92-1.fc28.x86_64
chromium-widevine-4.10.1192.0-1.fc28.x86_64
chromium-libs-69.0.3497.92-1.fc28.x86_64
chromium-pepper-flash-<IP_ADDRESS>-1.fc28.x86_64

@pasikarkkainen  Make sure Allow sites to play protected content is checked in
chrome://settings/content/protectedContent

@kuboosoft yep, "allow sites to play protected content" is enabled / checked in. Still no widevine.. any other ideas?

@pasikarkkainen Are you using netflix? We need to test if works it here...
Verifying Widevine CDM support
To verify whether widevine works, you can use following ways:
Open shaka-player-demo.appspot.com and load a manifest that uses Widevine.
Open dash-player.com/demo/drm-test-area, check whether the page says bitdash uses Widevine in your browser, then play the video.

I just tried the urls..
shaka-player-demo.appspot.com doesn't let me choose anything with widevine (they're all inactive / cannot be chosen), and also dash-player.com/demo/drm-test-area says "no DRM".
It feels like I'm missing some configuration setting, but I have no idea which one.

chromium-69.0.3497.92-1.fc28.x86_64 ??? please remove it...
I am using widevine without problem...

Format:

@pasikarkkainen chromium-69.0.3497.92-1.fc28.x86_64 ??? please remove it, chromium in Fedora is different...  I knew it was going to be something obvious.. yeah, I removed the stock fedora "chromium" rpm, and now using "chromium-freeworld".. and it works using the sites mentioned above!
Thanks a lot.

@pasikarkkainen No problem. but I can't close it, we need people writing if it works with Netflix...

well, im a bit late for that but - it does work fine with netflix.
Fedora30 , chromium-freeworld-74.0.3729.157-268.1.x86_64

Hi, please provides
rpm -q ffmpeg
rpm -q fdk-aac-free

ffmpeg-4.1.3-2.fc30.x86_64
package fdk-aac-free is not installed

@Frankstar Sorry but you are not using the ffmpeg of UnitedRPMs... The problem isn't here...
[makerpm@localhost ~]$ rpm -q unitedrpms
unitedrpms-30-14.fc30.noarch
[makerpm@localhost ~]$ rpm -q ffmpeg
ffmpeg-4.1.3-10.fc30.x86_64
[makerpm@localhost ~]$ rpm -q fdk-aac-free
fdk-aac-free-0.1.6-3.fc30.x86_64
[makerpm@localhost ~]$

i think you read my post wrong, i dont have a problem^^ i just said everything is working fine.

@Frankstar You are using the ffmpeg of rpmfusion and this will break the harmony in some programs. For example, our chomium was built with our ffmpeg. I ask you, have you excluded the UnitedRPMs repository in any way? Should we answer for a mix of repositories? Common sense.
https://github.com/UnitedRPMs/WIKI/wiki/Mixes-of-3rd-party-repositories-with-UnitedRPMs
https://github.com/UnitedRPMs/WIKI/wiki

nope, i added the UniteRPMS repo just for chromium-freeworld.
nothing exluded - so far everything works as expected and fine.
But thanks for the tip - will lower uniteRPMs priority.

@Frankstar I recommend prioritize our updates and avoiding incompatibilities.
https://github.com/UnitedRPMs/WIKI/wiki/Mixes-of-3rd-party-repositories-with-UnitedRPMs

thanks for the tip anyway.
i think its a bad idea to set the unitrpms repo to priority=1 - why would u do that?
set fedora to 10, rpmfusion to 20 and unitrpms to 90

@Frankstar You don't need touch nothing; only check why the ffmpeg of rpmfusion is installed in your system... If other repository has not configured anything, its priority is 99...
The default priority for repositories is 99

@Frankstar

"i think its a bad idea to set the unitedrpms repo to priority=1"

No, if you are a demanding user or a user mixing repositories...

ok.
i fixed it for me with
includepkgs=chromium-freeworld* in /etc/yum.repos.d/unitedrpms.repo

@Frankstar simple curiosity :smiley:
cat /etc/yum.repos.d/unitedrpms.repo

nothing changed here.
Installed it via
dnf install https://github.com/UnitedRPMs/unitedrpms/releases/download/14/unitedrpms-$\(rpm -E %fedora)-14.fc$(rpm -E %fedora).noarch.rpm
all i added is includepkgs=chromium-freeworld*
But here you go:
[unitedrpms]
name=unitedrpms $releasever - $basearch
#mirrorlist=https://raw.githubusercontent.com/UnitedRPMs/unitedrpms/master/mirrorlist_x86_64.txt
baseurl=https://sourceforge.net/projects/unitedrpms/files/$releasever/x86_64/
enabled=1
priority=1
includepkgs=chromium-freeworld*
metadata_expire=1d
skip_if_unavailable=1
gpgkey=file:///etc/pki/rpm-gpg/URPMS-GPG-PUBLICKEY-Fedora
gpgcheck=1
repo_gpgcheck=1
type=rpm
enabled_metadata=1

[unitedrpms-source]
name=unitedrpms $releasever - Source
#mirrorlist=https://raw.githubusercontent.com/UnitedRPMs/unitedrpms/master/mirrorlist_source.txt
baseurl=https://sourceforge.net/projects/unitedrpms/files/$releasever/srpm/
enabled=0
priority=1
metadata_expire=1d
skip_if_unavailable=1
gpgkey=file:///etc/pki/rpm-gpg/URPMS-GPG-PUBLICKEY-Fedora
gpgcheck=1
repo_gpgcheck=1
type=rpm

[unitedrpms-debuginfo]
name=unitedrpms $releasever - $basearch - Debug
#mirrorlist=https://raw.githubusercontent.com/UnitedRPMs/unitedrpms/master/mirrorlist_debug.txt
baseurl=https://sourceforge.net/projects/unitedrpms/files/$releasever/x86_64/debug/
enabled=0
priority=1
metadata_expire=1d
skip_if_unavailable=1
gpgkey=file:///etc/pki/rpm-gpg/URPMS-GPG-PUBLICKEY-Fedora
gpgcheck=1
repo_gpgcheck=1
type=rpm

@Frankstar Very strange; the priority is "1" If you are using unitedrpms it should avoid a package with lower release... ¿bug? maybe. I need test it and open a bugzilla report...


Condition::Between crashes when calling against a nil

Example:
rs = Ruy::RuleSet.new
rs.any do
    between :age, 10, 20
    eq :name, 'Steve'
end

rs.outcome "hello world"

rs.(age: 11) # => Works (prints "hello world)
rs.(age: 22, name: 'Jeff') # => Works (nil)
rs.(name: 'Jeff') # => ArgumentError: comparison of Fixnum with nil failed

If absent, the condition should return false (IMHO). Might also want to ensure that @from and @to are actually ordered correctly.

We've been discussing how to handle nil values coming from the context, but didn't reach any agreement yet.
I don't support the idea of just evaluate the condistion as false.
Take, for example, greater_than_or_equal 18, :age evaluating to false because of :age being nil, someone would expect that less_than 18, :age will evaluate true.
If still considering no to crash when nil, why the condition should return false instead of true.
Also, I tihnk that everyone is not being surprised that 3 < nil will raise raise an exception, so why Ruy should behave differently?
Said that, I consider we need to raise more friendly exceptions.

@migl has different opinions on this topic, I think his opinions are more closer to @dkatten than me :)

I do feel like we need to reach an agreement on a convention of what the "nil" value means across the library. Even though Ruby encourages its developers to treat "nil" as just another value, I do feel like the purpose of a nil value is to express nullity, emptiness, void... you know what I mean. If Ruby doesn't encourage that convention, then maybe Ruy should.
Regardless of that, I convinced myself that comparing a number against the void should be an invalid operation, and an error should be risen. Friendlier exceptions are definitely something good to have.
To work around the case @dkatten mentions, we take advantage of the minimal evaluation approach of the all matcher, adding an except condition before the comparison is made. If the except condition does not match, the comparison won't be done.
all do
  except { eq nil, :age }
  less_than 18, :age
end

I do know it's not the most intuitive way, so we should keep our eyes open to alternatives.
One from the top of my mind:
except nil, :age do
   less_than 18, :age
end

except would have two modes: one without arguments where the inner conditions are logically negated, and one with arguments that would by default check for equality to determine if it should or not perform the evaluation of the inner conditions.

If users rely on the shortcut evaluation of the all matcher, Ruy will be unable to make some optimizations based on statistics. For example:
all do
  eq 'Mr.', :title
  less_than 18, :age
end

If the first matcher evaluates to false 50% of the times, and the second matcher evaluates to false 90% of the times, Ruy could reverse the evaluation order and achieve better evaluation performance.
That's an idea I've been thinking on ...

So, if that optimization logic is in the plans, we should start thinking of a break condition like the one I proposed in my previous comment. It doesn't have to be THAT one, but there needs to be a way to put exceptions to evaluations.
We need to be careful not to end up reproducing Ruby's control statements. This should be a very specific syntax that applies to exceptions and nothing else.

Closing this issue. Favoring the same behavior as Ruby. Informative exceptions is something that we'll take on.


[REQ] Add a (GH-compliant) license file

Hi there, 1st of all thanks for this awesome work !
Since we've 'doxed' it in our HyMPS project (under VIDEO section \ PTZ page \ Misc), can you please add a GH-compliant license file for it ?
As you know, expliciting licensing terms is extremely important to let anyone better/faster understand how to reuse/adapt/modify sources (and not only) in other open projects and vice-versa.
Although it may sounds like a minor aspect, license file omission obviously causes an inconsistent generation of the relative badge too:

(badge-generator URL: https://badgen.net/github/license/irdkwmnsb/icpc-panasonic-to-visca)
You can easily set a standardized one through the GH's license wizard tool.
Last but not least, let us know how we could improve - in your opinion - our categorizations and links to resources in order to favor collaboration between developers (and therefore evolution) of listed projects.
Hope that helps/inspires !

Hello! Thank you!
That's quite unexpected for me :D
Added the MIT License as it's the one I prefer for my open source projects
https://github.com/irdkwmnsb/icpc-panasonic-to-visca/commit/f23b6f19a7b1ce2618a5bf9e6ef36272f415b982


[FLOC-4197] Remote test-redirects and update documentation redirect documentation

Fixes: https://clusterhq.atlassian.net/browse/FLOC-4197
Since #2503 we no longer add latest and  devel 302 redirects.
Instead we now copythe released documentation to a version key and to the latest or devel key, replacing the content that was there from the last release.
This means there's very little point in the test-redirects script which only tested the latest and devel redirects.
I considered updating the tool to check the redirects that are generated from docs/redirects.yaml but that seems like a different piece of work which can be done in another branch if we think it's important.
I'll follow this with https://clusterhq.atlassian.net/browse/FLOC-4199 which will add some version checking to `admin/publish-docs`` .

Thanks @wallrj. Please address the one comment above and merge when the lint test is green.


Use Wayback Machine Archive to Prevent Accidental AntiDDOS Blocking During Scraping

So I know many people have trouble due to the fact that MyAnimeLIst no longer whitelists new IP addresses from their antiDDOS software which leads to many people struggling to scrape data of the website. An workaround I discovered is to access the website's archive.org backup instead of the website itself. Does this package allow you to do this? If not, it doesn't seem like it'd be a very difficult to add as a nice feature. You could even update archive.org's backup by requesting that pages that haven't been indexed by the wayback machine are added (through archive.org's API).

Using the internet archive as a secondary source is a good idea as it (currently) indexes MAL. The package does not currently allow this as it is still very much WIP. I plan to add this as a post version 1 feature.
The Wayback Machine supports a simple API allowing you to discover the history of a page and the right URLs to use. The page itself should parse similarly.


[WIP] Add github runner scripts for ECP

I'd recommend to guard the self-hosted actions with conditionals like here.
Otherwise 'foreign' PRs (containing malicious code) could run on internal runners.


Bump to Go v1.23 and update deps to match

What this PR does / why we need it
Towards: https://github.com/giantswarm/giantswarm/issues/31630
Checklist

[x] Updated CHANGELOG.md.

Trigger E2E tests

/run app-test-suites

/run app-test-suites-single PROVIDER=capa

/run app-test-suites-single PROVIDER=capa


Partition predicate typing inconsistencies, and no support for OR in partition predicates

Environment
Delta-rs version: 0.13.0
Binding: python
Environment:

Cloud provider: n/a
OS: ubuntu 22.04
Other: testing locally via jupyter notebook

Bug
What happened:
There are inconsistencies between the python type-hints, docstring comments, and rust implementation for partition predicates.
In table.py, we see partitions: Optional[List[Tuple[str, str, Any]]] (https://github.com/delta-io/delta-rs/blob/main/python/deltalake/table.py#L704). There is also a docstring comment here referencing a DeltaTable.files_by_partitions, which seems to be a deprecated method, so I'm going to assume that is an out of date comment.
In _internal.pyi, we see Optional[FilterType] (https://github.com/delta-io/delta-rs/blob/main/python/deltalake/_internal.pyi#L86), which is defined as a DNF or Conjuction (https://github.com/delta-io/delta-rs/blob/main/python/deltalake/_internal.pyi#L717-L720).
In lib.rs, we see PartitionFilterValue (https://github.com/delta-io/delta-rs/blob/main/python/src/lib.rs#L655), which is defined as a string, or a vector of strings (https://github.com/delta-io/delta-rs/blob/main/python/src/lib.rs#L60-L63).
To my understanding, these three, which should all be defining the same partition filter type, all have different typing. The one in table.py and lib.rs are relatively congruent with each other, if we treat Any as Union[str,List[str]], which sort of makes sense.
The bigger difference is with _internal.pyi, which presents a whole different form of filter. This DNF style would allow for OR in the predicate filter, but this seems to be impossible in the python or rust typing. Would it be difficult to add support for OR in partition predicates via this DNF style or another?
What you expected to happen:
At the minimum, in the above code's current standing, I am not sure what the correct typing for predicate filters are. If the python one is incorrect, that should be fixed to provide accurate type hints and allow for correct static type checking when using python bindings.
Perhaps this should be raised in a Feature Request, but I'm also wondering why there isn't support for OR in predicate filters?

I think the type consistency is resolved now


metatable not working

Hello,
Thanks for developing such a great plugin, after just updating obsidian plugins metatable is not shown in preview mode:
for example I have this:

it becomes:

Hey @s1avash26 , thanks for reporting. I need to look into your case properly but in the meanwhile could you tell me:

version of Obsidian
version of Metatable
theme (whether it's the default or not)
custom css (y/n)

Finally, if you have other plugins installed, during the metatable upgrade did they also upgrade? the problem is likely to be with metatable but I've seen some conflicts between plugins and better to check :)

thank you for the response, I just struggled a few hours after that I found that I had updated "RTL" so I disabled it and then everything started working fine, I don't know why but maybe a collision.
I have updated everything to last version.

Thanks for the update. I've never used RTL but a quick test doesn't show any issue. Let me know if you find any other clue so we can narrow down what could be the issue.

Closing as I haven't been able to reproduce. Please let me know if it happens again so we can try to reduce the problem to a minimal tests case.


Add support for IPv6 to LISTEN_ADDRESS directive for OpenNebula daemon

The OpenNebula Daemon (oned) currently only ever attempts to listen on IPv4.
This patch adds support for listening on IPv6 if an IPv6-like address is supplied.

I've added the IPv6 support through getaddrinfo, as a bonus it now support DNS resolves.
https://github.com/OpenNebula/one/commit/44290311171bf6823319b3c867ab0e72a60279c1#diff-85521f07a5d817d404e1f2567819deb3


Data not shown properly when grid is resized

Hello everyone,
i encountered the problem, when the grid changes it's size (we generate our whole view through a json object, so this happens everytime), it doesn't shows the "new" visible entrys.
I created a little plunker:
http://plnkr.co/edit/01JK9r?p=preview
The case is, let the data load, press the button, so that the grid gets bigger and on the first time the table is half empty. After you scroll or resize the browser or something, the data is rendered properly.
After changing the size again, it works. (So you have to stop and start the plunker).

Try this: http://plnkr.co/edit/9wtuN5H5HwK1do72kGCV?p=preview
The grid doesn't really deal with dynamic size well, and it's something we continue to think about.  You could look at using the autoresize feature, which may give some options, but failing that usually some combination of intervals, handleWindowResize and queueRefresh will work.

Sorry that it took so long to test your solution.
Calling the queueGridRefresh-function actually solved my problem and the data is shown correctly.
Thank you very much!

Excellent, closing then.


Add disconnect listener for native to managed abort.

Currently the abort logic only works for managed to native. When native sends a signal for ClientDisconnected, we need to stop reading and writing and cleanup the connection once fired.

@muratg / @jkotalik - anything to do here for preview1?

Push this to preview2. I have a WIP branch to implement this but I need to do a bit of redesign.

I'll let @muratg do the honors.

@jkotalik could you file one more bug to fix crashes? We can keep this one for the feature for managed events etc.

https://github.com/aspnet/IISIntegration/issues/1020


feat: allow redirect_uri to be passed as parameter for getInstance

This PR allows the redirect_uri to be passed as parameter for the getInstance method in order to override the default redirect_uri format.

:rocket: PR was released in<EMAIL_ADDRESS>:rocket:


Fix CI failure: Add config to FakeAsyncBeaconChainDB.__init__

What was wrong?
config is added in BaseBeaconChainDB. Sorry I made the CI fail because I didn't rebase before merging my PR.
How was it fixed?
Add config in FakeAsyncBeaconChainDB, and pass the corresponding configs in the tests.
Cute Animal Picture

Thank you for the review:)


Track U at bottom of system

Fixes #22
Also added live plotting (although unrelated to that issue). Final graph is stored as Final_distributions.pdf in stored_folder.
The values of U at the bottom of the system and the corresponding times as a fraction of the total integration time span - which, in turn, is expressed in units of T* - are recorded in a single Pandas dataframe though py-pde's DataTracker class. This class is instantiated calling a function which has access to the state of the system during integration. This function rederives U at intervals set in the parameters.Tracker dataclass.
Now, since the Pandas dataframe is stored as an hdf5 file, the simplest way to read in this hdf5 file into a Numpy array and plot it is something like this:
import numpy as np
import pandas as pd
pandas_df = pd.read_hdf("File_just_created.h5")
U_at_bottom_and_times = pandas_df.to_numpy()
U_at_bottom_and_times.shape
(101, 2)
import pylab as pyl
pyl.plot(U_at_bottom_and_times[:, 0], U_at_bottom_and_times[:, 1], "ro")
pyl.show()

pipenv install gives errors (attached) and stops. This doesn't happen on main.
pipenv_error.txt

This was originally requested by @NiklasHohmann so I added him to take a look.

Same as for @EmiliaJarochowska , pipenv install throws errors

Does deleting Pipfile.lock solve the problem?

And does this also happen from a fresh git clone?

It had been solved after a fresh git clone but just running a new pipenv install in this folder again brings back the errors.
https://mastodon.social/@jk/110769222900259244

Does the error also reoccur when you first delete Pipfile.lock?
I could consider stopping to git track that file.

From a discussion with @NiklasHohmann it seems that me adding pandas and tables to the Pipfile has caused problems. But they are needed for writing results to hdf5 files. These results are collected in a Pandas dataframe.
From a first glance at your pipenv_error.txt, it may be that your problems have the same cause, but I am not 100% sure.

Btw, how does a poetry install work for you?

I thought pipenv install --skip-lock would also solve the problem but it doesn't.
pipenv_errors.txt
poetry_errors.txt

Perhaps I have to update the instructions for a pipenv install now that I have added these two packages. That would require help from a conda Python 3.11 environment:
What you can do, is a pipenv install while using packages already installed in
some conda environment. Let's say a Python 3.11 environment which conda refers
to as py311, but you have obviously chosen whatever name for that conda
environment that you like.

Now in your conda py311 environment install pandas and tables:

conda install pandas
conda install -c anaconda pytables

Going back to your conda base environment, you can do a pipenv install
while making use of the conda py311 installed packages.

pipenv --python=/path/to/python --site-packages

You need to insert the path to your python executable in your conda
py311 environment.

Instructions from here

That requires using conda. Is this not too restrictive a requirement?

@EmiliaJarochowska Thanks for trying poetry also. That message is clear:
Note: This error originates from the build backend, and is likely not a
problem with poetry but with tables (3.8.0) not supporting PEP 517 builds.
You can verify this by running 'pip wheel --use-pep517 "tables
(==3.8.0)"'.

But it is yet unclear to me how to fix it.

@EmiliaJarochowska Wrt the additional requirement of Conda: that is an issue indeed. Not sure how to proceed.

Okay, SO shows an alternative solution, i.e. alternative to conda, but related to a different error message, by installing PyTables from source:
pip install git+https://github.com/PyTables/PyTables

I could add that to pyproject.toml and to Pipfile, to see if that works for you. But your issue may be unrelated.

I tried locally as well, although not sure if correctly, and it didn't work either. Trying it on linux, but I have some issues with pip so I didn't get to that step yet.

Thanks for trying.

CI gave no problems, so I guess the pipenv install gave no problems on the OS used by GH Actions (probably Linux).

The problems with running are, within certain constraints, resolved. So I wanted to check what values we get: Whether anything is moving across the boundary and in what direction.
You can see an example from a run here:
https://github.com/MindTheGap-ERC/LMA_utils/blob/main/Track_U_at_bottom.ipynb
The U values saved in this branch are different from those calculated using Eq. 46 so I wonder if I made a mistake. @NiklasHohmann could you please double check? Most likely my calculation is wrong but I would like to clarify this before closing the PR.
Having all keys in a hdf5 file is amazing for keeping track of run outputs.
Next step is having them somewhere we can access them. I have put this run at https://osf.io/ews27/ where it can be downloaded directly into a notebook.
Is this useful? If you think you need to be saving runs where we can access them, I can give you write access.

Thank you very much for checking.
I tried a run with higher porosities and used that to compare U that is saved into the file, what the value would be calculated using the steps in marlpde and what it would be according to Eq. 46. In the same place.
 S is 0.1, so u from Eq. 46 would be 11.074 which is indeed quite close to that coming out from marlpde. I can't pinpoint if Eq. 46 should be u not U, i.e. the scaling factor is missing in either direction.
The value of u is what we'd be happy with, i.e. positive, but hard to tell if we can trust it since the results of the run are clearly wrong.
Our discussions on Teams illustrated the need for comparing outputs from various runs systematically. It would be handy to render this notebook into a static document with values of different runs. I might switch from Jupyter to Quarto for this. Or add entangled tags into marlpde; that would be cool but I struggled a bit with rendering with it. I clearly should have attended @jhidding's talk as I don't know what the best way is here.

Clearly wrong....? So that refers to your Teams message, showing a graph depicting U gradually dropping to a small positive number (0.094) after 16T*?
Why is that not possible?

U calculated from Eq. 46 = 110.74, U exported into hdf5 = 12.54, U calculated in marlpde = 11.97

So trying to explain the factor 10 difference....
I don't yet understand why you would do an extra division by S.
You have
Vscale = S
P_32 = beta/Vscale
betasV = P_32
k = betasV * phi ** 3 / (1 - phi) ** 2
k = k * (1 - np.exp(-10 * (1 - phi) / phi))

So effectively
betasV = beta/S

Why the extra divison by S?

Oh no. Of course you're right. There's no division by S in k. I rewrote the equation and still didn't see it 😔
I rewrote the calculation of k directly from Fortran.
After your correction:
U calculated from Eq. 46 = 11.97, U exported into hdf5 = 12.54, U calculated in marlpde = 11.97
Also for the other run I made, with Phi0 = PhiIni = 0.75 it's much closer. And if we add units:
u calculated from Eq. 46 = 0.002 cm/a, u exported into hdf5 = 0.009 cm/a, u calculated in marlpde = 0.002 cm/a
Is that a lot? For carbonates most accumulation rates lie between 0.0001 and 1 cm/a (Kemp & Sadler 2014). These are called sedimentation rates in the paper, but that's wrong: sedimentation is what comes on the surface with its initial porosity, equaling to production in CarboKitten, but what is measured there and what we try to obtain is deposition rate, after compaction. So these data should be comparable, even if they're not labeled correctly in the paper. Maybe @NiklasHohmann will have more insights on this?
TL;DR the values are realistic. But what's saved in the hdf5 is slightly different than what is calculated in marlpde, although that calculation is correct. And probably there was another error in the Fortran code 😬
I ran out of battery to hotspot myself so that's it for now.

RE sedimentation rates at the surface vs. compacted export at the bottom of the system: I calculated the proportion of material lost in Fortran, and got to values of around 80 %, so rates of export at the bottom can be one order of magnitude lower than input at the surface. Physically the explanation is that the material is dissolved and exported via the pore fluid.
RE deposition vs. sedimentation rate: There seems to be no consensus in the usage of these terms. Because of the underlying scaling laws when time scales of observations are varied (e.g., the Sadler effect) and the lack of erosion in our model I'd be cautious when comparing our model values (which are instantaneous rates) with rate compilations from deep time. Maybe it is worth to extract the mass balance of CA, AR & TE from the model outputs. This will give us a clue whether

the degree of dissolution in the system is plausible, and
whether the difference between rates at the surface and bottom is driven by compaction or dissolution

Clearly wrong....? So that refers to your Teams message, showing a graph depicting U gradually dropping to a small positive number (0.094) after 16T*?

Sorry, that was indeed unclear. "Clearly wrong" referred to the porosity at the bottom. The system relies on high compressibility, but it doesn't seem to drop very much. I had in mind that in the model and in Fortran $\phi_{\inf} = \epsilon = 1e^{-2}$ and that intuitively makes sense, but in marlpde porosity remains high through the grid and through long runs, e.g.:

so u and phi seem to have very similar development. What happens at 16 T*?

But L'Heureux also reports only a small drop in porosity at the bottom in his Fig. 5, which is inconsistent with his own PhiInf. However, that's for very short runs. One would expect continuous compaction until an equilibrium is reached.

I had in mind that in the model and in Fortran $\phi_{inf} = 0.01$

Ah, do you mean that you interpreted $\phi_{inf}$ as the porosity reached after a long time?
As you noted, in none of the L'Heureux figures such a low porosity is ever reached.
Not sure how to interpret $\phi_{inf}$ .... first used in equation (23), while referring to Boudreau and Bennett (1999) (among others).
Below their equation (5) it says:
$\phi_{inf}$ is the apparently constant porosity reached at some depth....

Is it possible that they mean a depth much deeper than the maximum depth of 5m that we are considering?

But what's saved in the hdf5 is slightly different than what is calculated in marlpde, although that calculation is correct.

I am puzzled by this. What should have been saved is calculated in this code snippet:
        Phi = state.data[4][-1]
        F = 1 - np.exp(10 - 10 / Phi)
        one_minus_Phi = 1 - Phi
        U = self.presum + self.rhorat * Phi ** 3 * F /one_minus_Phi
        return {"U at bottom": U}

So if we compare this calculation with the "regular" calculation of U in marlpde we should know the exact value of the porosity that was used.

With this last commit, the Pytables dependency has been removed, for both the pipenv and poetry installs, since this casused problems for both Mac OS and Windows.
We could get around the Pytables dependency by converting the pandas dataframe, containing the data for U at the bottom, to a Numpy array and store that in an HDF5 file.
We decided to use the HDF5 file already created for the five fields, i.e. LMAHeureuxPorosityDiff.hdf5.
We added a separate group called "U", containing a dataset called "U_at_bottom".
The way to retrieve the data is as follows:
import h5py
hf = h5py.File(some_path_with_trailing_slash + "LMAHeureuxPorosityDiff.hdf5", "r")

# Show all the entries for metadata
hf.attrs.keys()

# Show all the groups
hf.keys()
----> <KeysViewHDF5 ['U', 'data', 'times']>

# Retrieve the U at the bottom data
U = hf.get('U')
U.keys()
----> <KeysViewHDF5 ['U_at_bottom']>
U_at_bottom = U.get('U_at_bottom')

# Plot U at the bottom as a function of time.
import pylab as pyl
pyl.plot(U_at_bottom[:, 0], U_at_bottom[:, 1], "ro")
pyl.show()

# Turn U_at_bottom into Numpy array
import numpy as np
U_at_bottom = np.array(U_at_bottom)

Oh no. Of course you're right. There's no division by S in k. I rewrote the equation and still didn't see it 😔 I rewrote the calculation of k directly from Fortran.
After your correction: U calculated from Eq. 46 = 11.97, U exported into hdf5 = 12.54, U calculated in marlpde = 11.97
Also for the other run I made, with Phi0 = PhiIni = 0.75 it's much closer. And if we add units: u calculated from Eq. 46 = 0.002 cm/a, u exported into hdf5 = 0.009 cm/a, u calculated in marlpde = 0.002 cm/a
Is that a lot? For carbonates most accumulation rates lie between 0.0001 and 1 cm/a (Kemp & Sadler 2014). These are called sedimentation rates in the paper, but that's wrong: sedimentation is what comes on the surface with its initial porosity, equaling to production in CarboKitten, but what is measured there and what we try to obtain is deposition rate, after compaction. So these data should be comparable, even if they're not labeled correctly in the paper. Maybe @NiklasHohmann will have more insights on this?
TL;DR the values are realistic. But what's saved in the hdf5 is slightly different than what is calculated in marlpde, although that calculation is correct. And probably there was another error in the Fortran code 😬 I'm sorry about the mistake. I ran out of battery to hotspot myself so that's it for now.

Okay....trying to reproduce that difference. For which Phi0 & PhiIni did you find values of U at the bottom of 12.54 (saved) and 11.97 (marlpde) respectively?
You derived the marlpde value of U at the bottom by hand, as shown in your notebook.
If I run marlpde in a debugger with suitable breakpoints, I do find agreement between U at the bottom as derived in def track_U_at_bottom(self, state, t): and in U = self.presum + self.rhorat * Phi ** 3 * F /one_minus_Phi in def evolution_rate(self, state, t=0): (using the slow Numpy backend, which is more suitable for debugging), at least after one time step.

That was for Phi0 = PhiIni = 0.8. You can see in the plot at the bottom.

Thanks.
Adding these two lines
                if t==1 and i==no_depths-1:
                    print(U[-1])

here yields almost the same value:
12.539086320888092

as from a breakpoint here:
12.539086322190391

I would consider these values the same, when taking into account accuracies in numerical representations.

These values come from a value of Phi = state.data[4][-1] of 0.9812637484259564.
What is phi_bottom = data[3000,4,199] in your notebook?

I should add that my run was only over T*, not 30 times T*.
So I have tmax: int     = Map_Scenario().Tstar
cf. line 161 in parameters.py.

Oh btw if you get annoyed by not being able to reproduce it, you should be able to access the same file by running:
import datahugger
dh = datahugger.get("10.17605/OSF.IO/EWS27", "../data")
Solution_path = '../data/21_09_2023_09_29_17/LMAHeureuxPorosityDiff.hdf5'
Solution = h5py.File(Solution_path, 'r')
data = Solution['data']

but you might need to install datahugger. Couldn't come up with a better solution for sharing data files so we can retrieve data from runs.

Okay, if the porosities are the same, then one of the constants (presum or rhorat) must differ, there is no other way to explain the difference between 12.54 and 11.97.

datahugger is a great way to share data. Thanks! I did not know about this tool. I can easily run your notebook after a !pip install datahugger.
The difference between 11.97 and 12.54 in U comes from a difference in rhorat, which you have calculated to be 1.734, while I have 1.799.
You have
rhorat = (rhos_bottom / rhow - 1) * beta / S
while I have
rhorat = (rhos/ rhow - 1) * beta / S
with an initialization in parameters.py of rhos = rhos0, which has been copied from the original Matlab script.
So, effectively, in marlpde:
rhorat = rhorat0
while your notebook has
rhos = rhos_bottom, so rhorat != rhorat0.

Perhaps the choice rhos = rhos0 is a consequence of the constant density approximation, described in paragraph 2.5 of L'Heureux:
We thus set ρ_s equal to a constant defined by the initial composition of the sediment and let ρ_A ≅ ρ_C ≅ ρ_T ≅ ρ_s .
Not sure what has been implemented in the FORTRAN code.

In the FORTRAN code, line 137 you have:
rhosw0=P(20)

and for u(i), line 260:
u(i)=k(i)*(1-ph(i))*(rhosw0-1)+P(23)-P(13)*k(0)*(1-ph(0))

and P(20) seems to be set in line 841:
P(20)=rhos0/rhow

so that seems to agree with the Matlab and Python codes, but this interpretation could be too simple.
@NiklasHohmann How did you get to rhos=rhos0;?

@HannoSpreeuw via the constant density approximation as described by you above

Thanks for this detective work. I believe I made a mistake by disregarding the constant density approximation. I should have noted on why I assumed that rhos was to be evaluated for each node. I think maybe because both Fortran and Python codes allow for rhos ≠ rhos0. E.g. in Fortran we can see that Ivan clearly ran both options, but constant density would be used with the current settings:
!  case where all densities are equal to rhos
           P(7)=ccal0
           P(9)=0.
           P(10)=0.
           P(11)=rhos0/rhow
           P(12)=P(11)
           P(27)=1.

https://github.com/astro-turing/lheureux/blob/6fd4acc010aad2dbc82d23aac16546ba751beed4/src/lheureux.f#L853-L859
I'm sorry this costed you a lot of extra work, @HannoSpreeuw. I'll triple-check next time.
Correcting rhos_bottom to rhos0 gives the same values of U as saved in the file so we can merge.


Panning control fix

Fixed issue where panning could get stuck on if ctrl was released when pointer outside window

Same issue with mouse up/down


Fix response.status default value documentation

Resolves #888, also see #705

Current coverage is 100% (diff: 100%)

Merging #889 into v2.x will not change coverage

@@           v2.x   #889   diff @@
==================================
  Files         4      4
  Lines       418    418
  Methods      80     80
  Messages      0      0
  Branches    100    100
==================================
  Hits        418    418
  Misses        0      0
  Partials      0      0

Powered by Codecov. Last update 2db3b1b...432968f


What-If - Microsoft.Network/azureFirewalls ipconfigurations properties.subnet.id

Describe the noise
Resource type
Microsoft.Network/azureFirewalls
apiVersion
2020-11-01
Client (PowerShell, Azure CLI, or API)
Azure CLI
Relevant ARM Template code (we only need the resource object for the above resourceType and apiVersion, but if it's easier you can include the entire template
resource vnet 'Microsoft.Network/virtualNetworks@2020-11-01' = {
  name: 'vnet-name'
  location: resourceGroup().location
  properties: {
    addressSpace: {
      addressPrefixes:[
        '<IP_ADDRESS>/18'
      ]
    }
    subnets: [
      {
        name: 'AzureFirewallSubnet'
        properties: {
          addressPrefix: '<IP_ADDRESS>/24'
        }
      }
    ]
  }
}

resource firewallPip 'Microsoft.Network/publicIPAddresses@2020-05-01' = {
  name: 'pip-00'
  location: resourceGroup().location
  sku: {
    name: 'Standard'
  }
  properties: {
    publicIPAllocationMethod: 'Static'
    idleTimeoutInMinutes: 4
    publicIPAddressVersion: 'IPv4'
  }
}

resource firewall 'Microsoft.Network/azureFirewalls@2020-11-01' = {
  name: 'azf-name'
  location: resourceGroup().location
  properties: {
    sku: {
      name: 'AZFW_VNet'
      tier: 'Standard'
    }
    ipConfigurations: [
      {
        name: firewallPip.name
        properties: {
          subnet: {
            id: vnet.properties.subnets[0].id
          }
          publicIPAddress: {
            id: firewallPip.id
          }
        }
      }
    ]
  }
}

Expected response (i.e. "I expected no noise since the template has not been modified since the resources were deployed)
When deploying the above template on top of itself, I would expect no noise to be produced, since the template has not been changed between deployments.
Current (noisy) response (either include a screenshot of the what-if output, or copy/paste the text)

Additional context
The above template is enough to reproduce this issue consistently.
Seems to be related to https://github.com/Azure/arm-template-whatif/issues/202 and another issue I have reported recently, https://github.com/Azure/arm-template-whatif/issues/227.

Can you try re-running this? We suspect this may have been resolved with the partial fix to #157. There is also some default values here, so tagging with provider bug.

Hi @alex-frankel
Apologies for the late reply.
I have now tried to re-run the deployment, and I see the exact same output as before.
I also tried updating the API versions of the resources, which only added the following to the output:

However, I suspect that the added output for the publicIpAddress is expected in this scenario as the new API version adds this as default values (which of course wasn't specified with the old API version).


manual scroll will cancel jump

This is solution for issue #7
I added new option:
Jump.jump('.selector', {
  scrollCancelJump: true
})

If true jump will be cancelled and user will be able to continue scrolling with the mouse or touchpad or whatever.

going to take a pass on this - I think there may be an easier way to implement it, and I'm not sure I want to do so yet. thanks for the contribution though


Error installing on Windows due to incorrect usage of uname()

When installing on Windows machines, the command pip install -r "...\label-studio-ml-backend\label_studio_ml\examples\tesseract\requirements.txt" results in an error due to  os.uname() being called. On Windows systems, the correct command would be platform.uname().
Stack trace:
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [8 lines of output]
    Traceback (most recent call last):
      File "<string>", line 2, in <module>
      File "<pip-setuptools-caller>", line 34, in <module>
      File "C:\Users\Csanád\AppData\Local\Temp\pip-install-p77nn440\uwsgi_b4cbfe78a9d749e0966273c0acc5bef3\setup.py", line 3, in <module>
        import uwsgiconfig as uc
      File "C:\Users\Csanád\AppData\Local\Temp\pip-install-p77nn440\uwsgi_b4cbfe78a9d749e0966273c0acc5bef3\uwsgiconfig.py", line 8, in <module>
        uwsgi_os = os.uname()[0]
    AttributeError: module 'os' has no attribute 'uname'
    [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

I believe it's not label-studio-ml-backend problem, contact uwsgi developers please.
Try to use docker compose to run it:
docker compose up


[GLUTEN-7953] Fetch and dump all inputs for micro benchmark on middle stage begin

Collect all input data and save it into a Parquet file. Then, read the data from the Parquet file to feed it into the pipeline.

does this PR only works for middle stage? or dump the data comes from shuffle?

@Yohahaha Yes. It only works for middle stage. Updated PR titile.

@marin-ma Curious what's the improvements here, comparing to https://github.com/apache/incubator-gluten/pull/725? Thanks.

@marin-ma Curious what're the improvements here, comparing to #725? Thanks.

@zhztheplayer Currently, the input files are being dumped during the middle stage of execution. This PR will fetch all the data and save it into file before the pipeline starts. The stage input will then be read from this dumped file. This will help to save a complete input file even if the task fails. In this way, we can have the full input data of the failed task, and reproduce the failure with microbenchmark.


potential fix for the BTS-57 fix

Scope & Purpose
Potential fix for the BTS-57 fix.
It should allow concurrent read/write ops in streaming transactions again, at least from the client application perspective. On the server side, the ops will be serialized. And error is return if the operation cannot be started within 30 seconds.
This should fix the original problem reported in BTS-57 and not break downwards-compatibility.
Still needs to be tested with client drivers and confirmed!

[x] Bug-Fix for devel-branch (i.e. no need for backports?)
[ ] Bug-Fix for a released version (did you remember to port this to all relevant release branches?)
[ ] The behavior in this PR can be (and was) manually tested (support / qa / customers can test it)
[x] The behavior change can be verified via automatic tests

Related Information

[x] There is a JIRA Ticket number: https://arangodb.atlassian.net/browse/BTS-57

Testing & Verification
This change is already covered by existing tests, such as shell_client --test transaction.
We need to perform additional tests using drivers!
http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/10315/

No

http://jenkins.arangodb.biz:8080/view/3.devel/job/arangodb-devel-docker-and-drivers-nightly/262/

@graetzer : can you please be a bit more verbose?
Instead of just commenting "No", please explain why you think there is a problem and what needs changing.

No

Can you give details? @graetzer

http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/10326/

if the java tests would work it should trigger this assertion https://github.com/arangodb/arangodb/blob/50152de0f24c5887e5bebc0dd007dd5aab5acfca/arangod/Transaction/Manager.cpp#L473
so the tests are 💩

http://<IP_ADDRESS>:8080/view/PR/job/arangodb-matrix-pr/10373/

Obsoleted in favor of upcoming fix by @graetzer


WFP-1220 update all occurrences of crn when tier is updated

Two different databases, hmpps-allocations doesn't have access to the workload db


Update Composer dependencies (2023-12-15-00-18)

Visual regression test passed!
View the visual regression test report


Merging Develop into Master 3.20.2019 - moving 'using handlebars', fixing broken links, minor tweaks

Description of the change:
Reason for the change:
Link to original source:

Closes #

Hello @Whatthefoxsays,Thanks again for the PR! We appreciate your contribution and look forward to                                              continued collaboration. Thanks!                                             Team SendGrid DX


[DOCFIX] Update Flink documentation

In the english version of the flink doc, in the prerequisite section it says Flink has been set up and is running. which sounds like there should be a running cluster started by the Flink's bin/start-cluster.sh command. However, after the changes are made to the configuration of hadoop and flink, running the example in the doc won't work unless the running flink cluster is stopped.

alluxio-bot, merge this please

alluxio-bot, merge this please

alluxio-bot, cherry-pick this to branch-2.7 please


Select "Lovelace" as a category – lovelace not available as category

I can't get it to work. The only clue I have is that the category "lovelace" cited in the install guide. Please advise.

manual Card works for m,e:

Lovelace is now dashboard. See here


Add support for a tableland.network gateway, redirecting to Tableland testnet or mainnet

Is your feature request related to a problem? Please describe.
Register & use a tableland.network domain that handles redirects to the Tableland testnet or mainnet gateways via inference.
Describe the solution you'd like (via @sanderpick)
Ultimately, we want this:

Tableland testnet only deals with evm testnets
Tableland mainnet only deals with evm mainnets

This means that chainID actually infers the Tableland network. So, instead of standing up some new gateway like mainnet.tableland.network and requiring devs to make changes to their contracts, we can just alias testnet.tableland.network with tableland.network and create some redirect rules:

If chainID is an evm testnet, permanent redirect to testnet.tableland.network if need be
If chainID is an evm mainnet, permanent redirect to tableland.network if need be

Describe alternatives you've considered
As noted, a dedicated mainnet.tableland.network was considered, but the solution above makes any future migration much more seamless.
Additional context
This reduces the need to update an ERC721 contract's tokenURI (or other methods) that reference the Tableland gateway. It alleviates some friction points, especially, if a contract was not upgradable and couldn't change the URI itself.

One other idea that was floated by @andrewxhill was adding versioning to the gateway, which aligns with @carsonfarmer's current API overhaul design, too.
The idea also mentioned using gateway.tableland.xyz, which I'm mainly noting here because leveraging the word gateway might be a nice little DX play: it helps describe what a gateway is. Maybe we implement tableland.gateway (or gateway.tableland) instead of tableland.network? No strong opinion...might be easier to maintain the general format of what we already have.
(Also, perhaps I should have created this as a discussion vs. issue...can move there if needed)

@brunocalza or @jsign you guys have thoughts here? tl;dr, create ability to redirect based on chainID to some configured hosts in the config. we'd have a testnet and mainnet host in the config.
related to https://github.com/tablelandnetwork/go-tableland/issues/287

Not every API endpoint has {chainID} information today; some examples:

/query endpoint doesn't need {chainID} information since you can join tables in the same network (requested by #287).
/schema/{table_name} doesn't have {chainID} information since the table name uniquely identifies the table, so it isn't needed from the route or SIWE.

In those two cases, the way to infer the redirection isn't that trivial, since there's no {chainID} in the path or headers, but it's API dependent (e.g: parsing the query, or parsing path-subpaths to look for patterns to be maintained). If tomorrow we create a new API, we should always think how to create the appropriate custom  (since isn't always headers or path) rule in the reverse proxy, and potentially program that as part of the main work.
It can also produce some weird behavior from the user side. For example, /schema/{table_name} would give you info from testnet, and you might expect that in some other API that has relevant mainnet information, you can access that table; but since the backends are different validators you might get some table not found which is technically correct if this second API routed to mainnet (for whatever rule it has, which is hard to model since might be custom). The point is this might create incoherence between APIs in ways that might be surprising.

Good points.
The main concern is providing some easy migration path for folks that have tables on mainnets (Ethereum, etc.) that are referenced by in tokenURI (or similar) methods over the current Tableland "testnet". Right now, we plan on migrating those tables to Tableland mainnet. We don't want folk to have to update the Tableland host in their contracts. The problem is probably obvious, just outlining it here to be clear.
I think #287 takes precedence over this concern. After that work, as you say, there is no feasible way to create a reverse proxy that can handle redirects across all APIs that are used in contracts today.
At this point, I think we want to strongly encourage people to allow updating any reference to a Tableland host in their contacts, eg, in baseURIs, etc. We can continue to think about creating some nicer migration path.


Unclear structure of the list file that is required for feature extraction

The file structure for list file that is required for feature extraction is:
org_video,label,start_frm,video_id
I am confused about the video_id here. According to the feature extraction tutorial each clip has a different video_id, but according to the list files available on the dropbox here, all the clips from the same video should have the same video_id. I personally think that the latter should be correct.
Can you help me here? Also, why do the files on that dropbox link has start_frm difference of 1 frame? That's like each frame is considered as a clip, right?
Thanks

That list is for different purpose, e.g. dense prediction where we don't really care about the identities of clips within a video, for example, we just want to average pool the predictions to make the video-level prediction. However, for some other use cases, e.g. detection, if we want to have the real identities of clip, then we can keep the video_id for each clip different so after feature extraction we can have a corresponding map between features and clips.

Oh, I see. Thanks for the help.

And what's the reason for the 1 frame clips though?


Add strict type checking for array_search() and array_keys().

Will only check for the $strict parameter for array_keys() if the second parameter has been set.
Fixes #503.
The file/sniff name is now a bit dated as the sniff checks for more than just in_array(), but changing the file/sniff/classname would break backward compatibility.
What do you think ?

The file/sniff name is now a bit dated as the sniff checks for more than just in_array(), but changing the file/sniff/classname would break backward compatibility.
What do you think ?

Yeah, we'll just leave it like it is.


V4 config fails on Thinkpad X390

Ouput of linux-enable-ir-emitter -v -d /dev/videoX configure

configure command output
[~]$ sudo linux-enable-ir-emitter -v -d /dev/video2 configure
INFO: Ensure to not use the camera during the execution.
INFO: Warning to do not kill the process !
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
DEBUG: unit: 9, selector: 10, cur control: 0 8 0 187 187 187 187 187, first control to test: 0 0 0 0 0 0 0 0, res control: 1 0
0 0 0 0 0 0, max control: 255 255 255 255 255 255 255 255
DEBUG: Negative answer limit exceeded, skipping the pattern.
ERROR: Impossible to reset the control.
INFO: Please keep this debug in case of issue :
DEBUG: unit: 9, selector: 10, control: 0 8 0 187 187 187 187 187
DEBUG: unit: 10, selector: 2, cur control: 1 0 0 0 0 0 0 16 39 0 0 0 0 0 0, first control to test: 0 0 0 0 0 0 0 16 39 0 0 0 0
0 0, res control: 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0, max control: 7 0 0 0 0 0 0 200 20 5 0 0 0 0 0
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
DEBUG: Computing the resolution control.
DEBUG: unit: 10, selector: 6, cur control: 1 3 1 0 0 0 0 0 0, first control to test: 1 3 2 0 0 0 0 0 0, res control: 0 0 1 0 0
0 0 0 0, max control: 1 3 3 0 0 0 0 0 0
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
DEBUG: unit: 10, selector: 9, cur control: 0 0 0 0, first control to test: 1 0 0 0, res control: 1 0 0 0, max control: 1 0 0 0
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
DEBUG: unit: 14, selector: 14, cur control: 0 0, first control to test: 1 10, res control: 1 10, max control: 2 100
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
DEBUG: unit: 14, selector: 16, cur control: 0, first control to test: 1, res control: 1, max control: 1
Is the ir emitter flashing (not just turn on) ? Yes/No ? n
ERROR: The configuration has failed.
INFO: Do not hesitate to visit the GitHub ! https://github.com/EmixamPP/linux-enable-ir-emitter/wiki

Output of v4l2-ctl --list-devices
[~]$ v4l2-ctl --list-devices
Integrated Camera: Integrated C (usb-0000:00:14.0-8):
        /dev/video0
        /dev/video1
        /dev/video2
        /dev/video3
        /dev/media0
        /dev/media1

Ouput of v4l2-ctl -d /dev/videoX --list-formats-ext

v4l2 device output
[~]$ v4l2-ctl -d /dev/video2 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
        Type: Video Capture

        [0]: 'GREY' (8-bit Greyscale)
                Size: Discrete 640x360
                        Interval: Discrete 0.067s (15.000 fps)
                        Interval: Discrete 0.033s (30.000 fps)

Additional info

Distro: Arch Linux
Version: latest
Version of linux-enable-ir-emitter: 4.1.2
How did you install linux-enable-ir-emitter: AUR
Device: Lenovo Thinkpad X390

Possibly related to Issue #71
Until V4 it was working without any issues but after updating to V4 the program broke. I have tried reinstalling it several times both from the AUR and directly from github and it fails the same way every time. Installing V3 from git creates a functioning configuration but upgradig to V4.1.2  and running the script to migrate the config breaks the program and subsequent attempts to reconfigure the program fails.

Theoretically, I've fixed the installation script for Arch since v4.1.2 which . Therefore, it should not be necessary to run the migration script manually. So I don't understand why the update v3->v4.1.2 broke the software only on Arch but not on Fedora.
And I don't understand why on Arch the configuration does not trigger the emitter. I think this is related to OpenCV which does not work proprely ...

Installing V3 from git creates a functioning configuration but upgradig to V4.1.2 and running the script to migrate the config breaks the program and subsequent attempts to reconfigure the program fails.

Did you use the bash installer.sh update command ? Because I realize that this command cannot update major release (I will remove it).

Can you install the v3.2.5 from git (with bash installer)
Configure your emitter
reboot
Download the v4.2.1 from git, install it (with bash installer)
Past the output of cat /etc/linux-enable-ir-emitter.yaml
Past the output of cat /etc/linux-enable-ir-emitter/video2
Past the output of sudo linux-enable-ir-emitter boot status
Execute sudo linux-enable-ir-emitter boot enable
Past the output of sudo linux-enable-ir-emitter boot status

Thank you !

cat /etc/linux-enable-ir-emitter.yaml
Doesn't exist anymore since the 4.1.2 installation removes this file, I reinstalled 3.2.5 and backed up the file before installing 4.1.2 and here's the original file:

#Caution: any manual modification of this file may corrupt the operation of the program! You must therefore be very careful.
#Please consult https://github.com/EmixamPP/linux-enable-ir-emitter/wiki/Manual-configuration before.
#If you currupt the driver file: execute 'linux-enable-ir-emitter fix driver' to reset the file.

!!python/object:driver.Driver.Driver
_control:
- 1
- 3
- 3
- 0
- 0
- 0
- 0
- 0
- 0
_device: /dev/video2
_selector: 6
_unit: 10

/etc/linux-enable-ir-emitter/video2 contains:
device=/dev/video2
unit=10
selector=9
size=4
control0=1
control1=0
control2=0
control3=0

systemctl status (it looks the same both before and after it is enabled at boot):
○ linux-enable-ir-emitter.service - enable the infrared emitter
     Loaded: loaded (/usr/lib/systemd/system/linux-enable-ir-emitter.service; enabled; preset: disabled)
     Active: inactive (dead) since Sun 2022-07-17 14:29:13 CEST; 12min ago
    Process: 792 ExecStartPre=/sbin/modprobe uvcvideo (code=exited, status=0/SUCCESS)
    Process: 793 ExecStart=/usr/bin/linux-enable-ir-emitter run (code=exited, status=0/SUCCESS)
   Main PID: 793 (code=exited, status=0/SUCCESS)
        CPU: 303ms

Jul 17 14:29:13 host systemd[1]: Starting enable the infrared emitter...
Jul 17 14:29:13 host systemd[1]: linux-enable-ir-emitter.service: Deactivated successfully.
Jul 17 14:29:13 host systemd[1]: Finished enable the infrared emitter.

Don't put too much thought into what systemctl says either, after installing and configuring 3.2.5 the IR emitter continues to work for a while even without any version of linux-enable-ir-emitter installed.

Regarding opencv, interestingly enough on 3.2.5 I get these error messages when running the configuration but I do not get them on 4.1.2
[<EMAIL_ADDRESS>global /build/opencv/src/opencv-4.6.0/modules/videoio/src/cap_gstreamer.cpp (2401) handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module source reported: Could not read from resource.
[<EMAIL_ADDRESS>global /build/opencv/src/opencv-4.6.0/modules/videoio/src/cap_gstreamer.cpp (1356) open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global /build/opencv/src/opencv-4.6.0/modules/videoio/src/cap_gstreamer.cpp (862) isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created

/etc/linux-enable-ir-emitter/video2 is the result of a configuration with the v4 ?
Because I don't think the migration script (automatically executed during the installation of the v4) could have produced that.

Regarding opencv, interestingly enough on 3.2.5 I get these error messages when running the configuration but I do not get them on 4.1.2

Yes, I've disabled OpenCV log

/etc/linux-enable-ir-emitter/video2 is the result of the configuration with 3.2.5 but after installing 4.1.2
Configuration fails during 4.2.5 but if I tell it it passed successfully after the second attempt (same as 3.2.5) I get this:
´´´
device=/dev/video2
unit=10
selector=2
size=15
control0=0
control1=0
control2=0
control3=0
control4=0
control5=0
control6=0
control7=16
control8=39
control9=0
control10=0
control11=0
control12=0
control13=0
control14=0
´´´

Ok, things become complicated to explains ^^
The problem is that I cannot find a fix if I don't have precisely the state of the two mentioned files before and after update in a "regular" situation.

Uninstall the v3 and v4 (no more files in  /usr/lib/linux-enable-ir-emitter/ and /etc/linux-enable-ir-emitter/ and /etc/linux-enable-ir-emitter.yaml)
Shut down your computer
remove the AC adaptater
boot, install the v3 and configure the emitter
reboot, is everythings working ?
install the v4
past the content of /etc/linux-enable-ir-emitter/video2 and linux-enable-ir-emitter boot status

I won't have time to try debugging today. So I think it's better for you to go back to v3. And probably tomorrow I'll install a VM with Arch to do some tests ...

@supdrewin, sorry to bother you, did you have any problems with v4 ? Thanks

At the moment the IR emitter just works without anything installed, this has happened once before and it stops working again fairly quickly. I'll update with the yaml and video2 files after it has stopped working and I've reconfigured V3 again.
If I have enough time on Monday or Tuesday I'll boot a fedora live-usb and see if I have the same issue there

video2 file from 3.2.5 config after 4.1.2 install:
device=/dev/video2
unit=10
selector=6
size=9
control0=1
control1=3
control2=2
control3=0
control4=0
control5=0
control6=0
control7=0
control8=0

boot status after 4.1.2 install but before reboot
○ linux-enable-ir-emitter.service - enable the infrared emitter
     Loaded: loaded (/usr/lib/systemd/system/linux-enable-ir-emitter.service; enabled; preset: disabled)
     Active: inactive (dead) since Sun 2022-07-17 15:19:18 CEST; 3min 36s ago
    Process: 796 ExecStartPre=/sbin/modprobe uvcvideo (code=exited, status=0/SUCCESS)
    Process: 798 ExecStart=/usr/bin/linux-enable-ir-emitter run (code=exited, status=0/SUCCESS)
   Main PID: 798 (code=exited, status=0/SUCCESS)
        CPU: 327ms

Jul 17 15:19:17 host systemd[1]: Starting enable the infrared emitter...
Jul 17 15:19:18 host systemd[1]: linux-enable-ir-emitter.service: Deactivated successfully.
Jul 17 15:19:18 host systemd[1]: Finished enable the infrared emitter.

boot status after 4.1.2 install but after reboot
○ linux-enable-ir-emitter.service - enable the infrared emitter
     Loaded: loaded (/usr/lib/systemd/system/linux-enable-ir-emitter.service; enabled; preset: disabled)
     Active: inactive (dead) since Sun 2022-07-17 15:23:51 CEST; 16s ago
    Process: 640 ExecStartPre=/sbin/modprobe uvcvideo (code=exited, status=0/SUCCESS)
    Process: 641 ExecStart=/usr/bin/linux-enable-ir-emitter run (code=exited, status=0/SUCCESS)
   Main PID: 641 (code=exited, status=0/SUCCESS)
        CPU: 80ms

Jul 17 15:23:51 host systemd[1]: Starting enable the infrared emitter...
Jul 17 15:23:51 host systemd[1]: linux-enable-ir-emitter.service: Deactivated successfully.
Jul 17 15:23:51 host systemd[1]: Finished enable the infrared emitter.

For now it seems to be working with the 3.2.5 config but 4.1.2 install, I'll leave it as is and update if it stops working

(Miss click on close)
Everything seems good, therefore I think there is an issue with AUR, not with the migration script.

I'll boot a fedora liveusb tomorrow and see what that does, could also be something weird going on with my specific arch install.

This problem may be corrected in v4.1.4. I forced v4l2 as opencv backend.

Let me know if you have the time to test the v4.1.4

uninstall it
shutdown and boot (in order to reset the camera driver)
install the new version
configure again and see if the problem still there

Thanks

Sorry for not updating, had a very busy few weeks.
I tried v4.1.4 and configuration is now working, thank you so much! :)


Address deprecations

Waiting for https://github.com/almond-sh/almond/pull/329 (that this may conflict with).


Cursor size is not consistented with font size.

You see the text with font size 36 but the cursor size is not changed but it should.

I am not sure if i did something wrong, but i installed flutter_quill: ^10.4.5 and I for me the cursorheight doesn't ever adjust to the fontsize.

For me this issue exists on MacOS, iOS, Android, Chrome (ran on mac) - I didn't check windows.

Here is a little video which shows the issue in the repo using the example project.
Video on Google Drive

This bug hasn't been fixed. Moving the discussion to #2169.


bug(route): Fields such as host are not required

@membphis

API will response 400 error if I only post URI field.


How to run this ? ./halftone seems not possible

Hello,
by the lack of instructions I tried a chmod +x halftone (deep in Contents/Application) but it throws a error format for exec(): halftone.
I'm on Debian and I may not have all Qt libs installed.
Thanks !

You downloaded the OS X release. Try this or simply:
(ql:quickload :halftone)
(halftone:start)

I'd never have found myself^^ (it was the second time I tried…) thanks. Works like a charm. Gonna have to study this source code.


unit test error when run the file in test folder

Hi， I install the rocm deepspeed via the source code. And now I want to test the op in my platform. And I test with the following commands:
cd tests; pytest
But I find many import mistakes shows like below:
/path/of/my/python/installed/python3.7/importlib/__init__.py:127: in import_module     return _bootstrap._gcd_import(name[level:], package, level) tests/unit/inference/test_checkpoint_sharding.py:10: in <module>     from transformers import AutoConfig, AutoModelForCausalLM E   ModuleNotFoundError: No module named 'transformers'
I want to know how to run the test in the project. Hope for your replay

Have you installed transformers?

Have you installed transformers?

what's your transformers mean? I compile the project from source with the  args  DS_BUILD_TRANSFORMER=1. Do you mean I need to install the transformers package from pip?
pip install transformers

Yes, you need to do pip install transformers. Sorry, DS_BUILD_TRANSFORMER= is unrelated to transformers package.


just a question

Hello,
do you have any idea about online multivariate change point detection?

No, haven't looked into it. Sorry.


Can't create a new game

Symptom
Trying to create a new game doesn't work anymore. With the Chrome dev tools console open, I can see that it's caused by a 500 internal server error in the console. This error is thrown with every click of the "Create" button.

Cause
It looks like this bug was introduced in #115 when host was accidentally renamed to owner in the Serializer during a merge conflict resolution - see the change here. For context, "owner" was the original name, but it was changed to "host" a couple of weeks ago.

Closed by #117


Add licence badge

small thing worth adding to README.md

Looks good!
The only thing (and its a minor thing):
Perhaps we could move it to the top, next to the other badge?


Relation extraction?

I was wondering whether relation extraction (e.g. geneX associated-with diseaseY, or geneX interacts-with geneY, etc) is on your roadmap?

Hi,
The short answer is 'not at the moment but it could be in future'.
There was already relation extraction work done for BIKG (see the paper) before we made KAZU, which unfortunately is not open source (currently at least, and may prove more difficult to open source than KAZU was for a few reasons).
At the moment, BIKG is the only internal AstraZeneca user depending on relation extraction, so there's not any immediate internal demand to add relation extraction to KAZU.
That said, it does seem like a natural fit to expand KAZU into, so it's something we'd be interested in hearing about external demand/requirements from KAZU users as well. That said, if there's no internal demand, we'd have to work on it in our personal time, so may proceed slowly (although external contributions could of course speed this up!).
Leaving this issue open at least for now, to allow others interested in 'relation extraction in KAZU' to add perspectives/thought - thanks for kicking off the conversation!


Acala parachain

I cant see my dot contribution in acala crowdloans winner tab  in polkawallet

I can’t either

Only direct contribute can be seen in crowdloan page. Contributions with lcDOT go through an Acala proxy account, so it won't be displayed there. You can check your contributions in Acala's official website https://acala.network/.

Thanks alot


Block malware

Welcome
Does the DNS resolver block malicious content?
Example
<IP_ADDRESS>
<IP_ADDRESS>
security.cloudflare-dns.com
https://security.cloudflare-dns.com/dns-query
Because I want it
If it is not prohibited
I hope you will add the prohibition of harmful content

Hello,
We didn't block anything. You may install 3rd party service like Pi-hole or adguard to block them.


Circular class references failing with SystemJS

Hi,
I'm trying to switch our project from using requirejs to systemjs.  The project has some circular references between classes.  The simple circular reference case works (parent refers to child, and child refers to parent).   However, if the child extends from another class, it fails.    I've boiled it down to a simple three class example that illustrates the problem (each class is in a different file), along with a test that illustrates the runtime failure:
import {CircularChild} from "CircularChild";

export class CircularParent {
    public child: CircularChild;
}

export class CircularChildBase {
    public myString: string;
}

import {CircularParent} from "CircularParent";
import {CircularChildBase} from "CircularChildBase";

export class CircularChild extends CircularChildBase {
    public child: CircularParent;
}

and here is the jasmine test
import {CircularParent} from "abweb/test/sample/CircularParent";
import {CircularChild} from "abweb/test/sample/CircularChild";

describe("SystemJS Circular Testing Suite", function ()
{
    it("Circular class succeeds if it does not extend from another class", function ()
    {
        var parent: CircularParent = new CircularParent();
        expect(parent).not.toBeNull();
    });
    it("Circular classes fail if extends from another class", function ()
    {
        var child: CircularChild = new CircularChild();  // This line fails
        expect(child).not.toBeNull();
    });
});

The first test succeeds, and the second test fails with the following exception:
TypeError: CircularChild_1.CircularChild is not a function
	    at Object.<anonymous> (C:/sand/webcommons/webcommons/abweb/webapp/abweb/test/specs/utils/CircularUtilsUSpec.js:18:33)

which corresponds to the 'new CircularChild()' invocation (in the generated test javascript, this line looks like var child = new CircularChild_1.CircularChild(); // This line fails.
When the child class does NOT extend from another class, the test works.    The main difference that I see is in the typescript generated js file for the ChildClass, the ChildClass.js has an 'extends' block preamble before the System.register call:
var __extends = (this && this.__extends) || function (d, b) {
    for (var p in b) if (b.hasOwnProperty(p)) d[p] = b[p];
    function __() { this.constructor = d; }
    __.prototype = b.prototype;
    d.prototype = new __();
};System.register(["CircularChildBase"], function(exports_1) {
    var CircularChildBase_1;
    var CircularChild;
    return {
        setters:[
            function (_CircularChildBase_1) {
                CircularChildBase_1 = _CircularChildBase_1;
            }],
        execute: function() {
            CircularChild = (function (_super) {
                __extends(CircularChild, _super);
                function CircularChild() {
                    _super.call(this);
                }
                return CircularChild;
            })(CircularChildBase_1.CircularChildBase);
            exports_1("CircularChild", CircularChild);
        }
    }
});
//# sourceMappingURL=CircularChild.js.map

I'm using typescript 1.5.3 and systemjs 0.18.14, and obviously compiling with the tsc --module system option
Any ideas?  Is this a known bug, or is there a workaround?
Thanks,
Brad

More research shows this can bug can be further simplified to systemjs not being able to load any of my classes that extend another class (the circular reference part was a red herring).  Thus it looks like I have a systemjs configuration error, and I'm closing this issue.


Remove .DS_Store files and update .gitignore

(Sorry for skipping to create issues)
Hi, this PR just removes unnecessary cache files of macOS.
My recommendation for macOS users is to append the content of https://github.com/github/gitignore/blob/master/Global/macOS.gitignore to your ~/.gitignore_global and run git config --global core.excludesfile ~/.gitignore_global command. This prevents committing the same files in the future. 🙂

Thanks.
Can you add this to the gitignore too?
https://github.com/github/gitignore/blob/master/Global/macOS.gitignore

Thanks for reviewing, @grant.  I've updated .gitignore too.


Tab Order

Accessibility Report
The tab order skips the following page elements:

Header nav search
Color mode
Header nav children with sub-menus (Opportunities, Resources, Connect)
Banner close icon

Following page elements are selected with tabbing, but have no focus styling:

Header nav items (Technology, Developers, Vision, Ecosystem)
Sidebar nav open/close icon

Other tab order issues:

Banner is selected first
When using sidebar nav, tabbing position is reset on click
Table of Contents nav is after article in tab order
Footer: Social media icons are before Privacy Policy and ToS in tab order
Hamburger Menu: when inside hamburger menu items can not be tabbed through- perhaps a similar issue to the dialog where tab index is on content behind?

Most of the issues raised here will be addressed by this PR: https://github.com/substrate-developer-hub/substrate-docs/pull/1210
Banner is selected first - this is correct.
When using sidebar nav, tabbing position is reset on click - this is correct.
There are some others that I am still looking into:
Table of Contents nav is after article in tab order
Footer: Social media icons are before Privacy Policy and ToS in tab order
Hamburger Menu: when inside hamburger menu items can not be tabbed through- perhaps a similar issue to the dialog where tab index is on content behind?

Closing this as I think it has been mostly resolved. If any other specific issues arise please crate a new issue or reopen this one.


Added 'durations' token type

Hello, thank you for the great library! We just started using it, and our design team would love to add three more token types (for motion and animation):

Durations
Delays
Easings

This PR covers "Durations" and if you think it looks ok, I will proceed to do the others as well.
My duration implementation is based on your work on z indices, the only difference is that I replaced parseInt with parseFloat

I've seen you have easings on your roadmap, not sure how to validate these, should they just be strings?

It seems tests are failing on CI because of the missing .env file, but I might be wrong.
    Missing one or more of required arguments: "figmaToken", "figmaUrl" when attempting to get data from Figma API!

I had the same issue locally and adding the .env file with my FIGMA_TOKEN and FIGMA_URL solved it.

Hey @Stanko and thanks for this!
The CI fails because I'm not (i.e. the repo isn't) allowing secrets access to external users. Don't worry about that.
Good work, I'll merge it.


Uncaught TypeError: projects.getCurrent is not a function

i can't save project.
[Enter steps to reproduce below:]

package>project Manager > Save Project
Error!

Atom Version: 1.8.0
System: Mac OS X 10.10.5
Thrown From: project-manager package, v2.9.7
Stack Trace
Uncaught TypeError: projects.getCurrent is not a function
At /Users/user-name/.atom/packages/project-manager/lib/save-dialog.coffee:23

TypeError: projects.getCurrent is not a function
    at new SaveDialog (/Users/user-name/.atom/packages/project-manager/lib/save-dialog.coffee:23:14)
    at atom-workspace.projectManagerSaveProject (/Users/user-name/.atom/packages/project-manager/lib/project-manager.js:23:10)
    at CommandRegistry.module.exports.CommandRegistry.handleCommandEvent (/Applications/Atom.app/Contents/Resources/app.asar/src/command-registry.js:260:29)
    at CommandRegistry.handleCommandEvent (/Applications/Atom.app/Contents/Resources/app.asar/src/command-registry.js:3:61)
    at CommandRegistry.module.exports.CommandRegistry.dispatch (/Applications/Atom.app/Contents/Resources/app.asar/src/command-registry.js:160:19)
    at AtomEnvironment.module.exports.AtomEnvironment.dispatchApplicationMenuCommand (/Applications/Atom.app/Contents/Resources/app.asar/src/atom-environment.js:1100:28)
    at EventEmitter.outerCallback (/Applications/Atom.app/Contents/Resources/app.asar/src/application-delegate.js:327:25)
    at emitTwo (events.js:87:13)
    at EventEmitter.emit (events.js:172:7)

Commands
     -7:41.4.0 project-manager:save-project (atom-text-editor.editor.is-focused)
     -4:43.1.0 application:add-project-folder (atom-text-editor.editor.is-focused)
     -4:23.2.0 command-palette:toggle (atom-text-editor.editor.is-focused)
     -0:12.6.0 core:close (div.package-detail.panels-item)
     -0:00.8.0 project-manager:save-project (atom-text-editor.editor.is-focused)

Config
{
  "core": {
    "allowPendingPaneItems": false
  }
}

Installed Packages
# User
atom-jade, v0.3.0
autocomplete-paths, v1.0.2
color-picker, v2.2.2
emmet, v2.4.3
file-icons, v1.7.17
git-history, v3.2.0
git-log, v0.4.1
highlight-column, v0.5.1
highlight-selected, v0.11.2
japanese-menu, v1.8.0
language-slim, v0.5.0
minimap, v4.24.7
minimap-autohide, v0.10.1
pigments, v0.31.2
project-manager, v2.9.7

# Dev
No dev packages

Your issue should hopefully be fixed in the new release


updated readme, took out sensitive .env info.

Description
Updated Back End's readme file.
Type of change
Please delete options that are not relevant.

[x] This change requires a documentation update

Checklist

[x] Edited documentation has been reviewed by at least one peer
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] There are no merge conflicts

@cmruss does Brianna still need to review this? Or can we go ahead and merge?


v3.27.0 release breaks functionality for returning html from formatters

Bug report

What is the behavior you expect?
Before v3.27.0 release, I was returning HTML from the formatters, to print more interesting legends

What is happening instead?
Now the HTML string is printed.

What error message are you getting?
There are no related error messages in the console

Same, formatter is not rendering html entities

!up - Same, formatter is not rendering html entities

Same, formatter is not rendering html entities
Please help!!!

@junedchhipa What changed with v3.27.0 that cause this? Was is a design decision or a regression bug?

@tonyalaribe @justineKlimato @alekbless @juliorosseti @idoshr
Can anyone provide a reproduction app via a codepen? Preferably one that works using the older version and one that's broken sig the newest version.
Thanks

@brianlagunas This was a decision taken in response to a vulnerability https://snyk.io/vuln/SNYK-JS-APEXCHARTS-1062708

I understand the XSS vulnerability but my input is not coming from the user... How do I get the formatter to stop escaping the html now? Besides downgrading the lib?

@EchopixUser there are many ways to use XSS that don't include input from a user. ApexCharts is a client side library and is easily manipulated by anyone that's not the original programmer. XSS does not need user input in order to be taken advantage of.

@EchopixUser there are many ways to use XSS that don't include input from a user. ApexCharts is a client side library and is easily manipulated by anyone that's not the original programmer. XSS does not need user input in order to be taken advantage of.

Anything on client side can be altered. What's your point. The only thing this fix achieved is forcing people to downgrade to prior versions to keep the desired behavior.

So what is the solution for custom rendering in tooltip???

There isn't any. Downgrade to 3.26.3 is your easiest option.

After speaking with @junedchhipa, we think we have some ideas to help sanitize the html markup to help eliminate the XSS vulnerability.
We will reopen this and see if you can safely implement this.  If anyone has any ideas, please share them

The new sanitize function allows HTML tags while removing any other special attrs supplied in it.
The next release will have this fixed.

I tested / implemented the 4cbc7c6 (SantizeHtml) patch above in the 3.42.0 release. But this implementation is also added to the tooltip function / domhandler, there the sanitize check is applied and fires on every mouse move event and eats away 380ms every move of the mouse. making the tooltip crawl.
I suggest to sanitize the tooltip data before domhandling.


Create a new pull request by comparing changes

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.07%) to 95.553%

Totals

Change from base Build<PHONE_NUMBER>:
0.07%

Covered Lines:
1961

Relevant Lines:
2015

💛  - Coveralls


Presto Rest API for Query

In the older version, http://localhost:8080/v1/query/ URL was giving the list of the query.
In new version 333 when I tried the same URL (also in POST method by passing X-Presto-User) it shows ERROR : Method Not Allowed / STATUS:405

got the solution, by providing X-Presto-User parameter in GET request instead of POST request.


What could be causing this -- ffmpeg related, but also zimg, I believe -- ?

Hi.
I'm asking it here, too, because I believe it may be related to some recent change in zimg that has cascaded down to ffmpeg and collided with my customized Wondows 10 x64 install.
This is my issue open at one of the current publishers of compiled ffmpeg binaries for windows. I'll post it here so I don't paste the whole thing.
https://github.com/GyanD/codexffmpeg/issues/57
In short, it seems [to me] that recent changes in zimg now require something to be available in Windows that it didn't require before. So, using zscale for resizing image in ffmpeg throws an error in my customized OS install, an error that never appeared before... and what's weirder to me, it only happns to a limited set of files wich might be malformed... but the error doesn't happen in a vanilla Windows 10 install.
I hope this makes some sense, and I also hope is a matter than can be adressed here. I'm just a user without knowledge or experience to know how to deal with this.

	if (state.active_width <= 0 || state.active_height <= 0)
		error::throw_<error::InvalidImageSize>("active window must be positive");

Your image has negative dimensions.

Your image has negative dimensions

What does this mean in layman terms for an image/video?

FFMPEG started setting this field in FFmpeg/FFmpeg@d0aefc3 . There is probably a bug in the calculation.

What's weird to me is latest version ffmpeg-zscale works OK with a vanilla Windows 10 x64 install but on my slimmed down install is showing this error.
Therefore I assume something I deleted or disabled on my install is also interfering but I can't imagine what does zimg/ffmpeg now needs from Windows that didn't need before [because previous version worked just fine].
Could you please explain a little bit about if zimg is depending on some protocol/library/whatever it expects to find in a Windows install in your latest version that didn't required before?
Thanks for taking the time to answer!

Could it be that the errors occur when processing videos with very low vertical resolution (height) while running on a CPU with many threads?

Hmmm... not the files themselves, but I've observed and tested a weird behaviour that looks related to this!
I used ffmpeg to generate a 4K test file so I wasn't getting weird results because of a malformed file.
I've found that, applying only the zscale filter and any video codec, say x265, to process the test file, I'm reproducing the error consistently and in a particular number succession.
I'm using an AMD 5900x, 12 cores, 24 threads
I've tested resizing the 3840x2160 file following this steps:

First I tested scaling only the horizontal dimension 3840...1920... 1280... 99... 5321... any number. No problem at all.
Then I did the same with vertical dimension, keeping horizontal dimension at 3840... and I started finding errors [zscale error code 2050] on a few numbers, and error plus ffmpeg.exe crash in a range of numbers.
I've taken a couple snapshots where I try to resume what I've found and what numbers trigger what result. I hope is clear enough to be understood.

Please report these findings to FFMPEG. Thanks.

FFMPEG started setting this field in FFmpeg/FFmpeg@d0aefc3 . There is probably a bug in the calculation.

Calculation is fine. Look at changes after that, latest version correctly use doubles for active region calculation.
Should zimg compare with 0.0 and not 0 in that code linked above?

Third bug introduced by Intel's patch. Thank you, @Zvictoria. If you will look into issue https://trac.ffmpeg.org/ticket/9811#comment:12
Both people there have 32 logical cores (detected 32 logical cores).
P.S.
@bokeron2020 used a virtual machine to check whether it is windows problem! Can you imagine? No, you cannot use a VM to check this. How can you be even sure it sees all 32 logical cores?

@bokeron2020 used a virtual machine to check whether it is windows problem

Well, until a few days ago ffmpeg was a magic black box to me [still is], so my tests just tried to limit possible sources of problems... though not very well thought out, as you just pointed. I wasn't even considering cores to be a factor until recently.
Anyways...
I've made more tests, and once I realized CPU cores were factor, I made sure VMware Workstation was using 2 cores, so ffmpeg only detected 2 logical cores.
But I've also tested on my main machine but limiting threads ffmpg uses to 2.
I still need to test assigning more cores to VM and using vanilla Windows 10 to see what happens then, but it's being a PITA setting VM like that.
Results so far seem to indicate [at least my modified Windows combined with] 'high-ish' CPU cores/threads have a problem with changes made to ffmpeg after May 12, 2022.
Many-threads + specific target numbers chosen for height in zscale=size filter >> ERROR
Two threads + 'Custom' Win OS >> NO ERROR, no matter what target size I set for zscale=size
I've explained it better, or so I hope, at ffmpeg trac.

wasn't even considering cores to be a factor until recently.

Oh, it is certainly a factor! Look at this beauty fo example:  https://trac.ffmpeg.org/ticket/8948

I had the time to review vf_zscale.c in some more detail, and the problem is obvious:
static void slice_params(ZScaleContext *s, int out_h, int in_h)
{
    int slice_size;

    slice_size = (out_h + s->nb_threads - 1) / s->nb_threads;
    if (slice_size % 2)
        slice_size += 1;
    s->out_slice_start[0] = 0;
    s->out_slice_end[0] = FFMIN(out_h, slice_size);
    for (int i = 1; i < s->nb_threads - 1; i++) {
        s->out_slice_start[i] = s->out_slice_end[i-1];
        s->out_slice_end[i] = s->out_slice_start[i] + slice_size;
    }

    if (s->nb_threads > 1) {
        s->out_slice_start[s->nb_threads - 1] = s->out_slice_end[s->nb_threads - 2];
        s->out_slice_end[s->nb_threads - 1] = out_h;
    }

    for (int i = 0; i < s->nb_threads; i++) {
        s->in_slice_start[i] = s->out_slice_start[i] * in_h / (double)out_h;
        s->in_slice_end[i]   = s->out_slice_end[i]   * in_h / (double)out_h;
    }
}

Consider out_h = 505, nb_threads=24:
    slice_size = (out_h + s->nb_threads - 1) / s->nb_threads;  //< slice_slice = 22

    s->out_slice_start[0] = 0;
    s->out_slice_end[0] = FFMIN(out_h, slice_size); //< out_slice_end[0] = 22
    for (int i = 1; i < s->nb_threads - 1; i++) {
        s->out_slice_start[i] = s->out_slice_end[i-1];
        s->out_slice_end[i] = s->out_slice_start[i] + slice_size; //< out_slice_end[22] = 22 + (24 - 1 - 1) * 22 = 506
    }

    if (s->nb_threads > 1) {
        s->out_slice_start[s->nb_threads - 1] = s->out_slice_end[s->nb_threads - 2]; // out_slice_start[23] = 506
        s->out_slice_end[s->nb_threads - 1] = out_h; // out_slice_end[23] = 505
    }

The code crashes on some resolutions, because we can see that out_slice_end[22] is beyond the end of the image. Error 2050 is because out_slice_start[23] = out_slice_end[22], which is beyond the end of the image.

Should be fixed https://github.com/FFmpeg/FFmpeg/commit/42289d5eaf3e938f0969aaf58c81550c0aed8f5e


Does the ChangedMemberOrder validation in smithy diff apply to anything other than C or C++ ?

I have created a smithy diff step in my release system to check for breaking changes. I started getting ChangedMemberOrder errors with this message

union shape members were reordered. This can cause ABI compatibility issues in languages like C and C++ where the layout and alignment of a data structure matters.

Questions

Does this validation apply to anything other than C or C++? I'm most interested in Javascript, Python, Java, and Rust. We don't use C or C++.
Is there a way to suppress specific errors codes from smithy diff? I don't see anything in smithy diff --help which I can use. As long as my languages aren't impacted by ChangedMemberOrder, I'd like to be able to do something like smithy diff --suppress ChangedMemberOrder

created a smithy diff step in my release system

This sounds like a great integration! Is this done through the Smithy CLI in an automated way?
For your questions:

This event type is mostly about code generators built atop language features. Languages that enable dynamic linking usually require a stable ABI to vend updates in a backwards compatible way. Code generators may or may not guarantee stability in this way, so a ChangedMemberOrder event is emitted at the DANGER severity level - essentially saying "make sure you know this is safe for your use case". Which languages support this set of features, and which code generators or toolchains make these guarantees isn't directly Smithy's concern.
This functionality doesn't exist at this time. The --severity flag could be raised to ERROR, but that would cover up other DANGER level events that you may care more about. With smithy diff run in an automated way, we'd recommend that your review framework call out that this doesn't currently apply to your use case and grants an exception -- t's easy to ignore what you don't see.

Yes, we have automation that fetches the current 'released' model.json file and compares it to the new version of model.json being built. We're using an Ant build task that invokes the software.amazon.smithy.cli.SmithyCli class.
Also, yes, we can grant ourselves override to our pipeline after reviewing the diffs. I'm not sure myself if ABI stability matters to any of our languages. We don't have dynamically linked binaries, so we ignored it.

Any reason why your members are being reordered?

My team had a habit of sorting union members alphabetically. When adding new members, it changes the order. example:
  union Color {
     hsl: Hsl
+    hsv: Hsv
     rgb: Rbg
  }

Thank you for #1914 !