Failing to build patched uvcvideo for 4.15.0-58-generic

Required Info

Camera Model
D415

Firmware Version
<IP_ADDRESS>

Operating System & Version
Linux (Ubuntu 16.04)

Kernel Version (Linux Only)
4.15.0-58-generic, x86_64

Platform
PC

SDK Version
2.15.0

Language
N/A

Segment
Robot

Issue Description
librealsense-dkms kernel module fails to build:
Building initial module for 4.15.0-58-generic
Error! Bad return status for module build on kernel: 4.15.0-58-generic (x86_64)
Consult /var/lib/dkms/librealsense2-dkms/1.3.5/build/make.log for more information.

$ cat /var/lib/dkms/librealsense2-dkms/1.3.5/build/make.log
DKMS make.log for librealsense2-dkms-1.3.5 for kernel 4.15.0-58-generic (x86_64)
Mon Aug 19 20:54:26 UTC 2019
make: Entering directory '/usr/src/linux-headers-4.15.0-58-generic'
Makefile:986: "Cannot use CONFIG_STACK_VALIDATION=y, please install libelf-dev, libelf-devel or elfutils-libelf-devel"
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_driver.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_queue.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_v4l2.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_video.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_ctrl.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_status.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_isight.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_debugfs.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvc_entity.o
LD [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvcvideo.o
MODPOST 1 modules
CC      /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvcvideo.mod.o
LD [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/usb/uvc/uvcvideo.ko
make: Leaving directory '/usr/src/linux-headers-4.15.0-58-generic'
make: Entering directory '/usr/src/linux-headers-4.15.0-58-generic'
Makefile:986: "Cannot use CONFIG_STACK_VALIDATION=y, please install libelf-dev, libelf-devel or elfutils-libelf-devel"
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-dev.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-ioctl.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-device.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-fh.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-event.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-ctrls.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-subdev.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-clk.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-async.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-compat-ioctl32.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/vb2-trace.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-trace.o
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/v4l2-mc.o
LD [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/videodev.o
MODPOST 1 modules
CC      /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/videodev.mod.o
LD [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/media/v4l2-core/videodev.ko
make: Leaving directory '/usr/src/linux-headers-4.15.0-58-generic'
make: Entering directory '/usr/src/linux-headers-4.15.0-58-generic'
Makefile:986: "Cannot use CONFIG_STACK_VALIDATION=y, please install libelf-dev, libelf-devel or elfutils-libelf-devel"
CC [M]  /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.o
/var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.c: In function ‘accel_3d_read_raw’:
/var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.c:163:11: error: too few arguments to function ‘sensor_hub_input_attr_get_raw_value’
*val = sensor_hub_input_attr_get_raw_value(
^
In file included from /var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.c:26:0:
./include/linux/hid-sensor-hub.h:191:5: note: declared here
int sensor_hub_input_attr_get_raw_value(struct hid_sensor_hub_device *hsdev,
^
scripts/Makefile.build:337: recipe for target '/var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.o' failed
make[1]: *** [/var/lib/dkms/librealsense2-dkms/1.3.5/build/4.15.0/drivers/iio/accel/hid-sensor-accel-3d.o] Error 1
Makefile:1738: recipe for target 'hid-sensor-accel-3d.ko' failed
make: *** [hid-sensor-accel-3d.ko] Error 2
make: Leaving directory '/usr/src/linux-headers-4.15.0-58-generic'

@phil-marble hello,
The latest update in the LTS 4.15 branch (4.15.0-58) introduced a breaking change in one of the kernel call signatures:

too few arguments to function ‘sensor_hub_input_attr_get_raw_value’

This currently breaks the DKMS package for that specific version.
We're working on a fix, in the meanwhile you can continue using the previous 4.15.0-55 kernel from that branch. Alternatively, you may install the attached WA DKMS  that is designed to run on 4.15.0-58 but fail previous versions (e.g. 4.15.0-55)
librealsense2-dkms_1.3.5-0ubuntu1_all.deb.txt
$sudo dpkg -i librealsense2-dkms_1.3.5-0ubuntu1_all.deb

Remove the ".txt" suffix before installation

The fix for the issues is available for download via PPA.
To upgrade from previous version use sudo apt update && sudo apt upgrade.,
For full reinstall use:
sudo apt purge librealsense2-dkms && sudo apt update && sudo apt install librealsense2-dkms

@phil-marble, do you still need assistance with dkms for 4.15 ?
Please update

@ev-mp I have been unable to test yet, but thanks for the update!


Validation with header as another scope

Hello, I need to validate a header in the request with certain value, can you please add support for headers? I did it but I lost my changes everytime I wrote npm install.
Thank you, this is a very useful module!

Hi @knife-s ,
It's a good idea. Could you give me some use cases ? How did you implement the feature in your local ?
It would be helpful for me to start implementing the feature.

Sorry for late reply.
One useful use-case would be when You need to validate a custom header such as "X-custom-Token: xxxx" to return custom data based on it.

Header validation is already support (thanks to @nphi1212).


chore: add CSI driver windows host process images and remove unused images

What type of PR is this?
/kind cleanup
What this PR does / why we need it:
chore: add CSI driver windows host process images and remove unused images
Note:
v1.28.0 and v1.28.0-windows-hp are two different image tags now since to keep backward compatibility on Windows, we still tag 1809 and ltsc2022 images to v1.28.0
Which issue(s) this PR fixes:

Fixes #
Requirements:

[ ] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall First build on andyzhangx/add-windows-hp-images at 61.524%

Totals

Change from base Build<PHONE_NUMBER>:
61.5%

Covered Lines:
2560

Relevant Lines:
4161

💛  - Coveralls


feat(precision): add support for arbitrary precision with big.js

Coverage remained the same at 100.0% when pulling 8730ec784d59a0b753a4b882fcbaebd84b9cb11b on arbitrary-precision into 9fc8951edd92243ed1dfd860af65c99bbf919cb3 on master.


ScheduledTask: Better compatibility with Group LogonType using built-in groups

Pull Request (PR) description
Allows the resource to create Scheduled Task that can run as with 'BUILTIN\Users' and other built in groups. Since groups do not have passwords and ExecuteAsCredential is a PSCredential that requires a non-null password, we extract the username from PSCredential, but ignore the password.
This Pull Request (PR) fixes the following issues
None
Task list

[x] Added an entry under the Unreleased section of the change log in the CHANGELOG.md.
Entry should say what was changed, and how that affects users (if applicable).
[x] Resource documentation added/updated in README.md in the resource folder.
[x] Resource parameter descriptions added/updated in schema.mof
and comment-based help.
[x] Comment-based help added/updated.
[x] Localization strings added/updated in all localization files as appropriate.
[x] Examples appropriately added/updated.
[x] Unit tests added/updated. See DSC Resource Testing Guidelines.
[x] Integration tests added/updated (where possible). See DSC Resource Testing Guidelines.
[x] New/changed code adheres to DSC Resource Style Guidelines and Best Practices.

This change is

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ShawnHardwick sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Codecov Report

Merging #232 into dev will decrease coverage by <1%.
The diff coverage is 75%.

@@         Coverage Diff         @@
##            dev   #232   +/-   ##
===================================
- Coverage    86%    86%   -1%
===================================
  Files        10     10
  Lines      1229   1232    +3
===================================
+ Hits       1059   1061    +2
- Misses      170    171    +1

Thanks for the suggestions @PlagueHO. This is my first PR so your comments are extremely helpful. It's also interesting to see Appveyor and Reviewable in the pipeline so I'll have to get familiar with this so future PRs can be less error-prone.

Not exactly sure why the integration test is failing. I've fixed from your suggestions so far though.

Hi @ShawnHardwick - I'll take a look tomorrow and advise (getting late here now).

Hey @PlagueHO, do you have an advice for my failed AppVeyor build?

Hi @ShawnHardwick - sorry about the delay! I've got this planned for tonight.

Looks good now. Thanks for the advice @PlagueHO

Hi @ShawnHardwick - sorry about the delay on this one (been a bit behind on this repo). Could you rebase and fix the conflicts and I'll get this one merged ASAP!

Hi @ShawnHardwick - let me know when you're ready for me to review again. Thank you!

@PlagueHO , should be good now.

@PlagueHO, thanks for the help. This is my first experience with unit tests so it is pretty overwhelming. I updated the Get-CurrentResource function to handle the IDs for group types so that it would pass the test correctly.

@PlagueHO, that is an older build. Look at the newer one, https://ci.appveyor.com/project/PowerShell/computermanagementdsc/builds/27245454


The simpler transform is semantically wrong

I came to your interesting package in searching of a lighter esm to cjs transformer.
But I noticed the code is semantically wrong which can lead to logic error.
Your example
// input
import { resolve as resolvePath } from "path";
resolvePath("./hello")

// what i wanted
const {  resolve: resolvePath } = require("path");
resolvePath("./hello")

Translated the esm import to a simple variable, this is wrong in esm semantic. There is a reason why all babel/TS transforms esm import into verbose a_namespace.an_exported_name, because in esm standard, the import does not create a local JS variable, it's a read-only property on the namespace of that esm module.
Consider following proof, create two local files:
foo.mjs
let foo = 1;
function increaseFoo() {
  foo += 1;
}
export { foo, increaseFoo };

index.mjs
import { foo, increaseFoo } from './foo.mjs';
console.log('foo is ' + foo);
increaseFoo();
console.log('foo is ' + foo);

Then use nodejs v12 or above
node --experimental-modules index.mjs

It prints out:
foo is 1
foo is 2

You can see that foo inside index.mjs is not a local variable, otherwise it cannot be mutated.

You're right. I didn't think of it this way. Thanks for reporting!
Unfortunately, I don't think I will fix this, as I don't use this project anymore and it has served me well the way I used it. PR welcome though. I'll add it in readme otherwise.

I understand, most code do not expose this kind of edge case.
BTW, any other alternative (of babel and tsc) you know of?

I understand,

Thank you :slightly_smiling_face:

BTW, any other alternative (of babel and tsc) you know of?

Umm no. I started using ES modules in general (Node 12+ and Deno) or Rollup in most cases.


Hive conf changes

As a test to fix Bug 1798741 we are trying switch Hadoop to the latest on the 3.3 branch and thus we also need a more recent Hive. With the latest 3.3.1 branch Hadoop, we pick up the bug fix for this issue: https://issues.apache.org/jira/browse/HADOOP-13230 which we hope solves the bucket cleanup issue we see in BZ 1798741.
This PR changes hadoop-config/core-site.xml and Hive startup flags for log specification for these newer versions of Hadoop and Hive.

@bentito Is this still needed? Can we close this out?

@timflannagan1 not needed, closing.


Test the app with slow connection

User sent feedback that when app is syncing with slow internet connection the app will slow down. No slowdown when app is totally offline.
case 726300

Fixed together with #2585


Add HTTP::Request#remote_address

This PR adds a remote_address property to HTTP::Request.
Some details:

the property is of type String?. It can be nil if the address can't be determined, but this usually won't happen. It's also nilable because for HTTP::Client it doesn't make sense. It's String and not a structured object like IPAddress because a middleware might want to overwrite this property, for example using the X-Forwarded-By or X-Real-IP headers. Also, this field is apparently commonly used for logging so it being a String is probably fine and the most flexible option.
I'm not super convinced about using responds_to?(:remote_address) to determine this, I'd maybe like a module that defines this as an abstract method, but we can change the implementation later.
I know I didn't document the local_address and remote_address getters of OpenSSL::SSL::Socket, but only because the underlying IO is not necessarily a IPSocket, so the type of those getters isn't IPAddress. Maybe we can assume the underlying IO is IPSocket, otherwise raise in this case. But this is something that we can improve later.
If you have a better idea for the doc comments of HTTP::Request#remote_address, let me know

The idea here is to define an API that's usable and we won't modify later on. I think adding HTTP::Request#remote_address : String? is enough for this. We can redefine the implementation details I mention above in subsequent PRs.
Fixes #453
Related to #5784
Supersedes #7302

Also, we should probably add some way to parse a network address that looks like "ip:port" into {String, Int32}?. Right now we have Socket::IPAddress.parse(URI) but you have to pass something like "tcp://ip:port". But here we only care about the "ip:port" part (would work for IPv6 too) and getting those values as IP (string) and port (int).
But again, this can be done later on.

Rebased against master. I noticed spec/std/http/spec_helper didn't include the general spec/std/spec_helper which contains datapath so I added that too.

Also thank you @omarroth for the original code, which I used almost as is. It's just that this needed a bit more forward pushing from us core team members and having it on our side makes it easier to rebase, edit, etc.

No worries, thanks @asterite!

I noticed today that determining remote_address "up front" for  request makes this benchmark:
https://gist.github.com/jgaskins/ba74aaca0ce45f714caaa7571703beba [1]
2.5% slower.(12500 -> 12225 req/s) single threaded, and about 5% slower multi-threaded.  Maybe there's a way to avoid the slowdown?
[1] https://forum.crystal-lang.org/t/multithreaded-crystal-initial-thoughts/1089

What exactly are you comparing? Crystal Vs Go? Different Crystal versions?

Crystal versus crystal with or without this patch applied:
diff --git a/src/http/request.cr b/src/http/request.cr
index f942c33f3..ade289eb1 100644
--- a/src/http/request.cr
+++ b/src/http/request.cr
@@ -110,7 +110,7 @@ class HTTP::Request
       request = new line.method, line.resource, headers, body, line.http_version, internal: nil

       if io.responds_to?(:remote_address)
-        request.remote_address = io.remote_address.try &.to_s
+        #request.remote_address = io.remote_address.try &.to_s
       end

       return request

First up any "small" HTTP server, here's one: https://gist.github.com/rdp/b136f6a998919fe0eae39dc7990d0ba0
then load test it with wrk: $ wrk  http://localhost:9000
Thanks!


Migrate pallet-treasury to the new pallet attribute macro

Part of #7882
Migrate the pallet-treasury to the new pallet attribute macro.
:warning:  Breaking Change :warning:
From https://crates.parity.io/frame_support/attr.pallet.html#checking-upgrade-guidelines

storages now use PalletInfo for module_prefix instead of the one given to decl_storage: Thus any use of this pallet in construct_runtime! should be careful to update name in order not to break storage or to upgrade storage (moreover for instantiable pallet). If pallet is published, make sure to warn about this breaking change.

So users of the pallet must be careful about the name they used in construct_runtime!. Hence the runtime-migration label, which might not be needed depending on the configuration of the pallet.
polkadot and kusama use Treasury as pallet name, thus no need for migration

polkadot companion: paritytech/polkadot#3359

@thiolliere @KiChjang PTAL

bot merge

bot merge


.scd file comparison for tracking changes during engineering process

While working on the same project sometimes it is required to check/compare a new .scd(SCL) file to older one to understand the changes... This helps in keeping a track of changes made during engineering process.

LF energy CoMPAS is based on OpenSCD and has a database back-end to store multiple versions (semver) and make comparisons. You can try it here: https://github.com/com-pas/compas-deployment

Another possibility is to use the "Merge Project" extension to "merge" the old version into the new (or the other way around) and only select the merge type list entries (purple checkboxes).
We are planning to remove the need to individually click each element I want to check the differences of by providing the merge user interface in a single dialog with a tree view of all changes at a glance. If you don't mind, I will hijack this issue as a place to track progress on this feature.

@ca-d we are currently using the "merge" function now as well and planning to build an overview as well.

@dlabordus

We will have a comparison diffing tool in the near future. If you want to see the progress on that, please follow the progress in the projects (Comparison/Diffing-Tool)[https://github.com/openscd/open-scd/projects/16].

A few thoughts on this:
It is sometimes very useful to have a simple, plain text comparison of XML files as well as the more sophisticated "semantic SCL differences" which has been discussed and I hope to work on soon.
We have previously discussed the possibility to use the ace-diff view to show XML differences.
I've been looking into this as part of finding a way to compare output between different tools which follow different approaches in the serialisation of XML -- e.g. order of attributes, approach to whitespace. The current state of tooling is that one tool often breaks the output of another tool 😞
Web standards define a thing called "Canonical XML" which is useful for allow a plain text comparison of XML files. (I don't think it matters so much but there is also a draft standard on "XML Normalisation" although it doesn't appear to have moved beyond draft)
If we use canonical XML then we can just do a standard text comparison to identify changes without worrying about serialisation order etc.
libxml2 includes a utility which can do this (man page) using the following option:
--c14n
Use the W3C XML Canonicalisation (C14N) to serialize the result of parsing to stdout. It keeps comments in the result.

Given that @ca-d has already turned schema validation into wasm in xmlvalidate.js it might not be a large task to do something similar here (and it would be better not to rewrite this which is probably well-tested and used code). And perhaps we could do other things (e.g. get nodes by line numbers which might be useful in some way to open wizards from a diff view!)
What I do by hand to check files at the moment is:
xmllint --c14n First.scd > First_Canonical.scd
xmllint --c14n Second.scd > Second_Canonical.scd
diff First_Canonical.scd Second_Canonical.scd > comparison.diff


Update Golang version for CAPX

Update Makefile to set Go Version to 1.19
Generated checksums using make update-attribution-checksums-docker.

@abhinavmpandey08 Need an ok-to-test :)

/ok-to-test

/assign @vignesh-goutham

Need an updated builder-base image in prowjob that has go1.19 https://github.com/aws/eks-anywhere-prow-jobs/pull/205

/retest

/assign @abhay-krishna


Feature request - scrub elasticsearch credentials from log output

Today capture logs the full elasticsearch URL, including the username and password provided.  It would be better practice if all logged instances of https://user:pass@host:port could be replaced with https://host:port or similar.

should we just add new esUser/esPass config.ini options?

That sounds like an excellent idea.  It would clean up the config quite a bit too.

3.1 - added elasticsearchBasicAuth/usersElasticsearchBasicAuth
3.0 - added elasticsearchAPIKey/usersElasticsearchAPIKey
Can also set logESRequests=false


Add support for CMEK to PubSub notification topic in GCS module

Fixed in commit ffa2602 (forgot to open a feature branch). 🤣


[Hue] After several changes to mapping of lights to rooms, "Set Scene" crashes in Raycast. "Control Groups" still works.

Extension
https://www.raycast.com/pindab0ter/hue
Raycast Version
1.79.1
macOS Version
14.5
Description
Error:
Error: unknown format: #NaNNaNNaN

S:chroma.js:186:18

---
183:             var rgb = _input.format[mode].apply(null, autodetect ? args : args.slice(0,-1))

### Steps To Reproduce

I suspect the bug is not easily reproducible, but hope the error message does help.

### Current Behaviour

After several changes to mapping of lights to rooms, "Set Scene" crashes in Raycast. "Control Groups" still works.

### Expected Behaviour

Set Scenes shouldn't crash

Hey, thank you for reporting this. I'm afraid I'd need at least a stack trace to be able to debug this one. The error shows the line where the exception is thrown, but that's deep inside of the chroma-js dependency, which doesn't tell me enough.
Do you think you'd be able to provide a stack trace?


chore(master): Release 0.32.0

:robot: I have created a release beep boop
aztec-package: 0.32.0
0.32.0 (2024-03-27)
Features

Sequencer checks list of allowed FPCs (#5310) (adf20dc), closes #5000

barretenberg.js: 0.32.0
0.32.0 (2024-03-27)
Miscellaneous

barretenberg.js: Synchronize aztec-packages versions

aztec-cli: 0.32.0
0.32.0 (2024-03-27)
Miscellaneous

aztec-cli: Synchronize aztec-packages versions

aztec-packages: 0.32.0
0.32.0 (2024-03-27)
⚠ BREAKING CHANGES

Brillig typed memory (#5395)

Features

Add specific error for attempting string[x] = ".." (https://github.com/noir-lang/noir/pull/4611) (27bd8d3)
avm: Dynamic gas costs for arithmetic, calldatacopy, and set (#5473) (bbd33fb)
avm: EQ opcode output u8 and execution (#5402) (3450e24), closes #5290
Benchmark tx size with fee (#5414) (543f8a2), closes #5403
Brillig typed memory (#5395) (16b0bdd)
Sequencer checks list of allowed FPCs (#5310) (adf20dc), closes #5000

Bug Fixes

l1-contracts/bootstrap.sh (#5479) (f7d1d70)
Add FPC to allowlist (#5464) (424960f)
ci: Fix earthly ctest (#5424) (9cac8a4)
Docs example e2e test (#5456) (ae5126a)
Serial bb builds for mac (#5462) (4317819)
Slice coercions (https://github.com/noir-lang/noir/pull/4640) (27bd8d3)
ssa: Fix slice intrinsic handling in the capacity tracker  (https://github.com/noir-lang/noir/pull/4643) (27bd8d3)
ssa: Use accurate type during SSA AsSlice simplficiation (https://github.com/noir-lang/noir/pull/4610) (27bd8d3)

Miscellaneous

Append-only merkle tree generics (#5355) (ef7bf79)
avm: Deterministic codegen from pil and some renaming (#5476) (ba834a4)
avm: Test cleanup and update yp to allow for zero gas (#5459) (1829741)
avm: Unify noir macros flow (#5461) (54aee58)
ci: Add missing dependency to circleci config (#5437) (753cb78)
ci: Add warning sticky comment (https://github.com/noir-lang/noir/pull/4647) (27bd8d3)
Convert BlockExpression into a standard struct (https://github.com/noir-lang/noir/pull/4623) (27bd8d3)
Delete R1CSTransformer (https://github.com/noir-lang/noir/pull/4649) (27bd8d3)
Fallback to building barretenberg targets sequentially when RAM constrained (#5426) (29588e0)
Fix acvm crates reporting errors as JS packages (https://github.com/noir-lang/noir/pull/4637) (27bd8d3)
Fix versioning of bn254_blackbox_solver crate (https://github.com/noir-lang/noir/pull/4638) (27bd8d3)
github: Improve PR template "document later" checkbox description (https://github.com/noir-lang/noir/pull/4625) (27bd8d3)
Introduce selectors to enable range checks of 8-bit and 16-bit sizes (#5465) (ef44674)
Leveraging Bufferable in pedersenHash(...) and sha256ToField(...) (#5444) (0e0748c)
Release Noir(0.26.0) (https://github.com/noir-lang/noir/pull/4526) (27bd8d3)
Renaming rand() as unsafe_rand() (#5457) (19ad2bb), closes #3746
Replace relative paths to noir-protocol-circuits (d332ad1)
Timestamp as u64 instead of a Field (#5453) (d80dbbf), closes #5446
Typed encrypted and unencrypted L2 log containers (#5422) (a4d4ee8)
Update docs with function names to match version 0.25.0 specifications (https://github.com/noir-lang/noir/pull/4466) (27bd8d3)
Update integers.md to note support for Fields using from_integer (https://github.com/noir-lang/noir/pull/4536) (27bd8d3)

Documentation

yp: Spec how bytecode is encoded in class registerer (#5471) (e3bced2)

barretenberg: 0.32.0
0.32.0 (2024-03-27)
⚠ BREAKING CHANGES

Brillig typed memory (#5395)

Features

avm: EQ opcode output u8 and execution (#5402) (3450e24), closes #5290
Brillig typed memory (#5395) (16b0bdd)

Bug Fixes

ci: Fix earthly ctest (#5424) (9cac8a4)
Serial bb builds for mac (#5462) (4317819)

Miscellaneous

avm: Deterministic codegen from pil and some renaming (#5476) (ba834a4)
Fallback to building barretenberg targets sequentially when RAM constrained (#5426) (29588e0)
Introduce selectors to enable range checks of 8-bit and 16-bit sizes (#5465) (ef44674)

This PR was generated with Release Please. See documentation.

Benchmark results
Metrics with a significant change:

note_successful_decrypting_time_in_ms (8): 249 (+31%)
note_successful_decrypting_time_in_ms (32): 584 (+20%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit ef7bf79b and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
676
676
676

l1_rollup_calldata_gas
6,424
6,424
6,424

l1_rollup_execution_gas
585,757
585,757
585,757

l2_block_processing_time_in_ms
1,322 (+1%)
4,764 (+1%)
9,520 (-1%)

note_successful_decrypting_time_in_ms
:warning: 249 (+31%)
:warning: 584 (+20%)
1,036 (-1%)

note_trial_decrypting_time_in_ms
52.0 (-46%)
102 (-3%)
58.5 (-12%)

l2_block_building_time_in_ms
13,711
50,327
99,402 (-1%)

l2_block_rollup_simulation_time_in_ms
7,866 (-1%)
27,552 (-1%)
54,133 (-2%)

l2_block_public_tx_process_time_in_ms
5,823 (+1%)
22,720 (+2%)
45,171

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
14,070
27,707 (+3%)

note_history_successful_decrypting_time_in_ms
1,241 (-4%)
2,612 (+5%)

note_history_trial_decrypting_time_in_ms
88.1 (-9%)
126 (-18%)

node_database_size_in_bytes
18,636,880
35,029,072

pxe_database_size_in_bytes
29,859
59,414

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
230 (-1%)
44,379
28,214

private-kernel-ordering
200 (-3%)
52,880
14,296

base-parity
3,476 (-2%)
128
311

root-parity
1,301 (+3%)
1,244
311

base-rollup
16,363 (-1%)
165,760
861

root-rollup
49.5
4,359
725

private-kernel-inner
295 (-2%)
73,795
28,214

public-kernel-app-logic
120
35,252
28,217

public-kernel-tail
165 (+1%)
40,928
28,217

merge-rollup
8.47 (+2%)
2,568
861

public-kernel-teardown
117 (+1%)
35,252
28,217

public-kernel-setup
116 (+1%)
35,252
28,217

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.1
16.2 (+1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.6
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.585
0.496
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
47.2 (-2%)
72.4 (-6%)
233 (+1%)
450 (+1%)
877 (+1%)
1,736 (-1%)
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
96.0
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.483 (-2%)
0.445 (-6%)
0.422 (+1%)
0.419
0.416 (+1%)
0.415
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
54.8
107
344 (+2%)
668 (+1%)
1,313 (+1%)
2,624 (-1%)
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
105
207
691
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.481
0.481 (-1%)
0.465 (+2%)
0.458 (+1%)
0.454 (+1%)
0.457
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
62.0 (+1%)

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
109

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.540

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
14,968
495,320

Transaction size based on fee payment method

Metric
none fee payment method
native fee payment method
fpc_public fee payment method
fpc_private fee payment method

tx_with_fee_size_in_bytes
773
905
1,161
1,377

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes
2 new note hashes

tx_pxe_processing_time_ms
2,071
1,362 (-2%)
4,728

Metric
0 public data writes
1 public data writes
2 public data writes
3 public data writes
4 public data writes
5 public data writes
8 public data writes

tx_sequencer_processing_time_ms
13.3 (+10%)
702
523
1,436 (+1%)
585 (+1%)
2,482
671

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-packages-v0.32.0 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-cli-v0.32.0 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/aztec-package-v0.32.0 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/barretenberg.js-v0.32.0 :sunflower:

:robot: Release is at https://github.com/AztecProtocol/aztec-packages/releases/tag/barretenberg-v0.32.0 :sunflower:


Accessibility: adding a disabled text to aria label

What
Defect raised by accessibility team, participant items that cannot be interacted with should say "disabled"
 and  did not have a `disabled` prop, so we are using the aria label and appending "disabled" after the participants name if there is no menu popover
Why
Accessibility defect
How Tested
Start 2 Chat Sample
Have 2 participants in the chat
Open participant pane
Turn on voice over
Cycle through the participants.
Process & policy checklist

[ ] I have updated the project documentation to reflect my changes if necessary.
[x] I have read the CONTRIBUTING documentation.

Is this a breaking change?

[ ] This change causes current functionality to break.

Looks great! Thanks for applying this fix. It definitely also applies to calling as well so you helped us out by getting this in :)

Checked the snapshots and behaviour nothing has really changed so we can safely update this.


[REVIEW] JOSS feedback

Hi @chenyangkang,
I'm providing my review of stemflow here in this issue. I don't have many detailed software issues, since the package installs correctly and works as demonstrated in the documentation, for what I've tested. I have a few other comments that I believe will improve user experience.
First, thank you for preparing this package. It is a valuable contribution to the community. The goals of my comments are to make it easier for others to use this package with their own data. It is very easy to run the examples provided using pre-processed data, but there appears to be a series of assumptions regarding how these data should be formatted that are not clear.
Since this package is designed around spatial and temporal data, it would help to clarify how time and space are encoded in the model. Do input dataframes require a DOY column? Does anything change if data are provided at other temporal scales (weekly, monthly, yearly, etc.)? I see latitude and longitude encoded in the mini test data - is that the only supported CRS? I see that geopandas is a dependency - does the model class support passing a GeoDataFrame, or do you need to explicitly encode column names?
Next, I think more guidance regarding feature data could be provided. I was assuming most of the input covariates would be datasets that are temporally resolved at a similar scale as the abundance data (e.g. daily NDVI). But it looks like the mini_data example is nearly all static features, with DOY being the only dynamic variable. Is this how other datasets are expected to be formatted? Can users provide a combination of static and dynamic covariates? Are categorical features supported? More clarification regarding best practices for how to extract and format covariate data would help a lot.
The example notebooks provide clear usage examples, but there is little to no explanation of why certain routines are performed. There are titles for groups of code, but little contextual information. In the intro notebook, for example, why were the parameters Spatio_blocks_count=50, Temporal_blocks_count=50 selected? what would turning these numbers up and down do? What are the grid_len_{}_{}_threshold parameters, and what do those defaults encode? Tracing back to the original function is often still challenging, as there are many parameters with slightly varying names that are still hard to understand. As a user I would appreciate more narrative clarification.
There are lots of great features in this package and in the documentation that I don't feel like I understand as well as I would like to. I'm not familiar with the Hurdle modeling approach, which seems great and appears foundational to AdaSTEM - tips on best practices here would be valuable. You mentioned using other base models from sklearn in the manuscript - when would this be advantageous? You also provide great examples for comparing learning curves and optimizing strixel sizes, but these notebooks are just code blocks with some plots and little interpretation. I found myself wanting more guidance for how to interpret these results, or even guidance on why such optimization is important (do you optimize strixel size to minimize overfitting, for example?).
Overall, I think this is a great package and will make a valuable contribution to the growing ecosystem of python biogeography tools. I mostly recommend providing more guidance to users for how to best use this valuable resource.
Cheers,

Hi Chris,
Thank you for your valuable comments. I agree on most of the issues you mentioned. Here are the replies and solutions for them:

About how time and space are encoded:

Do input dataframes require a DOY column?

No, the target spatial and temporal indexing columns are flexible, and could be passed as arguments.

Does anything change if data are provided at other temporal scales (weekly, monthly, yearly, etc.)?

No, the scale of the indexing is highly flexible and user-defined.

I see latitude and longitude encoded in the mini test data - is that the only supported CRS?

No. Any indexing system could be passed to AdaSTEM framework. If user wish to use other CRS, they could transform it in prior.

I see that geopandas is a dependency - does the model class support passing a GeoDataFrame, or do you need to explicitly encode column names?

This is a mistake. geopandas is not a dependency of stemflow. I removed them from requirement, for both pypi and conda. Currently we only support pandas dataframe as training data input (there is a type check). Geopandas dataframe can be tranfomed to pd.core.frame.DataFrame beforehand.

PR #14 was to add additional documentations on these issues.
All these issues are documented in the new documentation page Tips for data types as well as listed as features in the home page (section Model and data).

Thank you for your advice on more guidance for feature data. Here comes the replies and solutions:

But it looks like the mini_data example is nearly all static features, with DOY being the only dynamic variable. Is this how other datasets are expected to be formatted? Can users provide a combination of static and dynamic covariates?

This is a great question. You are right, the datasets are formatted with static features except for DOY. This is for specific reasons. Including:

Model assumption
Scale of interest
Consideration for overfitting
Align with prediction set

However, dynamic features are absolutely suitable for training, or combination of static and dynamic ones.
The details are discussed in the additional documentation Tips for data types.

Are categorical features supported? More clarification regarding best practices for how to extract and format covariate data would help a lot.

Yes, categorical features are supported. We mentioned the feature formatting in Tips for data types.

Thank you for your advice on more detailed annotation on notebooks. I have add additional comments and annotation to all notebooks. For example, please see here.

In the intro notebook, for example, why were the parameters Spatio_blocks_count=50, Temporal_blocks_count=50 selected? what would turning these numbers up and down do?

Thank you for pointing out this specific issue. We explained the choice of spatiotemporal train-test-split parameters in AdaSTEM demo, as they approximately catch the spatiotemporal scale of bird migration.

What are the grid_len_{}_{}_threshold parameters, and what do those defaults encode?

Thank you for pointing out this confusion. To help user better understand the parameters, we add inline comments at the home page usage example and AdaSTEM demo, such as:
model = AdaSTEMRegressor(
    base_model=Hurdle(
        classifier=XGBClassifier(tree_method='hist',random_state=42, verbosity = 0, n_jobs=1),
        regressor=XGBRegressor(tree_method='hist',random_state=42, verbosity = 0, n_jobs=1)
    ),                                            # hurdel model for zero-inflated problem (e.g., count)
    save_gridding_plot = True,
    ensemble_fold=10,                             # data are modeled 10 times, each time with jitter and rotation in Quadtree algo
    min_ensemble_required=7,                      # Only points covered by > 7 stixels will be predicted
    grid_len_lon_upper_threshold=25,              # force splitting if the longitudinal edge of grid exceeds 25
    grid_len_lon_lower_threshold=5,               # stop splitting if the longitudinal edge of grid fall short 5
    grid_len_lat_upper_threshold=25,              # similar to the previous one, but latitudinal
    grid_len_lat_lower_threshold=5,
    temporal_start=1,                           # The next 4 params define the temporal sliding window
    temporal_end=366,
    temporal_step=20,
    temporal_bin_interval=50,
    points_lower_threshold=50,                    # Only stixels with more than 50 samples are trained
    Spatio1='longitude',                          # The next three params define the name of
    Spatio2='latitude',                         # spatial coordinates shown in the dataframe
    Temporal1='DOY',
    use_temporal_to_train=True,                   # In each stixel, whether 'DOY' should be a predictor
    njobs=1
)

Tracing back to the original function is often still challenging, as there are many parameters with slightly varying names that are still hard to understand. As a user I would appreciate more narrative clarification.

I agree with you. For the first-time user, some parameter settings could be overwhelming. I hope the additional inline annotation, documentation, and notebooks could help clarify it.

Thank you for your comments on adding more explanation about functionality

I'm not familiar with the Hurdle modeling approach, which seems great and appears foundational to AdaSTEM - tips on best practices here would be valuable.

Definitely true. I add more information about what tasks stemflow could do, especially what is hurdle in the new document Tips for different tasks. We also mention the function repertoire at the home page.

You mentioned using other base models from sklearn in the manuscript - when would this be advantageous?

Thank you for your questions. We add additional analysis and bump chart for comparing the performance of using different base model in Base model choices. Basically the trade-off exists among "performance – speed – memory usage". stemflow is a bagging modeling framework, which makes it time-consuming and memory-consuming. We would want the best trade-off between performance and resources consumption.

You also provide great examples for comparing learning curves and optimizing strixel sizes, but these notebooks are just code blocks with some plots and little interpretation. I found myself wanting more guidance for how to interpret these results, or even guidance on why such optimization is important (do you optimize strixel size to minimize overfitting, for example?).

Thank you for your suggestions. I add additional charts, comments, and conclusion at section Optimizing stixel size for addressing why such optimization is important and how to optimize the stixels. I hope this helps users in understanding the parameter choices.

Still exploring the possibility of using geopandas as dependency #30

Not using geo-features for reasons mentioned in #30


low mAP value on PASCAL VOC 2007 dataset

Thank you for your excellent works!
l am freshman to simpledet. l follow bellow commands to train and test faster rcnn on pascal voc 2007 dataset. l think these procedures are ok, but l got very low mAP 13% , l don't know what's went wrong, l hope someone can help me, any suggestion will be welcomed!
Thanks!

create pascal voc roidb

python utils/create_voc_roidb.py --data-dir /media/guo/DataUbuntu/VOCdevkit0712/VOC2007/ --split trainval
python utils/create_voc_roidb.py --data-dir /media/guo/DataUbuntu/VOCdevkit0712/VOC2007/ --split test

They create _trainval.roidb and _test.roidb in data/cache dir,  l rename them to pascal_voc_train2007.roidb and pascal_voc_val2007.roidb

create label_map file

{"__backgroud__":0,"aeroplane":1,"bicycle":2,"bird":3,"boat":4,"bottle":5,"bus":6,"car":7,"cat":8,"chair":9,"cow":10,"diningtable":11,
"dog":12,"horse":13,"motorbike":14,"person":15,"pottedplant":16,"sheep":17,"sofa":18,"train":19,"tvmonitor":20}

train and test faster rcnn

# train
python detection_train.py --config config/faster_r50v1c4_c5_512roi_1x_voc07.py
# test
python detection_test.py --config config/faster_r50v1c4_c5_512roi_1x_voc07.py

my config file is modifed from 'config/faster_r50v1c4_c5_512roi_1x.py', the different is as follow :
diff --git a/config/faster_r50v1c4_c5_512roi_1x.py b/config/faster_r50v1c4_c5_512roi_1x.py
index 069a7e5..61ab6f5 100644
--- a/config/faster_r50v1c4_c5_512roi_1x.py
+++ b/config/faster_r50v1c4_c5_512roi_1x.py
@@ -17,7 +17,8 @@ def get_config(is_train):
     class KvstoreParam:
         kvstore     = "local"
         batch_image = General.batch_image
-        gpus        = [0, 1, 2, 3, 4, 5, 6, 7]
+        #gpus        = [0, 1, 2, 3, 4, 5, 6, 7]
+        gpus        = [0]
         fp16        = General.fp16

@@ -77,7 +78,7 @@ def get_config(is_train):
     class BboxParam:
         fp16        = General.fp16
         normalizer  = NormalizeParam.normalizer
-        num_class   = 1 + 80
+        num_class   = 1 + 20
         image_roi   = 512
         batch_image = General.batch_image

@@ -96,9 +97,9 @@ def get_config(is_train):

     class DatasetParam:
         if is_train:
-            image_set = ("coco_train2017", )
+            image_set = ("pascal_voc_train2007", )
         else:
-            image_set = ("coco_val2017", )
+            image_set = ("pascal_voc_val2007", )

     backbone = Backbone(BackboneParam)
     neck = Neck(NeckParam)
@@ -168,7 +169,7 @@ def get_config(is_train):
             thr = 0.5

         class coco:
-            annotation = "data/coco/annotations/instances_minival2014.json"
+            annotation = None

     # data processing
     class NormParam:

4 mAP results
 Average Precision (AP) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.299
 Average Precision  (AP) @[ IoU=0.50      | area=   all | maxDets=100 ] = 0.625
 Average Precision  (AP) @[ IoU=0.75      | area=   all | maxDets=100 ] = 0.244
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.088
 Average Precision  (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.225
 Average Precision  (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.357
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=  1 ] = 0.287
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets= 10 ] = 0.423
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=   all | maxDets=100 ] = 0.434
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.164
 Average Recall     (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.352
 Average Recall     (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.497
coco eval uses: 13.6

General VOC setting is train on voc0712 and test on voc07:
       if is_train:
            image_set = ("voc2007_trainval", "voc2012_trainval")
        else:
            image_set = ("voc2007_test", )

And we focus on<EMAIL_ADDRESS>in VOC experiments.

Thanks


先聚焦之后再双击无法正确选中

e.g.
                          v
                      full-box-form

Sadly I think it's the limitation. In VS Code extension, you can't access the DOM, nor the dbclick event. We have to do the hack to trigger based on selection changes. Closing this until anyone comes up with better idea.


Problem with updating map service urls in Story Map

Updating the map service URL's in a Story Map application did not work. We updated all of the individual web maps and the story map is still referencing the old web map definitions. Looks like we have to recreate the story map! Darn thought this would be a helpful tool..

Can you describe your workflow? Were you updating the URL of the Story Map itself, updating the web map IDs used in the Story Map, or updating the service URLs in the web maps?

Workflow for this was:
Creating Story Map and Web Maps in ArcGIS Personal Account
Used AGO Assistant to move content to Organizational Account
Used AGO Assistant to update the map service url’s in the Web Maps
All of the web maps were updated and but when the Story Map application when launched is still referencing the old web map definitions somehow.
We inspected the Story Map json and the web map ID’s do not match the migrated web map ID’s.
From: Evan Caldwell<EMAIL_ADDRESS>Sent: Wednesday, August 26, 2015 7:31 AM
To: Esri/ago-assistant
Cc: Richards. Ronnie
Subject: Re: [ago-assistant] Problem with updating map service urls in Story Map (#94)
Can you describe your workflow? Were you updating the URL of the Story Map itself, updating the web map IDs used in the Story Map, or updating the service URLs in the web maps?
—
Reply to this email directly or view it on GitHubhttps://github.com/Esri/ago-assistant/issues/94#issuecomment-135041152.
County of Sacramento Email Disclaimer: This email and any attachments thereto may contain private, confidential, and privileged material for the sole use of the intended recipient. Any review, copying, or distribution of this email (or any attachments thereto) by other than the County of Sacramento or the intended recipient is strictly prohibited. If you are not the intended recipient, please contact the sender immediately and permanently delete the original and any copies of this email and any attachments thereto.

Unfortunately, it doesn't handle updating the web maps. In the future, I may try to expand a deep copy option that automatically copies over and updates the dependencies for a given app (i.e. all of the web maps and services).
For now, your best bet is to edit the JSON in the data window to reflect the new webmap ids.

We also edited the web map id’s for several of the maps but this did not seem to work either. Maybe I have to close out of all of my sessions and clear cache
From: Evan Caldwell<EMAIL_ADDRESS>Sent: Wednesday, August 26, 2015 7:58 AM
To: Esri/ago-assistant
Cc: Richards. Ronnie
Subject: Re: [ago-assistant] Problem with updating map service urls in Story Map (#94)
Unfortunately, it doesn't handle updating the web maps. In the future, I may try to expand a deep copy option that automatically copies over and updates the dependencies for a given app (i.e. all of the web maps and services).
For now, your best bet is to edit the JSON in the data window to reflect the new webmap ids.
—
Reply to this email directly or view it on GitHubhttps://github.com/Esri/ago-assistant/issues/94#issuecomment-135050062.
County of Sacramento Email Disclaimer: This email and any attachments thereto may contain private, confidential, and privileged material for the sole use of the intended recipient. Any review, copying, or distribution of this email (or any attachments thereto) by other than the County of Sacramento or the intended recipient is strictly prohibited. If you are not the intended recipient, please contact the sender immediately and permanently delete the original and any copies of this email and any attachments thereto.

Here's a draft blog post with a procedure for copying a story map from one org to another:
https://medium.com/@OwenGeo/440586dffdf1

Closing this out as a question that has been answered and a current known limitation. Hopefully, we can automate some of the swizzling of the webmap id in the future.


add unit tests to the datapusher class

What Changed

standardized interior names (resource -> resource_id)
added basic unit tests for all Datapusher instance methods
remove search method (unsure if it was being used)
Standardize around json() method as opposed to a variety of .text and .content attributes.

Issues

fixes #1

@saylorsd let me know if you have any questions about this. Happy to discuss the implementation/changes in more detail.

@saylorsd I'd love to set up CI for the project as well (preferably with travis), but need to have admin rights. Here's the getting started page


MongoDB Index Management

Problem
Right now indices aren't enforced in the database. You may add an index to a field or model in the Prisma Schema Language, but it won't be enforced unless you manually create the index outside of Prisma.
Where this comes up most often is with @unique attributes in the Prisma Schema Language. If you don't manually create a unique index in MongoDB (using a tool like Compass), there's nothing stopping you from inserting duplicate records into your MongoDB database, despite what your schema says. Furthermore, the Prisma Client throws exceptions if you've labeled a column as unique but it's not actually unique.

People work around this by adding unique indices outside of Prisma and then writing @unique by hand to enable certain API features like findUnique in the client
With Mongoose, you can create unique indexes at runtime when the schema is initialized. There's some pitfalls with creating an index on boot, so they also offer a way to disable this.

From my understanding, people usually run this once with Mongoose then maybe comment it out or disable it once you have the index setup .

Suggested solution

Ideally prisma db push is able to manage unique constraints and indexes.
My hope is that this can be split off from the larger topic of #7305 because this has a more immediate need and should be less complicated.
Additional context

https://github.com/prisma/prisma/issues/6727
https://github.com/prisma/prisma/issues/7305
https://github.com/prisma/prisma/issues/8788

Should be fixed with https://github.com/prisma/prisma/releases/tag/3.4.0

I have version 3.10.0 and this problem continues

Hey @emimarz - could you maybe elaborate what is not working and how to reproduce? Thanks!

Hello, working with Prisma 4.2.1 and the Unique constraint isn't working in MongoDB.

Created a new schema with a value String with the Unique constraint
Added one document
Added again the same document. However, Unique didn't work and created a new document with the same @unique data

Ah, my mistake then. Didn't knew I had to do that. Works correctly then!

npx prisma db push
The above command solved my problem as well.

working after using prisma db push


Update dependencies - Go, Bazel toos, xxHash, nanopb, rules_go, curl, protobuf, Jinja, yaml-cpp, re2

Description: Update dependencies - Go, Bazel toos, xxHash, nanopb, rules_go, nghttp2, curl, protobuf, Jinja, yaml-cpp, re2.

Go 1.13.3
grailbio/bazel-compilation-database 0.4.1 (changes since 0.3.5)
bazelbuild/bazel-gazelle 0.19.0 (release notes)
Cyan4973/xxHash 0.7.2 (release notes)
nanopb <IP_ADDRESS> (changes since <IP_ADDRESS>)
jbeder/yaml-cpp 0.6.3 (release notes)
pallets/jinja 2.10.3 (changes since 2.10.1)
protocolbuffers/protobuf 3.9.2 (release notes)
bazelbuild/rules_go 0.20.1 (release notes)
curl curl-7_66_0 (changelog)
google/re2 2019-09-01 (changes since 2019-08-01)

Risk Level: Medium (updating core dependencies)
Testing: bazel build @envoy_api//envoy/..., bazel test //test/... and running on local test clusters
Docs Changes: None required
Release Notes: None required
Comment: had to back spdlog, fmt and googletest out of this PR due to test failures. More testing required. Edit: Also backed out nghttp2 - this update fixed the CVE that triggered Envoy 1.11.2. This means we have two dependencies now (http-parser and nghttp2) that have updates to address CVE's that conflict with the remediation added to the codebase.

/retest

/retest
Trying again as AWS saying DNS issues are resolved - https://status.aws.amazon.com/#r53

/azp run


Stealth mode - Hide what this app is until you login to it.

I rather not have a public facing site that makes it obvious what this app does...
So I want the ability to hide any references to 'Petio' on the login/auth screen. I also want to disable any media backdrop images on the login screen. Basically if you go to my petio url and you aren't logged in, you would have no idea the app is petio and it's for requesting media...

Customization is planned down the road.

Yes this will be addressed with customisation of the logo / meta title. As for media backdrops, we don't use media backdrops. Closing this issue as it is addressed in the planned customisation coming in later versions


cannot upload any parameter file for public submission

I tried uploading Proline outputs with the xlsx file that contains the tab for the plot data as well as the tabs with the parameter information, but when I upload it in the field Meta data for searches, the file name appears under the upload box but disappears after a few seconds. And then I cannot do anything more.
Did I understand well? For Proline the idea is to submit the same xlsx table for figure generation and public submission, right?

I have not worked on the front end for now. I say that for Proline, the parameter upload should be deactivated as the outputs and parameters are as you said in one xlsx excel file with many sheets. I will try to reproduce the bug and see if I can find something in the logs...

I checked and as far as I can find out, the issue is not related to the parsing of parameters, but with the file upload button, which doesn't work. So, right now it is broken also for the params files of any software. I think it might be related to the unique identifier of the element since I get a functioning button once I remove that. Not sure why though. Also this is not a permanent solution, because without the unique id, I get the error of non-unique streamlit element.
@RobbinBouwmeester any idea?

Looking into this right now... It is strange, it should not reload the elements, but somehow it does.

Fixed in #192

Very important though is that you use the new secrets.toml! Otherwise you will not be able to open a PR.
Previous token had an expiration of a year, so it had to be renewed.

Where do we get the new secrets.toml from?


pythonPackages.mezzanine: fixes #19989

Motivation for this change
mezzanine depends on Django-1.6 that does not support python>3.3. But it also depends on filebrowser_safe that depens on self.django that is actually a Django-1.10. I've explicitly overrided django for dependent filebrowser_safe to get a correct installation error.
Things done

[x] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] OS X
[ ] Linux

[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

Tests:
[15:01] igor@nixos-pc nixpkgs (master *) $ nix-shell -I nixpkgs=~/nixpkgs -p python33Packages.mezzanine
[15:01] igor@nixos-pc nixpkgs (master *) [nix-shell] % python3
Python 3.3.6 (default, Oct 12 2014, 07:03:57)
[GCC 5.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import mezzanine
>>> from mezzanine import utils
>>>
[15:02] igor@nixos-pc nixpkgs (master *) [nix-shell] % exit
[15:02] igor@nixos-pc nixpkgs (master *) $ nix-shell -I nixpkgs=~/nixpkgs -p python34Packages.mezzanine
error: Django-1.6.11 not supported for interpreter python3.4m
(use ‘--show-trace’ to show detailed location information)
[15:02] igor@nixos-pc nixpkgs (master *) ✗ (1) $ nix-shell -I nixpkgs=~/nixpkgs -p python35Packages.mezzanine
error: Django-1.6.11 not supported for interpreter python3.5m
(use ‘--show-trace’ to show detailed location information)
[15:02] igor@nixos-pc nixpkgs (master *) ✗ (1) $

cc @lsix

#19989

Packages shouldn't depend on a specific version by directly referring to the attribute. What I mean is, its not good to have django_1_6 as a buildInput. Instead, use the approach as is done by lti, i.e., override self.
let
  self' = (self.override {self = self';}) // {django = django_1_6;};
in .....

 propagatedBuildInputs = with self' [ django ... ];

Perfectly, it works: it has the same behaviour for python35, python34 and python33. Yes, it is better to override self instead of each package.

even so, I am not so fond of having this. What you easily get now is that you include this package, and then another package that also depends on django, and suddenly you have two versions of django in your closure...oops!
Instead, the user should override the package set and select the correct Django.

@FRidh, I've updated MR. Is it ready to be merged?

While I am not fond of this solution, it is okay. But, before I merge, is there any reason not to update mezzanine to the latest available version?

Because, unless some other Nixpkgs package needs it, we do not keep older versions.

Yes, it makes sense. But I need to update filebrowser_safe, grappelli_safe and add django-contrib-comments package. Can I do it in this MR or split them?

do you need all packages, including this mezzanine, at the latest version, or not? If not I suggest you use pypi2nix

No, I personaly don't need the latest version of mezzanine. I just want the mezzanine to be compiled because I can't move forward with pyjwt and oathlib packages that are required for conan.

ohh, ok. Since the mezzanine version we have is so old and because it is not worked you can add meta.broken = true;. Leave it to a user of mezzanine to fix it.

Seems fair to me to mark it as broken until someone proceed with the updates.


end user documentation concept

Ideas of how we can avoid writing a hand book (end-user documentation):

[ ] mouse over hints (title) explain functionality
[ ] gamification guide through how to do something
[ ] and of course: design everything as intuitive and simple as possible

maybe (if start time is too high):

[ ] FAQ (in Markdown)
[ ] tip of the day (e.g. shortcuts), while starting

less relevant:

[ ] question marks/help
[ ] further markdown files
[ ] chat bot (see below)

@ThorbenStaufer we will discuss this tomorrow, maybe you can already think about it in advance. Especially I would like to know which tasks you see as joint effort and what do you see as part of gamification (done alone by you).

[ ]  Build a PermaplanT chatbot that introduces potential PermaplanT contributors to its use in a low-threshold way and motivates them to participate in further development

@HappyPony thank you for your suggestion! We will talk tomorrow about it! I love the idea that beginners get invitations to chat with more experience people (@ThorbenStaufer what do you think?). I don't think, however, we will have the capacity to develop a chat bot, though.
For developers I don't think we can deliver an in-app help. Instead they must read our documentation here. We already have:

https://github.com/ElektraInitiative/PermaplanT/blob/master/doc/contrib/README.md
https://github.com/ElektraInitiative/PermaplanT/blob/master/.github/CONTRIBUTING.md

(I improved them a bit in #325.)
Please feel free to create issues on any questions. If you are interested in becoming a contributor, please write us to<EMAIL_ADDRESS>

Sounds good

We will have documentation built-in the app in mouse-over hints.


Update tabula to 1.1.0

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.
[x] The commit message includes the cask’s name and version.

Ok, figured out that it should be {{version.major_minor_patch}} and added another commit.  Anything else I need to do?

Ok, figured out that it should be {{version.major_minor_patch}}

No, it should’ve been left as version. Your change is doing the same with more work.

Thank you for the changes and your contribution!


OpenCV was not built with xfeatures2d module

Hello, i built opencv using your instruction and when using rtabmap the following errors appear.  Features2d.cpp:529::create() BRIEF and FREAK features cannot be used because OpenCV was not built with xfeatures2d module. GFTT/ORB is used instead.   Features2d.cpp:1084::parseParameters() GPU version of ORB not available (OpenCV cudafeatures2d module)! Using CPU version instead... please help me how to install or fix this module

That should be built since OPENCV_ENABLE_NONFREE=ON is the default in the script. I will check it out. Thanks for reporting.

Thank you, I will wait for your answer

Or maybe the problem is in the opencv version? i installed 4.4.0

get any solution？


mjml.io 503 service unavailable

To help us help you, provide as much information as you can. You'll find below a template you can use to submit your issue, but feel free to remove any part that wouldn't be relevant here.
Website is down
Reproduction Steps:

Navigate to https://mjml.io

Expected behavior:
Website is up
Screenshots and GIFs

Hi,
We're aware of that, and working on it. No need to open an issue for each downtime 👍


Installation on Symfony 3.3: is there a manual action to perform?

I am new to Symfony. I have 3.3 and I have installed your package with:
composer require ninsuo/symfony-collection

Then (I don't know if that was necessary because I'm new to composer too):
composer install

Then I added the code to my form type (add the required parameters) and edited my form as per the readme on this project (my bundle is AppBundle):
 {% form_theme myForm 'AppBundle::jquery.collection.html.twig' %}

Then Symfony fails to load it:
Unable to find template "::jquery.collection.html.twig" (looked into: /home/xxx/projects/qiv/app/Resources/views, /home/xxx/projects/qiv/vendor/symfony/symfony/src/Symfony/Bridge/Twig/Resources/views/Form).

So my question is: should composer/symfony automatically do their magic to find that template, or do I need to copy the Twig template (and the javascript file) to my app resources directory so that Symfony finds it?

Hello,
This question is related to #58
I will have a look to it at the beginning of next week.
Until that time, yes, you'd better copy the Twig template somewhere manually.
Thanks for your patience,

OK I have read carefully #58 and forgot to mention that in my question.
So first of all thanks for the insanely fast feedback, and then I'll copy the files manually for the time being.
Cheers


Cannot query data from Teradata using pyodbc after upgrading Python from 2.7.12 to 3.6.3 on Linux

Hi,
Environment

Python: 64 bit version 3.6.3
pyodbc: 4.0.17
OS: Linux Red Hat 4.4.7-1
DB: Teradata
driver: UnixODBC 2.3.4

Issue
I cannot query data from Teradata DB after upgrading Python from 2.7 to 3.6.

pyodbc.pooling=False
con=pyodbc.connect('DSN=TERAPROD_WH',autocommit=True)
cur=con.cursor()
cur.execute('select top 1 parm1 from db.table1')
Traceback (most recent call last):
File "", line 1, in
pyodbc.Error: ('HY000', 'The driver did not supply an error!')

I checked whether I have access to the driver as below.

print(os.access('/opt/teradata/client/16.00/odbc_64/lib/tdata.so', os.R_OK))
True

However, I was able to run the same SQL as above without error when using Python 2.7.12.
What could be the problem?
Thanks.

Post the ODBC traces with Python 2 and 3, and then you can compare them to see the difference.

Shoot.  I'm guessing the encoding of the connection string.  If you could get two ODBC traces, that would help a lot.

Closed due to inactivity. Feel free to re-open with current information if necessary.


xadmin and runserver command

The problem occurs when running the command runserver 8080 and django starts to make validations in the system.
branch master
django 1.9.6
Unhandled exception in thread started by <function wrapper at 0x044B25F0>
Traceback (most recent call last):
  File "...\django\utils\autoreload.py", line 226, in wrapper
    fn(*args, **kwargs)
  File "...\django\core\management\commands\runserver.py", line 116, in inner_run
    self.check(display_num_errors=True)
  File "...\django\core\management\base.py", line 426, in check
    include_deployment_checks=include_deployment_checks,
  File "...\django\core\checks\registry.py", line 75, in run_checks
    new_errors = check(app_configs=app_configs)
  File "...\django\core\checks\urls.py", line 13, in check_url_config
    return check_resolver(resolver)
  File "...\django\core\checks\urls.py", line 23, in check_resolver
    for pattern in resolver.url_patterns:
  File "...\django\utils\functional.py", line 33, in __get__
    res = instance.__dict__[self.name] = self.func(instance)
  File "...\django\core\urlresolvers.py", line 417, in url_patterns
    patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module)
  File "...\django\utils\functional.py", line 33, in __get__
    res = instance.__dict__[self.name] = self.func(instance)
  File "...\django\core\urlresolvers.py", line 410, in urlconf_module
    return import_module(self.urlconf_name)
  File "...\Python2.7\Lib\importlib\__init__.py", line 37, in import_module
    __import__(name)
  File "project\urls.py", line 9, in <module>
    url(r'^', include(xadmin.site.urls))
  File "...\xadmin\sites.py", line 320, in urls
    return self.get_urls(), self.name, self.app_name
  File "...\xadmin\sites.py", line 302, in get_urls
    name=name) for path, clz_or_func, name in self._registry_views
  File "...\xadmin\views\base.py", line 480, in __init__
    super(ModelAdminView, self).__init__(request, *args, **kwargs)
  File "...\xadmin\views\base.py", line 231, in __init__
    self.request_method = request.method.lower()
AttributeError: 'AdminSite' object has no attribute 'method'

The problem was caused by the following implementation
from django.views.generic import FormView
from xadmin.views import ModelAdminView

class MyModelView(ModelAdminView, FormView):
    ""Custom admin view: Inherits two views that have metaclasses"

xadmin.site.register_view(r'^myapp/myapp/add/$', MyModelView, name='myapp_myapp_add')

And the fix for the error
However as there metaclass conflict is necessary to solve this inheriting the involved metaclasses.
from django.views.generic.edit import FormMixinBase
from xadmin.sites import MergeAdminMetaclass

class Metaclass(FormMixinBase, MergeAdminMetaclass):
    """Resolve conflito de metaclass"""

The final solution
from django.views.generic import FormView
from xadmin.views import ModelAdminView
from django.views.generic.edit import FormMixinBase
from xadmin.sites import MergeAdminMetaclass
from django.utils import six

class Metaclass(FormMixinBase, MergeAdminMetaclass):
    """Resolve conflito de metaclass"""

class MyModelView(six.with_metaclass(Metaclass, ModelAdminView, FormView):
    ""Custom admin view: Inherits two views that have metaclasses"

xadmin.site.register_view(r'^myapp/myapp/add/$', MyModelView, name='myapp_myapp_add')

I hope you understand the problem I had and because sometimes you may need to inherit from more than one view.


more like question

how to get reedem-token

The redeem-token field is for the account you want to redeem the nitro on. Here's a quick explanation on how to get your token: https://github.com/Tyrrrz/DiscordChatExporter/wiki/Obtaining-Token-and-Channel-IDs#how-to-get-a-user-token


Show a clipboard

Create a clipboard button in textarea of code!

I guess this won't help much. DOM clipboard actions are not supported for all browsers for reasons. On a system without Flash, you will still have to select and copy. The current implementation already select the <textarea> when you click or hover on it. I think add a button won't help much.


README.md "Upload cookbook to Chef Server"

Cookbook version
2.0.0
Chef-client version
n/a
Platform Details
n/a
Scenario:
https://github.com/chef-cookbooks/audit#upload-cookbook-to-chef-server
If you want to upload the cookbook from git, use the following commands:

mkdir chef-cookbooks
cd chef-cookbooks
git clone https://github.com/chef-cookbooks/audit
cd ..
knife cookbook upload audit -o ./chef-cookbooks

Steps to Reproduce:
Follow the exact commands above verbatim.
Expected Result:
audit cookbook uploaded
Actual Result:
$ knife cookbook upload audit -o ./chef-cookbooks
Uploading audit        [2.0.0]
ERROR: Cookbook audit depends on cookbooks which are not currently
ERROR: being uploaded and cannot be found on the server.
ERROR: The missing cookbook(s) are: 'compat_resource' version '>= 0.0.0', 'chef_handler' version '>= 0.0.0'
$

Since there are dependency cookbooks now (compat_resource, chef_handler), we need to use berks to help.
$ berks vendor -e integration
Resolving cookbook dependencies...
Fetching 'audit' from source at .
Using audit (2.0.0) from source at .
Using compat_resource (12.16.1)
Using chef_handler (2.0.0)
Vendoring audit (2.0.0) to /Users/jmiller/Devel/ChefProject/audit/berks-cookbooks/audit
Vendoring chef_handler (2.0.0) to /Users/jmiller/Devel/ChefProject/audit/berks-cookbooks/chef_handler
Vendoring compat_resource (12.16.1) to /Users/jmiller/Devel/ChefProject/audit/berks-cookbooks/compat_resource
$ knife cookbook upload -a -o berks-cookbooks
Uploading audit          [2.0.0]
Uploading chef_handler   [2.0.0]
Uploading compat_resource [12.16.1]
Uploaded all cookbooks.
$

@jeremymv2 Nice, would you like to update the readme via PR?

sure


Incorrect build of the vuejs project

Hi,
I've met an issue, which is described here.
To reproduce it, I've created the jsbin:
http://jsbin.com/rutuka/edit?html,js,output
However, if I assemble all the components manually - everything is working.
So I have only one assumption, for some reason, vueify or browserify is messing up with the code during the assembling.
I've made the project public, so you can reproduce:
https://github.com/PavelPolyakov/twiliocms
How to install:
git clone git@github.com:PavelPolyakov/twiliocms.git .
npm i
bower i
npm run build
gulp serve

open localhost:3000, do the thing from video http://monosnap.com/file/L0Yup4PNZ2FTkeQD4eWdAWqmDWmPPl .
I hope you see it doesn't work, while it works on jsbin.

@yyx990803
Hi, sorry for bother you, but interesting if I'm right and it's something about vueify/browsify or not.
What do you think?
Regards,

The data option in your modal component should be a function.

@yyx990803
https://github.com/PavelPolyakov/twiliocms/blob/master/public/app/components/add-verb-modal.vue#L38
Even so, it doesn't work.
Please, give another hint :)
Regards,

@yyx990803
Looking forward for the solution.

@yyx990803
Sorry for bothering you, but really want to understand why it doesn't work and I think only you can help.

As I would move forward, here I have created a tag https://github.com/PavelPolyakov/twiliocms/tree/vueify-bug , if this issue would be examined at some point.

I believe, the reason is the same as here.
https://github.com/vuejs/vueify/issues/18


Keyword support

Each commit should be easy to review separately (except for the _mark, _reset) but that is just automatic renaming. Mypy complains locally but for something also visible on main so not sure why we do not see it in CI.
I can add tests if necessary.

ping @lysnikolaou, if you have time for a review.

Sorry @MatthieuDartiailh for taking so long with the review. I'll try to make some time until tomorrow evening.

ping in case somebody has time to give this a look.

On it!

Done !


Fixing DocSum for K8s per new API changes

Description
This PR fixes K8s issues arose during v1.1rc testing
Issues
N/a
Type of change
List the type of change like below. Please delete options that are not relevant.

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds new functionality)
[ ] Breaking change (fix or feature that would break existing design and interface)

Dependencies
List the newly introduced 3rd party dependency if exists.
N/A
Tests
Will ask K8s users to test manually once the CI's pass.

Closing this in favor of #590


Meilisearch Indexing takes a lot of time (4-5 days)

Indexing takes a lot of time (4-5 days)
Indexing takes a lot of time (4-5 days), even though from the PHP end, we batch together the records. The number of records are like 20000 - 50000 each with 200 byte sized
To Reproduce
Steps to reproduce the behavior:

Process data from backed via a queue with batches
Queue processing is getting completed in no time (very fast , > 1 minute)
Send to Meilisearch to index via invoking the "searchable" method

Expected behavior
The Meilisearch STATS API show allways indexing, and TASKS API's response is quite large (<20MB), and has more than 7000 records 'enqueued'. For one record to be enqueued->succeed takes around 1 minute
Screenshots
If applicable, add screenshots to help explain your problem.
Meilisearch version: [e.g. v0.20.0]
Additional context
Additional information that may be relevant to the issue.
The applcations runs on,
PHP 7.4.25 (cli) (built: Oct 22 2021 12:34:33) ( NTS )
Copyright (c) The PHP Group
Zend Engine v3.4.0, Copyright (c) Zend Technologies
with Zend OPcache v7.4.25, Copyright (c), by Zend Technologies
Laravel Framework 8.65.0
meilisearch-http 0.25.0
Please can anybody suggest is there anything that i can do to speed up the indexing time?
Thank you.

Hello, you could try to use the auto-batching feature; https://github.com/meilisearch/meilisearch/discussions/2070

Hey @deadsec07,
We are aware of this issue and worked hard to improve the situation, you can send your feedback in the appropriate discussion. If you want to try out our auto-batching experimental feature you can look at the dedicated discussion.
We are also working on reducing the base time of indexing documents! You will see those improvements in the next release (v0.27).

Closing this issue then since we have an already dedicated discussion :)


I cant connect via wifi React Native

Please provide all the information requested. Issues that do not follow this format are likely to stall.
Description
Hello programmers, I am new to RN, I have a problem that I cannot solve. I am trying to connect via wifi, my react project from my pc with the app generated on my phone.
I have followed the steps in the documentation but still cannot solve it: https://reactnative.dev/docs/running-on-device...
When I enter the development menu within the application, I go to the configuration and I enter debug server and port for device and I assign the ip of my computer and port 8081, it returns, "Could not connect to development server" and when I use ngrok, it returns me, '' Invalid URL port: '-1' "
I must clarify that I am using the react version 0.63 and my phone is android version 10, Samsung Galaxy A11 and i use window

.

I need help to solve this as setting react native is very tedious and I am newbie. Thanks a lot !
React Native version:
Run react-native info in your terminal and copy the results here.
React version 16.13.1
React Native version 0.63.4
Steps To Reproduce
Provide a detailed list of steps that reproduce the issue.

Open the in-app Developer menu.
Go to Dev Settings → Debug server host & port for device.
Type in your machine's IP address and the port of the local dev server (e.g. <IP_ADDRESS>:8081).
Go back to the Developer menu and select Reload JS.

Expected Results
Connect desktop rn project to the application generated on phone

It would be better to open this ERROR on Stackoverflow because this React native issue page to solve or let the team knows about a bug/issue. The error you got has a solution on Stackoverflow.
You can ask here

sorry, but i searched all over stackoverflow and i can't find an answer to help me

Latest Android could be blocking the request. Add the following configuration and see if that works.
IP address <IP_ADDRESS> is a sample one and just add machine IP address.
create a file, network_security_config.xml more details can be found here
<?xml version="1.0" encoding="utf-8"?>
<network-security-config>
    <domain-config cleartextTrafficPermitted="true">
        <domain includeSubdomains="true"><IP_ADDRESS></domain>
        <domain includeSubdomains="true">localhost</domain>
        <trust-anchors>
            <certificates src="system" />
            <certificates src="user" />
        </trust-anchors>
    </domain-config>
</network-security-config>

Latest Android could be blocking the request. Add the following configuration and see if that works.
IP address <IP_ADDRESS> is a sample one and just add machine IP address.
create a file, network_security_config.xml more details can be found here
<?xml version="1.0" encoding="utf-8"?>
<network-security-config>
    <domain-config cleartextTrafficPermitted="true">
        <domain includeSubdomains="true"><IP_ADDRESS></domain>
        <domain includeSubdomains="true">localhost</domain>
        <trust-anchors>
            <certificates src="system" />
            <certificates src="user" />
        </trust-anchors>
    </domain-config>
</network-security-config>

I tried it and it keeps giving the error: 'Could not connect to development server'

try the following IP address since you are using an emulator, <IP_ADDRESS>

With the emulator I don't have the connection problem, it works fine for me.
Only for a physical device it doesn't work for me.
My pc is low-resource, so the use of an emulator is not recommended. So I want to use my phone instead of an emulator, I have investigated and with 'adb connect IP_PHONE' it seems to work, the problem that only works with rooted phones and mine is not

You don't need a rooted phone. Did you ran adb reverse tcp:8081 tcp:8081 ? I am debugging the App in Samsung S10 runs on latest Android without any rooting.

You don't need a rooted phone. Did you ran adb reverse tcp:8081 tcp:8081 ? I am debugging the App in Samsung S10 runs on latest Android without any rooting.

I tried it but it keeps giving the error. First I connect my phone to my pc and check if it is linked with adb devices, then I add the command you tell me and it returns 8081 in cmd, I start the project with react-native run-android and it follows the same problem with the ip and port from my pc: <IP_ADDRESS>:8081

It's worth to try wireless Debugging as well and it's really easy to setup. Give it a try and see. https://developer.android.com/studio/command-line/adb

It's worth to try wireless Debugging as well and it's really easy to setup. Give it a try and see. https://developer.android.com/studio/command-line/adb
Also see the device logs in Android Studio. Hopefully it will print an error and tell why it can't speak to the metro server

Thank you very much samithaf !!!

, I solved the problem by following the steps in the adb documentation.
The problem was that the IP of my cell phone is wrong when using adb connect IP-phone.
To solve this problem, follow these steps: Connect your cell phone to your pc through a usb cable, open cmd and enter adb devices to see if the phone is connected. Then write adb tcpip 5555, this number can be whatever you like. Now unplug your cable. Find your phone's ip in Settings -----> About Phone -----> Status -----> IP Address.
After looking for your ip, type in cmd adb connect IP PHONE. Ready you can now run react-native run-android. Note: do not use Debug Server Host and Port, leave it empty. If it is busy with an ip and port, remove it and rerun react-native run-android

That's cool. Probably you can close the defect. :)


New feature: Explicit attributes declaration of child components

In the current template syntax, a value is passed from a parent component to a child component using :bind , etc., but it is difficult to quickly see the name of the attribute that the child component accepts. Therefore, using the fact that the NueJS template syntax is based on the ES6 class, I would like to propose the following writing style:

{ #title }

{ #format(desc) }

I would appreciate your opinion.
Thanks!

I think this is a great suggestion - apart from the 'optional default values' bit, which makes the declaration statements look like expressions. In this case I would prefer the more verbose type = null or type = undefined.

Makes sense. I think Nue should support this. ie the instance variables get overridden by the given attributes. But I feel this is more like a best practise and not a requirement.


fix: improve stylelint

integrate of lint-staged/husky
add stylelint-copyright check
add stylelint-high-performance-animation check and fix bugs that it reported (use pointer-events instead of visibility)

Unexpected use of low performance transition property (visibility).   plugin/no-low-performance-animation-properties

LGTM 👍


VarInt Autodetect

When implementing 2.1.0 into Dovetail, I discovered that currently NBTify can't auto-detect the formatting of a little-varint-encoded file.

It looks like, compared to Prismarine-NBT's binary output for a VarInt write, NBTify is incorrectly serializing TAG_Int_Array and TAG_Long_Array values.

So it looks like it actually was a binaried-version of bigtest.snbt that I had made for the demo, and that has an empty root name, as well as the IntArray tag and LongArray tag, both of which appear not to be implemented correctly compared to Prismarine-NBT's output.

All fixed! Published to npm as well.


Vacuum showing as a fan

Hi, I have both a vacuum and a fan by Xiaomi and they both show up as fans in HomeKit, which creates issues when controlling HomeKit with Siri.
Would it be possible to differentiate the devices, ie. make all vacuums show up only as smart plugs?

Hi,
thanks for the feedback.
I actually also have the same setup as you (a vacuum and fan) and did not have any issues yet. I can understand that it might cause issues when you want to turn off all fans using Siri😅

Anyway, I made the vacuum accessory as a fans since it is the closest to a vacuum which we currently have in HomeKit, also I was planning on using the fan slider to control additional things like the mode of the vacuum. Besides that having it configured as a fan you can faster distinguish which switch controls the actual vacuum and which one is for configuration in the group.

Your point is definitely valid but I am not sure how other people would think about it. It would be certainly possible to change it to a simple switch but that would close the door for me to implement extra functionality  using the rotation speed slider or rotation direction switch...

My Siri conversations go something like this:

Hey Siri, turn off the fan.
Which fan should I turn off? Fan, Vacuum, or both?
Fan.
Which fan should I turn off? Fan, Vacuum, or both?
…

Anyways, I understand the issue – HomeKit is still a hot mess, and so is Siri. 😂

Maybe as a tip, try not to use the generic names for the devices. I call my fan "Smartmi Fan 3" and when I say to Siri to turn it on then it works without any questions asked😅 It is also to useful to say like "turn on the living room fan" if your fan and vacuum are in different rooms, that works well too.


Editor properties do not reflect theme was cleared

Operating system or device - Godot version:
Windows 10
Godot 2.1
Issue description (what happened, and what was expected):
If you create a new theme for a button then goto theme details and back: custom font settings disappear.
Now if you clear theme -- custom font settings are still hidden and you cannot change anything font related until you switch to another node and back.
Steps to reproduce:
as above
Link to minimal example project (optional but very welcome):

Fixed in 3.1


feat: Add support for vpc_configuration along with creating an associated security group

Description
Added a dynamic block to support the vpc_configuration settings and checks to support that block to either create or not create based on the presence of settings in vpc_configuration = {}
Breaking change
This update does require a later version of the aws provider (4.47).  - fix patched in 4.51.0
Motivation and Context
Required to create a grafana workspace within a vpc.
How Has This Been Tested?

[x] I have updated at least one of the examples/* to demonstrate and validate my change(s)
[x] I have tested and validated these changes by deploying these changes into my own account
[x] I have executed pre-commit run -a on my pull request

@bryantbiggs I don't seem to be able to request a review on this PR, if theres anything I can do, please let me know. Thanks!

This PR is included in version 1.7.0 :tada:


feat: reference types argument

This PR adds a new argument --reference-types, which enables reftype compilation for wasm-bindgen.
This feature is hoped to enable more efficient communication between the host (JS) and the wasm module, but not yet all browsers support it.
For more information about reference types, you should read the wasm-bindgen Guide.
This argument will automatically disable wasm-opt.
Otherwise compilation would crash with the following error:
[parse exception: Only 1 table definition allowed in MVP (at 0:4234)]
Fatal: error in parsing input

Hello @Tarnadas 👋🏽
The patch looks great :)
You should be able to make wasm-opt run successfully by passing the --enable-reference-types command line flag. This way you could still get the optimization 🚀

I tried this out, and found this bug. Not sure if its related to this particular commit, or due to wasm-bindgen.
https://github.com/rustwasm/wasm-bindgen/issues/2291

This shouldn’t be related to this particular commit.
It rather sounds like a memory allocation issue, which might be totally normal. I’m not sure if there is an option for wasm-bindgen to increase the initial memory size, but you could do it manually in the generated JS glue code file and see if that fixes your problem:
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/WebAssembly/Memory
Also I don’t quite get why this shouldn’t happen without reference types enabled.
Btw today I will be fixing the wasm-opt stuff. Thanks for the hint @Urhengulas

Excuse my ignorance on javascript/wasm.
I cant seem to find in the glue code where to memory is allocated -- I can find  a buffer with ref-types disabled, as there is a "heap", but I can't see anything of the like here.
Strangely, even if I'm just missing that, I preallocated  using Vec::with_capacity(1 million), (which is not included in the benchmarks), and the issue is totally outside of that (and there's no further allocations are made besides the Vec, unless the gluecode is doing it somehow, but that does not seem to be the case).

Apparently the JS glue code does not instantiate a WebAssembly memory, which would result in the default values being used.
You should see a line in your JS glue code which looks somewhat like this:
const wasmModule = new WebAssembly.Module(bytes);
const wasmInstance = new WebAssembly.Instance(wasmModule, imports);

Here you can instantiate a WebAssembly Memory with a larger initial size:
const wasmModule = new WebAssembly.Module(bytes);
const wasmInstance = new WebAssembly.Instance(wasmModule, {
  js: {
    mem: new WebAssembly.Memory({ initial: /* large number */, maximum: /* large number */ })
  },
  ...imports
});

The corresponding flag for wasm-bindgen is called --reference-types. Maybe we should use the same longer name here for consistency?

That sounds definitely like a good idea. I’ll update my PR, but I’m a little worried about the maintenance of this repository

Hey @drager @azriel91,
I just rebased my PR with the latest master branch.
Any chance this could be reviewed and merged?

@Tarnadas heya, I'm simply a fellow contributor; that said the changes look good :v:


svelte 5 support

if a new release could be published. thanks!

I've seen @anatoliy-t7 has a great work on this. He's library can work very well in my Svelte 5's project. https://github.com/anatoliy-t7/svelte-5-french-toast
Anatoliy would you mind sharing your progress in this issue? Like for me, I'm really willing to use this library in my Svelte 5 project.

Check PR here https://github.com/kbrgl/svelte-french-toast/pull/82

Can we please merge the changes - would really prefer to use this library instead of opting for something else

Hello, is there any progress here?

Hey folks. I'm good to merge the PR linked above as soon as the package-lock.json issue is fixed (this project uses PNPM).
Thanks for waiting--I know it's frustrating. I have a day job and can't always get to PRs in time.
By the way, if someone wants to help maintain this package, let me know. Ideally it would be someone who has made PRs before. Absent a maintainer I'll merge PRs where necessary, but things might be slow.


Portal boolean 'didFocusPortal' is not accurate

Steps
Create a popup that triggers on focus of trigger element. Place content inside popup. Trigger the popup by focusing on the trigger, and then click inside the popup (not on a link or button, but on any empty space or text)
Expected Result
Popup stays open, as the 'focus' is still inside the generated Portal component
Actual Result
Popup closes
Note: After the popup opens, if you click on an html element that is allowed to receive focus (links, buttons, inputs etc...) the popup does not close, so it works as expected. The reason for this is that the boolean didFocusPortal inside the Popup is not defined correctly. It relies on the onBlur event from the target element, which has a reference to 'relatedTarget'. If an element that is allowed to receive focus is clicked on, the relatedTarget is not null and the function is able to correctly calculate if the element is within the portal. If, however, you click on an element that is not allowed to receive focus (divs, text, etc...), the 'relatedTarget' for the onBlur event is null, and 'didFocusPortal' is incorrectly set to false. The exact line of code where this is broken is here:
https://github.com/Semantic-Org/Semantic-UI-React/blob/23ec465c77e0f2c69efe22a3d8f7f0c24c951af3/src/addons/Portal/Portal.js#L230
I'm not exactly sure the best solution though, so I would like to open a discussion surrounding this issue.
Version
0.71.5
Testcase
I made two test cases to illustrate the issue. One where the popup works as it should (when links or buttons inside the Portal are clicked first) and one where the popup closes when it shouldn't (when empty space or text or other elements are clicked inside the Portal)
https://codepen.io/anon/pen/brKQPp

For anyone looking for a quick fix for this, the solution is to wrap all the content inside the Popover in an  tag. Just set href='javascript:void(0)' and the style={{cursor: 'default'}}. This works perfectly, but I get the following warning raised by React in the console:

Warning: validateDOMNesting(...):  cannot appear as a descendant of .

What is inserted into the DOM is not technically valid HTML. Although it works for my use case, I would like to fix this at the source (Portal component) so others can benefit without adding this 'hack'.

I've made the following change to the handleTriggerBlur() function:
handleTriggerBlur = (e) => {
    const { trigger, closeOnTriggerBlur } = this.props

    // Call original event handler
    _.invoke(trigger, 'props.onBlur', e)

    // do not close if focus is given to the portal
    // document.activeElement is set to 'body' until blur event completes
    // e.relatedTarget is null for elements that cannot receive focus such as div, so it can't be used
    setTimeout(() => {
      const didFocusPortal = _.invoke(this, 'rootNode.contains', document.activeElement)

      if (!closeOnTriggerBlur || didFocusPortal) return

      debug('handleTriggerBlur()')
      this.close(e)
    }, 1)
  }

I believe this fixes the problem. e.relatedTarget just isn't something that can be used as far as I understand, because it is not getting set when the focus is moved to an un-focusable element. So some brief searching online led me to document.activeElement. The problem is that when a BlurEvent is triggered, the browser clears activeElement and sets it to the document body. As soon as the focus event is called for the new element, document.activeElement is set to the correct element. But for the moment inside the BlurEvent, we can't use activeElement either. Setting a timeout of 1 and then accessing activeElement and completing the function works. Unfortunately it feels like a hack, but I can't find a better solution at the moment.
I've never made a pull request before, but I am trying to make one for this change. Unfortunately the "closes the portal on blur when set" test in Portal-test.js is failing, but I'm not sure why. Can anyone guide me on this?

There is a known issue and limitation here.  I'd love to solve it.  Please open a PR and we'll chat there.

Oh, is your original issue solved with the hoverable prop?  This allows you to hover and click within the Popup.

No, the issue is not solved via adding the hoverable prop. I don't want the popover to be triggered on hover. Also I'd be happy to open a PR but I don't really have any good solutions at the moment. I was hoping we could discuss options

My time and budget for this particular issue are unfortunately non-existent.  I can help review a PR for the issue, however.
Note, I do use SUIR in my daily work as well.  If this issue pops up there, I will be able to tackle it at that time.


test: Add mod file

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

/test all


Tailwind Viewer doesn't work in 4.0.0/4.0.1

Version
@nuxtjs/tailwindcss: 4.0.1
nuxt: 2.15.3
node: 14.15.4
npm: 7.5.4
Reproduction Link
N/A
Steps to reproduce
Create a fresh Nuxt project with version 2.15.3 (I used npm init nuxt-app nuxt-tailwind2-test). Then follow steps from https://tailwindcss.nuxtjs.org/setup to install TailwindCSS
What is Expected?
Running npm run dev should start the tailwind viewer at http://localhost:3000/_tailwind/
What is actually happening?
I'm getting the error message Cannot find module 'tailwindcss/resolveConfig' when running npm run dev. Tailwind CSS compilation and Nuxt dev server works though.

The error doesn't appear if I set viewer: false for tailwind in the nuxt.config.js

Update:
This seems to have something to do with npm. I saw that the sandbox was using yarn and I couldn't reproduce the error there. Tried using yarn on my local machine and it worked there as well.
@Atinux: Would you generally advise against using nuxt with npm? I see in the nuxt docs that yarn is the "first class citizen" shown for the guides and I'm wondering if this is just a matter of taste or if you would advise me to run existing and new nuxt projects with yarn.

Can you tell that when running npm install tailwindcss it works?

Can you tell that when running npm install tailwindcss it works?

Yes, then it works. 👍🏻

@pi0 Your fix is merged in v1.5.1

tailwind-config-viewer refers to tailwind's absolute path assuming it is in root folder (node_modules/tailwindcss), while @nuxtjs/tailwind package uses tailwind in subfolder (node_modules/@nuxtjs/tailwindcss)

@Atinux or @toxin20 is it fixed ? Please closed issue :)