perform release with deployment to maven central

All necessary preps should be done so far. Would be nice to see a release with deployment to maven central.

Done.


⚠ gorzdrav.org has degraded performance

In fedee7e, gorzdrav.org (https://gorzdrav.org) experienced degraded performance:

HTTP code: 200
Response time: 1963 ms

Resolved: gorzdrav.org performance has improved in 776b2c7.


Add hreflang for language URLs

Hello!
It seems Google crawls the different languages as different pages. I added few lines to fix this.
By the way, do you think ISO codes should be used for language subdomains as well (ex: ja instead of jp)?

Thanks! For subdomains, we use domain suffixes instead of ISO codes, as they're often more familiar in a web context.

Hello @chrisvfritz
It seems the alternate URLs *.vuejs.org don't include the hreflang tags, do you know why? Without them, it can't be crawled correctly.

@lucpotage They will - there'll just be a little lag as translators merge recent commits into their translated forks.


Parameter Setup for Transformer-Big

Question in short: In train_transformer.py, currently the default setting is for Transformer-Base. If I want to train Transformer-Big, what parameter should I change?
I refer to the Transformer's paper and find out the major setup differences between Transformer-BIG and Transformer-BASE are num of heads, num of dimensions and filter dimensions. Then I try to find the associated parameters in train_transformer.py script, and confirm --num_heads is for num of heads, while num_units is for num of dimensions. But I cannot determine what parameter I can change to set filter dimensions.
Tensorflow seems to have the option to change filter dimension: https://github.com/tensorflow/tensor2tensor/blob/master/tensor2tensor/models/transformer.py#L1837

In our script, it is --hidden_size. You  may also need to change dropout and epsilon accordingly.

@ymjiang I am interested in your transformer-big result. Feel free to share if you are able to reproduce it, or hit any blocker. BTW I'm adding fp16 support to the transformer encoder block in #505 which may benefit your work, too

Hi @eric-haibin-lin , unfortunately I haven't succeed in training Transformer-big to reasonable BLEU so far (my current setup only converges to BLEU=3.2 on WMT2016BPE en-de).
Transformer-base param: (this can converge to BLEU=25)
--adam_beta2 0.98 --hidden_size 2048 --num_heads 8 --num_units 512 --dropout 0.1
My Transformer-big param: (only converge to BLEU=3.2)
--adam_beta2 0.998 --hidden_size 4096 --num_heads 16 --num_units 1024 --dropout 0.3

@ymjiang how does the log look? We might be able to offer some help.

@szha Sorry I am currently engaged with another task. Will get back here once I am free.


Filters logging

Hello Anton,
When I look at the logs for the filtering, I can see things like this:
2016-10-19 08:46:41  INFO: Position filtered by Duplicate filters from 4

However, unless I look into the database itself, there is no way to tell which device is "4".
Would it be better to incorporate the device identifier (or name) in the logs or to put the deviceId on the web interface?

I don't think it's a good idea to show internal id to the user in the web interface. Logging unique id is a better option.

Why isn't this a good idea? Confusion?
If we log unique id, then the user still has to figure out which device it is since it's also not clearly shown in the web interface unless you click on edit for each device. Or maybe, the unique id could be shown in the web interface in a column not shown by default.

Note that the deviceId could also be in a column not shown by default.

Yes, confusion. User has to entered unique id, so he must know what it is.
We can add it to list of columns, but then most people probably won't know that it's there.

That can be documented. Many people won't check logs like this anyway. Web interface is mostly for users and "lambda users" don't have access to the logs anyway, so no worries if they don't know that the column is there.

Check https://github.com/renaudallard/traccar-web/commit/0978b6eb284d34f6b1ad5593c8b7cff5209a105a

I think I misunderstood. I was thinking to add "uniqueId" hidden column. I don't want to make internal id visible to regular users.

But then you also need to make the logging show the "uniqueId"

Correct, but it shouldn't be hard. We do it in other place. For example when we log decoded position.

OK, here it is :)
https://github.com/tananaev/traccar/pull/2461

You already have the pull request, so it's useless to keep this issue open


Unlabled container images still stored in ACR

Problem statement
Azure security center is reporting 403 vulnerable container images which are not labeled, but still stored in the ACR.
Security center reports: This image has no tags. It still exists in the registry. If it's pulled by its digest, it'll expose security vulnerabilities.
What you need to know
soft-delete
 is not enabled (see below).
ACR retention policy is set to 365 days (see below).
% az acr config soft-delete show -r XXXXXXX --subscription XXXXXXX
Command group 'acr config soft-delete' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
{
  "lastUpdatedTime": null,
  "retentionDays": 7,
  "status": "disabled"
}

% az acr config retention show --registry XXXXXXX --subscription XXXXXXX
Command group 'acr config retention' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus
{
  "days": 365,
  "lastUpdatedTime": "2022-12-08T17:34:55.685413+00:00",
  "status": "enabled"
}

[Links to documents, workflows, or list of key people and contact info]

Document 1
Document 2
...

Acceptance criteria

[ ] ...

To do

[ ] ...

Staging cleanup


Installation of obsmon fails on Fedora 35

When installing obsmon 4.1.0 & 4.2.0 on Fedora 35 it fails with errors like:
Progress 7%, installing R-lib 12/157: stringi (== 1.7.3) ... * installing *source* package ‘stringi’ ...
** package ‘stringi’ successfully unpacked and MD5 sums checked
** using staged installation
sh: line 1: NA: command not found
Warning in system(cmd) : error in running command
ERROR: configuration failed for package ‘stringi’
* removing ‘/swrepos/free_fedora35/installed/obsmon-4.2.0/.installer_local_R-libs/R-libs/stringi’

Error: installation of package ‘stringi’ had non-zero exit status
Error in file(con, "r") : cannot open the connection
Calls: install ... tryCatchOne -> <Anonymous> -> tryCatch -> readLines -> file
In addition: Warning message:
In file(con, "r") :
  cannot open file 'stringi.out': No such file or directory

Installing the package stringi in R manually in the directory where obsmon expects it works fine. After then tar.gzipping it in obsmon-4.2.0/.installer_local_R-lib/compiled_binaries/x86_64-redhat-linux-gnu-Fedora-35/R_4.1 and updating the .installer_pkg_versions.txt it goes a bit further until it crashes in some next package.
Having repeated this procedure till a 157 have been installed it seems to work well.
I then expected that I could easily re-install obsmon-4.2.0 on another Fedora 35 machine using the modified .installer_pkg_versions.txt file, but it crashes in the same manner in the stringi installation (now 1.7.6).
Note the NA: command not found error. Any ideas what could be causing this?

Hi!
I've finally had time to look into this. This was a bug in the install script, thanks for reporting. It should now be fixed (v4.3.0). See https://github.com/Hirlam/obsmon/commit/8d8f55dba7b5130d41d06fc43d42deaa64b29fbf.
I'll close the issue but feel free to make a new report should you continue to face this issue.

What do you mean? Did you need to update packages after this update? You shouldn't in principle need to do this after this update, but, if you did, which packages were those and why did you need to update them?

Compilation of three packages failed with the list in git. I changed these to more recent changes, that I also used in my dodgy obsmom-4.2.0 installation:
isoband  == 0.2.4  --> 0.2.5
RcppTOML == 0.1.3  --> 0.1.7
testthat == 3.0.2  --> 3.1.1

I haven't stored the errors it gave.

Would you be able to run the install again with the original packages (ans using the --live option )? It would be good for me to understand why they failed for you, because in my (limited) test environments the install worked fine. I may even update these packages in the repo if I see that it's a general issue.
For context: The reason I fixed these pkg versions is that they are updated quite frequently on CRAN and then things can often start to misbehave as a result. And that's something I don't have control over.

Great, didn't know the --live option. I tried it on a different Fedora 35 system, it gave the same errors (see below, click to expand). Is there a good method to find a consistent, non-conflicting set of package versions?

The crash for isoband:
Progress 37%, installing R-lib 58/154: isoband (== 0.2.4) ...
No pre-compiled binary for package "isoband (== 0.2.4)". Building...

* installing *source* package ‘isoband’ ...
** package ‘isoband’ successfully unpacked and MD5 sums checked
** using staged installation
** libs
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c clip-lines.cpp -o clip-lines.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c init.cpp -o init.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c isoband.cpp -o isoband.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c polygon.cpp -o polygon.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c separate-polygons.cpp -o separate-polygons.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c test-clip-lines.cpp -o test-clip-lines.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -Itestthat  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c test-runner.cpp -o test-runner.o
In file included from /usr/include/signal.h:328,
                 from testthat/vendor/catch.h:6472,
                 from testthat/testthat.h:65,
                 from test-runner.cpp:8:
testthat/vendor/catch.h:6495:33: error: size of array ‘altStackMem’ is not an integral constant-expression
 6495 |         static char altStackMem[SIGSTKSZ];
      |                                 ^~~~~~~~
testthat/vendor/catch.h:6546:45: error: size of array ‘altStackMem’ is not an integral constant-expression
 6546 |     char FatalConditionHandler::altStackMem[SIGSTKSZ] = {};
      |                                             ^~~~~~~~
make: *** [/usr/lib64/R/etc/Makeconf:177: test-runner.o] Error 1
ERROR: compilation failed for package ‘isoband’
* removing ‘/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/isoband’

Error: installation of package ‘isoband’ had non-zero exit status

Execution halted

The crash for RcppTOML:
Progress 93%, installing R-lib 144/154: RcppTOML (== 0.1.3) ...
No pre-compiled binary for package "RcppTOML (== 0.1.3)". Building...

* installing *source* package ‘RcppTOML’ ...
** package ‘RcppTOML’ successfully unpacked and MD5 sums checked
** using staged installation
** libs
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I../inst/include/ -DCPPTOML_USE_MAP -I'/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/Rcpp/include' -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c RcppExports.cpp -o RcppExports.o
gcc -m64 -I"/usr/include/R" -DNDEBUG -I../inst/include/ -DCPPTOML_USE_MAP -I'/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/Rcpp/include' -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c init.c -o init.o
g++ -m64 -std=gnu++11 -I"/usr/include/R" -DNDEBUG -I../inst/include/ -DCPPTOML_USE_MAP -I'/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/Rcpp/include' -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c parse.cpp -o parse.o
In file included from parse.cpp:22:
../inst/include/cpptoml.h: In static member function ‘static cpptoml::value_traits<T, typename std::enable_if<((! cpptoml::valid_value_or_string_convertible<T>::value) && std::is_signed<typename std::decay<_Tp>::type>::value)>::type>::value_type cpptoml::value_traits<T, typename std::enable_if<((! cpptoml::valid_value_or_string_convertible<T>::value) && std::is_signed<typename std::decay<_Tp>::type>::value)>::type>::construct(T&&)’:
../inst/include/cpptoml.h:341:24: error: ‘numeric_limits’ is not a member of ‘std’
  341 |         if (val < std::numeric_limits<int64_t>::min())
      |                        ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:341:46: error: expected primary-expression before ‘>’ token
  341 |         if (val < std::numeric_limits<int64_t>::min())
      |                                              ^
../inst/include/cpptoml.h:341:49: error: ‘::min’ has not been declared; did you mean ‘std::min’?
  341 |         if (val < std::numeric_limits<int64_t>::min())
      |                                                 ^~~
      |                                                 std::min
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3455:5: note: ‘std::min’ declared here
 3455 |     min(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
In file included from parse.cpp:22:
../inst/include/cpptoml.h:346:24: error: ‘numeric_limits’ is not a member of ‘std’
  346 |         if (val > std::numeric_limits<int64_t>::max())
      |                        ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:346:46: error: expected primary-expression before ‘>’ token
  346 |         if (val > std::numeric_limits<int64_t>::max())
      |                                              ^
../inst/include/cpptoml.h:346:49: error: ‘::max’ has not been declared; did you mean ‘std::max’?
  346 |         if (val > std::numeric_limits<int64_t>::max())
      |                                                 ^~~
      |                                                 std::max
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3467:5: note: ‘std::max’ declared here
 3467 |     max(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
In file included from parse.cpp:22:
../inst/include/cpptoml.h: In static member function ‘static cpptoml::value_traits<T, typename std::enable_if<((! cpptoml::valid_value_or_string_convertible<T>::value) && std::is_unsigned<typename std::decay<_Tp>::type>::value)>::type>::value_type cpptoml::value_traits<T, typename std::enable_if<((! cpptoml::valid_value_or_string_convertible<T>::value) && std::is_unsigned<typename std::decay<_Tp>::type>::value)>::type>::construct(T&&)’:
../inst/include/cpptoml.h:367:46: error: ‘numeric_limits’ is not a member of ‘std’
  367 |         if (val > static_cast<uint64_t>(std::numeric_limits<int64_t>::max()))
      |                                              ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:367:68: error: expected primary-expression before ‘>’ token
  367 |         if (val > static_cast<uint64_t>(std::numeric_limits<int64_t>::max()))
      |                                                                    ^
../inst/include/cpptoml.h:367:71: error: ‘::max’ has not been declared; did you mean ‘std::max’?
  367 |         if (val > static_cast<uint64_t>(std::numeric_limits<int64_t>::max()))
      |                                                                       ^~~
      |                                                                       std::max
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3467:5: note: ‘std::max’ declared here
 3467 |     max(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
In file included from parse.cpp:22:
../inst/include/cpptoml.h: In function ‘typename std::enable_if<((! std::is_floating_point<_Tp>::value) && std::is_signed<_Tp>::value), cpptoml::option<T> >::type cpptoml::get_impl(const std::shared_ptr<cpptoml::base>&)’:
../inst/include/cpptoml.h:1006:29: error: ‘numeric_limits’ is not a member of ‘std’
 1006 |         if (v->get() < std::numeric_limits<T>::min())
      |                             ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:1006:45: error: expected primary-expression before ‘>’ token
 1006 |         if (v->get() < std::numeric_limits<T>::min())
      |                                             ^
../inst/include/cpptoml.h:1006:48: error: ‘::min’ has not been declared; did you mean ‘std::min’?
 1006 |         if (v->get() < std::numeric_limits<T>::min())
      |                                                ^~~
      |                                                std::min
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3455:5: note: ‘std::min’ declared here
 3455 |     min(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
In file included from parse.cpp:22:
../inst/include/cpptoml.h:1010:29: error: ‘numeric_limits’ is not a member of ‘std’
 1010 |         if (v->get() > std::numeric_limits<T>::max())
      |                             ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:1010:45: error: expected primary-expression before ‘>’ token
 1010 |         if (v->get() > std::numeric_limits<T>::max())
      |                                             ^
../inst/include/cpptoml.h:1010:48: error: ‘::max’ has not been declared; did you mean ‘std::max’?
 1010 |         if (v->get() > std::numeric_limits<T>::max())
      |                                                ^~~
      |                                                std::max
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3467:5: note: ‘std::max’ declared here
 3467 |     max(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
In file included from parse.cpp:22:
../inst/include/cpptoml.h: In function ‘typename std::enable_if<((! std::is_same<T, bool>::value) && std::is_unsigned<_Tp>::value), cpptoml::option<T> >::type cpptoml::get_impl(const std::shared_ptr<cpptoml::base>&)’:
../inst/include/cpptoml.h:1033:52: error: ‘numeric_limits’ is not a member of ‘std’
 1033 |         if (static_cast<uint64_t>(v->get()) > std::numeric_limits<T>::max())
      |                                                    ^~~~~~~~~~~~~~
../inst/include/cpptoml.h:1033:68: error: expected primary-expression before ‘>’ token
 1033 |         if (static_cast<uint64_t>(v->get()) > std::numeric_limits<T>::max())
      |                                                                    ^
../inst/include/cpptoml.h:1033:71: error: ‘::max’ has not been declared; did you mean ‘std::max’?
 1033 |         if (static_cast<uint64_t>(v->get()) > std::numeric_limits<T>::max())
      |                                                                       ^~~
      |                                                                       std::max
In file included from /usr/include/c++/11/algorithm:62,
                 from ../inst/include/cpptoml.h:10,
                 from parse.cpp:22:
/usr/include/c++/11/bits/stl_algo.h:3467:5: note: ‘std::max’ declared here
 3467 |     max(initializer_list<_Tp> __l, _Compare __comp)
      |     ^~~
make: *** [/usr/lib64/R/etc/Makeconf:177: parse.o] Error 1
ERROR: compilation failed for package ‘RcppTOML’
* removing ‘/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/RcppTOML’

Error: installation of package ‘RcppTOML’ had non-zero exit status

Execution halted

testthat errors:
Progress 98%, installing R-lib 152/154: testthat (== 3.0.2) ...
No pre-compiled binary for package "testthat (== 3.0.2)". Building...

* installing *source* package ‘testthat’ ...
** package ‘testthat’ successfully unpacked and MD5 sums checked
** using staged installation
** libs
gcc -m64 -I"/usr/include/R" -DNDEBUG -I../inst/include -DCOMPILING_TESTTHAT  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c init.c -o init.o
gcc -m64 -I"/usr/include/R" -DNDEBUG -I../inst/include -DCOMPILING_TESTTHAT  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c reassign.c -o reassign.o
g++ -m64 -std=gnu++14 -I"/usr/include/R" -DNDEBUG -I../inst/include -DCOMPILING_TESTTHAT  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c test-catch.cpp -o test-catch.o
g++ -m64 -std=gnu++14 -I"/usr/include/R" -DNDEBUG -I../inst/include -DCOMPILING_TESTTHAT  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c test-example.cpp -o test-example.o
g++ -m64 -std=gnu++14 -I"/usr/include/R" -DNDEBUG -I../inst/include -DCOMPILING_TESTTHAT  -I/usr/local/include   -fpic  -O2 -flto=auto -ffat-lto-objects -fexceptions -g -grecord-gcc-switches -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -fstack-protector-strong -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1  -m64  -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection  -c test-runner.cpp -o test-runner.o
In file included from /usr/include/signal.h:328,
                 from ../inst/include/testthat/vendor/catch.h:6472,
                 from ../inst/include/testthat/testthat.h:65,
                 from ../inst/include/testthat.h:1,
                 from test-runner.cpp:7:
../inst/include/testthat/vendor/catch.h:6495:33: error: size of array ‘altStackMem’ is not an integral constant-expression
 6495 |         static char altStackMem[SIGSTKSZ];
      |                                 ^~~~~~~~
../inst/include/testthat/vendor/catch.h:6546:45: error: size of array ‘altStackMem’ is not an integral constant-expression
 6546 |     char FatalConditionHandler::altStackMem[SIGSTKSZ] = {};
      |                                             ^~~~~~~~
make: *** [/usr/lib64/R/etc/Makeconf:177: test-runner.o] Error 1
ERROR: compilation failed for package ‘testthat’
* removing ‘/home/ulft/source/obsmon-4.3.0/.installer_local_R-libs/R-libs/testthat’

Error: installation of package ‘testthat’ had non-zero exit status

Execution halted

When running obsmon, and selecting things in the browser, obsmon prints messages like:
Warning in mccollect(jobs = jobs, wait = TRUE) :
  1 parallel job did not deliver a result
ERROR [2022-02-10 12:13:25] Error: Failed to retrieve the result of MulticoreFuture (<none>) from the forked worker (on localhost; PID 549786). Post-mortem diagnostic: No process exists with this PID, i.e. the forked localhost worker is no longer alive.

Unhandled promise error: Failed to retrieve the result of MulticoreFuture (<none>) from the forked worker (on localhost; PID 549786). Post-mortem diagnostic: No process exists with this PID, i.e. the forked localhost worker is no longer alive.

Could that be related to these changed versions?

I am facing the same issue as @BertvanUlft on Ubuntu 22.04, when I'll try to deploy obsmon with ansible.
I am checking out version 4.3.0, but I still see the error:
Progress 15%, installing R-lib 24/154: stringi (== 1.7.3) ...
"stderr": "Error: installation of package ‘stringi’ had non-zero exit status
Error in file(con, \"r\") : cannot open the connection
Calls: install ... tryCatchOne -> <Anonymous> -> tryCatch -> readLines -> file
In addition: Warning message:
In file(con, \"r\")
cannot open file 'stringi.out': No such file or directory\nExecution halted"

I have tried installing stringi=1.7.3 using devtools before installing obsmon, which succeeds, but the obsmon install script still gives the same error.
For reference I give my R related ansible steps below:

Ansible steps
- name: Add key for CRAN-R repository
  apt_key:
    url: https://cloud.r-project.org/bin/linux/ubuntu/marutter_pubkey.asc
    state: present

- name: Add CRAN-R repository
  apt_repository:
    repo: "deb https://cloud.r-project.org/bin/linux/{{ ansible_distribution|lower }} {{ ansible_distribution_release }}-cran40/"
    state: present
    update_cache: yes

- name: Install r-base
  apt:
    name:
      - r-base=4.2.1-1.2204.0
    state: present
    update_cache: yes

- name: Install the necessary CRAN devtools package
  shell: R -e "install.packages('devtools', repos='http://cran.rstudio.com/')"
  args:
    warn: yes

- name: Install shiny
  shell: R -e "require(devtools); install_version('shiny', version = '1.7.1', repos = 'http://cran.us.r-project.org')"
  args:
    warn: yes

- name: Get and install shiny-server
  shell: |
    wget https://download3.rstudio.org/ubuntu-18.04/x86_64/shiny-server-<IP_ADDRESS>7-amd64.deb
    gdebi --non-interactive shiny-server-<IP_ADDRESS>7-amd64.deb
    ufw allow 3838
  args:
    warn: yes

- name: Install rmarkdown
  shell: R -e "require(devtools); install_version('rmarkdown', version = '2.14', repos = 'http://cran.us.r-project.org')"
  args:
    warn: yes

- name: Install tidyverse required by obsmon
  shell: R -e "require(devtools); install_version('tidyverse', version = '1.3.1', repos = 'http://cran.us.r-project.org')"
  args:
    warn: yes

#####################
# Fetch and install obsmon
#####################

- name: Git checkout obsmon
  ansible.builtin.git:
    repo: "{{ obsmon_repo }}"
    dest: /srv/checkout
    version: "{{ obsmon_tag }}"

- name: Install stringi required by obsmon
  shell: R -e "require(devtools); install_version('stringi', version = '1.7.3', repos = 'http://cran.us.r-project.org')"
  args:
    warn: yes

# #status stringi fails
- name: Install obsmon frontend
  shell: cd /srv/checkout/ && ./install
  args:
    warn: yes


[Issue]:  ERROR error generating community report

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have checked #657 to validate if my issue is covered by community support

Describe the issue
When generating community_reports it just shows error, it seem like some errors on json?
I was tried #772 solution but it is not wokring on my desktop and changed model_supports_json: true from true to false. it also not work.
the llm model is from ollama
the embeddings model is from xinference
Steps to reproduce
🚀 Reading settings from ragtest/settings.yaml
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
🚀 create_base_text_units
id  ... n_tokens
0   1deea9b3aeb4529df57728a72417237d  ...     1200
1   4d1761f41aa825a6417d33552ef73529  ...     1200
2   97b4d69360a070ff501e3d7094acf40f  ...     1200
3   cfbb152ad20108f6f58cfa90af159af9  ...     1200
4   df6f974f9acf69c0bafd15380675749e  ...     1200
5   a97140c6424e74226e5ebd23e53160c4  ...     1200
6   3819b16dae74480c7ec3ce53bc8991d0  ...     1200
7   52ae7c86022db4776478eb43aa539b03  ...     1200
8   1616eba3f8622b53a008bf849ddb4a54  ...     1200
9   d8368121eff28a357b7e912aab1884c6  ...     1200
10  9594e43f483ac153d505ccede24f1f4d  ...     1200
11  ad9fdb9694ea81cc940f0e612898d06b  ...     1200
12  6d13e94314df51b7fdabfe3d336e3d31  ...     1200
13  7244b563fbccd65c898abb0bb8f597e0  ...     1200
14  33337490d8b278c9858195fb30091d09  ...     1200
15  f5d314ff303d1a66ba9c694769d73a35  ...     1200
16  4460d651dd1c95fff3379d1425c81b00  ...     1200
17  7f39647bd9c095d0d3a62f410f83723c  ...     1200
18  2ce7b25ada84e2226875b97edece0c7d  ...     1200
19  819e13a7bc211f07e3d3ce0eb63a18ac  ...     1200
20  32d7318349fad1e1bbb142e0731ec319  ...     1200
21  9d754a400f1eec5864314616b57bf489  ...     1200
22  2e4cd4170a12f9768f298ff99d804410  ...     1200
23  1a81298f81d9721c9cf5d252a2f80f51  ...     1200
24  047c60953620c0bba26cf0b662d050fc  ...     1200
25  51034a0b4a725ffedf938732ecd31fc9  ...     1012
[26 rows x 5 columns]
🚀 create_base_extracted_entities
entity_graph
0  <graphml xmlns="http://graphml.graphdrawing.or...
🚀 create_summarized_entities
entity_graph
0  <graphml xmlns="http://graphml.graphdrawing.or...
🚀 create_base_entity_graph
level                                    clustered_graph
0      0  <graphml xmlns="http://graphml.graphdrawing.or...
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
🚀 create_final_entities
id  ...
description_embedding
0  b45241d70f0e43fca764df95b2b81f77  ...
[-0.0066836378537118435, -0.028212515637278557...
1  4119fd06010c494caa07f439b333f4c5  ...
[-0.08931764960289001, 0.03248097002506256, -0...
[2 rows x 8 columns]
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/dat
ashaper/engine/verbs/convert.py:72: FutureWarning:
errors='ignore' is deprecated and will raise in a future
version. Use to_datetime without passing errors and catch
exceptions explicitly instead
datetime_column = pd.to_datetime(column, errors="ignore")
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/dat
ashaper/engine/verbs/convert.py:72: UserWarning: Could not
infer format, so each element will be parsed individually,
falling back to dateutil. To ensure parsing is consistent
and as-expected, please specify a format.
datetime_column = pd.to_datetime(column, errors="ignore")
🚀 create_final_nodes
level          title  ...  x  y
0      0  SAMUEL NAMARA  ...  0  0
1      0      FIRUZABAD  ...  0  0
[2 rows x 14 columns]
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
🚀 create_final_communities
id  ...                       text_unit_ids
0  0  ...
[1 rows x 6 columns]
🚀 join_text_units_to_entity_ids
text_unit_ids  ...
id
0  d8368121eff28a357b7e912aab1884c6  ...
d8368121eff28a357b7e912aab1884c6
[1 rows x 3 columns]
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/num
py/core/fromnumeric.py:59: FutureWarning: 'DataFrame.swapaxes'
is deprecated and will be removed in a future version. Please
use 'DataFrame.transpose' instead.
return bound(*args, **kwds)
/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/dat
ashaper/engine/verbs/convert.py:65: FutureWarning:
errors='ignore' is deprecated and will raise in a future
version. Use to_numeric without passing errors and catch
exceptions explicitly instead
column_numeric = cast(pd.Series, pd.to_numeric(column,
errors="ignore"))
🚀 create_final_relationships
source     target  ...  target_degree rank
0  SAMUEL NAMARA  FIRUZABAD  ...              1    2
[1 rows x 10 columns]
🚀 join_text_units_to_relationship_ids
id
relationship_ids
0  d8368121eff28a357b7e912aab1884c6
❌ create_final_community_reports
None
⠏ GraphRAG Indexer
├── Loading Input (InputFileType.text) - 1 files loaded (0… …
├── create_base_text_units
├── create_base_extracted_entities
├── create_summarized_entities
├── create_base_entity_graph
├── create_final_entities
├── create_final_nodes
├── create_final_communities
├── join_text_units_to_entity_ids
├── create_final_relationships
├── join_text_units_to_relationship_ids
└── create_final_community_reports
❌ Errors occurred during the pipeline run, see logs for more
details.
GraphRAG Config Used

encoding_model: cl100k_base
skip_workflows: []
llm:
  api_key: ${GRAPHRAG_API_KEY}
  type: openai_chat # or azure_openai_chat
  model: qwen2:0.5b
  model_supports_json: false # recommended if this is available for your model.
  # max_tokens: 4000
  # request_timeout: 180.0
  api_base: http://<IP_ADDRESS>:11434/v1
  # api_version: 2024-02-15-preview
  # organization: <organization_id>
  # deployment_name: <azure_model_deployment_name>
  # tokens_per_minute: 150_000 # set a leaky bucket throttle
  # requests_per_minute: 10_000 # set a leaky bucket throttle
  # max_retries: 10
  # max_retry_wait: 10.0
  # sleep_on_rate_limit_recommendation: true # whether to sleep when azure suggests wait-times
  # concurrent_requests: 25 # the number of parallel inflight requests that may be made
  # temperature: 0 # temperature for sampling
  # top_p: 1 # top-p sampling
  # n: 1 # Number of completions to generate

parallelization:
  stagger: 0.3
  # num_threads: 50 # the number of threads to use for parallel processing

async_mode: threaded # or asyncio

embeddings:
  ## parallelization: override the global parallelization settings for embeddings
  async_mode: threaded # or asyncio
  llm:
    api_key: ${GRAPHRAG_API_KEY}
    type: openai_embedding # or azure_openai_embedding
    model: bge-base-zh-v1.5
    api_base: http://<IP_ADDRESS>:9997/v1
    # api_version: 2024-02-15-preview
    # organization: <organization_id>
    # deployment_name: <azure_model_deployment_name>
    # tokens_per_minute: 150_000 # set a leaky bucket throttle
    # requests_per_minute: 10_000 # set a leaky bucket throttle
    # max_retries: 10
    # max_retry_wait: 10.0
    # sleep_on_rate_limit_recommendation: true # whether to sleep when azure suggests wait-times
    # concurrent_requests: 25 # the number of parallel inflight requests that may be made
    # batch_size: 16 # the number of documents to send in a single request
    # batch_max_tokens: 8191 # the maximum number of tokens to send in a single request
    # target: required # or optional

chunks:
  size: 1200
  overlap: 100
  group_by_columns: [id] # by default, we don't allow chunks to cross documents

input:
  type: file # or blob
  file_type: text # or csv
  base_dir: "input"
  file_encoding: utf-8
  file_pattern: ".*\\.txt$"

cache:
  type: file # or blob
  base_dir: "cache"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

storage:
  type: file # or blob
  base_dir: "output/${timestamp}/artifacts"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

reporting:
  type: file # or console, blob
  base_dir: "output/${timestamp}/reports"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

entity_extraction:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/entity_extraction.txt"
  entity_types: [organization,person,geo,event]
  max_gleanings: 1

summarize_descriptions:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/summarize_descriptions.txt"
  max_length: 500

claim_extraction:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  # enabled: true
  prompt: "prompts/claim_extraction.txt"
  description: "Any claims or facts that could be relevant to information discovery."
  max_gleanings: 1

community_reports:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/community_report.txt"
  max_length: 2000
  max_input_length: 8000

cluster_graph:
  max_cluster_size: 10

embed_graph:
  enabled: false # if true, will generate node2vec embeddings for nodes
  # num_walks: 10
  # walk_length: 40
  # window_size: 2
  # iterations: 3
  # random_seed: 597832

umap:
  enabled: false # if true, will generate UMAP embeddings for nodes

snapshots:
  graphml: true
  raw_entities: false
  top_level_nodes: false

local_search:
  # text_unit_prop: 0.5
  # community_prop: 0.1
  # conversation_history_max_turns: 5
  # top_k_mapped_entities: 10
  # top_k_relationships: 10
  # llm_temperature: 0 # temperature for sampling
  # llm_top_p: 1 # top-p sampling
  # llm_n: 1 # Number of completions to generate
  # max_tokens: 12000

global_search:
  # llm_temperature: 0 # temperature for sampling
  # llm_top_p: 1 # top-p sampling
  # llm_n: 1 # Number of completions to generate
  # max_tokens: 12000
  # data_max_tokens: 12000
  # map_max_tokens: 1000
  # reduce_max_tokens: 2000
  # concurrency: 32

Logs and screenshots
14:11:13,922 graphrag.index.graph.extractors.community_reports.community_reports_extractor ERROR error generating community report
Traceback (most recent call last):
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/index/graph/extractors/community_reports/community_reports_extractor.py", line 58, in call
await self._llm(
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/openai/json_parsing_llm.py", line 34, in call
result = await self._delegate(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/openai/openai_token_replacing_llm.py", line 37, in call
return await self._delegate(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/openai/openai_history_tracking_llm.py", line 33, in call
output = await self._delegate(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/caching_llm.py", line 96, in call
result = await self._delegate(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/rate_limiting_llm.py", line 177, in call
result, start = await execute_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/rate_limiting_llm.py", line 159, in execute_with_retry
async for attempt in retryer:
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/tenacity/asyncio/init.py", line 166, in anext
do = await self.iter(retry_state=self._retry_state)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/tenacity/asyncio/init.py", line 153, in iter
result = await action(retry_state)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/tenacity/_utils.py", line 99, in inner
return call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/tenacity/init.py", line 398, in
self._add_action_func(lambda rs: rs.outcome.result())
^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/rate_limiting_llm.py", line 165, in execute_with_retry
return await do_attempt(), start
^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/rate_limiting_llm.py", line 147, in do_attempt
return await self._delegate(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/base/base_llm.py", line 48, in call
return await self._invoke_json(input, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/llm/openai/openai_chat_llm.py", line 88, in _invoke_json
raise RuntimeError(FAILED_TO_CREATE_JSON_ERROR)
RuntimeError: Failed to generate valid JSON output
14:11:13,923 graphrag.index.reporting.file_workflow_callbacks INFO Community Report Extraction Error details=None
14:11:13,923 graphrag.index.verbs.graph.report.strategies.graph_intelligence.run_graph_intelligence WARNING No report found for community: 0
14:11:13,948 datashaper.workflow.workflow INFO executing verb window
14:11:13,948 datashaper.workflow.workflow ERROR Error executing verb "window" in create_final_community_reports: 'community'
Traceback (most recent call last):
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/datashaper/workflow/workflow.py", line 410, in _execute_verb
result = node.verb.func(**verb_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/datashaper/engine/verbs/window.py", line 73, in window
window = __window_function_mapwindow_operation
~~~~~~~~~~~^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/pandas/core/frame.py", line 4102, in getitem
indexer = self.columns.get_loc(key)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/pandas/core/indexes/range.py", line 417, in get_loc
raise KeyError(key)
KeyError: 'community'
14:11:13,950 graphrag.index.reporting.file_workflow_callbacks INFO Error executing verb "window" in create_final_community_reports: 'community' details=None
14:11:13,950 graphrag.index.run ERROR error running workflow create_final_community_reports
Traceback (most recent call last):
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/graphrag/index/run.py", line 323, in run_pipeline
result = await workflow.run(context, callbacks)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/datashaper/workflow/workflow.py", line 369, in run
timing = await self._execute_verb(node, context, callbacks)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/datashaper/workflow/workflow.py", line 410, in _execute_verb
result = node.verb.func(**verb_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/datashaper/engine/verbs/window.py", line 73, in window
window = __window_function_mapwindow_operation
~~~~~~~~~~~^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/pandas/core/frame.py", line 4102, in getitem
indexer = self.columns.get_loc(key)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/karl/anaconda3/envs/Rag/lib/python3.11/site-packages/pandas/core/indexes/range.py", line 417, in get_loc
raise KeyError(key)
KeyError: 'community'
14:11:13,950 graphrag.index.reporting.file_workflow_callbacks INFO Error running pipeline! details=None
Additional Information

GraphRAG Version:0.2.2
Operating System: ubuntu22.04
Python Version:3.11.9
Related Issues:error when executing verb create_community_reports

I had the same issue when using local embeding and model service.

Routing to #657 for non-OpenAI models


Signposts

Category:

UI
Map

Feature description
It would be interesting if there were signposts around the game world that players could inspect to get information about the surrounding area, or a view of a section of the map.
This would be a better balance of giving people useful info and not distracting from the environment, and to not have to open the entire world map to find where you are if lost.
Signposts would be clickable (highlighted like crafting stations when near) and would open a modal when clicked to show the local info.
Perhaps what they show could be more detailed than the world map, i.e. shop types, dungeon entrance locations, rare resource node locations.

This is pretty redundant now with the pannable world map.


Update the API doc for adding change listener API

Update the API doc for adding change listener API regarding the thread where the changes will be posted on.

Yea, I knew. Let's wait and see if this will become such an issue before we start to offer java.swing and java.fx. I kind of like your idea about java and android is under the same umbrella.


docs(contributing): Added page with instructions for making a change using the GitHub UI

Added page with instructions for making a change using the GitHub UI

Partial: #1707

/assign @celanthe


[Bug]: Installing PyBaMM on M1 chip fails (both pip and install from source)

PyBaMM Version
all
Python Version
3.9
Describe the bug
PyBaMM cannot be installed on an M1 mac from pip as well as from source. I think casadi does not support M1 chips?
I was able to set everything up by installing casadi from source, and removing casadi as a dependency when installing PyBaMM from source. Should this be documented in the installation page?
Also, should we be specifically building intel wheels till casadi supports M1 wheels? This way users will get a "No matching distribution found for pybamm" error when installing through pip on M1, rather than than the installation failing midway.
Building casadi locally -
brew install cmake swig
git clone https://github.com/casadi/casadi.git casadi
cd casadi
git checkout 3.5.5
mkdir build
cd build
cmake -DWITH_PYTHON=ON \
-DWITH_PYTHON3=ON \
-DPYTHON_INCLUDE_DIR=$(python3 -c "from distutils.sysconfig import get_python_inc; print(get_python_inc())") \
-DPYTHON_LIBRARY=$(python3 -c "import distutils.sysconfig as sysconfig; print(sysconfig.get_config_var('LIBDIR'))") \
..
make
sudo make install

Steps to Reproduce
pip3 install pybamm

pip3 install -e .

Relevant log output
ERROR: Could not find a version that satisfies the requirement casadi>=3.5.0 (from pybamm) (from versions: none)
ERROR: No matching distribution found for casadi>=3.5.0

I'm able to install pybamm on M1 from source, but maybe it's using Rosetta?

I think so. #2072 looks related (casadi not found), the only difference is that I did not try building up the IDAKLUSolver.

You can force it to use rosetta if you're using conda by setting the environment variable CONDA_SUBDIR to osx-x64.

I managed to get it to install and sort of work.
Using an M1 MBA (2020):

Download and install Python 3.8.10 universal installer (maybe 3.9 works too, I haven't tried)
Use the interpreter /Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8-intel64 to create a venv and run the pip install pybamm

I think using the intel64 binary, which I guess automatically runs under rosetta, seems to work? When I run a script after doing import pybamm it does take a ~4 secs to start running. Not sure if this is how it usually is with this package.

@savvn001's method on Python 3.8.10 works for me - it did not work with 3.9.
Specifically:
0. From within a rosetta terminal:

Installed 3.8.10 from https://www.python.org/downloads/release/python-3810/
Created a virtual environment based on the intel64 interpreter: /Library/Frameworks/Python.framework/Versions/3.8/bin/python3.8-intel64 -m venv venv38intel
For usage in jupyter lab, added the kernel ipython kernel install --user --name=venv39intel
Activated the venv source venv38intel/bin/activate

conda-forge should also work (no rosetta required)

FYI the following worked for me on Python 3.9.13 + M2 Macbook Air + MacOS 13.2

Installed Python 3.9.13 universal installer from here
Created a virtual env using the intel64 interpreter Library/Frameworks/Python.framework/Versions/3.9/bin/python3-intel64 -m venv env
Activate and install as normal

MacBook Pro 14 2021 (M1 Pro chip) / MacOS 12.6 /

Out of curiosity has anyone checked if there's a performance difference between Conda/build-from-source and the rosetta options?

Casadi 3.6.0 brings support for Apple Silicon: https://github.com/casadi/casadi/releases/tag/3.6.0


net/http/httptest: adds test for #37650

This PR adds tests for https://github.com/golang/go/issues/37650.
It does not add a fix, so please take this as a starting point.

Sorry, please ignore as this was not really testing the issue.


Move recursion in Term::reduce onto the heap

Problem
Normal compiler operation is already running into stack space restrictitons. Term::reduce should not add to that.
Solution
Just allocate all resources in Term::reduce on the heap.

L1IR replaces Term::reduce


Search cached grep results

Is it possible to search a grep result using another consumer?
This setup is not quite working for me...
local snap = require('snap')
snap.run({
  producer = snap.get('consumer.fzf')(snap.get('consumer.cache')(snap.get('producer.vim.currentbuffer'))),
  select = snap.get('select.vimgrep').select,
  multiselect = snap.get('select.vimgrep').multiselect,
  views = { snap.get('preview.vimgrep') }
})

The flow is

Snap will initiate the ripgrep command with no query (this would produce a large result of each line in each file)
Cache it using the cache consumer
Filtering it with FZF

Which in turn similar to just a ripgrep filtering, but it only run a ripgrep command once.

It's documented I the README, search for steps.

Subsequent configured steps can be activated using C-q. You might need to change the -M parameter via vimgrep args if you find not enough content for each line is being placed in the results buffer.

This setup looks good to me...
snap.run {
  producer = snap.get'producer.ripgrep.vimgrep',
  steps = {{
    consumer = snap.get'consumer.fzf',
    config = {prompt = "FZF>"}
  }},
  select = snap.get'select.vimgrep'.select,
  multiselect = snap.get'select.vimgrep'.multiselect,
  views = {snap.get'preview.vimgrep'}
}

It working great if I did some filtering with ripgrep first. However, if I open up the ripgrep then C-q immediately, fzf is taking some time to do the processing, and even throwing some errors. Not sure if there is too much result to be processed here.

With filtering first,
https://user-images.githubusercontent.com/1087399/123526744-18bfdc00-d704-11eb-9754-0b65e6509103.mov

Without filtering first,
https://user-images.githubusercontent.com/1087399/123526750-2aa17f00-d704-11eb-92c8-a6c5baebf89c.mov

Interesting, I suspect that it is only working when it has all the results. I need to iterate on this apparently. For now I think it's only going to work when you have all the results from ripgrep. Apologies.

No worry, I can live with it for now. Thanks for the great plugin by the way, I really like how things get composed together.

I've recently released a new configuration API which generates fucntions that call snap.run with reasonable configuration given a minimal API (less verbose). Under the hood it's really just doing all the appropriate composition and calling snap.run but it makes making mappings easier for common use cases. It's now documented in the readme. However it does support steps/next yet.
Let me know what you think if you give it a try.

This issue (https://github.com/camspiers/snap/issues/1) seems to be exactly what I'm looking for.


auro-select:  Allow choosing what value shows up as a selected item in the component

Is your feature request related to a problem? Please describe.
In the case of a phone code, we would like to be able to display the country name in addition to the phone code in the dropdown.  When a phone is selected, we don't want to display the full country, just the code
Describe the solution you'd like
Maybe have <auro-menuoption have 2 different values?  1 for display in the dropdown and another for what is shown when the value is selected.
Describe alternatives you've considered
No other options considered
Additional context
<auro-select
    aria-label="Phone Code"
    class="xs:tw-col-span-2 sm:tw-col-span-3 md:tw-col-span-2 lg:tw-col-span-2"
    value="1"
>
    Code
    <auro-menu>
        <auro-menuoption value="1">United States/Canada (+1)</auro-menuoption>
        <auro-menuoption value="506">Costa Rica (+506)</auro-menuoption>
        <auro-menuoption value="52">Mexico (+52)</auro-menuoption>
        <auro-menuoption value="93">Afghanistan (+93)</auro-menuoption>
        <auro-menuoption value="355">Albania (+355)</auro-menuoption>

Putting this into the backlog for @megrenn to assess where this fits into our product roadmap.  Building in this functionality is complicated to do at the component level.


Improve Configuration documentation for OpenAI

I've installed the extension, edited the Settings to use OpenAI for the model, code completion, and (ada) embedding. Added my OpenAI key. No Wingman features work. They fail silently except for the hotkey for code completion, which reports a 401 error (unauthorized). But my OpenAI key shows no activity. I did copy/paste it correctly. I can't figure out what I could have done wrong. I've uninstalled and reinstalled and tried again, no dice with OpenAI as my preferred models. The "Configuration" page of the documentation says "Wingman has a built-in configuration window that will persist configuration locally into the vscode settings file in your repository" but I don't find this built-in configuration window anywhere, just a VSCode-driven Settings tab that has many links that just open up settings.json. It would be very nice for the settings to have some thorough testing/validation and guidance if not set up properly. This is clearly a misconfiguration on my end, I just don't know how to resolve it.

Hi,
The new version v0.7.0 persists configuration in a common directory, no longer in the settings file in VSCode.
Mainly because of source control concerns. You can safely remove that file after updating.
if you want to review where it’s saved at, open the terminal window and switch to Wingman LSP and it will show the directory in a log message when the extension starts.
Let me know if this helps

That is very strange because the prior versions used that file but none of that code exists anymore in the latest version. I will publish a small update in a second that removes any lingering configuration in the extensions' package.json.
Could you please open terminal -> ouput -> Wingman Language Server, you should see something like this:

Then could you open that ".wingman" directory and look for "settings.json" ? That should be the file its referencing and it has a different structure.
That file persists when you save from the Config View for the first time. On failure to load, it will load defaults.
Default example:
{
  "aiProvider": "OpenAI",
  "embeddingProvider": "OpenAI",
  "interactionSettings": {
    "codeCompletionEnabled": true,
    "codeStreaming": false,
    "codeContextWindow": 256,
    "codeMaxTokens": -1,
    "chatContextWindow": 4096,
    "chatMaxTokens": 4096
  },
  "embeddingSettings": {
    "Ollama": {
      "embeddingModel": "mxbai-embed-large",
      "baseUrl": "http://localhost:11434",
      "dimensions": "1024",
      "enabled": true
    },
    "OpenAI": {
      "embeddingModel": "text-embedding-ada-002",
      "dimensions": "1536",
      "apiKey": "Add me",
      "enabled": true
    }
  },
  "providerSettings": {
    "Ollama": {
      "codeModel": "deepseek-coder-v2:16b-lite-base-q4_0",
      "chatModel": "deepseek-coder-v2:16b-lite-instruct-q4_0",
      "baseUrl": "http://localhost:11434",
      "apiPath": "/api/generate",
      "modelInfoPath": "/api/show"
    },
    "HuggingFace": {
      "codeModel": "codellama/CodeLlama-7b-hf",
      "chatModel": "mistralai/Mixtral-8x7B-Instruct-v0.1",
      "baseUrl": "https://api-inference.huggingface.co/models/",
      "apiKey": "Add me"
    },
    "Anthropic": {
      "chatModel": "claude-3-5-sonnet-20240620",
      "codeModel": "claude-3-5-sonnet-20240620",
      "baseUrl": "https://api.anthropic.com/v1",
      "apiKey": "Add me"
    },
    "OpenAI": {
      "chatModel": "gpt-4o-2024-08-06",
      "codeModel": "gpt-4o-2024-08-06",
      "baseUrl": "https://api.openai.com/v1/chat/completions",
      "apiKey": "Add me"
    }
  }
}

V0.7.1 should be up shortly :) usually takes a few minutes for approval. This will add logging under the "Wingman" output channel under the terminal window.

Okay, I'll look out for the next version.
When I opened terminal output and pointed it to Wingman Language Server, here is what I got:
and there is no settings.json file in that folder anywhere, just an index.json that is mostly blank.

Also including (cropped) screenshot of the extension settings tab.

I looks like that settings.json file lives in my AppData folder: AppData/Roaming/Code/User/settings.json
If I go to the Workspace tab, then click settings.json, that opens in my project folder in a .vscode folder where there is now a settings.json file (not ideal as you said due to version control and API keys)

Ok, just make sure you look in the .wingman folder and not the subfolders, each workspace gets an index under the sub folder but settings are global.
the other file you mentioned is obsolete and can be ignored :)
V0.7.1 is published now, and logs for settings happen client side under “Wingman” output.
Any changes that are saved from the Config View should persist that settings.json file

Great progress! With 0.7.1, I now see the "Wingman Config" panel next to the Terminal now. Using that, I am now getting the Code (Compose) tab working! Code Completion via hotkey also works! The Chat tab just hangs after my message, no response nor error. The Index refuses to build no matter what I put into the filters (and what I put there doesn't persist), so it's always "Status: Not Found".
Separate but related question: Is gpt-4o-mini supported? Might want to use that for the Chat window instead, if it starts working.

Update: I re-save the Wingman Config file and Chat is now working. Index is still not building or saving my filters.

Update: I re-save the Wingman Config file and Chat is now working. Index is still not building or saving my filters.

Great! Yeah filters do not persist just yet :) You can look for any errors using the Terminal Window -> Output -> Wingman Language Server.
It runs on an interval outside of the "full build" in the chat window thing. But it takes a little bit to run, I need to diagram this but what it does:

Filters out files based on includsion/exclusion (includes gitignore file in exclusion list).
Takes those files and breaks them down, passes them to your Chat Provider for "summarizing"
Then passed them to the embedding provider
Persists it to disk

Solved: I got the Index to start processing after I fiddled with the path for the inclusion filter, removing slashes. I guess it was just my ignorance and there's no error message given saying that my filter was invalid for some reason. So, adding helpful error messages for that part would be helpful, and also maybe adding some kind of status for the indexer because it is taking quite awhile to process and no feedback on progress/number of files processed. Assuming this index processing will complete at some point, I appear to be up and running. Many thanks for your super quick help!

Solved: I got the Index to start processing after I fiddled with the path for the inclusion filter, removing slashes. I guess it was just my ignorance and there's no error message given saying that my filter was invalid for some reason. So, adding helpful error messages for that part would be helpful, and also maybe adding some kind of status for the indexer because it is taking quite awhile to process and no feedback on progress/number of files processed. Assuming this index processing will complete at some point, I appear to be up and running. Many thanks for your super quick help!

Awesome! I will add a message if there are no files found after running the filters and try to make this more clear.

Thanks. Super excited to dive into this. :)


query return not in line with expectations

I insert some data to a measurement and field has a key="test-1"，but when I query data just like:
select test-1 from table1;

then return
name: table1
time                                         test-1
----                                          -------------
1558785480000000000

Is it in line with expectations?

@chnn @russorat


Remove unnecessary check

Lines 75-77 of LibraryMetaTest.java have the following code:
        if (metaFileContent.equals(originalLibraryContent)) {
            throw new RuntimeException("Meta test " + getName() + " failed to replace code.");
        }

This code doesn't do anything, as the meta file content is always a shifted version of the original, where all indentation is removed, so the exception will never be thrown. We already do a (proper) check for this in the StringReplacementEvaluator, so this check should be removed.

Please assign me this issues. I want to contribute


Metadata for AVIF, format returned as 'heif'

Using Sharp 27, which now supports AVIF and is great. Thanks!
Downloading this image and then extracting metadata with sharp(inputavif).metadata()

http://download.opencontent.netflix.com.s3.amazonaws.com/AV1/Chimera/AVIF/Chimera-AV1-10bit-1280x720-2380kbps-100.avif

The format returned is heif as that's the encoder used by libvips.
Is it true that this metadata format will be returned for both avif and heic images?
If so, it's not going to be possible to use the metadata to distinguish between the two, one of which is patent-encumbered and cannot be processed without globally installed libvips, as I understand it.
Would it be possible for the libvips metadata to return avif as the format, for consistency with mime type headers and Sharp output format strings?

libvips v8.11.0 will contain logic to expose the heif-compression metadata - see https://github.com/libvips/libvips/pull/1850

Not sure if this is related, but metadata throws error for this animated avif image

https://colinbendell.github.io/webperf/animated-gif-decode/2.avif

I'm guessing not supported at the moment.

$ hexdump -C 2.avif | head -1
00000000  00 00 00 20 66 74 79 70  61 76 69 73 00 00 00 00  |... ftypavis....|

Please see https://github.com/strukturag/libheif/issues/377

v0.29.0 now available.

When we use https://sharp.pixelplumbing.com/api-output#tobuffer with resolveWithObject, it does not return the new compression property.

@adityapatadia This issue relates to the metadata() function - please see https://github.com/lovell/sharp/commit/d000f577735c8e5d666ab1ed2440b0636648b03d#diff-7593ef01ed4401c670c4acf3cc96c2fbaee20979169fb66f81dddb45b91ec132 for a usage example.

Yes, but ideally resolveWithObject should also return same data as metadata(). For example, when an image is compressed inside a function, its return info should ideally have all info about how was the image encoded.

The object returned/resolved by toBuffer() contains properties that are calculated or might change during processing. The compression property of avif() is known before processing and does not change during.


[JAST-016] Mutable syntax tree ops

As a developer, I want the syntax tree to be mutable so that I can have better performance for the end user.

Closed following component split and remade here: https://github.com/zach-cloud/JSyntaxTree/issues/1


Add json file support for inclusion proofs

This was done, see https://github.com/silversixpence-crypto/dapol/issues/159


SCSS Highlighting - Variables

(Original issue 1321 created by hey-stacy on 2017-01-27T15:41:28.042068+00:00)
When declaring a variable in scss the class is .nv but when calling it later it gets the .nt class. I would have expected the same .nv class.

I just started working with Pygments and have noticed a few css/scss issues so I am going to document these as they show up :)

(Original comment by birkenfeld on 2017-01-30T06:39:36.853137+00:00)
Looking at these issues, I think the lexer is too complex for its own good. It tries to differentiate selectors and CSS properties, which is easy with plain CSS (clearly separated by braces, minimal nesting, no meta syntax like @if) but complex here.
I think I'll overhaul the lexer completely to be much less stateful and instead match properties from a whitelist of names.

(Original comment by birkenfeld on 2017-01-30T06:40:38.946496+00:00)
Thanks for the reports BTW, the detailed images really help identifiying the problem immediately!


Test/update api sync criteria

Issue
https://gravitee.atlassian.net/browse/APIM-XXX
Description
A small description of what you did in that PR.
Additional context

📚  View the storybook of this branch here

https://github.com/gravitee-io/gravitee-api-management/pull/4726 superseeded by the aforementiond PR


Add to my React framework

Good morning,
I hope this message finds you well. I found impressive your library and I hope to implement some functions in the create-new-startup bundler.
I was writing to formally seek your permission before I implemented a portion of your codebase. I'm only taking functions that interest me. Is there an attribution style you prefer? Thank you.

Yes, take whatever you need. Please do credit me though. Hope it goes well and if there's any question just let me know and I'm sure I can help!

Sorry I took so long to respond @MurageKibicho Outlook broke so it didn't tell me that I have new emails. But thanks for asking!

That's fine. Thank you!


Nested subgraphs are not nesting correctly.

I think there's a problem with subgraph creation.
A single nested set of graphs will create the expected graph, but multiple sets of nested structures do not seem to generate the correct dot.
Example of working, single nest:
from gvgen import *

graph = GvGen()

# Everything in our graph should be within this
mainContainer = graph.newItem("Main Container")

# a2 nests under a1 which nests under mainContainer
a1 = graph.newItem("a1", mainContainer)
a2 = graph.newItem("a2", a1)
a3 = graph.newItem("a3", a2)

with open("testout.dot", 'w') as f:
    graph.dot(f)

Results in:

However, an attempt to add a second set of nested objects results in unexpected results:
from gvgen import *

graph = GvGen()

# Everything in our graph should be within this
mainContainer = graph.newItem("Main Container")

# a2 nests under a1 which nests under mainContainer
a1 = graph.newItem("a1", mainContainer)
a2 = graph.newItem("a2", a1)
a3 = graph.newItem("a3", a2)

b1 = graph.newItem("b1", mainContainer)
b2 = graph.newItem("b2", b1)
b3 = graph.newItem("b3", b2)

with open("testout.dot", 'w') as f:
    graph.dot(f)

Results in:

Which is not correct, the expected output should look closer to:

Looking at https://github.com/stricaud/gvgen/issues/9 it looks like this issue arose previously, and @stricaud attempted to address.

The problem lies in the browse and tree functions.
I've not had time to fix those (I can take a look if you'd like - it was actually easy just to implement my own.
I wrote an alternative implementation here - it doesn't include styling or smartlinks but does do the nested rendering correctly - hope it helps!

Demo script showing the issue: https://gist.github.com/hyakuhei/33f48cf48cc15062631634433ac7454b

Thanks, this is indeed an issue. I have no time to fix it right now but will be on this ASAP.

If you want to work on fixing this and publish a pull request, I would be more than happy to merge it! If not, still need to wait a little.

I decided to implement my own dot-generator instead of looking to fix this in GvGen. It doesn't manage styling the same way but handles drawing, nesting and implements a similar idea to the smartLinks feature you have in GvGen.
The Dot class in util.py contains all the functionality


Fix partition duration format pattern

A counter proposal to fix PartitionDurationFormatPattern by not using Table iteration.
Compete against https://github.com/tc39/proposal-intl-duration-format/pull/134/

The rendering of this PR is currently in https://frankyftang.github.io/proposal-intl-duration-format/

The PR is totally outdated I will close this one. I think we should simplified PartitionDurationFormatPattern but not need to be done in this way.


Add error prone and google java format plugins as project requirements

@etanshaul what do you think about this?

what actually happens? It forces you to install the plugins?


Draft custom color scheme.

Handing over to @alexbndk for branding and new logos.

@artob @paouvrard Tried to push my changes but it looks like I don't have permission. Could you double check please?

Here's how it will look like:


Unable to find module with Gradle path ':moduleName'

I am facing this issue, unable to sync the project successfully. I do have the module in my application. But still, this giving me the error which leads to sync failure.
Android Studio Version: 4.0.1
Gradle: 5.6.4

Thank you for your interest in Gradle!
This issue lacks information and/or a reproducer to track down the problem. Unless you provide that information over the next 7 days, this issue will be closed.

This might be an issue with AGP, please refer to sources to track this down.


General plan outline

Contents of MVP2:

[x] Optimize airline experiment
[x] Add comparison with XGBoost hist
[x] Add Guolin experiments and run them on the same machine
[x] Update notebooks with new parameters
[ ] Add experiments with GPU
[ ] Change notebooks with bokeh
[ ] Blog writeup

TODO cleanup:
-airline: remove evaluation
-football remove evaluation
-remove xgboost hist and leave the loader
-change df_plane_numeric_small = df_plane_numeric.sample(n=10000000).reset_index(drop=True) to df_plane_numeric_small = df_plane_numeric.sample(n=1e6).reset_index(drop=True)
-remember gotchas:

evaluation will slow the training
custom loss functions in python are also slower
ligthgbm is cache aware

TODO GPU:

finish parameters in both airline and higgs
code results for different dataset sizes
add GPU times and perf to the LightgbmvsXgboost notebook
also the results for different dataset sizes

TODO bokeh:

save as png and render it to github
change requirements with recent version of bokeh

TODO blog:

export bokeh plots to htlm+js
-try to render bokeh in the post blog
-think about the normal post
-think about Q&A
decide if put Q&A together or in a different post


[SPARK-46290][PYTHON] Change saveMode to a boolean flag for DataSourceWriter

What changes were proposed in this pull request?

This PR updates the writer method in the Python data source API from
def writer(self, schema: StructType, saveMode: str)

to
def writer(self, schema: StructType, overwrite: bool)

The motivation here is that saveMode offers four modes: append, overwrite, error, and ignore, but practically speaking, only append and overwrite are meaningful. Also, DSv2 only supports the append and overwrite mode. Python data sources should be consistent.
Why are the changes needed?

To make the API simpler.
Does this PR introduce any user-facing change?

No
How was this patch tested?

Existing tests
Was this patch authored or co-authored using generative AI tooling?

No

Merged to master.


Custom overrides

Hello, I really like this project it is an amazing starting point for what can be a little daunting. Would it be possible to add more custom files, such as a file for variable overrides and alias overrides, like you have for plugins, this would avoid merge conflicts for forks.

The point of this repo isn't really to be a whole Zsh config kickstarter (aka: $ZDOTDIR), but rather to show you how to create a composable config yourself just with just antidote and a well structured .zsh_plugins.txt. It's also a clean ZDOTDIR for my own testing when there's an issue reported to antidote and it would be easier to show a solution via a code branch than to type up a solution. So, in that vein, I won't be doing anything like this in this project.
However, I have considered creating a Zsh kickstarter project. I just haven't had the time. I would welcome a PR though.


Receive package

Hi
I use your UDPPackageIO.cs and send packages to the server but i cant receive them. how can i receive  them ?

For UDPPackageIO.cs, please refer to this repo: https://github.com/polyrhythmatic/unity-osc-receiver/


Simple state management error refactor

Firstly I would like to thank you for this quality work,
I found a malfunction of the inputs on the simple-state-management part in the example module.
The error message was configured badly in the html file for the inputs : name + surname.
I fixed it and this is my first pull request 👍
Regards

Codecov Report

Merging #512 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #512   +/-   ##
=======================================
  Coverage   57.97%   57.97%
=======================================
  Files          65       65
  Lines         552      552
  Branches       34       34
=======================================
  Hits          320      320
  Misses        225      225
  Partials        7        7

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3695e80...51ac361. Read the comment docs.

Hi @KadarH !
Thank you for your contribution, great catch!


Add test for second  to schematron

@tcatapano Please add a rule to the schematron that gives the following message if two or more <dsc> are present.
"The use of multiple <dsc> elements is discouraged. It may be deprecated in the future and eliminating multiple <dsc> elements will ease future migration."
Feel free to wordsmith if that seems unclear.

Tested and looks good. Closing.


Great work

I love your work mate, learned a ton from your code about swing and ui.

@norbert-gaulia Big thank for sponsoring me 😘.
I just wanted to thank you for sponsoring my work on GitHub. Your support means a lot to me and motivates me to continue building and improving open-source projects for the community.
Thanks again 🥰


Kjv new options

Adding three new options:

-W num: to set the width of the line.
-i: disable the highlighting (if you want to copy the text in less)
-b: add a blank line after all versus

Example:
kjv -b -i -W 50 matthew:7:1-5

In less press | then $ then run xclip -selection clipboard. I didn't find an easier way to copy or print the text without using less (If you have another method without using less or xclip, say so. Thank you)
Output:
Matthew

7:1	Judge not, that ye be not judged.

7:2	For with what judgment ye judge, ye
	shall be judged: and with what measure
	ye mete, it shall be measured to you
	again.

7:3	And why beholdest thou the mote that is
	in thy brother's eye, but considerest
	not the beam that is in thine own eye?

7:4	Or how wilt thou say to thy brother, Let
	me pull out the mote out of thine eye;
	and, behold, a beam is in thine own eye?

7:5	Thou hypocrite, first cast out the beam
	out of thine own eye; and then shalt
	thou see clearly to cast out the mote
	out of thy brother's eye.

It seems that @layeh is gone, therefore this project appears to be unmaintained. It also appears that there is nobody interested on replacing him as a maintainer. Trying to contact him to see if he can the lead to someone else to let community develop it instead.

It seems that @layeh is gone, therefore this project appears to be unmaintained. It also appears that there is nobody interested on replacing him as a maintainer. Trying to contact him to see if he can the lead to someone else to let community develop it instead.

Yes, you are right. I will close this PR.
I have a fork at https://github.com/rofe33/kjv-layeh


Cannot use 'in' operator to search for 'command' in undefined

TypeError: Cannot use 'in' operator to search for 'command' in undefined
at u.value in out/vs/workbench/workbench.desktop.main.js:1733:4283
at h.y in src/vs/base/common/event.ts:1196:13
at h.fire in src/vs/base/common/event.ts:1227:9
at <anonymous> in src/vs/platform/quickinput/browser/quickInput.ts:879:35
at u.value in src/vs/base/common/event.ts:1645:15
at h.y in src/vs/base/common/event.ts:1196:13
at h.z in src/vs/base/common/event.ts:1207:9
at h.fire in src/vs/base/common/event.ts:1231:9
at <anonymous> in src/vs/base/common/event.ts:127:84
at <anonymous> in src/vs/base/common/event.ts:1622:40
at flush in src/vs/base/common/event.ts:1671:33
at Array.forEach (<anonymous>)
at A.bufferEvents in src/vs/base/common/event.ts:1671:16
at <anonymous> in src/vs/base/browser/ui/tree/abstractTree.ts:2559:23
at each in src/vs/base/common/event.ts:142:77
at h.y in src/vs/base/common/event.ts:1196:13
at h.z in src/vs/base/common/event.ts:1207:9
at h.fire in src/vs/base/common/event.ts:1231:9
at b.t in src/vs/base/browser/ui/tree/indexTreeModel.ts:320:21
at b.splice in src/vs/base/browser/ui/tree/indexTreeModel.ts:160:9
at D.l in src/vs/base/browser/ui/tree/objectTreeModel.ts:122:14
at D.setChildren in src/vs/base/browser/ui/tree/objectTreeModel.ts:71:8
at ne.setChildren in src/vs/base/browser/ui/tree/objectTree.ts:56:14
at j.filter in src/vs/platform/quickinput/browser/quickInputTree.ts:1501:14
at s.Nb in src/vs/platform/quickinput/browser/quickInput.ts:580:36
at u.value in src/vs/platform/quickinput/browser/quickInput.ts:846:11
at h.y in src/vs/base/common/event.ts:1196:13
at h.fire in src/vs/base/common/event.ts:1227:9
at r.Z in src/vs/base/browser/ui/inputbox/inputBox.ts:537:21
at HTMLInputElement.<anonymous> in src/vs/base/browser/ui/inputbox/inputBox.ts:199:39

Go to Errors Site

This was fixed in debt week - the errors site says these users see this in stable.


Fix preventDefaultTouchmoveEvent and other props not propagating updates

Currently different props objects are sent to getHandlers on each render.
In theory this is fine, but because of the way that getHandlers sets up event listeners (such as onMove listeners), the state.props object that gets used by these listeners is actually fixed as an older value.
In practice, what this means, is that if props like preventDefaultTouchmoveEvent change on the fly, then the value of state.props.preventDefaultTouchmoveEvent in the onMove callback does not get the new value, and instead keeps the initial value sent through.
This PR sets up an explicit props object to be passed through - so that the object reference is the same everywhere, so that the callback handlers get the up to date prop values.

@stephencookdev this is absolutely a valid concern and thank you for taking a look and setting up a PR. But I do think this may have been fixed recently?
I remember dealing with this issue and my concerns when working on #131 , and think it was fixed with this addition then updated in #132 here
If you still think it is an issue could you add a test that would fail before this PRs additions? That would be incredibly helpful. Thank you again!

Definitely still an issue, I think! But yes, I'll work on a failing test on Monday morning 🙂

@stephencookdev does #138 , published as<EMAIL_ADDRESS>fix the issue for you?

Should be fixed from #138 and released as 5.2.0
@stephencookdev Please let me know if this is not the case. Thank you again for the PR and for bringing the issue to my attention!


code formatting issue

There is one formatting issue in docs How to: Parse Strings Using String.Split.
string[] separatingChars = { "<<", "..." };
    string text = "one<<two......three<four";
    System.Console.WriteLine("Original text: '{0}'", text);

    string[] words = text.Split(separatingChars, System.StringSplitOptions.RemoveEmptyEntries );
    System.Console.WriteLine("{0} substrings in text:", words.Length);

    foreach (var word in words)
    {
        System.Console.WriteLine(word);
    }

Should be like this
string text = "one<<two......three<four";
System.Console.WriteLine("Original text: '{0}'", text);
string[] words = text.Split(separatingChars, System.StringSplitOptions.RemoveEmptyEntries );
System.Console.WriteLine("{0} substrings in text:", words.Length);
foreach (var word in words)
{
System.Console.WriteLine(word);
}
This code should be in the same format as the previous two pieces of code. There should be no spaces before each line of code.

Thanks for your feedback @jack147527. This was fixed in https://github.com/dotnet/samples/pull/847.


Posynomial Equality Constraints in SP's

So, I'd really like to be able to enforce a Posynomial Equality Constraint in SP's.  I know this is a bad idea, but it is nice to have during model development.  I propose two methods of implementing this:
Solution 1
Have the constraint:
x + y  ==  z + w
automatically default within the code to:
x + y  >=  z + w
x + y  <=  z + w
And throw whatever nasty bold flags that @bqpd no doubt wants.
Solution 2
Enable some type of sandbox mode where I can do my early modeling that essentially has no guarantees, but will at least run implementing Solution 1.  This may also be a good place to implement some of those 'pressure' or 'flow' tools that were discussed on Thursday.
I realize this may be controversial, so please feel free to discuss.

I'm all for Posy Eq in SPs! At least, once @whoburg and I implement the inner loop for finding a feasible SP starting point that we discussed last Thursday. Right now they're almost guaranteed to be infeasible without a starting point guess.

Yea, I'm ok with that.  It's just easier to start my modeling with all == than >=.  If I see a == I'll try to fix it, but I may assume that the >= is correct and not come back to it...

Inline comments could help with that as well.

I suppose so, but if I have to do all my early modeling with #fix at the end of each line, it will become a little tiresome...

How about: every line that should be an equality, you put "# should be an
equality" after.

I'm looking forward to helping with implementation of the inner SP solution heuristic. Would be helpful to have a baseline sketch of the current algorithm (as requested in #207), which we can then modify and iterate on.

@cjk12, if you have a simple minimum working example of an SP that involves a posynomial equality constraint, that would be helpful.
(I will likely also have some examples myself, from working on the QPROP formulation).

Unfortunately I don't at the moment, but I probably will in the near
future.  The wing aerodynamics problem is a little too big for this
application.
On Tue, Apr 28, 2015 at 8:19 AM, Warren Hoburg<EMAIL_ADDRESS>wrote:

@cjk12 https://github.com/cjk12, if you have a simple minimum working
example of an SP that involves a posynomial equality constraint, that would
be helpful.
(I will likely also have some examples myself, from working on the QPROP
formulation).
—
Reply to this email directly or view it on GitHub
https://github.com/convexopt/gpkit/issues/234#issuecomment-97041467.

--
Cody J. Karcher
Graduate Student
Department of Aeronautics and Astronautics
Massachusetts Institute of Technology

Should I implement fake Posy EQ for now, or leave it be until it works?

I'm fine with leaving it be.

Yeah, I think we should wait on allowing posy equality constraints until we expect them to perform well. Don't want bad initial experiences to create unconscious prejudice against what will probably be a useful formulation.
Technically, if someone has a feasible initial guess and knows what they're doing, they can create (as I understand it) what would have been fake Posy EQ by bounding both sides with signomial constraints, and specifying the feasible initial guess.
But I think the best plan is to hold off for @bqpd and me to do a clean implementation.

Isn't this the ticket that captures the need to "implement the inner loop for finding a feasible SP starting point that we discussed last Thursday", as well as exposing signomial/posynomial equality constraints to the user?
Feel free to re-close if this is a duplicate.

I wonder if we should call them signomial equality constraints, to further highlight the lack of solution guarantees.

Ooh, I like that naming.
Yeah this issue should probably remain open; I wrote up agorithm draft over in #207.

I propose closing this, duplicate of #397.

SGTM


base64 application on Mac is different to base64 application on Linux

Problem
In the barretenberg binary, we call base64 and pipe that output to gunzip. The base64 call assumes that Mac and Linux both have the same command line options and implementations, which is not the case.
Solution
Conditionally compile the statement which uses the base64 application

Note: we don't test on mac which is why this was not caught. It was not caught earlier in Noir because we were using nix which installs a base64 package in the sandbox which uses the "linux" version of base64 regardless of OS

Another way to do this which avoids the conditional compilation but it creates an intermediate file that you need to clean up is:
base64 -d < file > temp_output && gunzip < temp_output

As noted, you need to clean up temp_output so its not that desirable -- given that removing base64 encoding has been floated, I think we can live with conditional compilation for now


Rewrite ingress translator tests for more coverage

Note: The diff will be meaningless, please look at the changed file on its own.

This rewrites the ingress translator tests to be a bit more principled in that we test an input + a given state and assert the complete output. That allows us to achieve much more coverage and also makes the test serve as documentation about what the outputted configuration actually looks like.
/assign @jmprusi @davidor

/lgtm


Dev fix ssm vpc endpoints

There were some changes made to the working code in this commit:
https://github.com/thinkstack-co/terraform-modules/commit/45b0f55ee7a352626b020d3f399be99b5e967f36
Example of changes:
aws_subnet.private_subnets..id[0]]
changed to
aws_subnet.private_subnets[].id
Terraform does not like this because it wants a string and sees a tuple with 2 items in it.
Since these changes the code has not worked. I am keeping the subnets list that includes all of the subnets, but choosing 1 AZ for Private, Public, DMZ, etc. This will get the code in a working state and allow us
Proof of functioning code will be provided in an additional comment after the VCCU or SOL dr is created.


Create path to abstract pixel sequence

For example:
.art {
  a = 10px
  rect(a, a)
  box-shadow:
    p(2, 2, a),
    p(3, 3, a),
    p(4, 4, a);
}

result in:
.art {
  a = 10px
  rect(a, a)
  box-shadow:
    path(2, 4, 2, 4, a); //p(x1, y1, x2, y2, a)
}

I tried some similar syntax,
but I think your suggestion is better :laughing:


Memory issue

Hi,
I'm trying to call the fit() on a relatively large tensor of images, and considering the size of the image tensor itself, my RAM(24GB) gets filled and leads to killing the process by the OS.

 (I mean calling the fit method of the same BaSiC object each time on a chunk.)
Do you have any suggestions on what I should do to resolve the memory(RAM) problem?

image_list = skimage.io.imread_collection((f'{input_path}/' + channel_files[channel_files.str.startswith(plate)]).to_list()).concatenate()

basic = basicpy.BaSiC(get_darkfield=True, smoothness_flatfield=1)
basic.fit(images=image_list)

images_transformed = basic.transform(image_list, timelapse=False)

Sorry mistakenly closed, reopening.

Hi, I was wondering if there are any news regarding this issue. I am getting a crash of my kernel when I run basic.fit() most likely due to memory issues.
Thanks in advance

I am also getting a crashing kernel when I run basic.fit(), but I have 128 gigs of ram and the process doesn't even get close to allocating that much

I ran into kernel crashes running basic.fit when using the cuda-enabled jax and jaxlib packages. Uninstalling and then deleting those + pybasic from my env, then reinstalling pybasic, resolved the kernel crash -- hth


Debugger Segmentation fault when a file contains 6 functions

Describe the bug
I set up debugger as the documentation guides. When I place a breakpoint inside a file that contains more than 5 functions debugger crashes with segmentation fault.
Reproduction
// test.ts

import { foo } from './parser'

describe('parser', () => {
  it.only('works', () => {
    const f = foo()
  })
})

// parser.ts
function bar() {}
export function bar2() {}
export function bar3() {}
export function bar4() {}
// export const bar4 = () => {}

export function foo() {
  const a = 1 // breakpoint is here
}

//zsh: segmentation fault  /usr/bin/env   /usr/local/bin/node ./node_modules/vitest/vitest.mjs run

Note: If I replace a function by arrow function debugger works without a crash
System Info
System:
    OS: macOS 11.5.2
    CPU: (8) arm64 Apple M1
    Memory: 269.11 MB / 16.00 GB
    Shell: 5.8 - /bin/zsh
  Binaries:
    Node: 16.9.1 - /usr/local/bin/node
    npm: 7.21.1 - /usr/local/bin/npm
  Browsers:
    Chrome: 97.0.4692.71
    Safari: 14.1.2
  npmPackages:
    @vitejs/plugin-react-refresh: ^1.3.6 => 1.3.6
    vite: ^2.7.12 => 2.7.12
    vitest: ^0.1.16 => 0.1.16

Used Package Manager
npm
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

I'm not sure if this is related, but my tests suddenly started failing with a seg fault as well.

I am also suffering random segmentation faults (sometimes it works, sometimes not) while using the debugger with vitest.
I appreciated that, when I tried to record the issue with OBS (that is, when I have the processor with a higher load) segmentation faults are less prone. I assume then it seems to be some kind of race condition, which is also compatible with @Zombobot1's issue.
$> ~/.config/nvm/versions/node/v17.3.0/bin/node --inspect-brk=42855 ~/my-project/www/node_modules/vitest/vitest.mjs --run --threads false -r src/data -c __tests__/vitest.config.ts __tests__/audience.test.ts
Debugger listening on ws://<IP_ADDRESS>:42855/bf20dc67-c771-437d-af4d-46b9a58979e6
For help, see: https://nodejs.org/en/docs/inspector
Debugger attached.

 RUN  ~/my-project/www/src/data

Process finished with exit code 139 (interrupted by signal 11: SIGSEGV)

Not reproducible anymore. All segmentation issues should be reported as separate issues. Thank you!


fix(datastore): fix observe query unit test

Issue #, if available:
N/A
Description of changes:
Moves initial saves to after initial query for testObserveQuery.
Check points: (check or cross out if not relevant)

[ ] ~Added new tests to cover change, if needed~
[x] Build succeeds with all target using Swift Package Manager
[x] All unit tests pass
[ ] ~All integration tests pass~
[x] Security oriented best practices and standards are followed (e.g. using input sanitization, principle of least privilege, etc)
[ ] ~Documentation update for the change if required~
[x] PR title conforms to conventional commit style
[ ] ~If breaking change, documentation/changelog update with migration instructions~

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

ObserveQuery InitialQuery in parallel with saves may result in missed items from the saves happening in parallel.
The implementation change we'd like to do is subscribe to changes before intiial query with a change in how we process the changes.

Scenario 1. Initial query has not finished, aggregate items to be applied to the initial query results. this is the new subscribe we’d like to add
Scenario 2 (already exists). Initial query has finished && ! model synced, existing implementation does not change
Scenario 3 (already exists). Initial query has finished && model Synced, existing implementation does not change

Once the initial query finishes, we take the changes observed while initial query has not finished and apply them to the snapshot. This is to allow observeQuery to be kicked off in parallel with the saves.


Supports for exporting CornerNet to ONNX with dynamic shapes and comparable performance

Hi, This implementation supports for exporting CornerNet to ONNX with dynamic shapes, achieving comparable performance (e.g. 40.4 vs 40.6 for onnxruntime and pytorch respectively, with no test-time flip of this config).
Note this PR is relied on customized onnxruntime operations implemented in previous PRs, involving mmcv::cummax, (or mmcv::CornerPool for torch version lower than 1.5,0) and mmcv::SoftNonMaxSuppression.
The difference between pytorch and exported onnx model mainly comes from the handle of regression coordinates relied on border offset. Since RandomCenterCropPad is done on CPU with numpy and it's not dynamic traceable when exporting to ONNX, thus border does not appears as key in img_meta. As a solution, the handle of border is moved to the postprocess after finished exporting to ONNX, which is handle in model_wrappers.py. The performance affected between torch and exported onnx model might be ignored.
Duplicated of #5112.

kindly ping @ZwwWayne

ping @RangiLyu

Any other comments?

@v-qjqs Please resolve the conflict with the master branch.