推理时无线processing

使用的是: 参考音频的方式生成语音, 但是一直卡在processing..
控制台窗口加载到一下信息后就没有后续了
To create a public link, set share=True in launch().
You are using the latest version of funasr-1.1.2
2024-07-19 12:28:59,203 - modelscope - WARNING - Using the master branch is fragile, please use it with caution!
2024-07-19 12:28:59,203 - modelscope - INFO - Use user-specified model revision: master
另外: 使用了最新的代码(即: fix modelscope version problem (#396))

 使用的是: 参考音频的方式生成语音, 但是一直卡在processing.. 控制台窗口加载到一下信息后就没有后续了 To create a public link, set share=True in launch(). You are using the latest version of funasr-1.1.2 2024-07-19 12:28:59,203 - modelscope - WARNING - Using the master branch is fragile, please use it with caution! 2024-07-19 12:28:59,203 - modelscope - INFO - Use user-specified model revision: master 另外: 使用了最新的代码(即: fix modelscope version problem (#396))

还是加载出来了, 但是花了6,7分钟... 这明显不合理, 因为只有十几个字, 而且我用的编译推理, 本身是3090

因为auto_rerank功能需要下载funasr的权重，时间长的话请自行检查网速是否太慢。

LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
[2024-07-18 15:45:44,275][fish_speech.models.text2semantic.lit_module][INFO] - [rank: 0] Set weight decay: 0 for 459 parameters
[2024-07-18 15:45:44,275][fish_speech.models.text2semantic.lit_module][INFO] - [rank: 0] Set weight decay: 0.0 for 65 parameters
| Name                  | Type              | Params | Mode
0 | model                 | DualARTransformer | 394 M  | train
1 | model.embeddings      | Embedding         | 2.4 M  | train
2 | model.layers          | ModuleList        | 311 M  | train
3 | model.norm            | RMSNorm           | 1.0 K  | train
4 | model.output          | Linear            | 280 K  | train
5 | model.fast_embeddings | Embedding         | 1.1 M  | train
6 | model.fast_layers     | ModuleList        | 77.9 M | train
7 | model.fast_norm       | RMSNorm           | 1.0 K  | train
8 | model.fast_output     | Linear            | 1.1 M  | train
4.3 M     Trainable params
390 M     Non-trainable params
394 M     Total params
1,577.969 Total estimated model params size (MB)
Sanity Checking: |          | 0/? [00:00<?, ?it/s][2024-07-18 15:45:44,446][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,446][fish_speech.datasets.text][INFO] - [rank: 0] Reading 2 / 1 files
[2024-07-18 15:45:44,447][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,447][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,447][fish_speech.datasets.text][INFO] - [rank: 0] Read total 2 groups of data
[2024-07-18 15:45:44,447][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,448][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,448][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,448][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,448][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,450][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,451][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,452][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,452][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:44,452][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:44,452][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,450][fish_speech.datasets.text][INFO] - [rank: 0] Reading 2 / 1 files
[2024-07-18 15:45:47,451][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,451][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,452][fish_speech.datasets.text][INFO] - [rank: 0] Read total 2 groups of data
[2024-07-18 15:45:47,458][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,458][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,458][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,459][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,461][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,461][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,461][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,461][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,464][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,464][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[2024-07-18 15:45:47,508][fish_speech.datasets.text][INFO] - [rank: 0] Reading 1 / 1 files
[2024-07-18 15:45:47,508][fish_speech.datasets.text][INFO] - [rank: 0] Read total 1 groups of data
[rank0]:[E ProcessGroupNCCL.cpp:1414] [PG 0 Rank 0] Process group watchdog thread terminated with exception: CUDA error: unspecified launch failure
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
Exception raised from c10_cuda_check_implementation at ../c10/cuda/CUDAException.cpp:43 (most recent call first):
frame #0: c10::Error::Error(c10::SourceLocation, std::string) + 0x57 (0x7f4941b7a897 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10.so)
frame #1: c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::string const&) + 0x64 (0x7f4941b2ab25 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10.so)
frame #2: c10::cuda::c10_cuda_check_implementation(int, char const*, char const*, int, bool) + 0x118 (0x7f4941f06718 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10_cuda.so)
frame #3: c10d::ProcessGroupNCCL::WorkNCCL::finishedGPUExecutionInternal() const + 0x56 (0x7f48f58598e6 in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #4: c10d::ProcessGroupNCCL::WorkNCCL::isCompleted() + 0x58 (0x7f48f585d9e8 in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #5: c10d::ProcessGroupNCCL::watchdogHandler() + 0x77c (0x7f48f586305c in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #6: c10d::ProcessGroupNCCL::ncclCommWatchdog() + 0x10c (0x7f48f5863dcc in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #7:  + 0xd44a3 (0x7f49412ba4a3 in /usr/lib/x86_64-linux-gnu/libstdc++.so.6)
frame #8:  + 0x89134 (0x7f4943751134 in /usr/lib/x86_64-linux-gnu/libc.so.6)
frame #9: __clone + 0x40 (0x7f49437d0a40 in /usr/lib/x86_64-linux-gnu/libc.so.6)
terminate called after throwing an instance of 'c10::DistBackendError'
what():  [PG 0 Rank 0] Process group watchdog thread terminated with exception: CUDA error: unspecified launch failure
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
Exception raised from c10_cuda_check_implementation at ../c10/cuda/CUDAException.cpp:43 (most recent call first):
frame #0: c10::Error::Error(c10::SourceLocation, std::string) + 0x57 (0x7f4941b7a897 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10.so)
frame #1: c10::detail::torchCheckFail(char const*, char const*, unsigned int, std::string const&) + 0x64 (0x7f4941b2ab25 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10.so)
frame #2: c10::cuda::c10_cuda_check_implementation(int, char const*, char const*, int, bool) + 0x118 (0x7f4941f06718 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10_cuda.so)
frame #3: c10d::ProcessGroupNCCL::WorkNCCL::finishedGPUExecutionInternal() const + 0x56 (0x7f48f58598e6 in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #4: c10d::ProcessGroupNCCL::WorkNCCL::isCompleted() + 0x58 (0x7f48f585d9e8 in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #5: c10d::ProcessGroupNCCL::watchdogHandler() + 0x77c (0x7f48f586305c in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #6: c10d::ProcessGroupNCCL::ncclCommWatchdog() + 0x10c (0x7f48f5863dcc in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #7:  + 0xd44a3 (0x7f49412ba4a3 in /usr/lib/x86_64-linux-gnu/libstdc++.so.6)
frame #8:  + 0x89134 (0x7f4943751134 in /usr/lib/x86_64-linux-gnu/libc.so.6)
frame #9: __clone + 0x40 (0x7f49437d0a40 in /usr/lib/x86_64-linux-gnu/libc.so.6)
Exception raised from ncclCommWatchdog at ../torch/csrc/distributed/c10d/ProcessGroupNCCL.cpp:1418 (most recent call first):
frame #0: c10::Error::Error(c10::SourceLocation, std::string) + 0x57 (0x7f4941b7a897 in /usr/local/lib/python3.10/site-packages/torch/lib/libc10.so)
frame #1:  + 0xe32119 (0x7f48f54e7119 in /usr/local/lib/python3.10/site-packages/torch/lib/libtorch_cuda.so)
frame #2:  + 0xd44a3 (0x7f49412ba4a3 in /usr/lib/x86_64-linux-gnu/libstdc++.so.6)
frame #3:  + 0x89134 (0x7f4943751134 in /usr/lib/x86_64-linux-gnu/libc.so.6)
frame #4: __clone + 0x40 (0x7f49437d0a40 in /usr/lib/x86_64-linux-gnu/libc.so.6)  这是啥原因呢

 使用的是: 参考音频的方式生成语音, 但是一直卡在processing.. 控制台窗口加载到一下信息后就没有后续了 To create a public link, set share=True in launch(). You are using the latest version of funasr-1.1.2 2024-07-19 12:28:59,203 - modelscope - WARNING - Using the master branch is fragile, please use it with caution! 2024-07-19 12:28:59,203 - modelscope - INFO - Use user-specified model revision: master 另外: 使用了最新的代码(即: fix modelscope version problem (#396))

还是加载出来了, 但是花了6,7分钟... 这明显不合理, 因为只有十几个字, 而且我用的编译推理, 本身是3090

rerank用到了音频转写，有一些问题，现在pr中修复。

#515 Change title to English.

Fixed


cachebuster: Use first 8 chars of SHA1 digest only

Instead of the full 40 characters, which seems fairly wasteful in production CSS.
It only has to be unique in the history of the same file, within cache age.
First 8 characters should provide more than enough entropy.

Ping :sparkles:


[7.x] Update the encryption algorithm to provide deterministic encryption sizes

Resubmission of #31698, now targeted to 7.x since it was released.
What's the issue?
This PR addresses issue #31512. When Laravel encrypts a value, the size of the encrypted result is not deterministic, even though a deterministic block cipher is being used.
Even though it may not be considered a bug (see #31512), this is a very simple fix that may solve an issue for some developers, and prevent unexpected errors for others.
Backwards Compatible?
This PR is fully backwards compatible. It does not change any method signatures and it does not affect decrypting any pre-existing encrypted data.
Will this break anything else?
The JSON spec does not require forward slashes to be escaped, but PHP does it by default. This PR just turns that off in this one instance.
I didn't find anything official, but the StackOverflow consensus about why PHP does this seems to be related to default protection for embedding JSON data <script> tags.
Since this JSON value is not output anywhere or shared with anything else, this option is safe to add here.

Extra information that no one needs...

Who cares?
For the most part, this isn't really an issue. However, if one intends to store the encrypted data in a database, one needs to know the size of the field to create. If a developer isn't careful, they may accidentally chose a value that is too small, causing errors later on.
$results = [];
for ($i = 0; $i < 10000; $i++) {
    $results[] = strlen(encrypt('000000000'));
}
dump(array_count_values($results));

[
    216 => 7425,
    220 => 2548,
    224 => 26,
    228 => 1,
]

Based on the above results, it is feasible that a developer could run a couple tests, always get 216 as a result, and decide it is safe to make the database field a char(216), which will eventually blow up.
Long-winded details...
This issue is caused by forward slashes in base64 encoded values that are json encoded.
When Laravel encrypts a value, it generates an array containing the IV, the encrypted value, and the MAC. It json_encodes this array and returns the base64_encoded value of that.
The IV is randomized, but it is always the same size.
Since the IV is always randomized, the encrypted value is always a different result, but it is always the same size due a deterministic block cipher being used.
The MAC is always the same size.
However, the IV and the encrypted value are both base64 encoded, which includes the forward slash in its alphabet. By default, when json encoding data, PHP will escape forward slashes with backslashes, adding more characters to the json encoded result. These extra escape characters increases the size of the final base64 encoded result.
So, the size of the final encoded result depends on how many forward slashes had to be escaped in the base64 encoded IV and encrypted result.
This PR prevents PHP from escaping the forward slashes, so the resulting size will always be the same.
Let me know if there are any problems or issues.
Thanks,
Patrick

Maybe best fir this to go to Laravel 8?

@GrahamCampbell I don't see any breaking change. This is a bug fix that will normalize a behaviour.

Obviously up to you guys, but this really shouldn't break anything for anyone.
Everything I could think of:

No method signature changes.
The JSON_UNESCAPED_SLASHES option was added in PHP 5.4.0, so it is available in ^7.2.5.
Escaping forward slashes is not required by the JSON spec.
json_decode() will decode unescaped forward slashes without issue.
Existing encrypted data will still decrypt properly.
The resulting encrypted size is the smallest possible size, so the result won't be bigger than anyone already accounted for (in the example in the original post above, encrypting the 9 digit string will always return the smallest size of 216 characters).
The < and > characters are not part of the base64 alphabet, so in the small possibility someone is base64 decoding the encryption result and outputting the raw json into a <script> tag, there still won't be the possibility of the json value having a </script> tag in it (original reason PHP escapes the forward slashes).

Here is an example json result that gets base64 encoded and returned as the result from the encrypt function.
{
    "iv": "gWHjzJRJbcC3jk\/rM85HOA==",
    "value": "rN\/\/tKWFM7S+6O+5MPmEhQ==",
    "mac": "c950df930356c14be9a668ff0945e19c00ae91295dae0b01c7b4c51d46c37777"
}

The only thing this PR does is prevent escaping the forward slashes (found in the iv and value):
{
    "iv": "gWHjzJRJbcC3jk/rM85HOA==",
    "value": "rN//tKWFM7S+6O+5MPmEhQ==",
    "mac": "c950df930356c14be9a668ff0945e19c00ae91295dae0b01c7b4c51d46c37777"
}

This means that the json result will be a consistent size, since it won't fluctuate based on how many forward slashes were escaped. Additionally, the consistent size is the smallest possible size, so it won't break anything for anyone that has already allocated space for storing encrypted data.
If there are any questions or issues, please let me know.
Thanks,
Patrick


how does worker pick a site after crash?

Scenario: I have warcprox and brozzler worker running on my local machine. While in the middle of archiving a website, if brozzler worker process is killed such as either using 'kill -9 <process_id>' or closing the console session.
After both warcprox and brozzler worker instances are restarted (on same ports as before), the site will not be picked for crawling. This is due to reason that db('Brozzler').table('sites').claimed property = true.
Query:

Is there a configuration property that can be set up so that the site can be picked by any single brozzler worker even if claimed=true?

If you wait an hour, it should start crawling again. See https://github.com/internetarchive/brozzler/blob/e23fa68d6/brozzler/frontier.py#L117. If you can't wait, you could set claimed=false in rethinkdb.

Thanks @nlevitt for your quick reply. The problem is deciding when to make claimed=false. Is there any specific reason to choose 60 minutes or is just random?
Do you think it would be acceptable to make this 60 minutes configurable? If yes, please let me know and I can raise a PR for the same and if you need branch name to be against issue #231 or something else?


Windows socket interface

I tried to make modifications to pigpiod_if2 interface and had success with it working on windows, can you check it out and extend the library
in pigpiod_if2.c i excluded/included following headers for windows version
#ifdef _WIN32
#include "winsock2.h"
#include "ws2tcpip.h"
#else
#include <netdb.h>
#include <sys/socket.h>
#include <netinet/tcp.h>
#include <sys/select.h>
#include <arpa/inet.h>
#endif

in function stop_thread pthread_join was giving me invalid parameter passed to c function so i excluded it, i am not sure about consequences...
#ifndef _WIN32
      pthread_join(*pth, NULL);
#endif

in pigpio_stop function changed close function to closesocket
#ifdef _WIN32
      closesocket(gPigCommand[pi]);
#else
      close(gPigCommand[pi]);
#endif

and
#ifdef _WIN32
       closesocket(gPigNotify[pi]);
#else
       close(gPigNotify[pi]);
#endif

How important is it for you to have native bindings to the socket interface?  I use Windows machine to develop all my pigpio applications but use nodejs.  Python and other languages are supported.

Aside from extending pigpiod_if2.c for Windows, are you indicating there is an issue with close() vs closesocket()?
Also, this is a big red flag:

in function stop_thread pthread_join was giving me invalid parameter passed to c function so i excluded it, i am not sure about consequences...


CLI fails to send TAZ on testnet

Based on commit fa5589988b4adb6f17cbc51847921851f41f940b
I created an account on testnet using zingo-cli. This account has two incoming transactions on it (both Orchard).
When I try to send, a transaction is created and a txid printed on the screen, but the testnet mempool never registers the transaction and it is never mined.
I have zingo-cli pointed at my own testnet lightwalletd server, backed by my own testnet zebra node. Neither of these print a console log about broadcasting a transaction (although I'm not certain they normally would.)

alright so the stable release is over here https://github.com/zingolabs/zingolib/releases/tag/vzing-0.3.0
i see you added a pr to dev, maybe it can git-magic over there? good luck
im mostly focused on finishing the next release :)

@fluidvanadium What PR are you referring to? I've made several PRs, but none of them to fix this problem.


WIP: Docker / Docker-compose for deploying intercity-next

[x] Containerize intercity-next with postgres and redis
[x] Add nginx-proxy and expose ports 80/443
[x] Add Letsencrypt support
[x] Add setup script to kick-off deployment

Currently known issues

[x] Stuck on spinner when adding a new server (validating ssh)
[x] No services/plugins seem to have been installed on a new server (no pgsql, redis, etc.)
[ ] Ugly 502 Bad Gateway error when booting

Steps to setup a new Intercity Next machine:

Create a server (tested on Ubuntu 16.04)
Clone intercity-next
Run ./scripts/setup which will setup docker/docker-compose for you and kick off the installation
Wait for containers to boot, database to be migrated and SSL certs to be requested, takes a minute or so.
Done.

Known issues:

Not sure if it's related to this setup, but adding a new server gets stuck at verifying the SSH key.

The SSH spinner issues has been resolved by downgrading ruby to 2.4.2. There's some changes in how Ruby handles private keys, and this was the fastest way to work around it. Upgrading to Ruby 2.5.1 will be a bit more involved because of that.
Next issues: docker/dokku are installed fine, but not the extra services, like postgresql, redis and mariadb.

@jvanbaarsen is it necessary to run rake intercity:seed_plugins when installing or even when booting? Seems to be the reason I don't have any services installed.

@ariejan Aaah yeah good one! The reason that seed task is in there is that I needed a simple way to add new services without having to login on all instances that we have running to update the available services list.

@ariejan I'm trying out this PR locally, but I can't seem to get it to work. What domain did you use to test this? Does it have to be a domain that is reachable for letsencrypt? Or can I just use localhost?

I spun up a €3 vps with hetzner and a real fqdn.

On 7 Aug 2018 at 20:43,    wrote:
@ariejan  I'm trying out this PR locally, but I can't seem to get it to work. What domain did you use to test this? Does it have to be a domain that is reachable for letsencrypt? Or can I just use localhost?
—
You are receiving this because you were mentioned.
Reply to this email directly,   view it on GitHub, or   mute the thread.

@ariejan Looks like we can solve the 502 errors with the following snippet in the entrypoint script:
echo "-- Waiting for DB to be active"
while ! pg_isready -h db > /dev/null 2> /dev/null; do
  printf "."
  sleep 1
done

We would then also need to add postgresql-client to the docker file as a dependency to install.
For me this at least solved some of the errors in the logs when the app started earlier then the DB is active.

Very intersting stuff @ariejan! I'll also be checking this out. See if it can be combined or run alongside my other PR where I started a docker-compose setup for local development (then you don't need the nginx and letsencrypt proxies and other magic).

Hi @ariejan
I'm planning on picking up deploying Intercity as Docker (Compose) app again, but you've already done massive important work in this PR Is this PR something you'd like to continue on and ship? Or would you like me to take over?
Thanks for your reply!
Michiel

@michiels due to time constraints I cannot work on this right now, so feel free to continue working on it. Feel free to mention me here if you have any questions.

Hi @ariejan Perfect! Thank you for your swift reply. I'll analyze your PR and do some follow up steps :)


Create new collections MATCHED_IDS and MATCHED_MSGS

MODSEC-330: It would be useful to have MATCHED_IDS and MATCHED_MSGS collections.  This is similar to MATCHED_VARS.  This would allow rule writers to check if a previous rule(s) have matched before executing other actions.

Logically-wise such feature could be achieved by having the chained rules. Closing till we have a better example why such feature will be important.


SerialPort (for pxt-microbit) not working on Mac

@pelikhan mentioned that it might be something related to the regex for understanding which device it is.
Note that I was serving pxt from the master branch.

@caitlin-hennessy Is this something you're looking into?

Not sure why I closed this? Tom is still seeing issues


Update IDV Bundles on ramadda-jetstream VM

Update bundles on ramadda-jetstream to point to thredds-jetstream.unidata.ucar.edu/thredds/ and adde-jestream.unidata.ucar.edu

Done.


Print basic instructions how to install copr builds

Commits:

skip failing copr tests
copr: print basic instructions on succ build
copr: don't tback if copr sends us invalid state
copr,status: name it packit/rpm-build instead
copr,state changes: more user friendly
packit.yaml: build packit only for f29

@dhodovsk
I have freakin' no idea. These are the logs:
[Thu May 02 18:49:52.051328 2019] api.py            DEBUG  Watching copr build 902080
[Thu May 02 18:49:52.826599 2019] api.py            DEBUG  COPR build 902080, state = pending
[Thu May 02 18:49:52.826714 2019] jobs.py           DEBUG  Reporting state of copr build ID=902080, state=pending, commit=696c667af5a5df1af37cf12de306d20a29940280
[Thu May 02 18:49:53.762291 2019] local_project.py  DEBUG  Cleaning: /tmp/tmp6sife9zt

And they are pretty clear I'd say: it reports things once and then execution just shuts down. And the worst thing is that I can't see anything reported.

@dhodovsk
I have freakin' no idea. These are the logs:
[Thu May 02 18:49:52.051328 2019] api.py            DEBUG  Watching copr build 902080
[Thu May 02 18:49:52.826599 2019] api.py            DEBUG  COPR build 902080, state = pending
[Thu May 02 18:49:52.826714 2019] jobs.py           DEBUG  Reporting state of copr build ID=902080, state=pending, commit=696c667af5a5df1af37cf12de306d20a29940280
[Thu May 02 18:49:53.762291 2019] local_project.py  DEBUG  Cleaning: /tmp/tmp6sife9zt

And they are pretty clear I'd say: it reports things once and then execution just shuts down. And the worst thing is that I can't see anything reported.

This works now, doesn't it?

@dhodovsk yes, this was the problem: https://github.com/packit-service/packit/pull/300/commits/d8dc828cdc79d7ab6d096ac681434ef4333883ec we got an exc when packit changed state: it did not have permissions to do that and the traceback did not propagate


Enforce dataset_lifetime column to be integer and not null

Fixes #11108
Alternative to https://github.com/dmwm/WMCore/pull/11111
Status
not-tested
Description
This change will ensure that:

the database won't accept None as input for the dataset_lifetime column
that we properly convert None to 0 whenever needed, before creating a record in the database.

Is it backward compatible (if not, which system it affects?)
NO (database schema change)
Related PRs
If this proposal is acceptable and correct, we might want to merge this in master only; backport and merge #11111 to the 2.0.2_wmagent branch and create a new patch release.
External dependencies / deployment changes
None

Hi @amaltaro, Alan please consider the following changes in this PR in order to fix an issue in the deployment of a T0 agent during creation of the oracle tables as can been seen below
DEBUG:root:Problem creating database table

CREATE TABLE dbsbuffer_dataset_subscription (
                 id                 INTEGER      NOT NULL,
                 dataset_id         INTEGER      NOT NULL,
                 site               VARCHAR(100) NOT NULL,
                 custodial          INTEGER      DEFAULT 0,
                 auto_approve       INTEGER      DEFAULT 0,
                 move               INTEGER      DEFAULT 0,
                 priority           VARCHAR(10)  DEFAULT 'Low',
                 subscribed         INTEGER      DEFAULT 0,
                 phedex_group       VARCHAR(100),
                 delete_blocks      INTEGER,
                 dataset_lifetime   INTEGER      NOT NULL DEFAULT 0,
                 PRIMARY KEY (id),
                 CONSTRAINT uq_dbs_dat_sub UNIQUE (dataset_id, site, custodial, auto_approve, move, priority)
               )

(cx_Oracle.DatabaseError) ORA-00907: missing right parenthesis
[SQL: CREATE TABLE dbsbuffer_dataset_subscription (
                 id                 INTEGER      NOT NULL,
                 dataset_id         INTEGER      NOT NULL,
                 site               VARCHAR(100) NOT NULL,
                 custodial          INTEGER      DEFAULT 0,
                 auto_approve       INTEGER      DEFAULT 0,
                 move               INTEGER      DEFAULT 0,
                 priority           VARCHAR(10)  DEFAULT 'Low',
                 subscribed         INTEGER      DEFAULT 0,
                 phedex_group       VARCHAR(100),
                 delete_blocks      INTEGER,
                 dataset_lifetime   INTEGER      NOT NULL DEFAULT 0,
                 PRIMARY KEY (id),
                 CONSTRAINT uq_dbs_dat_sub UNIQUE (dataset_id, site, custodial, auto_approve, move, priority)
               )]

I deployed a replay with WMCore 2.0.2.patch2 + PR11115 + Commit63d99e and the replay finished without issues. I checked the container rules created by T0 for subscriptions to disk and the rules have the proper lifetime.

@jhonatanamado thank you very much for testing this in a replay! I fixed the order of those constraints in my second commit. It also has a fix further data type checks, as requested by Valentin and Todor. Please have another look at it.

I confirm that Oracle-based Jenkins tests are happier now, while the previous order of constraints was causing 92 new tests to fail.

Since you mentioned several times that some values are validated upstream please put appropriate comment to the code about these checks. It would be useful to know why some values you check and others do not.

I understand your request, but bear in mind that EVERY single workflow parameter is actually validated by WMSpec/StdSpecs specs. If we do so, then we should do it for 100s of files that are using/setting workflow related parameters.
Instead, just give it some time and you will get to know what those parameters are, but in short everything is defined in this super class:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/WMSpec/StdSpecs/StdBase.py#L968

BTW, these latest changes have also been tested with oracle jenkins.

@vkuznet Valentin, I just added a docstring string and further comments on the parameters/validation. However, as stated above, every workflow-related information that goes to the relational database is validated beforehand and IMO adding such comments to 1 DAO out of hundreds won't be of much help. Please have another look at your convenience.

Thank you Valentin and Todor. Given that it doesn't change anything in the central services, I'm merging it now.


Loader::sanitiseVariableValue() fails with quoted value containing backslash

Version used is "vlucas/phpdotenv": "^2.4"
I have this line in .env file :
PATH="C:\myPath"
$value parameter in Loader::sanitiseVariableValue() isstring '"C:\myPath"' (length=11)
Returned $value is still the same instead of expected string 'C:\myPath' (length=9)
This only happens if string contains backslash (i.e. Windows path), strings with slashes are well handled.
If I escape backslashes (PATH="C:\\myPath") returned $value is expected string 'C:\myPath' (length=9)

Same problem here on Win7 running php 5.6.24
Escaping the backslashes solves the problem.

Fixed by v2.6

Not so much fixed, it just allows it in undefined circumstances in previous versions. It's banned again in 3.x, but now with proper error messages.

2.6.1 fixed my issues with backslash


feat(dark-mode): Add dark mode

:star2: What does this PR do?

Add a dark mode toggle on the settings page
When enabled, make the settings page, browser popup and integration popups dark
Update the timer block slightly

:bug: Recommendations for testing

Turn it on and click around, is there anything that looks weird?

:memo: Links to relevant issues or information
Closes #1575

WHAT!!!!!!!!! DARK MODE! ?!?!?!?!?!? OMGOMGOMG

@tcrammond good catch, that flashing was horrible :frowning_face:
I've reworked the links in the settings page to just swap the active class around instead of loading a new page. It still flashes on first load, there's probably something we can do to block rendering until the value is resolved right? Is it worth bothering with?
Updated the icons to stand out a little more :+1:
I think it's better to let people define dark/light indepdendent of their system; mobile had a lot of people asking for exactly that and I expect we'd get the same (assuming people find out the feature exists :smile: )

Nice 👏

It still flashes on first load, there's probably something we can do to block rendering until the value is resolved right?

yeah, might be straightforward 🤔

@tcrammond now also storing dark mode value in localStorage (as it's not async) and fetching it before load :eyes:
we could put it inline in the settings file but that would require the inline script permission and i didn't want to do that :grimacing:

oh damn :cry: : window.matchMedia('(prefers-color-scheme: dark)').matches didn't work for me either but i thought it was just another :penguin: thing
i tried reproducing the flash a bit today but it's not doing that for me in chrome or firefox, not sure :thinking:
i hope someone else can pick this up, good luck guys :wave:

Pushed a commit to default to system-theme if no value is stored in Db solves the initial render flash for me.

Tested a bit, works better now @shantanuraj 🙌
I pushed a quick commit to fix a problem where: I would be running on the system dark preference, then toggle it to ON in settings, but the class would be removed - putting me in light mode . Please sanity check it
❓ After you toggle the setting to ON and then OFF, it will never use your system preference again because there is a non-null value for the setting. Should we pivot to use system preference / light mode / dark mode selection?

Opened new issue #1771 to tackle system-default theme preference. If you give it a 💚  I'll merge this one.

Could someone increase the contrast when hovering in the project dropdown list? When I'm choosing project in the projects list, I couldn't see which one I am selecting.

Hi @nmiquan I've created an issue at #1813 the team will look into it

@shantanuraj can we have the dark mode be enabled automatically? via system color scheme
i.e. activate when system dark mode is on and vice versa when dark mode is off?


Refresh token with HTTP GET method

Is there a option to use refresh token with GET method. As of now all refresh HTTP request are going through a POST, I am look to send refresh with GET and no body (My refresh API doesn't support the POST for refresh).

1


Animal tab doesn't display; error on click

I'm not sure what happened, but my animal tab no longer displays (even though it used to work), and I get this error in my log:
Root level exception in OnGUI(): System.NullReferenceException: Object reference not set to an instance of an object
  at BetterPawnControl.AnimalManager+<>c__DisplayClass6_0.<UpdateState>b__0 (BetterPawnControl.AnimalLink x) [0x00000] in <7db7a9c0c7c842c8bbd28e7598605eba>:0
  at System.Collections.Generic.List`1[T].FindAll (System.Predicate`1[T] match) [0x00013] in <567df3e0919241ba98db88bec4c6696f>:0
  at BetterPawnControl.AnimalManager.UpdateState (System.Collections.Generic.List`1[T] links, System.Collections.Generic.List`1[T] pawns, BetterPawnControl.Policy policy) [0x0001f] in <7db7a9c0c7c842c8bbd28e7598605eba>:0
  at BetterPawnControl.MainTabWindow_Animals_Policies.PreOpen () [0x00020] in <7db7a9c0c7c842c8bbd28e7598605eba>:0
  at Verse.WindowStack.Add (Verse.Window window) [0x0001f] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainTabsRoot.DMD<DMD<ToggleTab_Patch1>?66738048::ToggleTab_Patch1>(RimWorld.MainTabsRoot,RimWorld.MainButtonDef,bool)
  at RimWorld.MainButtonWorker_ToggleTab.Activate () [0x00005] in <b9022531d79047b2b6baad3f7d519f01>:0
  at RimWorld.MainButtonWorker.InterfaceTryActivate () [0x0004d] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainButtonWorker.DMD<DMD<DoButton_Patch0>?-1308741760::DoButton_Patch0>(RimWorld.MainButtonWorker,UnityEngine.Rect)
  at RimWorld.MainButtonsRoot.DoButtons () [0x0010c] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainButtonsRoot.DMD<DMD<MainButtonsOnGUI_Patch1>?98404992::MainButtonsOnGUI_Patch1>(RimWorld.MainButtonsRoot)
  at RimWorld.UIRoot_Play.UIRootOnGUI () [0x00037] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) Verse.Root.DMD<DMD<OnGUI_Patch1>?-1867099264::OnGUI_Patch1>(Verse.Root)
Verse.Log:Error(String, Boolean)
Verse.Root:DMD<DMD<OnGUI_Patch1>?-1867099264::OnGUI_Patch1>(Root)

I'm suspicious of https://github.com/voult2/BetterPawnControl/blob/master/Source/Managers/AnimalManager.cs#L145 - I think x.zone might be the null, because I have noticed that among all my animal mods I've managed to get some in state where no zone was selected before. I think this might be an interaction with the 'Area inclusion & exclusion' mod

It's not due to Area inclusion - I removed that to test, and the problem persists.

I cloned the project to open it in Rider, and looking at the source a bit more carefully, it seems like more likely the problem is that one of the AnimalLink values in the links argument is null.
If so, this might help; I'll try to figure out how to build and test on my world locally
-            //get all links from the current map
-            mapLinks = links.FindAll(x => x.mapId == currentMap);
-            //get all links from the selected zone
-            zoneLinks = mapLinks.FindAll(x => x.zone == policy.id);
+            //get all links from the current map
+            mapLinks = links.FindAll(x => x != null && x.mapId == currentMap);
+            //get all links from the selected zone
+            zoneLinks = mapLinks.FindAll(x => x != null && x.zone == policy.id);

OK, I was able to confirm that AnimalManager.links contains a null value by having PreOpen for the tab invoke PrintAllAnimalPolicies;
[BPC] ### List Animal links [67] ###
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal: Cow69680  Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:1  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:1  Animal: Cow69680  Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal: Dromedary29608  Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:1  Animal: Dromedary29608  Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:1  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:1  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area: RimWorld.Area_Home  FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal:   Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
[BPC]	Policy:0  Animal: Cow151497  Master:   Area:   FollowDrafted: False  FollowFieldwork: False  MapID: 0
Root level exception in OnGUI(): System.NullReferenceException: Object reference not set to an instance of an object
  at BetterPawnControl.AnimalManager.PrintAllAnimalPolicies (System.String spacer) [0x00126] in <6c6ec8003e37446fbc185f6a5ee0140b>:0
  at BetterPawnControl.MainTabWindow_Animals_Policies.PreOpen () [0x0000e] in <6c6ec8003e37446fbc185f6a5ee0140b>:0
  at Verse.WindowStack.Add (Verse.Window window) [0x0001f] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainTabsRoot.DMD<DMD<ToggleTab_Patch1>?-2069195392::ToggleTab_Patch1>(RimWorld.MainTabsRoot,RimWorld.MainButtonDef,bool)
  at RimWorld.MainButtonWorker_ToggleTab.Activate () [0x00005] in <b9022531d79047b2b6baad3f7d519f01>:0
  at RimWorld.MainButtonWorker.InterfaceTryActivate () [0x0004d] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainButtonWorker.DMD<DMD<DoButton_Patch0>?-1203342208::DoButton_Patch0>(RimWorld.MainButtonWorker,UnityEngine.Rect)
  at RimWorld.MainButtonsRoot.DoButtons () [0x0010c] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) RimWorld.MainButtonsRoot.DMD<DMD<MainButtonsOnGUI_Patch1>?952941952::MainButtonsOnGUI_Patch1>(RimWorld.MainButtonsRoot)
  at RimWorld.UIRoot_Play.UIRootOnGUI () [0x00037] in <b9022531d79047b2b6baad3f7d519f01>:0
  at (wrapper dynamic-method) Verse.Root.DMD<DMD<OnGUI_Patch1>?1404324992::OnGUI_Patch1>(Verse.Root)

I notice also that in DataManager.ExposeData there's some code that looks like it was intended to handle this, but is commented out.


Use data binding instead of view binding

See chapter 13 of HFAD

Done for main fragment, will see for stations search one


ghq.root should be able to be specified on a per URL basis

If we're using conditional includes in the global gitconfig (like this example), any git commands run in different directories may have invalid responses.
It would be very useful if (in conjunction with #109) you could specify a the git.root inside the VCS config block and then use that to cd before any other commands.
Example:
# .gitconfig-work
[url "git@gitlab.mycompany:"]
  insteadOf = gl:
  insteadOf = ssh://gl/
  insteadOf = https://gl/

# .gitconfig
[includeIf "gitdir:~/code/work/"]
  path = .gitconfig-work

[ghq "gl:"]
  root = ~/code/work

Implemented at #228 and released as v0.17.0.
Try it. Thanks!


mon: refactor of mgr key fetching

There is no need to stat for created mgr keyrings since they are created
anyway when deploying a ceph cluster > jewel.
We won't enter the block if ceph release is prior to luminous.
Signed-off-by: Guillaume Abrioux<EMAIL_ADDRESS>

jenkins test luminous-ansible2.4-centos7_cluster

jenkins test luminous-ansible2.4-docker_cluster

jenkins test luminous-ansible2.4-docker_cluster_collocation

jenkins test luminous-ansible2.4-ooo_collocation

jenkins test luminous-ansible2.4-xenial_cluster

jenkins test luminous-ansible2.4-xenial_cluster

jenkins test luminous-ansible2.4-xenial_cluster


Style/RedundantBegin causes syntax errors in Rake tasks

The Style/RedundantBegin can introduce a syntax error to a Rake task
Rake task is as follows:
$ cat lib/tasks/example.rake
desc 'An example Rake task'
task :example do
  begin
    puts "Hello there!"
  rescue
    puts "Oh no!"
  end
end

Expected behavior
Rubocop does not correct the file
Actual behavior
$ ruby -c lib/tasks/example.rake
Syntax OK
$ rubocop --only Style/RedundantBegin -a lib/tasks/example.rake
Inspecting 1 file
C

Offenses:

lib/tasks/example.rake:3:3: C: [Corrected] Style/RedundantBegin: Redundant begin block detected. (https://github.com/rubocop-hq/ruby-style-guide#begin-implicit)
  begin
  ^^^^^

1 file inspected, 1 offense detected, 1 offense corrected
$ ruby -c lib/tasks/example.rake
lib/tasks/example.rake:5: syntax error, unexpected keyword_rescue, expecting keyword_end
  rescue
        ^
lib/tasks/example.rake:8: syntax error, unexpected keyword_end, expecting end-of-input

Steps to reproduce the problem
See above
RuboCop version
$ rubocop -V
0.67.2 (using Parser <IP_ADDRESS>, running on ruby 2.6.3 x86_64-darwin18)

I was unable to reproduce the issue using RuboCop master and Ruby 2.6.3. The corrected code appears to have the correct syntax for me.
task :example do
  puts 'Hello there!'
rescue
  puts 'Oh no!'
end

As a sanity check, is the version of Ruby that you are using to check the syntax of the file the same version of Ruby that is being used with RuboCop? The error output looks like it comes from a version of Ruby prior to when implicit begins were added to blocks (I think 2.5 or 2.6).


Backend: User-specific newsblur.com email address to convert newsletters into RSS

From https://getsatisfaction.com/newsblur/topics/directing-email-newsletters-into-newsblur.
Need to figure out if it needs a big dialog with stats. Probably, as that would be ideal. Use mailgun to handle addresses.

Pretty sure you can close this now (http://blog.newsblur.com/post/146752875548/newsletters-in-your-newsblur). Thanks for the awesome feature! :smile:

Thanks for reminding me.


Add iana-etc as runtime dep for fping

fping code uses getprotobyname() library call
which rely on /etc/protocols as protocols database.
https://linux.die.net/man/3/getprotobyname
/etc/protocols is provided by iana-etc pkg.
Signed-off-by: Eric Desrochers<EMAIL_ADDRESS>
Merge Checklist

All boxes should be checked before merging the PR (just tick any boxes which don't apply to this PR)

[ ] The toolchain has been rebuilt successfully (or no changes were made to it)
[ ] The toolchain/worker package manifests are up-to-date
[ ] Any updated packages successfully build (or no packages were changed)
[ ] Packages depending on static components modified in this PR (Golang, *-static subpackages, etc.) have had their Release tag incremented.
[ ] Package tests (%check section) have been verified with RUN_CHECK=y for existing SPEC files, or added to new SPEC files
[ ] All package sources are available
[ ] cgmanifest files are up-to-date and sorted (./cgmanifest.json, ./toolkit/tools/cgmanifest.json, ./toolkit/scripts/toolchain/cgmanifest.json, .github/workflows/cgmanifest.json)
[ ] LICENSE-MAP files are up-to-date (./SPECS/LICENSES-AND-NOTICES/data/licenses.json, ./SPECS/LICENSES-AND-NOTICES/LICENSES-MAP.md, ./SPECS/LICENSES-AND-NOTICES/LICENSE-EXCEPTIONS.PHOTON)
[ ] All source files have up-to-date hashes in the *.signatures.json files
[ ] sudo make go-tidy-all and sudo make go-test-coverage pass
[ ] Documentation has been updated to match any changes to the build system
[ ] Ready to merge

Summary

What does the PR accomplish, why was it needed?
Change Log

Change
Change
Change

Does this affect the toolchain?

YES/NO
Associated issues

#xxxx

Links to CVEs

https://nvd.nist.gov/vuln/detail/CVE-YYYY-XXXX

Test Methodology

Pipeline build id: xxxx

Looks good, running an internal buddy build to verify the change.


have search term for ActivityId

as an extension to #163 where we ask for the ability to filter for content of the event XML, you could also have a specific ActivityId filter like you filter for description. This would make it easier to do GP operational and WDAC event analysis.
yeah, total luxury.

CorrelationID field is similar to this ask and one we use heavily for reviewing logs for AD FS. We then need to correlate a transaction of interest via this field to narrow down the log entries of interest as per https://learn.microsoft.com/en-us/windows-server/identity/ad-fs/troubleshooting/ad-fs-tshoot-logging#correlating-events . We currently dont see this at all in eventlog expert and would love to be able to do this filtering in a future release.


Enable hit debugger push in Assurance

Enable hit debugger push in Assurance by adding X-Adobe-AEP-Validation-Token to the request header.
Also removed p.debug=true in the call which is no longer needed.
Here is a screenshot of the request header for trackAction with Assurance is enabled in the app.  X-Adobe-AEP-Validation-Token is added in the header.  When Assurance is not enabled, it won't be sent with the header.

HitDebugger Hits we got after the feature

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] I have signed the Adobe Open Source CLA.
[ ] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

Can you paste the headers or Charles screenshot showing the headers?

We are able to see hitDebugger responses right?

Yes, I attached the Assurance Event View with the hitDebugger response.


Pin python requirements

Use semi-automatic process of determining existing stable python dependencies and manually updating requirements.txt file.

Looks good. However, could you briefly explain how this works and the use of these files:

Also, is there anyway we could run this command without sudo?

Note: Comment out bin script to use as reference, rest is fine to merge.

Note: Comment out bin script to use as reference, rest is fine to merge.

This should be ready to go now.


DCOS-14854: Remove edit link on service config page

This PR is the same as this: https://github.com/dcos/dcos-ui/pull/2075, it just backports it to relase 1.9 branch.
PR #1957 wrongly added onEditClick to this view. This PR reverts that effort and adds a test to guard against it
Checklist

[x] Did you add a JIRA issue in a commit message or as part of the branch name?
[x] Did you add new unit tests?
[ ] Did you add new integration tests?
[ ] If this is a regression, did you write a test to catch this in the future?

Yep, looks great! :ship:


Add GraphQL Support

It would be interesting to set up GraphQL on the backend and frontend so it is easy to get started with.

99d796177ff0d5190f6a08c53f44538c682dd320


Update sbt-wartremover, wartremover to 2.4.19

Updates

org.wartremover:sbt-wartremover
org.wartremover:wartremover

from 2.4.16 to 2.4.19.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.wartremover" } ]

labels: library-update, early-semver-patch, semver-spec-patch, commit-count:1

Superseded by #136.


Can't debug OpenApiParser.resolve

Thanks for this great API explorer tool. We are building an API builder tool and use RAPI to show the API spec. Now we are stuck at RAPI page when the query contains a deep nested and circular param.
So I decide to debug RAPI source code. The code now stuck at file spec-parser.js and line 13
specMeta = await OpenApiParser.resolve({ url: specUrl, allowMetaPatches: false });

But the @apitools/openapi-parser library's Github url is 404 now, I can't debug the source code. I found the repo is published by @mrin9 , please help.

I think this is related to https://github.com/rapi-doc/RapiDoc/issues/720

I am sorry @apitools/openapi-parser is a closed source and there are contributions from other committers who would not like to open it up. You may use your choice of OpenAPI resolver and resolve your spec and then submit an OpenAPI compliant spec to RapiDoc


Samsung Internet does not get polyfilled

Samsung Internet (Beta, based on Blink 537.36, with user agent advertising it as a Chrome/51.0.2704.106...among other things) still has the 300ms delay (tested on a page with width=device-width https://patrickhlauke.github.io/touch/fastclick/fastclick.html where Samsung Internet currently doesn't magically optimize the 300ms delay away like real Chrome etc do)

This is probably falling foul of https://github.com/ftlabs/fastclick/blob/master/lib/fastclick.js#L754-L761. This isn't really something that can be feature-detected, so we rely on UA parsing, which doesn't work in this case.
I might have time to look at this this week.

super, thank you (in parallel, i think Samsung folks are looking at this from their end as well https://twitter.com/jungkees/status/841072959754199041)


Support FrameSet mdoc files

Hi Alister,
thanks for making all our lives so much easier again (No more hacking the configparse module 🥳). This PR:

Adds support for the mdoc files saved together with movies
Adds two test files (for single exposure and multiple exposure files)
I had to set StagePosition in the MdocSectionData model to Optional, since its not included in the ZValue sections of multiple exposure movies.

Happy to make any changes you want.
Best,
Johannes

thanks for making all our lives so much easier again (No more hacking the configparse module 🥳)

😊 really glad you find these things useful - I didn't know about configparse actually, thanks for the tip!

This PR

Awesome - thanks so much for contributing! I've added FrameSet to the MdocSectionData model to mirror what I did with MontSection, PR over at jojoelfe/mdocfile#1, happy to merge here once that's in!


Session hang after 5min (approx) on Android devices

I have a server written in javaee with the session maxIdleTimeout() set to 0 so it remind open.
I run successfully an android client (using this library) on my emulator, as a simple java client on my local machine connecting to the websocket server. The TCP channel remind open until any of the two peers shut it down explicitly.
However the session hang after 5min (approx) as soon as the client run on a remote device.
Any idea about what's happening here?

Hello @poly-sb,
to be honest right now I have no idea what is happening there.
Could you provide me with some additional information:

On what android version does this happen?
On what device does this happen?
Any other things which may help me understand this problem?

Greetings
marci4

Hi @marci4
Thanks for your time.
We can close this issue since it's not related to your library.
I realised lastly that the device I used was triggering the broadcast receiver "android.net.conn.CONNECTIVITY_CHANGE" service provided by android every 5 min, even on stable network connectivity.
This was triggering some code which in turn reloaded the WebSocket.


feat: use fastdatatable for 1000x speedup

closes #181

failure is motherduck-related. annoyingly can't use the same duckdb version on all platforms at the moment.


Update README.md with Youtube link

This adds a Youtube video including preview

Let's merge this for now. We can update the README with a new video later.

Lets raise an issue about making a new video

@ShalokShalom here is a more up-to-date video: https://www.youtube.com/watch?v=Dv7cKDdNu1o
It's different, a very short overview without any explanation. Then there is also the GodotCon 2024 presentation: https://www.youtube.com/watch?v=EJDNYFha9GY


Action description for deleted images is empty

Description
When a user deletes an image the response is  "ACTION deletes:" instead of being something like,  "ACTION deletes: URL_Of_Image"
The same happens for deletion of own images.
Steps to reproduce

start a private conversation
other user uploads an image
3.other user deletes the same image
observe server reply with "ACTION deletes: "

Expected behavior
Server would reply with "ACTION deletes:  https://files.slack.com/files-... .png"
Client setup

IRC client and version: master#ab64a87908ca1de5cdcb0fd07057e57dbf8f4285

Thank you @zezadas


[0.9.3 rc-2] every http write is failing for me

I upgraded to rc2 and every http request has started to timeout. The data that I'm sending was the exact same I was sending in rc1 which wrote fine.
I can't even do the requests from the docs
curl -G http://server:8086/query --data-urlencode "q=CREATE DATABASE mydb"

This seems to have magically fixed itself by doing a force reinstall. I'm going to close for now.


OP - Improve shopping list

Edited gitignore
Improved readability/removed redudant code in AppStack.js, Household.js, and HomeScreen.js
Made household picker a drop down instead of a modal
Moved adding item to shopping list feature to a modal that opens with 'Add Item' button
Made UI consistent with rest of app

NOTE: UI For split functionality is not yet consistent. This is because I plan on moving this functionality to the add item modal.
Closes #133 #135

UI looks consistent, LGTM after testing the PayPal functionality


Removal of selected rows does not trigger rowSelectionChanged

If a selected row in gridOptions.data is slice()'d out, the grid properly removes it, but does not fire rowSelectionChanged, which seems reasonable, even if there are other events that do fire.

Misreferenced this from the above commit.

I don't think we can reasonably implement this.  The responsibility falls on the caller who manipulates the data to do any tidyup that is appropriate in their use case before manipulating the data.

Poor form? Responsibility fails on the caller? How about, lazy?

Or you could call in the order suggested - remove the selection before removing the row.
Feel free to submit a PR if you'd like this to be different, but calling someone lazy for not doing something that you want when you're not prepared to do it yourself seems somewhat hypocritical.


Switch the translation based on the device's language settings when opening the timetable detail screen

Currently, Japanese is displayed regardless of the device's language settings. It would be more convenient if, when English is set, the session descriptions and other elements are switched to English from the start. Additionally, for languages other than Japanese and English, it would be preferable if they are switched to English.

:raising_hand:

@mangano-ito Thanks! Assigned!

A more useful feature has been proposed in https://github.com/DroidKaigi/conference-app-2024/issues/748, and a PR has already been merged.
Therefore, we will close this issue. Thank you.


Fixed a typo on Table Expressions page

Fixes #7674.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/c0e9f2dd5f7c28fda5836f9a1716ae9fcb54022c/


AMBARI-23234. Issue with zeppelin after upgrade (dlysnichenko)

@## What changes were proposed in this pull request?
I performed the express upgrade to latest fenton build which has the fix for AMBARI-23113
Observed below issues after upgrading cluster from ambari-<IP_ADDRESS> with <IP_ADDRESS>-129 to ambari-<IP_ADDRESS>-96+HDP-<IP_ADDRESS>-162

Interpreter settings are not stored in HDFS. '/user/zeppelin/conf/interpreter.json' doesnt exist in hdfs.

Notebook authorisations are not stored in HDFS '/user/zeppelin/conf/notebook-authorization.json' doesnt exist in hdfs.

Look at the interpreter page on Zeppelin and see that there are duplicate interpreters

Previously created notebooks are not copied into hdfs.
found root cause, there is no property"zeppelin.config.fs.dir" = "conf" in zeppelin-config. After i've added it, "conf" directory was created in HDFS and interpreter.json was there. Also tested zeppelin, it really using this interpreter.json from HDFS. Looks like it works fine. For fresh install it will work fine because "zeppelin.config.fs.dir" by default is added to zeppelin 0.7.0 (zeppelin-config) but for upgrade we also should add this property.
zeppelin.config.fs.dir should be added from 2.6.3

How was this patch tested?
live cluster deployment.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1143/
Test FAILed.
Test FAILured.

Fixed according to clarifications from component team

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1156/
Test FAILed.
Test FAILured.

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/1166/
Test PASSed.


Support for version information and update of adapters

At the moment supported adapters can be installed by clicking a menu item and an empty/full circle indicates if an adapter is installed.
To update an adapter to a newer version one needs to remove the folder from your plugins data/debug_adapters folder and reinstall it via the menu.
I would suggest showing the actual installed version of an adapter in the text of the according menu item, and a click on an already installed adapter should check and update the adapter if appropriate, maybe after an info dialog with version information. Alternatively the click could just remove and reinstall the adapter.
Also or instead an update command could be useful which updates or reinstalls all already installed adapters.

Adapters should be able to be reinstalled by installing them again. There was a bug on Windows where some (notable vscode-python) could not be deleted because it has files with really long paths which was fixed in 9a1881c54e5387916aaae7f92957b73d9ab5fcce but that isn't on package control.
Displaying the version should be fairly easy it can get extracted from the package.json file
I think checking for updates is probably more work than it's worth at this point. It would need to be done for both adapters downloaded from Microsoft and the ones that have platform specific implementations that need to be downloaded from Github releases.

https://github.com/daveleroy/sublime_debugger/commit/3a693cf2cd2ef7b8695ac06ca47650b79b5281cc now shows the version next to an installed adapter.
Maybe an Update (reinstall) All Adapters should be added that downloads and reinstalls all the ones you have installed


avoid memory allocation during reconstruct if possible

This change checks whether a missing shard has enough capacity to avoid
allocating a new shard. If so an memory allocation is avoided.
Update doc to explicitly document behavior.
Fixes #67

Thank you. I merged #66 instead since it included a test.


Set min fee rate on create atomic txns wrapper and fix comment

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#1261  👈
#1260
#1259
#1258
#1256
#1252 : 1 other dependent PR (#1255 )
#1253
feature/proof-of-stake

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @lazynina and the rest of your teammates on  Graphite


Xcode plugin: use regexp to find projects or workspaces

In a project I'm working on, there are xcconfigs files in the project's root directory, which means that
using the xc alias finds and opens the first one instead of the workspace or the project.
Using grep with a regexp fixes this.

Is there anything I can do to get this PR merged?

As is now, the xc function shouldn't even be working, since ls only lists by default non-hidden files (those beginning with a dot are hidden). Are you sure this works?

Yes I'm using it right now. Be don't care about hidden files, the one we care about (project/workspace) aren't hidden.

Ok, this must be a particularity of OSX then, in Linux all files and folders beginning with a dot are hidden. Ok then, I can confirm that using this fix the .xcodeproj file will be selected instead of the .xconfig file:
$ ls -A
.xcodeproj  .xconfig
$ ls -A | grep "\.xc" | sort -r | head -1
.xconfig
$ ls -A | grep -E "\.(xcworkspace|xcodeproj)" | sort -r | head -1
.xcodeproj

and it will also prevent other .xc* files from being selected instead.
That said, a native zsh solution is preferred and if we're gonna fix it, let's fix it right. We can substitute the whole thing for just:
print -nl .{xcworkspace,xcodeproj}(N) | head -1

UPDATE: we could do it better by removing the print and using zsh arrays, like in this answer from stackoverflow. And while we're at it we will localize the xcode_proj variable.
Here's a diff ready to apply:
diff --git a/plugins/xcode/xcode.plugin.zsh b/plugins/xcode/xcode.plugin.zsh
index 1d1205b..82fe0e9 100644
--- a/plugins/xcode/xcode.plugin.zsh
+++ b/plugins/xcode/xcode.plugin.zsh
@@ -1,12 +1,12 @@
 #xc function courtesy of http://gist.github.com/subdigital/5420709
 function xc {
-  xcode_proj=`ls | grep "\.xc" | sort -r | head -1`
-  if [[ `echo -n $xcode_proj | wc -m` == 0 ]]
-  then
+  local xcode_proj
+  xcode_proj=(.{xcworkspace,xcodeproj}(N))
+  if [[ ${#xcode_proj} -eq 0 ]]; then
     echo "No xcworkspace/xcodeproj file found in the current directory."
   else
-    echo "Found $xcode_proj"
-    open "$xcode_proj"
+    echo "Found ${xcode_proj[1]}"
+    open "${xcode_proj[1]}"
   fi
 }

Also, you can go ahead and put Fixes #3259 in your PR description to autoclose PR #3259.

Shouldn't this be closed due to #4235 being merged?

Yes thank you.


angular-histogram-slider

hi,
I am working on an angular 11 project. can I use this component in it? if so, how?
else, there is a angular-histogram-slider @0.0.1 package
https://www.npmjs.com/package/angular-histogram-slider
but I have no clue how to use it. pl help

Hello,
sorry this component does not work with modern Angular (Angular 2 and newer).
It only works with deprecated AngularJS (Angular 1.8.3).


Directional loss without templates

Hi all. I noticed that by default the prompts that will be used to compute the text direction are composed based on a template. This generates a lot of directions and the mean is then used. This behaviour is not documented in the paper, am I missing something? Can I obtain the same results by only using two prompts (source and target) like described originally?

Hey,
We added the templates following their use in StyleCLIP (which motivate them through the improved classification accuracy these templates give in the original CLIP paper). In practice I can't really say the difference was meaningful. You should be able to remove them with minimal or no impact on results.

I'm experimenting without the templates and can confirm thay they have very little impact on the results! Thank you and awsome project by the way.


KAFKA-2502 - Documentation for quotas

Followed the approach specified here: https://issues.apache.org/jira/browse/KAFKA-2502
I also made a minor fix to ConfigCommand to expose the right options on add-config.

Thank you, Aditya. Very well written and comprehensive.
Left two minor comments.

awesomeness! LGTM.


Disable Program and Shader copy

I was having trouble getting programs to link, and the issue lies in Shader copies prematurely deleting the OpenGL Shader object when their destructor was called. To avoid this problem in the future, it is necessary to disable copying of these classes.
I also fixed a minor issue where the wrong OpenGL function was called to get the Program compilation errors.

I changed the Program class to receive its shader vector by reference, to avoid copying of shaders.
Now, I am trying to find a way to use the shaders in vectors, with the copy operation disabled. I am attempting to implement a move constructor for the shader class in order to fix this. However, since the id of the shader is defined as const, this is proving to be difficult. Perhaps if there was a way to disable the constructor of the other object, but I cannot find one as of now.

I've implemented the move functions for the Shader class. However, to do this I had to remove the const attribute of some of its variables, as I must set the OpenGL pointer to 0 whenever a Shader object is moved.
It should be functional as of now, however.

I've added tests for the shader copy operator and constructor. In them, I check if the values of a shader have been correctly copied. I would also like to check if the OpenGL objects are correctly deleted, but I am unsure of how to achieve this, although I have tested this manually.

I've added tests for the program class, which are functionally very similar to the ones used for the Shader class.

I've added what is necessary in order to find shader uniforms, attempting to save the time it takes OpenGL to find a uniform by using a map of strings and ints, which stores known uniform locations, thus eliminating the need to use glGetUniformLocation more than once per uniform.


GPG article

A few general comments:

Add link to the official gpg site in case users want to find out more information
Add a link to the gpgport release or describe how to download it using zopen

Otherwise, looks great!


build the project with error on OSX : error: please install uuid library

hey guys .
I try to build this project ,but with some error and I cant fix .
pls help me . thanks!
I just run ./configure command .
and show me message like this :
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... none
checking for g++... g++
checking whether we are using the GNU C++ compiler... yes
checking whether g++ accepts -g... yes
checking dependency style of g++... none
checking for main in -lpcre... yes
checking for main in -luuid... no
configure: error: please install uuid library

OS : OSX 10.10.4

I cant find like uuid-dev or libuuid with brew tool .

@forfuns I myself have only recently started working with a build on OSX, and here's what I did to get the basics built. You do need to be specific with the ./configure directives.
https://github.com/aol/moloch/wiki/OSX-build


No repo found plz help

No repository found at https://dl.bintray.com/thymeleaf/downloads/thymeleaf-extras-eclipse-plugin/3.0.0/update-site/.

Hi there, you might have to try again.  Bintray is currently performing service brown-outs during this period, and we're still using bintray to resolve the Eclipse plugin artifacts:

April 12th, 26th, 2021
We will have some short service  brown-outs to remind users about the services that are going away on May  1st. (Specific hours will be advertised in the Bintray status page.)

https://jfrog.com/blog/into-the-sunset-bintray-jcenter-gocenter-and-chartcenter/
We've got an open issue to move these artifacts out of Bintray: #102

Artifacts have now been moved out of Bintray


TypeError: type.getFields is not a function

Getting this error when running gql2ts from an introspection query:
$ get-graphql-schema http://localhost:3080/.api/graphql --json | gql2ts -o gqlschema.d.ts
/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:123
        const f1 = type.getFields();
                        ^

TypeError: type.getFields is not a function
    at typeToInterface (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:123:25)
    at typeArr.filter.filter.map.type (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:159:26)
    at Array.map (native)
    at typesToInterfaces (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:159:14)
    at run (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:165:12)
    at Object.exports.schemaToInterfaces (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:167:73)
    at Object.exports.generateNamespace (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:170:85)
    at run (/Users/felix/.../node_modules/gql2ts/dist/index.js:39:35)
    at Socket.process.stdin.on (/Users/felix/.../node_modules/gql2ts/dist/index.js:55:35)
    at emitNone (events.js:91:20)

This started happening after I added a union type. Could that be related?

@felixfbecker hmm, possibly. would you be able to give me a schema to reproduce with?

Sure schema.json.zip
I got it through introspection with https://github.com/graphcool/get-graphql-schema

awesome, thanks. taking a look now

cool, i've reproduced it. strangely enough it's because the string type is returning false for instanceof GraphQLScalarType.
looking trying to see why this is happening

@felixfbecker published 1.1.3, it should be fixed in there!

Still happening in 1.2.0 :(

><EMAIL_ADDRESS>graphql /Users/felix/...
> get-graphql-schema http://localhost:3080/.api/graphql --json | gql2ts -o gqlschema.d.ts

/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:126
        const f1 = type.getFields();
                        ^

TypeError: type.getFields is not a function
    at typeToInterface (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:126:25)
    at typeArr.filter.filter.map.type (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:162:26)
    at Array.map (<anonymous>)
    at typesToInterfaces (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:162:14)
    at run (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:168:12)
    at Object.exports.schemaToInterfaces (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:170:73)
    at Object.exports.generateNamespace (/Users/felix/.../node_modules/@gql2ts/from-schema/dist/index.js:173:85)
    at run (/Users/felix/.../node_modules/gql2ts/dist/index.js:39:35)
    at Socket.process.stdin.on (/Users/felix/.../node_modules/gql2ts/dist/index.js:55:35)
    at emitNone (events.js:110:20)

weird, i just ran it with the schema.json w/o errors
 ~/Downloads gql2ts -V
1.2.0
 ~/Downloads cat schema.json | gql2ts -o gqlschema.d.ts
 ~/Downloads

and here's the schema that gets uploaded:
gqlschema.d.ts.zip
could you check that the version is in fact updated? you can run gql2ts -V to get the running version

Yeah, checked the version. Weird. Maybe the schema changed?
schema.json.zip

Appreciate your help!

Can you check the version of @gql2ts/from-schema? It should also be 1.2.0

yup
└─┬<EMAIL_ADDRESS>  └──<EMAIL_ADDRESS>

hmm, the new one is still working for me
just for completeness sake, can you double check that the package.json lists 1.2.0 for both modules?
maybe try clearing node_modules and reinstalling?
super weird...

Hmm, npm info doesn't show<EMAIL_ADDRESS>19:19 $ npm info @gql2ts/from-query
{ name: '@gql2ts/from-query',
  description: 'generate typescript interfaces from a graphql schema and query',
  'dist-tags':
   { latest: '1.1.2',
     canary: '1.0.2-alpha.50a85222',
     next: '1.0.0-alpha.7' },
  versions:
   [ '0.6.0-alpha.0a7dd353',
     '0.6.0-alpha.113744b9',
     '0.6.0-alpha.52a568e6',
     '0.6.0-alpha.7c8d6c0a',
     '0.6.0-alpha.93b48d62',
     '0.6.0-alpha.a12f0f66',
     '0.6.0-alpha.cca3df5d',
     '1.0.0-alpha.0',
     '1.0.0-alpha.1',
     '1.0.0-alpha.2',
     '1.0.0-alpha.3',
     '1.0.0-alpha.4',
     '1.0.0-alpha.5',
     '1.0.0-alpha.7',
     '1.0.0',
     '1.0.2-alpha.50a85222',
     '1.0.3',
     '1.1.1',
     '1.1.2' ],

It's also not listed here: https://www.npmjs.com/package/@gql2ts/from-query

Oh sorry, from-schema. That's definitely at 1.2.0, checked the package.json

Note that the stack trace now has a different line number

yep just noticed that, definitely looks like it's the right version.
can you get me the version installed for graphql as well?

$ npm ls graphql
├─┬<EMAIL_ADDRESS>│ └──<EMAIL_ADDRESS>└─┬<EMAIL_ADDRESS>  └─┬<EMAIL_ADDRESS>    └──<EMAIL_ADDRESS>
I confirmed that the packages are correctly exactly as npm ls says

Does it still work when you install get-graphql-schema? That package has a dependency on<EMAIL_ADDRESS>(which resolves to 0.9.6), but it seems like @gql2ts/from-schema needs ^0.10.1. The problem is that @gql2ts/from-schema doesn't declare this dependency, only @gql2ts/util. So @gql2ts/util will get its own node_modules folder with<EMAIL_ADDRESS>but @gql2ts/from-schema when requiring graphql will resolve to the top-level<EMAIL_ADDRESS>installed by get-graphql-schema.
There are a lot of caveats with using instanceof with classes from other packages because it will return false for different package versions of the same class. It's better to do other checks, like calling is* methods or duck-typing type guards (not sure what is applicable here)

yeah, i realized that, so it's not only doing instanceof.
it also checks for the _scalarConfig see https://github.com/avantcredit/gql2ts/blob/master/packages/from-schema/src/index.ts#L48
let me see if 0.9.6 has something different i can check for

Can't you make sure that it uses the correct graphql version instead? Could you add it as a dependency to from-schema? I feel like any other approach is prone to break again in the future

sure that works. seems like the issue is 0.9.x doesn't support getFields on unions, so that's the issue

@felixfbecker 1.2.1 has versions pinned

awesome, works now! Thanks a lot!


Added rockylinux-9 to chef-foundation

Description

Related Issue

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Chore (non-breaking change that does not add functionality or fix an issue)

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] I have run the pre-merge tests locally and they pass.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.
[ ] All commits have been signed-off for the Developer Certificate of Origin.

test logs : https://buildkite.com/chef/chef-chef-foundation-main-omnibus-adhoc/builds/133 - paased


CodeSynthesis XSD package

I'm not sure if it's possible at all, but it would be really good to have a package for https://codesynthesis.com/projects/xsd/ in the repository.

We can’t reopen this issue until a PR is opened, unfortunately, consider making a pull request!


"The getter 'element' was called on null" from analysis server

Exception from analysis server (running from VSCode / Dart Code)
What I was doing
I was editing the file below - I was typing of backspacing on the second to last line (where the => is - I was typing the function syntax badly). I seem to be able to reproduce it semi-randomly be typing/removing characters around there.
// Before blank line

// After blank line

/// This is my class.
class MyClass {
  /// This is my num field.
  num myNumField;

  /// This is my num getter.
  int get myNumGetter => 1;

  /// This is my num setter.
  set myIntSetter(int value) {}

  /// This is my class constructor.
  MyClass();

  /// This is my class named constructor.
  MyClass.named();

  /// This is my void returning method.
  void myVoidReturningMethod() {}

  /// This is my string returning method.
  String myStringReturningMethod() {
    return "";
  }

  /// This is my method taking a string.
  void methodTakingString(String a) {}

  methodTakingFunction(Function(String) => )
}

Versions

Dart SDK 1.24.3
Visual Studio Code 1.20.1
Dart Code 2.9.0

Analyzer Info
The analyzer was launched using the arguments:
/Users/danny/Dev/dart/latest/bin/snapshots/analysis_server.dart.snapshot
--client-id=Dart-Code.dart-code
--client-version=2.9.0
--preview-dart-2

Exception
Analysis failed: /Users/danny/Dev/Dart-Code/test/test_projects/hello_world/lib/everything.dart context: exception_20180226_211052_835
NoSuchMethodError: The getter 'element' was called on null.

I noticed that it's reporting the version as "Dart SDK 1.24.3". That's really old; you might want to run a "2.0.0-dev" release.

Oh wow, my bad! I still have the stable versions on my PATH and then send to switch on various projects - this was the first time I was editing Dart inside of the Dart Code codebase so it wasn't set. Thanks for pointing it out! =D


As a user, I want the DCA Bot run as a Test Bot on the Private Testnet for end-to-end testing

Background
We want to move the private testnet to be able to automatically run tests of one bot on network start so that we will be able to test the deployment of bot Cosmwasm and Vyper contracts and run the actually test of a transaction.  We propose to select the DCA bot as the bot for automated testing.
Done when

[x] Follow the DCA bot test instructions sequence as documented here: How to run DCA bot using pancakeswap
[x] Deploy the DCA Bot cosmwasm contract to Paloma's private testnet with this repo: https://github.com/VolumeFi/dca-bot-pancakeswap-cosmwasm
[ ] Run the DCA bot Python script  from within Ansible: https://github.com/VolumeFi/dca_bot_python_script
[x] Check for the transaction hash of a successful transaction

This is not run as part of the Ansible playbook, but I don't think it's needed for this task @taariq @ToasterTheBrave or do we want to run this every time we spin up the testnet? I think we can close this out.

as discussed on standup, we do want the DCA bot to be run every time we spin  up the testnet, so we have an end to end test integration test of one bot

moving last task into separate ticket


Migrate to user defined managed identity

Right now different managed identities are created for each object. they could share and role assignment could be simpler. Investigate and change if appropriate.

Completed


Epic: Move-Stable Row Ids

Motivation
When we compaction data files, the row id changes. This causes us to need to update the index files whenever we compact. When the index files are updated, it invalidates them in the cache, degrading query performance. If row ids were stable when rows were moved, this would not happen.
Scope
This epic makes row ids stable after moving. It does not make them stable after updates. Rows that are updated will be deleted and appended under new ids.
A future epic will cover "primary keys", which will be the point at which row ids will be stable after updates in addition to moves. This is kept out of scope for now to keep the workload of this manageable.
Design
In very simple terms:

Add row ids as auto-incrementing u64 id. The manifest will track max_row_id and assign in similar process as fragment ids are assigned during the commit loop.
Each fragment metadata will contain a small row id index. This index maps from row id to row address. (Row address is what we currently call _rowid.) In most cases, such as after an append, this will be a simple range of values (max_row_id + 1)..(physical_rows + max_row_id + 1).
~Deletion files will be superceded by tombstones contained in the row id index. This cuts down on total number of files to manage.~
A new feature flag will be introduced to make sure older readers don't try to interpret these new row ids.

Plan

[x] #2308
[x] Manifest changes for stable row id (feature flag + fields) #2363

Overwrite
Update
Create table

[x] Scan with row id and address https://github.com/lancedb/lance/pull/2441
[x] Take with stable row id https://github.com/lancedb/lance/pull/2447
[x] Create index, query (including prefilter) https://github.com/lancedb/lance/pull/2452
[x] Compaction and querying https://github.com/lancedb/lance/pull/2544

The following tasks have been moved into the Primary Keys epic:

[ ] Follow ups for stabilization

[ ] Replace custom bitmap implementation
[ ] Finalize serialization format
[ ] Optimize row id access given real benchmarks

[ ] External files and cleanup

Write out external files if large enough
Cleanup implementation

Week of August 12

[x] Benchmark prefilter performance with stable row id https://github.com/lancedb/lance/pull/2706
[x] Move on to #2454

Week of July 29
Compaction and querying is waiting on review.

[ ] Compaction and querying https://github.com/lancedb/lance/pull/2544

Closing this, and continuing work in the #2454 epic.


Scale EntityMembersListCard children based on thier container's width instead of the page width

Hey, I just made a Pull Request!

The <EntityMembersListCard /> component renders incorrectly when its width is shrunk. This happens when trying to make the card take less space than the full width of a page using <Grid item ...>. For example, the following renders incorrectly:
<Grid item xs={3}>
  <EntityMembersListCard />
</Grid>

I believe that this happens because under the hood, <EntityMembersListCard /> is implemented using <Grid> which is relative to the screen size and not relative to whatever container it's in.
I have resolved this issue by replacing the use of <Grid> with CSS Grid which does scale based on its container.
Screenshots

Before
After

Note that these examples were generated with the following changes to the example app. While looking at team-b
diff --git a/packages/app/src/components/catalog/EntityPage.tsx b/packages/app/src/components/catalog/EntityPage.tsx
index ecc1f008b59a..5581604de883 100644
--- a/packages/app/src/components/catalog/EntityPage.tsx
+++ b/packages/app/src/components/catalog/EntityPage.tsx
@@ -801,6 +801,15 @@ const groupPage = (
         <Grid item xs={12}>
           <EntityMembersListCard />
         </Grid>
+        <Grid item xs={9}>
+          <EntityMembersListCard />
+        </Grid>
+        <Grid item xs={6}>
+          <EntityMembersListCard />
+        </Grid>
+        <Grid item xs={3}>
+          <EntityMembersListCard />
+        </Grid>
         <Grid item xs={12}>
           <EntityLikeDislikeRatingsCard />
         </Grid>

:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[ ] Added or updated documentation
[ ] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

This PR is ready and waiting for a review. Hopefully this comment will keep the stale bot at bay

Just wanted to mention we also have https://github.com/backstage/backstage/pull/21304, I feel like they won't conflict but wanted you to be aware 👍

@awanlin Thank you for the heads up. I synced with master and found that the merge produced broken code. It's all fixed now.

Would be great to get this in as we are now seeing this on the Demo site, for example: https://demo.backstage.io/catalog/default/group/team-a

Thanks for this contribution @dotboris and for the merge @Rugvip 🚀


Seg Fault on dev

OpenBLAS blas_thread_init: RLIMIT_NPROC 1029716 current, 1029716 max
run.sh: line 18:  8172 Segmentation fault
On Ubuntu 14.04

The commit that breaks it: https://github.com/PokemonGoF/PokemonGo-Bot/commit/e65602eec5526a74941f17e36f0c90ce49ef018a

works fine now on dev.


Make strings invariant for assertions

Otherwise, all tests will fail due to different float format.

Thank you for your contribution!


fix Fix the issue of missing and removing some old version delete bitmap

What problem does this PR solve?
Problem Summary:
pr https://github.com/apache/doris/pull/40204 support removing old delete bitmap, however it donesn't consider boundary which will lead to miss some delete bitmap should be removed on be , it only affect local delete bitmap, the delete bitmap store in fdb is right, and these missing delete bitmaps can only be deleted by next base compaciton before this pr.
pick pr:https://github.com/apache/doris/pull/44300
Release note
None
Check List (For Author)

Test

[ ] Regression test
[ ] Unit Test
[ ] Manual test (add detailed scripts or steps below)
[ ] No need to test or manual test. Explain why:

[ ] This is a refactor/code format and no logic has been changed.
[ ] Previous test can cover this change.
[ ] No code files have been changed.
[ ] Other reason

Behavior changed:

[ ] No.
[ ] Yes.

Does this need documentation?

[ ] No.
[ ] Yes.

Check List (For Reviewer who merge this PR)

[ ] Confirm the release note
[ ] Confirm test cases
[ ] Confirm document
[ ] Add branch pick label

run buildall


userData is null when manipulating it with transformRequestFunction

Describe the bug
Hello, I'm trying to limit the depth of my scraper. According to https://stackoverflow.com/questions/58419581/is-there-a-way-to-specify-max-crawl-depth-when-using-the-apify-sdk userData is the recommended approach. request.userData.depth is 0 on the first request but null on all subsequent requests.
To Reproduce
Apify.main(async () => {
  const requestQueue = await Apify.openRequestQueue();
  await requestQueue.addRequest({
    url: "https://www.example.com",
    userData: {
      depth: 0,
    },
  });
  const pseudoUrls = [new Apify.PseudoUrl("https://www.example.com/[.*]")];

  const crawler = new Apify.PuppeteerCrawler({
    requestQueue,

    handlePageFunction: async ({ request, page }) => {
      const title = await page.title();
      log.info(`Processing ${request.url}: ${title}`);

      // is null except the first request
      console.log(request.userData.depth);

      await Apify.utils.enqueueLinks({
        page,
        selector: "a",
        pseudoUrls,
        requestQueue,
        transformRequestFunction: (request) => {
          request.userData.depth += 1
          return request;
        },
      });
    },
  });

  await crawler.run();
});

Expected behavior
request.userData.depth should be preserved.
System information:

OS: Linux
Node.js version 12.18.2
Apify SDK version 0.21.8

the upper request variable from handlePageFunction is being shadowed by the request inside transformRequestFunction, you can't access the upper request reference without using a different name.
also, the request.userData.depth for enqueueLinks will always be unset, and doing a += 1 on undefined will become NaN, that can't be serialized to JSON, so it becomes null
I believe what you want meant was:
        transformRequestFunction: (req) => {
          req.userData.depth = request.userData.depth + 1;
          return req;
        },

@pocesar thank you!


suppression file location in multi-module build

Hi, i have a question i cannot answer from the information in the docs.
the owasp dependency-check maven-plugin allows to configure a suppressionFile. I have multiple projects that should use the same information. is there any way i can configure this? does this value support http-urls?

Yes, the suppressionFile property will accept URL based paths (http, https, and file URLs).


import io.flutter.plugins.GeneratedPluginRegistrant is unresolved reference

Hi Ricardo,
Following up on my previous question in your blog, I develop my SDK by referring to what you have implemented in this repository. Thanks a lot for doing this project. It is pretty helpful at least for me. Everything was perfectly running as I expect until I got stuck in this part:
File: tiki-sdk-android/app/src/main/kotlin/com/mytiki/tiki_sdk_android/core/CoreChannel.kt
import io.flutter.plugins.GeneratedPluginRegistrant

class CoreChannel(context: Context) : FlutterPlugin, MethodCallHandler {
...

init {
        val loader = FlutterLoader()
        loader.startInitialization(context)
        loader.ensureInitializationComplete(context, null)
        val flutterEngine = FlutterEngine(context)
        flutterEngine.dartExecutor.executeDartEntrypoint(DartExecutor.DartEntrypoint.createDefault())
        flutterEngine.plugins.add(this)
        GeneratedPluginRegistrant.registerWith(flutterEngine)
    }
}

Somehow, I could not find package io.flutter.plugins.GeneratedPluginRegistrant and it always returns an error when I compile my SDK. May I know how can you get this package? Or is there any library I must link to the Gradle or somewhere else? This question may not be too related to your project but your guideline will be more helpful for me to continue my work. I have been stuck for a day and looking for any solution on the internet, but not really helpful.
Thanks a lot for your time  and support
Sri

Hello @srieyulianti! Try to run flutter clean and fluter run in the Fluter root before compiling the Android code.
If you are using the same setup described in the blog post, the GeneratedPluginRegistrant should be automatically imported by Flutter.

Hello @srieyulianti sorry for the late response but your last comment got lost in the notifications. I got back to it just now cleaning up open issues. Do you still need help on this?

Hi @ricardobrg , no worries. I have solved the problem by myself. Thanks a lot for the samples. I think you can close the issue now.


How does DeepFM handle values of a feature not seen in training set?

One of the features in my trained DeepFM model is user_id. If there's a new user during inference how does DeepFM handle it? Thank you!

You can use hash for unseen user_id:
https://github.com/shenweichen/DeepCTR/blob/master/examples/run_classification_criteo_hash.py

After going through a lot of sources, I found this amazing source-
https://github.com/gcampanella/pydata-london-2019/blob/master/pydata_london_2019.pdf


No checkpoint  folder in src

Indeed, you may create one or update the config file. We will add logic to create non-existing checkpoint path in the future


G++还是g++

Requirements
OS Support: Linux and Mac OS
Go 1.12.x or later
G++ 4.8.x or later

编译器应该是小写g++合适吧。

I think C++ is better.


[6.0] Increasing memory with QueryExecuted event.

Laravel Version: 6.0.0
PHP Version: 7.3.6
Database Driver & Version: mysqld  Ver 8.0.16 for osx10.14 on x86_64 (Homebrew)

Description:
I have some memory issues using Laravel 6.0, while migrating over 1.5 million clients from an old legacy system to a new Laravel app we keep running out of memory.
When we remove the code $this->event(new QueryExecuted($query, $bindings, $time, $this)); from the Connection.php (line 683) the memory stops increasing and everything works as expected.
Steps To Reproduce:
Sample console command:
/**
 * Execute the console command.
 *
 * @return mixed
 */
public function handle()
{
    $db = DB::connection('mysql_legacy');

    DB::disableQueryLog();

    $db->table('clients')->orderBy('id', 'asc')->chunk(1000, function ($clients) {
        $clients->each(function ($client) {
            $user = User::find($client->id);

            // ...
        });

        $this->info('Memory: ' . memory_get_usage());
    });
}

Result with the line $this->event(new QueryExecuted($query, $bindings, $time, $this));:
Memory: 30296064
Memory: 30933784
Memory: 31632872
Memory: 32233856
Memory: 32964904

Results with the line $this->event(new QueryExecuted($query, $bindings, $time, $this)); removed:
Memory: 29567744
Memory: 29638008
Memory: 29638568
Memory: 29638256
Memory: 29638008

Do you have any packages that might listen to those events and cause the memory spike?

@crynobone That seems to be the case, coming from facade/ignition.

I too experienced OOM errors after upgrading to Laravel 6.0, but it wasn't until now, I found the that Ignition package is being the root cause.
At first, all our custom Artisan commands running as daemons started restarting. Because of the automatic failure restart, we didn't investigate further at the time.
Today, a team member was importing data into the database by uploading files through our web UI. The file is handled in chunks and uses batch insertion to reduce memory usage.
After some time troubleshooting, we too tried to disable the event dispatching in the Connection class as the author and the issue disappeared. Short after, we found that facade/ignition was listening and storing these queries with its bindings.
I wasn't even aware of this reporting feature, and it turns out the default flare.reporting.maximum_number_of_collected_queries isn't working for this kind of workload.
We're solving this issue by disabling flare.reporting.report_queries.
Perhaps, reporting shouldn't be the default option but instead, show a recommendation in the Debug tab when an exception is being rendered.
Otherwise, this feature should probably be mentioned in the package description and maybe in the Laravel Docs too.
Even though we don't use the reporting feature because of the use of laravel/telescope, I see the potential of the feature in this package while debugging. Having to turn it entirely off to support different use cases is a pity. Perhaps some methods like withoutRecording, stopRecording, startRecoding etc. inspired by the Telescope is useful?


Improve ModelObject type

Let's say there's a user model called User:
class UserModel extends Model {
  id!: number;
  email?: string;
}

Now we want to add a new user with User.query().insert method.
Let's define the parameter of insert method as userToInsert.
const userToInsert = { ... };
User.query().insert(userToInsert);

Objection provides (at least) two types that could be used for userToInsert: PartialModelObject and ModelObject.
The problem with these types is that PartialModelObject makes all properties optional where ModelObject makes them required.
Wanted end result:
// ERROR!
const userToInsert = {}

// OK
const userToInsert = {
  id: 1
}

// ERROR!
const userToInsert = {
  email<EMAIL_ADDRESS>}

I have created a new type ModelProperties<T> that fixes the issue and works as above.
It could be a good idea to refactor objection to use it instead of PartialModelObject and ModelObject. This way objections methods would also have stronger typings.

@AleksiVirkkala check this PR:
https://github.com/Vincit/objection.js/pull/2276
I made it to solve this issue few months ago, not merged yet.
WDYT ?
I suggest you to override the type in your project root if you want to solve it locally in your project.

Released in v3.0.5


Enhance Contact page

Add an illustration & match the font and colors to the website.

@swapnilsparsh please assign me this issue.


Column html in name

For icons etc

Done https://github.com/v-e-y/datatables-livewire/releases/tag/v0.0.14

https://github.com/v-e-y/datatables-livewire/releases/tag/v0.0.14