Is there an input size limit?

I just entered 200 kB of text in http://api.annif.org/doc/#!/Automatic32subject32indexing/post_autoindex and I've got a sensible response in a short time but I'm not sure whether this is frowned upon. Is the text being truncated after some point?

There is none. The input will be processed in chunks. The longer input you submit, the longer it will take to process.
Please note that this (and api.annif.org) is the repo of a discontinued prototype. The successor is being developed at https://github.com/NatLibFi/Annif and it is available for testing at http://dev.annif.org

I mean, there is no limit. In practice you might hit one but it will take much more than 200kB to get there.

Osma Suominen, 01/10/2018 22:31:

I mean, there is no limit. In practice you might hit one but it will
take much more than 200kB to get there.

Thanks! And sorry for not seeing the other repo at first.

@nemobis I've now added a notice in the README marking this repo as obsolete (should have done that a long time ago!). Also, the redesigned annif.org website now represents the new implementation. Thanks for the reminder :)

Osma Suominen, 22/10/2018 17:03:

@nemobis https://github.com/nemobis I've now added a notice in the
README marking this repo as obsolete (should have done that a long time
ago!). Also, the redesigned annif.org http://annif.org website now
represents the new implementation. Thanks for the reminder :)

Thank you!


Version change to 0.9.0

r? @Fraser999
(maidsafe_highfive has picked a reviewer for you, use r? to override)


Gaps in the resulting audio file in the umxse model

🐛 Bug
If I calculate an audio file with the model umxse or with my own trained model for voice cleaning, there are gaps in the resulting file that are about 1/10 second and are set with -32768 in a 16 bit pcm wav.
The gaps appears randomly all 30-90s estimated. I couldn't find out a connection between the position of the gaps and the input language record.
The resulting filename in the umxse model is Speech.WAV.
This error does not occur with the default music model umxl.
Environment

PyTorch Version: 1.13.1
OS: Windows 11
torchaudio loader (y/n):y
Python version: 3.9.13
CUDA/cuDNN version: only CPU

Are you feeding in the right sample rate? Maybe this is a resampling problem... I can investigate

Yes, i do. 44100Hz. My own model has also this frequecy

umxse is requiring 16khz. Depending on how you run the model you would need to resample yourself

i tried umxe also with 16khz samplingrate.
Ther are also gaps in 30-150s intervals.

I tried to reproduce that without success. Here is an example of the separation of a 3min sine wave input

i suggest you try to use the umx commandline separator and load the audio in the same way we do here - if that's not the case yet

i tested a 45 min podcast with a 16k samplingrate stereo with a lot of gaps and in mono with only one gap.
The output speech file is alway in stereo.
Is there an error in this code?
mixture, _ = sf.read(r"C:\temp\LanzPrecht16k.wav", dtype="float32", always_2d=False)
estimates = predict.separate(torch.as_tensor(mixture).float(), rate = 16000, model_str_or_path='umxse', device='cpu')
estimates_numpy = {}
for target, estimate in estimates.items():
estimates_numpy[target] = torch.squeeze(estimate).detach().cpu().numpy().T
target_path = str(r"C:\openunmix\umx_demo\openunmix\output\target.mp3")
stempeg.write_stems(
target_path,
estimates_numpy,
sample_rate=16000,
writer=stempeg.FilesWriter(multiprocess=False, output_sample_rate=16000),
)

Can you post a segment around the error here, please?

Here an example speech.wav from a stereo 16k input file:
https://drive.google.com/file/d/1JxJGaQLXHJd_kykMudblKWWU4avmtEvg/view?usp=sharing

thats very weird indeed. Is this deterministic with the same input file?

Maybe @TE-StefanUhlich has an idea? Is this some instability with the lstm?

I tested an a Windows 10 and Windows 11 computer.
It is deterministic on the same computer but different between this machines.

I could imagine that the problem is related to the Wiener filtering which breaks down due to receiving a stereo file which actually only is monaural. Do you use a Wiener filter at the output? Could you try to just feed in a mono file?

I use the default values from predict.py. I think wiener filter is on. (See my code i posted)
With a mono input file i had only one gap in a 45 minutes record.

is this the code i should try to deactivate? (model.py 294)
for sample in range(nb_samples):
pos = 0
if self.wiener_win_len:
wiener_win_len = self.wiener_win_len
else:
wiener_win_len = nb_frames
while pos < nb_frames:
cur_frame = torch.arange(pos, min(nb_frames, pos + wiener_win_len))
pos = int(cur_frame[-1]) + 1
targets_stft[sample, cur_frame] = wiener(
spectrograms[sample, cur_frame],
mix_stft[sample, cur_frame],
self.niter,
softmask=self.softmask,
residual=self.residual,
)

@frixos25 no, use set niter=0 when you call
https://github.com/sigsep/open-unmix-pytorch/blob/05fd4d8a0e3e50e308579052d762a342647c3408/openunmix/predict.py#L4-L16

Yes, without wiener filter there are no gaps with a stereo input file.

@frixos25 Great. The wiener filter is probably unstable with such long inputs.

Thank you for your support.
I tested the umxse and my own model with 44100Hz samplerate with and without the wiener filter.
In the umxse model i can not hear a difference.
In my model i hear more high frequency noise.
Will the stability of the wiener filter be improved in the next future?

@frixos25 you maybe also try https://github.com/sigsep/norbert which has higher accuracy than torch when running on cpu


Add CI for the lint/build/test

Currently, I only add the basic requirements to make sure:

Code style complaint with golangci-lint
Build bins is good
Unit tests are good if any

CI won't run before merging, but I checked on my side. Please refer: https://github.com/git-hulk/xdb/actions/runs/6289077075/job/17075213726


deployment issue in Management identity

Hi Team,
i have deployed Azure powershell function app  and i have used the ARM template provided on github
[]([]([]([](link:https://github.com/Azure/azure-quickstart-templates/blob/master/101-functions-managed-identity/azuredeploy.json))))
but i faced one issue with management identity. default management identity got created with error.
Error description:{"code":"DeploymentFailed","message":"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-debug for usage details.","details":[{"code":"NotFound","message":"{\r\n "error": {\r\n "code": "ResourceNotFound",\r\n "message": "The Resource 'Microsoft.Web/sites/efhmree5ljzne' under resource group 'testmanagedidentity1' was not found."\r\n }\r\n}"}]}
please give your feedback on this.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f57d3177-ce9e-ebfa-03a7-45beb8ca3212
Version Independent ID: a59df23d-f3ac-9809-61d3-5741e31f020a
Content: Managed identities overview - Azure App Service
Content Source: articles/app-service/overview-managed-identity.md
Service: app-service
GitHub Login: @mattchenderson
Microsoft Alias: mahender

Hi @rambabu0063 I'm sorry you are facing this issue and thanks for reaching out. Could you link the URL of the documentation you were following? That way, we can pass your feedback to the appropriate content author. (We try to keep this issues for documentation feedback)
If this is not a feedback entry and you need help with your implementation then please open a question on the Developer forums StackOverflow or MSDN. There unlike here there is a dev community + our engineering team that can help.

Hi Alberto,
i have used below given link:
https://github.com/Azure/azure-quickstart-templates/tree/master/101-functions-managed-identity
https://docs.microsoft.com/en-us/azure/app-service/overview-managed-identity?tabs=dotnet
Thanks
Rambabu
On Wed, Nov 20, 2019 at 11:47 PM Alberto Vega<EMAIL_ADDRESS>wrote:

Hi @rambabu0063 https://github.com/rambabu0063 I'm sorry you are facing
this issue and thanks for reaching out. Could you link the URL of the
documentation you were following? That way, we can pass your feedback to
the appropriate content author. (We try to keep this issues for
documentation feedback)
If this is not a feedback entry and you need help with your implementation
then please open a question on the Developer forums StackOverflow or MSDN.
There unlike here there is a dev community + our engineering team that can
help.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/azure-docs/issues/43203?email_source=notifications&email_token=AN2ORAKPVJUTEOAQF2LTKNTQUV5NBA5CNFSM4JPSL742YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEETPBYI#issuecomment-556200161,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AN2ORAIGCTWOWV2P6LGFQGDQUV5NBANCNFSM4JPSL74Q
.

@rambabu0063 Thanks for sharing the document. I have redirected it to the right team and they will reach out to you shortly.

We are also facing the same issue when we deploy the ARM template.
{ "code": "ResourceNotFound", "message": "The Resource 'Microsoft.Web/sites/SUMOBRDLQProcessorkjt756lp36tio' under resource group 'ProdIT-Sumo-Test' was not found." } }, "targetResource": { "id": "/subscriptions/2c3047b5-a922-4ad0-9319-851026c53797/resourceGroups/ProdIT-Sumo-Test/providers/Microsoft.Web/sites/SUMOBRDLQProcessorkjt756lp36tio/providers/Microsoft.ManagedIdentity/Identities/default", "resourceType": "Microsoft.ManagedIdentity/Identities", "resourceName": "default", "apiVersion": "2015-08-31-PREVIEW" } }

Any update on this one? We are suffering the same issue to locate the system assigned identity in ARM template.

Hello there, is there any update on this issue? We're also facing the same issue when assigning managed identity to a resource. It used to work but failed after upgrading azure cli to 2.0.74.

Hi all - Sorry for the delay in response. I'll prioritize this issue and share my findings.

An answer is provided here: https://stackoverflow.microsoft.com/a/180868/15429

Thanks @Tiano2017!
The solution in the ARM template referenced above was making use of an old parameter signature for the reference() function towards the end in the output section of the template. I have created a PR that resolves this issue and submitted it for review. In the meantime, you may click here to deploy the solution directly, or load the updated ARM template from my repo here as well.
Since this channel is more driving improvements towards MS Docs and this issue doesn't really warrant any change in this doc, we will now proceed to close this thread. If there are further questions regarding this matter with ARM template, please open a separate issue in the quick samples repo.

Hi,
I couldn't find any place to submit ARM template related issues (if there is, please let me know) and since this issue seems similar I thought I'd re-open it. Somewhere between April 22nd and 24th we've started to encounter the following error during multiple ARM template deployments spanning multiple projects:
ResourceNotFound: The Resource 'Microsoft.Web/sites/[websiteName]' under resource group '[resourceGroup]' was not found.
Deployment overview in Azure Portal:

It seems to have something to do with ManagedIdentities (which we use to allow KeyVault access to our Azure App Services) but the error doesn't give any meaningful message. The resource in question obviously exists. Also, if we run the exact same template again it will succeed, most likely due to the App Service already existing in the resource group. If we remove the resources and run the template again on the same resource group we can consistently reproduce the issue.
These exact same templates have been working for the past 2 years or so, they have only started to fail since last week and are still failing as of today.


[platform purple] issue

Hi there, i'm trying to download a video from platform purple before they go out of business.
I tried the following command:
youtube-dl --verbose https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462&signature=060454d15f0f8b669f95796b929bf0a8
and I received the following.
Any ideas? thank you :)
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg 2022-06-12-git-4d45f5acbd-essentials_build-www.gyan.dev, ffprobe 2022-06-12-git-4d45f5acbd-essentials_build-www.gyan.dev
[debug] Proxy map: {}
[generic] capi_JB_RNJ3_1: Requesting header
WARNING: Could not send HEAD request to https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462: HTTP Error 403: Forbidden
[generic] capi_JB_RNJ3_1: Downloading webpage
ERROR: Unable to download webpage: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\extractor\common.py", line 634, in _request_webpage
File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmpupik7c6w\build\youtube_dl\YoutubeDL.py", line 2288, in urlopen
File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
'signature' is not recognized as an internal or external command,
operable program or batch file.

Working in git master:
$ python -m youtube_dl -v  'https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462&signature=060454d15f0f8b669f95796b929bf0a8' --test
[debug] System config: [u'--prefer-ffmpeg']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462&signature=060454d15f0f8b669f95796b929bf0a8', u'--test']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Git HEAD: 6fece0a96
[debug] Python version 2.7.18 (CPython) - Linux-4.4.0-210-generic-i686-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 4.3, avprobe 4.3, ffmpeg 4.3, ffprobe 4.3
[debug] Proxy map: {}
[generic] capi_JB_RNJ3_1: Requesting header
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462&signature=060454d15f0f8b669f95796b929bf0a8'
[download] Destination: capi_JB_RNJ3_1-capi_JB_RNJ3_1.mp4
[download] 100% of 10.00KiB in 00:01
$

Read eg #31530 for updating instructions (only).

Critically, quote the URL.

'signature' is not recognized as an internal or external command, operable program or batch file.

That output shows that the command youtube-dl https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462& signature=060454d15f0f8b669f95796b929bf0a8 ...rest... was split at the & by the cmd shell into two commands:

a yt-dl command with URL https://vault2.platformpurple.com/products/catalog/capi_JB_RNJ3/media/capi_JB_RNJ3_1.mp4?expiration=1678892462
signature=060454d15f0f8b669f95796b929bf0a8 ...rest...

With cmd, use "double quotes".


adapt a few more topics to work with 2.26

accidentally made a commit straight to wip-2.26 for cpr-indoornav-base that this relates to.


ModuleNotFoundError: No module named 'frida' even when its installed

So I finished the installation of this fork, but when booting up it fails to start both "NVIDIA vGPU Daemon" and "NVIDIA vGPU Manager Daemon".
journalctl -u nvidia-vgpu-mgr.service gives:
Jul 10 19:01:19 archtower systemd[1]: Starting NVIDIA vGPU Manager Daemon...
Jul 10 19:01:19 archtower vgpu_unlock[414]: Traceback (most recent call last):
Jul 10 19:01:19 archtower vgpu_unlock[414]:   File "/opt/vgpu_unlock_5.12/vgpu_unlock", line 13, in <module>
Jul 10 19:01:19 archtower vgpu_unlock[414]:     import frida
Jul 10 19:01:19 archtower vgpu_unlock[414]: ModuleNotFoundError: No module named 'frida'
Jul 10 19:01:19 archtower systemd[1]: nvidia-vgpu-mgr.service: Control process exited, code=exited, status=1/FAILURE
Jul 10 19:01:19 archtower systemd[1]: nvidia-vgpu-mgr.service: Failed with result 'exit-code'.
Jul 10 19:01:19 archtower systemd[1]: Failed to start NVIDIA vGPU Manager Daemon.

I don't code that much, but IIRC this is because of a missing python library right?
after installing frida with pip, it keeps giving the same error.
I can even import frida from a separate python3 console...
asciinema: https://asciinema.org/a/EA1Twe22z0Z2dGN1jwlKYKxbC

Sort of fixed??? Installed frida as root and fixed it but now I get error: Failed to open PID file: File exists
Jul 10 19:55:21 archtower nvidia-vgpud[443]: vgpu_unlock loaded.
Jul 10 19:55:21 archtower nvidia-vgpud[525]: vgpu_unlock loaded.
Jul 10 19:55:21 archtower nvidia-vgpud[525]: Verbose syslog connection opened
Jul 10 19:55:21 archtower nvidia-vgpud[525]: Directory /var/run/nvidia-vgpud will not be removed on exit
Jul 10 19:55:21 archtower nvidia-vgpud[525]: error: Failed to open PID file: File exists
Jul 10 19:55:21 archtower nvidia-vgpud[525]: Shutdown (525)
Jul 10 19:55:21 archtower systemd[1]: nvidia-vgpu-mgr.service: Deactivated successfully.


Prepare

Improvements to IO and feature computations

bento.io.prepare(): first stab at ingesting external molecular and segmentation data 1fb026b

first assigns secondary seg. masks to cell in a 1-to-1 fashion
indexes points to cells and mapped sec. shapes

bento.tl.analyze_samples: sample computation memory usage is now tractable

naive dask partitioning only accounted for memory footprint of points dataframe, but memory blowup comes from MultiIndex groupby operations
custom partitioning ensures partitions have capped number of groupby groups
in the future make it a user parameter? needs more testing

some progress bars and emojis :cake:

Codecov Report

Merging #64 (d6844ac) into master (f9ca5fe) will increase coverage by 1.86%.
The diff coverage is 36.72%.

@@            Coverage Diff             @@
##           master      #64      +/-   ##
==========================================
+ Coverage   56.70%   58.57%   +1.86%
==========================================
  Files          24       24
  Lines        1379     1359      -20
==========================================
+ Hits          782      796      +14
+ Misses        597      563      -34

Impacted Files
Coverage Δ

bento/_utils.py
75.75% <ø> (ø)

bento/io/__init__.py
100.00% <ø> (ø)

bento/preprocessing/_preprocessing.py
86.66% <ø> (+37.39%)
:arrow_up:

bento/plotting/_plotting.py
15.15% <6.45%> (+1.51%)
:arrow_up:

bento/io/_io.py
16.87% <14.73%> (-0.96%)
:arrow_down:

bento/tools/_cell_features.py
55.00% <66.66%> (+3.40%)
:arrow_up:

bento/preprocessing/__init__.py
100.00% <100.00%> (ø)

bento/tools/_lp.py
41.22% <100.00%> (ø)

bento/tools/_sample_features.py
98.08% <100.00%> (+2.04%)
:arrow_up:

tests/test_sample_features.py
100.00% <100.00%> (ø)

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f9ca5fe...d6844ac. Read the comment docs.


⚠ Bofrost.at has degraded performance

In da5a9f3, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2554 ms

Resolved: Bofrost.at performance has improved in 148ab48.


[Optimization-2703][studio] Optimize online debug task

Purpose of the pull request

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.
(or)
This pull request is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:

close #2704


Announcement Extensions should move to new homes

This is a follow up to Issue #1 (Port Announcements).
There are a number of things in Announcements-Extensions-GemStone that probably deserve a different home.
Behavior.extension.st:Behavior >> includesBehavior: aBehavior [
Collection.extension.st:Collection >> removeAllSuchThat: aBlock [
This is a correct, but not optimal, default implementation. Other subclasses should have more specific variants.
ExecBlock.extension.st:ExecBlock >> hasReceiver [
ExecBlock.extension.st:ExecBlock >> receiver [
Object.extension.st:Object >> deprecated: aString transformWith: aRule [
This just redirects to #deprecated:, but offers the potential for more once we have RB tools available.
Object.extension.st:Object >> initialize [
TestAsserter.extension.st:TestAsserter >> should: aBlock notTakeMoreThan: aDuration [
This is a hack implementation. It doesn't terminate the block when the time expires; it let's the block complete.
It reports whether the block took too long after it finishes.

Collection>>removeAllSuchThat: and Object>>initialize have been added to the base, and Announcements is its own project now, so closing this issue.


bug: sound is not triggered when the device that detects motion does not have sound service

Scenario:

I have a rpi 0 in my courtyard, without speakers. The service object_detection detects somebody, it tells it to the core in name of this device (thanks to device_id).
I THINK the core will trigger sound for this device. So if it does not have any speaker the alarm does not ring.

It is not a bug. This behavior will be changeable as the user need through the issue #222 and related PR.


Worker trace v3: /backend/*{all}, image/selector

What is the problem that this PR is trying to fix?
refs: https://github.com/travis-ci/reliability/issues/199
This is the last of items of interest to trace in worker, namely:

any latency in http calls to job-board for /image package and selector interface.

What approach did you choose and why?
How can you test this?
This is a staging trace ran on this branch
What feedback would you like, if any?
De we haz all the interesting bits we want to trace now?

Ah.  GCE API calls are missing; I'll make that into a separate PR, per discussion with @igorwwwwwwwwwwwwwwwwwwww

Main thing missing at this point is CHANGELOG. :)


feat: TensorRT-LLM load multiple models

Currently can only run one model at a time

Deprecated due to TensorRT-LLM not supporting Desktop
Parent issue: https://github.com/janhq/cortex.cpp/issues/1742


F/fast farm

Modified NWTC_IO to allow for VECTORS and FIELD header in vtk files

This pull request is to my master instead of my f/fast-farm branch.  I'll simply merge you changes into my f/fast-farm branch and close this pull request.


kube-apiserver.service dead on arrival

Fresh install using v0.1.9 and default values.
Status shows kube-apiserver failed with result 'dependency' without any details on what that might be.
Set CoreOS Release Channel:
 1)  Alpha
 2)  Beta
 3)  Stable (recommended)

Select an option: 3

Please type Nodes RAM size in GBs followed by [ENTER]:
[default is 2]:
Changing Nodes RAM to 2GB...

Creating 1GB Data disk for Master ...
   1GiB 0:00:00 [ 1.3GiB/s] [=============================================================================================>] 100%
Created 1GB Data disk for Master

Please type Nodes Data disk size in GBs followed by [ENTER]:
[default is 10]:

Creating 10GB Data disk for Node1...
  10GiB 0:00:08 [ 1.2GiB/s] [=============================================================================================>] 100%
Created 10GB Data disk for Node1

Creating 10GB Data disk for Node2...
  10GiB 0:00:07 [ 1.3GiB/s] [=============================================================================================>] 100%
Created 10GB Data disk for Node2

Starting k8smaster-01 VM ...
> booting k8smaster-01
[corectl] downloading and verifying stable/835.13.0
28.93 MB / 28.93 MB [=============================================================================================================] 100.00 %
[corectl] SHA512 hash for coreos_production_pxe.vmlinuz OK
181.16 MB / 181.16 MB [===========================================================================================================] 100.00 %
[corectl] SHA512 hash for coreos_production_pxe_image.cpio.gz OK
[corectl] stable/835.13.0 ready
[corectl] '/Users/seren' was already available to VMs via NFS
[corectl] started 'k8smaster-01' in background with IP <IP_ADDRESS> and PID 76245

Starting k8snode-01 VM ...
> booting k8snode-01
[corectl] stable/835.13.0 already available on your system
[corectl] '/Users/seren' was already available to VMs via NFS
[corectl] started 'k8snode-01' in background with IP <IP_ADDRESS> and PID 76279

Starting k8snode-02 VM ...
> booting k8snode-02
[corectl] stable/835.13.0 already available on your system
[corectl] '/Users/seren' was already available to VMs via NFS
[corectl] started 'k8snode-02' in background with IP <IP_ADDRESS> and PID 76313

Installing Kubernetes files on to VMs...

Installing into k8smaster-01...
[corectl] uploading 'kube.tgz' to 'k8smaster-01:/home/core/kube.tgz'
41.46 MB / 41.46 MB [=============================================================================================================] 100.00 %
Done with k8smaster-01

Installing into k8snode-01...
[corectl] uploading 'kube.tgz' to 'k8snode-01:/home/core/kube.tgz'
41.46 MB / 41.46 MB [=============================================================================================================] 100.00 %
Done with k8snode-01

Installing into k8snode-02...
[corectl] uploading 'kube.tgz' to 'k8snode-02:/home/core/kube.tgz'
41.46 MB / 41.46 MB [=============================================================================================================] 100.00 %
Done with k8snode-02

fleetctl is up to date ...

Downloading latest version of helm for OS X
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 4760k  100 4760k    0     0  4585k      0  0:00:01  0:00:01 --:--:-- 6990k

Installed latest helm 0.3.1%2Bd4c0fa8 to ~/kube-cluster/bin ...
---> Checking repository charts
Already up-to-date.
---> Checking repository kube-charts
Already up-to-date.
---> Done
[ERROR] Remote kube-charts already exists, and is pointed to https://github.com/TheNewNormal/kube-charts
---> Checking repository charts
Already up-to-date.
---> Checking repository kube-charts
Already up-to-date.
---> Done

fleetctl list-machines:
MACHINE		IP		METADATA
a7a1af21...	<IP_ADDRESS>	role=node
e33df12e...	<IP_ADDRESS>	role=control
efdfb600...	<IP_ADDRESS>	role=node

Starting all fleet units in ~/kube-cluster/fleet:
Unit fleet-ui.service inactive
Unit fleet-ui.service launched on e33df12e.../<IP_ADDRESS>
Unit kube-apiserver.service inactive
Unit kube-apiserver.service launched on e33df12e.../<IP_ADDRESS>
Unit kube-controller-manager.service inactive
Unit kube-controller-manager.service launched on e33df12e.../<IP_ADDRESS>
Unit kube-scheduler.service inactive
Unit kube-scheduler.service launched on e33df12e.../<IP_ADDRESS>
Unit kube-apiproxy.service
Triggered global unit kube-apiproxy.service start
Unit kube-kubelet.service
Triggered global unit kube-kubelet.service start
Unit kube-proxy.service
Triggered global unit kube-proxy.service start

fleetctl list-units:
UNIT				MACHINE				ACTIVE		SUB
fleet-ui.service		e33df12e.../<IP_ADDRESS>	activating	auto-restart
kube-apiserver.service		e33df12e.../<IP_ADDRESS>	inactive	dead
kube-controller-manager.service	e33df12e.../<IP_ADDRESS>	inactive	dead
kube-scheduler.service		e33df12e.../<IP_ADDRESS>	inactive	dead

Generate kubeconfig file ...
cluster "k8smaster-01" set.
context "default-context" set.
switched to context "default-context".
Waiting for Kubernetes cluster to be ready. This can take a few minutes...

bash-3.2$ fleetctl status kube-apiserver.service
● kube-apiserver.service - Kubernetes API Server
   Loaded: loaded (/run/fleet/units/kube-apiserver.service; linked-runtime; vendor preset: disabled)
   Active: inactive (dead)
     Docs: https://github.com/GoogleCloudPlatform/kubernetes

Feb 19 09:45:14 k8smaster-01 systemd[1]: Dependency failed for Kubernetes API Server.
Feb 19 09:45:14 k8smaster-01 systemd[1]: kube-apiserver.service: Job kube-apiserver.service/start failed with result 'dependency'.

fleetctl list-machines:
MACHINE		IP		METADATA
a7a1af21...	<IP_ADDRESS>	role=node
e33df12e...	<IP_ADDRESS>	role=control
efdfb600...	<IP_ADDRESS>	role=node

fleetctl list-units:
UNIT				MACHINE				ACTIVE		SUB
fleet-ui.service		e33df12e.../<IP_ADDRESS>	activating	auto-restart
kube-apiproxy.service		a7a1af21.../<IP_ADDRESS>	active		running
kube-apiproxy.service		efdfb600.../<IP_ADDRESS>	active		running
kube-apiserver.service		e33df12e.../<IP_ADDRESS>	inactive	dead
kube-controller-manager.service	e33df12e.../<IP_ADDRESS>	inactive	dead
kube-kubelet.service		a7a1af21.../<IP_ADDRESS>	activating	start-pre
kube-kubelet.service		efdfb600.../<IP_ADDRESS>	activating	start-pre
kube-proxy.service		a7a1af21.../<IP_ADDRESS>	activating	start-pre
kube-proxy.service		efdfb600.../<IP_ADDRESS>	activating	start-pre
kube-scheduler.service		e33df12e.../<IP_ADDRESS>	inactive	dead

@serenbean can you post journalctl -u kube-apiserver.service output.
Also what about other k8s services, are they running there?

core@k8smaster-01 ~ $ journalctl -u kube-apiserver.service
-- Logs begin at Fri 2016-02-19 11:56:14 UTC, end at Fri 2016-02-19 12:01:32 UTC. --
Feb 19 11:56:29 k8smaster-01 systemd[1]: Dependency failed for Kubernetes API Server.
Feb 19 11:56:29 k8smaster-01 systemd[1]: kube-apiserver.service: Job kube-apiserver.service/start failed with result 'dependency'.

bash-3.2$ kubectl get services
error: couldn't read version from server: Get http://<IP_ADDRESS>:8080/api: dial tcp <IP_ADDRESS>:8080: connection refused

bash-3.2$ fleetctl list-units
UNIT				MACHINE				ACTIVE		SUB
fleet-ui.service		ee0dcdc8.../<IP_ADDRESS>	failed		failed
kube-apiproxy.service		3664985d.../<IP_ADDRESS>	active		running
kube-apiproxy.service		dc4a2a43.../<IP_ADDRESS>	active		running
kube-apiserver.service		ee0dcdc8.../<IP_ADDRESS>	inactive	dead
kube-controller-manager.service	ee0dcdc8.../<IP_ADDRESS>	inactive	dead
kube-kubelet.service		3664985d.../<IP_ADDRESS>	activating	auto-restart
kube-kubelet.service		dc4a2a43.../<IP_ADDRESS>	activating	auto-restart
kube-proxy.service		3664985d.../<IP_ADDRESS>	activating	auto-restart
kube-proxy.service		dc4a2a43.../<IP_ADDRESS>	activating	auto-restart
kube-scheduler.service		ee0dcdc8.../<IP_ADDRESS>	inactive	dead

Judging by that return, I don't think any k8s services are running.

@serenbean interesting issue, any files in /opt/bin folder?
as it is where k8s binary files get copied

core@k8smaster-01 /opt/bin $ ls -l
total 187800
-rwxr-xr-x 1 501 20  6839840 Feb  7 15:50 kube-apiproxy
-rwxr-xr-x 1 501 20 45545720 Feb  7 15:50 kube-apiserver
-rwxr-xr-x 1 501 20 37686944 Feb  7 15:50 kube-controller-manager
-rwxr-xr-x 1 501 20 19886520 Feb  7 15:50 kube-proxy
-rwxr-xr-x 1 501 20 19007504 Feb  7 15:50 kube-scheduler
-rwxr-xr-x 1 501 20 22589648 Feb  7 15:50 kubectl
-rwxr-xr-x 1 501 20 40736800 Feb  7 15:50 kubelet

Yes, same files on two nodes as well.

can you try to run fleetctl start kube-apiserver.service ?

and please the out put of $ ls -alh /data/kubernetes/ on the master.

Still not running after that command I'm afraid, same as before.
core@k8smaster-01 ~ $ ls -alh /data/kubernetes/
total 36K
drwxr-xr-x 2 root root 4.0K Feb 19 09:44 .
drwxr-xr-x 6 root root 4.0K Feb 19 09:39 ..
-rw-rw---- 1 root  149 1.2K Feb 19 09:44 ca.crt
-rw------- 1 root root 4.4K Feb 19 09:44 kubecfg.crt
-rw------- 1 root root 1.7K Feb 19 09:44 kubecfg.key
-rw-rw---- 1 root  149 4.8K Feb 19 09:44 server.cert
-rw-rw---- 1 root  149 1.7K Feb 19 09:44 server.key

it looks like something is doggy on coreos side, try to Halt then Up via menu

Tried that multiple times before (with CoreOS beta release as well, also seen alpha has a separate issue so didn't bother with that), did it again now and still the same issue.

that's very weird that even stable or beta does not work for you.
Can you give a try for the kube-solo then? let's see how it behaves

Set CoreOS Release Channel:
 1)  Alpha
 2)  Beta
 3)  Stable (recommended)

Select an option: 3

Please type VM's RAM size in GBs followed by [ENTER]:
[default is 2]:
Changing VM's RAM to 2GB...

Please type Data disk size in GBs followed by [ENTER]:
[default is 10]:

Creating 10GB disk ...
  10GiB 0:00:09 [1.07GiB/s] [=============================================================================================>] 100%
Created 10GB Data disk

Starting VM ...
> booting k8solo-01
[corectl] downloading and verifying stable/835.13.0
28.93 MB / 28.93 MB [=============================================================================================================] 100.00 %
[corectl] SHA512 hash for coreos_production_pxe.vmlinuz OK
181.16 MB / 181.16 MB [===========================================================================================================] 100.00 %
[corectl] SHA512 hash for coreos_production_pxe_image.cpio.gz OK
[corectl] stable/835.13.0 ready
[corectl] '/Users/seren' was already available to VMs via NFS
[corectl] started 'k8solo-01' in background with IP <IP_ADDRESS> and PID 50119

Installing Kubernetes files on to VM...
[corectl] uploading 'kube.tgz' to 'k8solo-01:/home/core/kube.tgz'
39.59 MB / 39.59 MB [=============================================================================================================] 100.00 %
Done with k8solo-01

fleetctl is up to date ...

Downloading latest version of helm for OS X
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 4760k  100 4760k    0     0  3227k      0  0:00:01  0:00:01 --:--:-- 4457k

Installed latest helm 0.3.1%2Bd4c0fa8 to ~/kube-solo/bin ...
---> Checking repository charts
Added 1 charts
minecraft
---> Checking repository kube-charts
Already up-to-date.
---> Done
[ERROR] Remote kube-charts already exists, and is pointed to https://github.com/TheNewNormal/kube-charts
---> Checking repository charts
Already up-to-date.
---> Checking repository kube-charts
Already up-to-date.
---> Done

fleetctl list-machines:
MACHINE		IP		METADATA
8d882cbc...	<IP_ADDRESS>	-

Starting all fleet units in ~/kube-solo/fleet:
Unit fleet-ui.service inactive
Unit fleet-ui.service launched on 8d882cbc.../<IP_ADDRESS>
Unit kube-apiserver.service inactive
Unit kube-apiserver.service launched on 8d882cbc.../<IP_ADDRESS>
Unit kube-controller-manager.service inactive
Unit kube-controller-manager.service launched on 8d882cbc.../<IP_ADDRESS>
Unit kube-scheduler.service inactive
Unit kube-scheduler.service launched on 8d882cbc.../<IP_ADDRESS>
Unit kube-kubelet.service inactive
Unit kube-kubelet.service launched on 8d882cbc.../<IP_ADDRESS>
Unit kube-proxy.service inactive
Unit kube-proxy.service launched on 8d882cbc.../<IP_ADDRESS>

fleetctl list-units:
UNIT				MACHINE				ACTIVE		SUB
fleet-ui.service		8d882cbc.../<IP_ADDRESS>	activating	auto-restart
kube-apiserver.service		8d882cbc.../<IP_ADDRESS>	inactive	dead
kube-controller-manager.service	8d882cbc.../<IP_ADDRESS>	inactive	dead
kube-kubelet.service		8d882cbc.../<IP_ADDRESS>	activating	start-pre
kube-proxy.service		8d882cbc.../<IP_ADDRESS>	activating	start-pre
kube-scheduler.service		8d882cbc.../<IP_ADDRESS>	inactive	dead

Generate kubeconfig file ...
cluster "k8solo-01" set.
context "default-context" set.
switched to context "default-context".
Waiting for Kubernetes cluster to be ready. This can take a few minutes...

core@k8solo-01 ~ $ journalctl -u kube-apiserver.service
-- Logs begin at Fri 2016-02-19 14:01:01 UTC, end at Fri 2016-02-19 14:05:46 UTC. --
Feb 19 14:03:18 k8solo-01 systemd[1]: Dependency failed for Kubernetes API Server.
Feb 19 14:03:18 k8solo-01 systemd[1]: kube-apiserver.service: Job kube-apiserver.service/start failed with result 'dependency'.

core@k8solo-01 ~ $ ls -l /opt/bin
total 181120
-rwxr-xr-x 1 501 20 45545720 Feb  7 15:49 kube-apiserver
-rwxr-xr-x 1 501 20 37686944 Feb  7 15:49 kube-controller-manager
-rwxr-xr-x 1 501 20 19886520 Feb  7 15:49 kube-proxy
-rwxr-xr-x 1 501 20 19007504 Feb  7 15:49 kube-scheduler
-rwxr-xr-x 1 501 20 22589648 Feb  7 15:49 kubectl
-rwxr-xr-x 1 501 20 40736800 Feb  7 15:49 kubelet

core@k8solo-01 ~ $ ls -alh /data/kubernetes
total 36K
drwxr-xr-x 2 root root      4.0K Feb 19 14:02 .
drwxr-xr-x 8 root root      4.0K Feb 19 14:04 ..
-rw-rw---- 1 root kube-cert 1.2K Feb 19 14:02 ca.crt
-rw------- 1 root root      4.4K Feb 19 14:02 kubecfg.crt
-rw------- 1 root root      1.7K Feb 19 14:02 kubecfg.key
-rw-rw---- 1 root kube-cert 4.8K Feb 19 14:02 server.cert
-rw-rw---- 1 root kube-cert 1.7K Feb 19 14:02 server.key

Same error as kube-cluster :(

that's really strange, have not encountered such problem before.
it is something to do with your Mac setup I think
what OS X version are you using? any unusual setup there?

10.11.2 (15C50)
Nothing I would call unusual, standard brew installation, etc.

what do you mean by standard brew installation?

Development related packages (ruby) installed via brew. Don't think it would cause any issues with kube-cluster at all.

I see.
can you ssh to one of VM's and check that internet access is available there?

You may be onto something :)
It does have internet access but there seems to be an issue with DNS resolver.

aha, so we are finally getting something :)
so as I said it is the issue with your Mac setup, just try a reboot for the start

as you have DNS problems on your Mac, that caused VMs not start flanneld.service which needs to access to Internet to download quay.io/coreos/flannel docker image:
ExecStartPost=/usr/bin/docker run --net=host --rm -v /run:/run quay.io/coreos/flannel:${FLANNEL_VER} ...

I'm still do not understand why coreos does not include the required flannel version and needs to download it.

It was too good to be true, restart didn't change anything at all.

you are having some DNS setup issues on your Mac, xhyve is used there in a bridge mode, so nothing can be changed on the App side I'm afraid.
Any VPN is running there, OS X firewall enabled?

This issue is not related to the App's setup, closing it down


[Button] Submit is always triggered v5

Current Behavior 😯
In version 5 a button click always triggers a submit.
Expected Behavior 🤔
Submit should only be triggered if the button is of type 'submit'.
Steps to Reproduce 🕹
Version 5:
https://codesandbox.io/s/funny-silence-4wdsx?file=/src/App.tsx
Version 4:
https://codesandbox.io/s/cool-forest-25i0x?file=/src/App.tsx

@oliviertassinari I'm interested in giving it a shot as my first PR. If you'd like me to use your solution and just add a test for it let me know.

@RTEYL I would suggest starting with adding a test case, then looking for a solution. The one I have proposed is good enough, I believe, but they might be better ones. The tests should give you confidence when iterating.

@oliviertassinari all checks passed but I'd still feel more comfortable if you could review it for me as it is my first PR on an opensource project.


Support for Apollo clientside query via @client without clientside schema

gql-gen errors when generating types for clientside graphql queries (with @client directive) where clientside schema isn't defined or needs to. Apollo allows you to define clientside queries with or without a clientside schema.

We're planning to add this feature but haven't started working on it yet

#561

@emmanuelbuah Defining GraphQL Schema in Apollo is optional but to generate types and queries you need to have it defined. The tool can't say if a field is a string or a number.

@kamilkisiela I completely agree. Since apollo allows the user to either define a schema or not for @client queries. I think the required behavior should be to not throw an error if it sees a query @client directives without a match graphql schema definition. Currently, it throws an error.

Please refer to my PR in ReactQL: https://github.com/leebenson/reactql/pull/129
It shows a good example for how to use the codegen with remote schema and local schema, along with apollo-link-state and @client directive.


Improve UI E2E test usability

Description
Various improvements to improve usability of web console end-to-end tests:

Update playwright to latest version
Provide environment variable to disable/enable headless mode
Allow running E2E tests against any druid cluster running on standard
ports (tutorial-batch.spec.ts now uses an absolute instead of relative
path for the input data)
Provide environment variable to change target web console port
Druid setup does not need to download zookeeper

This PR has:

[x] been self-reviewed.
(Remove this item if the PR doesn't have any relation to concurrency.)
[x] added documentation for new or modified features or behaviors.

These are great improvements.


ability to select location of cholorpeth legen (lefttop,leftbottom,rightbottom,bottomcenter, etc)

The current default location of the legend is interfering with whitetoolgui access
feature request

ability to select location during the m.add(gdf,....., legend_location ='bottomleft')
2)ability to move the legend after ployment to organize before export to html

when having two cholorpeth layers this is an even bigger issue.
edit: https://leafmap.org/notebooks/53_choropleth/  has a moveable one by default? how is this is the leafmap package not the same one? do i need to update it manually? i tried to leafmap.update_package() and try by restarting runtime but not getting the same effects
same with the layer info it is not attached to one part of the screen but rather follows the maps
edit2: ran your 53 cholorpeth map on colab and it became fixed just like mine, so maybe it's colab? binder jupyter didn't work Error displaying widget: model not found

The legend for folium is movable, while the legend for ipyleaflet is not movable. Binder might have some issues with installing ipyleaflet. For ipyleaflet, the legend height and position can be customized. You can also make the map fullscreen so the components do not overlap.
https://leafmap.org/leafmap/#leafmap.leafmap.Map.add_legend

Tried to run folium

Worked fine with the started code
but my working ipyleaflet code is giving the following error on folium backend

It was working as expected on ipyleaflet with the same code

This is likely an issue caused by your data. I just tried out the notebook example. Both the ipyleaflet and folium backends work fine.

Ok i will investigate my data and reproduce it using the notebook example as the reference file.
I tried kepler backend
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
[<ipython-input-23-4833d09b646d>](https://localhost:8080/#) in <module>
      5 #m.add_data(gdf, column='Median Total Household Income 2020', scheme='Quantiles', cmap='Blues', legend_title='Median totalHousehold Income 2020', layer_name = "Income")
      6 #m.split_map(left_layer="SATELLITE", right_layer="nlmaps.water")
----> 7 m.add_data(gdf, column='Average Household Size 2021', scheme='Quantiles', cmap='Reds', legend_title='Ave House ppl 2021', layer_name = "House Size", )
      8 m
      9

TypeError: add_data() got an unexpected keyword argument 'column'

same code that was working for default backend.  Technically the code should be identical when changing backend correct?

Not necessarily. Not all backends support the same arguments.


export a metric which states if credhub is in read only mode

Hello,
Is it possible to add a metric which states if credhub is in read only mode or not ?
For example, the naming could be :
credhub_read_only

1 means credhub is read only
0 means credhub is not read only
Regards,
Jean-Christophe.

Hello,
Since this information is available through credhub API, the exporter should be able to expose it with a new metric.
Feel free to create a PR implementing this feature, I'll be happy to merge it.


Switch to self-hosted pool to fix Android CI

Switch to internal pool to avoid being hit by GHA image updates.
Add script to install Android emulator if needed.

Thanks 👍🏽


props.children not working properly in react-anime.js?

I am having an issue when the props.children change for an <Anime>.
To solve my issue, I made this change to function componentWillReceiveProps in react-anime.js file:
this.children = {
        /*
        cur: children.filter(function (c) {
          return difChildren.indexOf(c) < 0;
        }),
        */
        cur: children,
        prev: childrenWereRemoved ? difChildren : this.children.prev,
        next: !childrenWereRemoved ? difChildren : this.children.next
      };

For some reason, the filter was returning zero children, even though there was a child component.
I am using anime like this;
//inside parent component
<FadeIn>{messageWords}</FadeIn>

let FadeIn = props => {
    return (
        <Anime easing="linear"
            autoplay={true}
            duration={500}
            direction="normal"
            loop={false}
            opacity={[0, 1]}
            delay={(el, index) => ((index * 200) + 1500)}>
            {props.children}
        </Anime>
    )
}

+1 on this -- discovered this while playing with react-anime today.

+1 the same  problem


[WIP] Fixed auth for new Auth table, added Permissions

This briefly fixes mainline so as to work with the newly-separated Auth table in the base.
It also contains a reference implementation for permissions, with the intent of expanding their scope later.

As mentioned in chat, I don't think a separate auth table is the right way to approach this. We're essentially layering on complexity for everyone and messing with our table design (which means we can't easily import from Google Forms or use Airtable's built in form view) for the sake of one special case.
Although it's not the most technically pure approach, I believe we should create a special exhibitor named Admin or something and set a flag in the code granting anyone logged in as that exhibitor special permissions. Thoughts? @Grissess @imjoshdean

That is, in fact, a perfectly viable solution--though not the most flexible nor necessarily manageable. I'm willing to sacrifice either of those for simplicity as long as the involved understand the trade-offs involved :P
I'm not entirely sure how much we would have gained by actually having fine-grained permissions, anyway--most of us can touch the tables directly, so things would have probably degenerated into "permissions equals groups", or, worse, the binary "Do Absolutely Everything" flag and nothing else. The other cases I can think of--mostly sending emails on our behalf, or access to pretty reports--is probably fine via an administrative user (at least for now).
Note that I can't predict this is the decision most organizations will want to take; this may make this product less marketable to others. I'm not sure if that's a priority at the moment--get it working first, maybe? :P
Adding this functionality later is always an option, if possibly harder, depending on how the ad-hoc "Admin" system evolves. I don't have my crystal ball for such occasions :P

The changes requested have been implemented :D


Fix nosetests to run tests only once

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@334a3bb). Click here to learn what that means.
The diff coverage is n/a.

@@          Coverage Diff           @@
##             main      #1   +/-   ##
======================================
  Coverage        ?     65%
======================================
  Files           ?     560
  Lines           ?   26854
  Branches        ?    3877
======================================
  Hits            ?   17497
  Misses          ?    8636
  Partials        ?     721


how to yield from subscription function

I am using riverpod with StreamProvider and want to use yield when new record created but I cant do that because RecordSubscriptionEven output Void at the end

I'm not sure that I understand your use case but I don't think you can yield to the parent context from within the subscribe callback even if the function was async*.
You can try to create your own stream and push data to it via the subscribe callback.
Then inside the riverpod function you can use the await for (not .listen(...)) construct with your stream and yield within its block.

I'm not sure that I understand your use case but I don't think you can yield to the parent context from within the subscribe callback even if the function was async*.
You can try to create your own stream and push data to it via the subscribe callback. Then inside the riverpod function you can use the await for (not .listen(...)) construct with your stream and yield within its block.

Okay its works, but how to query old data tho ??
like I want to aquire existing data if there are some but as long as new data get inserted. it gets automatically added

Okay its works, but how to query old data tho ??

PocketBase realtime events reacts only on changes (aka. create/update/delete of a record).
If you want to fetch the already inserted data you'll have to query it manually with the regular getList()/getFullList() methods.

By the way, you can also check the StateProvider which might be better for your use case since you'll not need the extra stream.
In any case, I'll close the issue for now but feel free to comment if you stumble on something else.


Setting incorrect cron syntax

I wrote the following in schedule.rb:
every :year, at: 'July 26th 3:15 pm' do
#task
end
When I did, whenever added a cron job with the following syntax:
15 15 26 12 * <command> Notice, the month is Dec instead of July.

This PR should fix this: https://github.com/javan/whenever/pull/692.


Create a separate Next application for the news archive

The News archive consists of almost 20.000 static pages from AEM. In order to not have to rebuild the news archive every time we deploy the web application, we should extract that into it’s own application. If we build the menu so that’s it can render in the client, then we would only have to deploy the news archive application once and unless there are problems it could run for years without being touched. This also makes sense from a Next perspective, since we could then identify the most popular archive pages based on page views, build and deploy those, and have the rest of the pages be built on demand. The number of built pages would then increase over time, which means the longer it runs the less pages need to be built.

Duplicate of #374?

This seems indeed to be a duplicate of #374. We need to make a decision. In the meantime I close this one, and we may tack history in 374 instead.


Added option to set permissions using sudo

Codecov Report

Merging #7 into master will decrease coverage by 0.04%.
The diff coverage is 0%.

@@             Coverage Diff              @@
##             master       #7      +/-   ##
============================================
- Coverage     33.58%   33.54%   -0.05%
- Complexity      275      276       +1
============================================
  Files            23       23
  Lines           792      793       +1
============================================
  Hits            266      266
- Misses          526      527       +1

Impacted Files
Coverage Δ
Complexity Δ

src/Console/PermissionsCommand.php
0% <0%> (ø)
3 <0> (+1)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7db9871...70fe2e4. Read the comment docs.


ZTNA client install - updates

🚨 Looks like you arrived from the internal review site
🚨 Do not enter Microsoft confidential information here
[Enter feedback here]
The IPv6 Script provided does a lot more than IPv6 that the customer should be aware of before running.
There should be a warning provided under Disable Ipv6 section, stating we don't recommend customer disable IPv6, DNS over HTTP at scale in production environment without detailed consideration with the network team.
Disabling Ipv6 should not be a pre-requite to install client.
Under pre-requites: need to mention that a local admin credential on the local device required to install the client.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 44c5e5d2-9999-6e26-1a24-a675b878e08a
Version Independent ID: 329a1508-45db-8062-d753-9b9f86629063
Content: How to install the Global Secure Access Windows client
Content Source: articles/global-secure-access/how-to-install-windows-client.md
Service: network-access
GitHub Login: @MicrosoftGuyJFlo
Microsoft Alias: joflore

@Abizerh
Thanks for your feedback! We will investigate and update as appropriate.

#please-close @Abizerh do not use GitHub Issues for this content. I have your email.


[BUG] longhorn_node_cpu_usage_millicpu is missing

Describe the bug (🐛 if you encounter this issue)
I check metrics in lorghorn-manager pod and can't find longhorn_node_cpu_usage_millicpu.
To Reproduce
Deploy longhorn 1.5.1.
Open nodeport for longhorn-backend service.
Curl or open with browser with /metrics path.
Here is what i got from /metrics
I cut only head because it might be too long in this post.
But the metrics that missing should be around longhorn_node_cpu_capacity_millicpu right?
# HELP longhorn_disk_capacity_bytes The storage capacity of this disk
# TYPE longhorn_disk_capacity_bytes gauge
longhorn_disk_capacity_bytes{disk="default-disk-fd0000000000",node="10-136-48-38.ssnc-corp.cloud"} 1.46131648512e+11
# HELP longhorn_disk_reservation_bytes The reserved storage for other applications and system on this disk
# TYPE longhorn_disk_reservation_bytes gauge
longhorn_disk_reservation_bytes{disk="default-disk-fd0000000000",node="10-136-48-38.ssnc-corp.cloud"} 4.3839494553e+10
# HELP longhorn_disk_usage_bytes The used storage of this disk
# TYPE longhorn_disk_usage_bytes gauge
longhorn_disk_usage_bytes{disk="default-disk-fd0000000000",node="10-136-48-38.ssnc-corp.cloud"} 5.5954112512e+10
# HELP longhorn_instance_manager_cpu_requests_millicpu Requested CPU resources in kubernetes of this Longhorn instance manager
# TYPE longhorn_instance_manager_cpu_requests_millicpu gauge
longhorn_instance_manager_cpu_requests_millicpu{instance_manager="instance-manager-96d363ebf476c1997ad21c20e9e122c0",instance_manager_type="aio",node="10-136-48-38.ssnc-corp.cloud"} 480
# HELP longhorn_instance_manager_memory_requests_bytes Requested memory in Kubernetes of this longhorn instance manager
# TYPE longhorn_instance_manager_memory_requests_bytes gauge
longhorn_instance_manager_memory_requests_bytes{instance_manager="instance-manager-96d363ebf476c1997ad21c20e9e122c0",instance_manager_type="aio",node="10-136-48-38.ssnc-corp.cloud"} 0
# HELP longhorn_node_count_total Total number of nodes
# TYPE longhorn_node_count_total gauge
longhorn_node_count_total 7
# HELP longhorn_node_cpu_capacity_millicpu The maximum allocatable cpu on this node
# TYPE longhorn_node_cpu_capacity_millicpu gauge
longhorn_node_cpu_capacity_millicpu{node="10-136-48-38.ssnc-corp.cloud"} 4000
# HELP longhorn_node_memory_capacity_bytes The maximum allocatable memory on this node
# TYPE longhorn_node_memory_capacity_bytes gauge
longhorn_node_memory_capacity_bytes{node="10-136-48-38.ssnc-corp.cloud"} 1.6389722112e+10
# HELP longhorn_node_status Status of this node
# TYPE longhorn_node_status gauge
longhorn_node_status{condition="allowScheduling",condition_reason="",node="10-136-48-38.ssnc-corp.cloud"} 1
longhorn_node_status{condition="mountpropagation",condition_reason="",node="10-136-48-38.ssnc-corp.cloud"} 1
longhorn_node_status{condition="ready",condition_reason="",node="10-136-48-38.ssnc-corp.cloud"} 1
longhorn_node_status{condition="schedulable",condition_reason="",node="10-136-48-38.ssnc-corp.cloud"} 1
# HELP longhorn_node_storage_capacity_bytes The storage capacity of this node
# TYPE longhorn_node_storage_capacity_bytes gauge
longhorn_node_storage_capacity_bytes{node="10-136-48-38.ssnc-corp.cloud"} 1.46131648512e+11
# HELP longhorn_node_storage_reservation_bytes The reserved storage for other applications and system on this node
# TYPE longhorn_node_storage_reservation_bytes gauge
longhorn_node_storage_reservation_bytes{node="10-136-48-38.ssnc-corp.cloud"} 4.3839494553e+10
# HELP longhorn_node_storage_usage_bytes The used storage of this node
# TYPE longhorn_node_storage_usage_bytes gauge
longhorn_node_storage_usage_bytes{node="10-136-48-38.ssnc-corp.cloud"} 5.5954112512e+10
# HELP longhorn_rest_client_rate_limiter_latency_seconds Rate limiter latency in seconds. Broken down by verb and URL.

Environment

Longhorn version: 1.5.1
Installation method (e.g. Rancher Catalog App/Helm/Kubectl): helm
Kubernetes distro (e.g. RKE/K3s/EKS/OpenShift) and version: 1.26.0

Number of management node in the cluster: 6
Number of worker node in the cluster: 7

Node config

OS type and version: Centos8
Kernel version:
CPU per node: 4
Memory per node: 16
Disk type(e.g. SSD/NVMe/HDD): SSD
Network bandwidth between the nodes:

Underlying Infrastructure (e.g. on AWS/GCE, EKS/GKE, VMWare/KVM, Baremetal): W=VMWare
Number of Longhorn volumes in the cluster:

Additional context

It seems that the longhorn_node_memory_usage_bytes is also missing. This could indicate a possible failure during scraping. It is hard to tell without the logs. You can look into the manager logs of errors, or provide the support-bundle for analysis.

@c3y1huang Thank you for you reply. Understood I will try to get log from longhorn_manager pod.


Fix timestamp response certificate verification

Hello,
I found that OpenSSL does not verify the timestamp response properly in a specific case.
Specifically in cases when the timestamp authority response with more than one certificate ids in the signing certificate section.
Coincidentally, @zhanzhenzhen found the same bug at almost the same time as me.
Most of the debugging work was done by him.
Basically, when the response provides one signing certificate, OpenSSL verifies one certificate fingerprint, but when facing multiple signing certificates, OpenSSL attempts to verify the chain beyond what is specified by the response.
For instance, when two certificate fingerprints are specified in the response but the chain length is three, OpenSSL tries to match all three of the certificates with the set of two certificate fingerprints, which isn't quite working.
The actual request and response found in the wild can be found at #14190.

Could you please submit a CLA? https://www.openssl.org/policies/cla.html
Also, it would be nice to add the test case to 80-test_tsa.t

I will do the CLA + tests later.
For now, I found the patch is not correct. (working on it)
In the meantime, could anyone confirm some terms in RFC 2634, section 5.4?
It is still ambiguous to me whether OpenSSL is correct and CAs are wrong or vice versa.
The problematic term is authorization certificates.
OpenSSL interprets it as all certificates in the chain, including the trusted root; while some CAs might interpret it as:

All certificates in the chain, excluding the trust anchor
Or all certificates present in the response

In Sectigo's case, they seem to have 2 possible trusted paths, but they only respond with the fingerprints of the certificates included in their response.
So we (I) have three possible definitions right now. Could someone clarify the ambiguity?
If CAs are in the wrong, there's no need for any patch for OpenSSL.

@t8m CLA cleared; I also add the test, as you suggested, from the issue thread. I hope it is acceptable.
The CI is queuing on AppVeyor, but it should pass since I did not touch any platform-specific code.
I quite understand why OpenSSL behaves the way it is; the behavior might be the correct interpretation of the standard.
Please note that this is the only chance to review/amend the standard; OpenSSL is the only major implementation that does not agree with the rest. If OpenSSL accepts the pull request, there is no going back, the behavior will become de facto.

In the meantime, could anyone confirm some terms in RFC 2634, section 5.4?

You should probably ask on the mailing list of the IETF LAMPS working group (confusingly named<EMAIL_ADDRESS>, linked from https://datatracker.ietf.org/wg/lamps/about/).
That said, my understanding is that typically one does not expect to send the trust anchor certificate, which would suggest the "All certificates in the chain, excluding the trust anchor" interpretation.

One reason why OpenSSL may be wrong is that the project was never really all that interested in time stamping. The last functional change in apps/ts.c was 08538fc0a57a9317da22958beeab3ff8af4b2ded. Almost all of the work in app/ts.c and crypto/ts was done by Zoltan Glozik of opentsa.org.
So if "everyone else" does it differently from OpenSSL, I would expect OpenSSL is wrong.
I also strongly agree asking the LAMPS group as @kaduk suggested.  Russ Housley is a co-chair of that group and he's deeply involved with CMS, and also OpenSSL's implementation.

I just asked the mailing list. I'll get back to you soon.

Russ gave me a concise reply.
To elaborate on it:
Whether or not the trust anchor should be validated with ESS should be objectively focused.
ESS's objective is to prevent the attacks discussed in section 5.1 of the RFC. The attack vector described is not applicable to trust anchors.
So, he confirmed that we should validate every certificate in the chain except the root certificate.
I can't make the right call myself because I lack an understanding of attack vectors.
But luckily, the confirmed method happens to be the easiest way forward, and I already implement them as described. I also wrote the tests observed from the real CAs, which happened to have the exact problem described in section 5.1.2 of the RFC.
This is the minimal patch for the preliminary solution.

I am willing to also provide the backport to 1.1.1, it seems the function names are different.
ESS module is also used in email verification. If I have some spare time later, I will refactor and unify the code, too; the code for RFC2634 is scattered everywhere. (2 places now to be precise) It would be better to implement the functionality once (in the ESS module) and apply it everywhere.

@t8m wrote:
The all-zero tsq and tsr files are empty. Is that right?

The files are encoded in der format, so GitHub doesn't show the content. You can see that they contain something by looking at their size.

@t8m wrote:
The all-zero tsq and tsr files are empty. Is that right?

The files are encoded in der format, so GitHub doesn't show the content. You can see that they contain something by looking at their size.

Ah, this is totally confusing. Why is GitHub saying the files are empty and not that they are just binary? Anyway when I click on the view file I can see there is some content.

In the meantime, could anyone confirm some terms in RFC 2634, section 5.4?

That said, my understanding is that typically one does not expect to send the trust anchor certificate, which would suggest the "All certificates in the chain, excluding the trust anchor" interpretation.

Although for the sentences in question, namely

The first certificate identified in the sequence of certificate
identifiers MUST be the certificate used to verify the signature.

and

If more than one certificate is present in the sequence of
ESSCertIDs, the certificates after the first one limit the set of
authorization certificates that are used during signature validation.

the interpretation "either only the signer cert or all the chain except the root" makes sense,
in my view it is not the most general possible sensible (and supposedly intended) interpretation, but:
Each of the given ESSCertIDs requires the presence of a certificate with the given identification,
no matter at which position in the chain it appears, while the first ESSCertID must refert to the signer cert.
So for a chain of length >=4 the signer may, for example, give three such ESSCertIDs referring to the 1st (signer) cert, the 3rd (intermediate CA) cert, and the root CA cert.

So I believe the search logic should be generalized and inverted as follows.
Add to ess_lib.c (and the respective decl to include/crypto/ess.h):
/* Returns < 0 if certificate is not found, certificate index otherwise. */
int ossl_ess_find_cid(const STACK_OF(X509) *certs,
                      ESS_CERT_ID *cid, ESS_CERT_ID_V2 *cid_v2)
{
    unsigned char cert_digest[EVP_MAX_MD_SIZE];
    unsigned int len, cid_hash_len;
    int i;
    const ESS_ISSUER_SERIAL *is;

    if (certs == NULL || (cid == NULL && cid_v2 == NULL))
        return -1;

    /* Look for cert with cid in the certs. */
    for (i = 0; i < sk_X509_num(certs); ++i) {
        const X509 *cert = sk_X509_value(certs, i);
        const EVP_MD *md;

        /* TODO(3.0): fetch sha algorithm from providers */
        if (cid != NULL)
            md = EVP_sha1();
        else
            md = cid_v2->hash_alg == NULL ? EVP_sha256() :
                EVP_get_digestbyobj(cid_v2->hash_alg->algorithm);
        cid_hash_len = cid != NULL ? cid->hash->length : cid_v2->hash->length;
        if (!X509_digest(cert, md, cert_digest, &len)
                || cid_hash_len != len)
            return -1;

        if (memcmp(cid != NULL ? cid->hash->data : cid_v2->hash->data,
                   cert_digest, cid->hash->length) == 0) {
            is = cid->issuer_serial;
            if (is == NULL || ess_issuer_serial_cmp(is, cert) == 0)
                return i;
        }
    }

    return -1;
}

Replace in ts_rsp_verify.c the definition of ts_check_signing_certs() by:
static int ts_check_signing_certs(PKCS7_SIGNER_INFO *si,
                                  STACK_OF(X509) *chain)
{
    ESS_SIGNING_CERT *ss = ossl_ess_signing_cert_get(si);
    ESS_SIGNING_CERT_V2 *ssv2 = ossl_ess_signing_cert_v2_get(si);
    int i, j;
    int ret = 0;

    /*
     * Check if first ESSCertIDs matches signer cert
     * and each further ESSCertIDs matches any cert in the chain.
     */
    if (ss != NULL) {
        for (i = 0; i < sk_ESS_CERT_ID_num(ss->cert_ids); i++) {
            j = ossl_ess_find_cid(chain, sk_ESS_CERT_ID_value(ss->cert_ids, i),
                                  NULL);
            if (j < 0 || (i == 0 && j != 0))
                goto err;
        }
        ret = 1;
    } else if (ssv2 != NULL) {
        for (i = 0; i < sk_ESS_CERT_ID_V2_num(ssv2->cert_ids); i++) {
            j = ossl_ess_find_cid(chain, NULL,
                                  sk_ESS_CERT_ID_V2_value(ssv2->cert_ids, i));
            if (j < 0 || (i == 0 && j != 0))
                goto err;
        }
        ret = 1;
    }

 err:
    if (!ret)
        ERR_raise(ERR_LIB_TS, TS_R_ESS_SIGNING_CERTIFICATE_ERROR);
    ESS_SIGNING_CERT_free(ss);
    ESS_SIGNING_CERT_V2_free(ssv2);
    return ret;
}

@DDvO Thank you for the review.
I am neither a cryptographer nor a PKI developer, but I respectfully disagree with you; please hear me out.
The current function signature of the ESS module needs to be changed but not in the way you suggested.
Here the reason:
The ESS module should not expose ESS_SIGNING_CERT to the interfaces because the consumer shouldn't care.
The consumer shouldn't care if it v1 or v2. They shouldn't care how to traverse the chain, nor how far the chain should be validated.
If we were to refactor the ESS module, the code on the consumer side should look like:
static int ts_check_signing_certs(PKCS7_SIGNER_INFO *si, STACK_OF(X509) *full_chain) {
  ESSVerifier *verifier = ossl_ess_new_verifier(si);
  int valid = ossl_ess_verify(verifier, full_chain);
  if(!valid)
    ERR_raise(ERR_LIB_TS, TS_R_ESS_SIGNING_CERTIFICATE_ERROR);
  ossl_ess_cleanup(verifier);
  return valid;
}

I avoided touching the ESS module in this pull request because it will take more reviewers and more time before the pull request is mergeable. This is simply the minimal change.
If you prefer a cleaner interface, I'd gladly send another pull request at a later time.
If you have specific concerns or reasons, please elaborate. I will work something out after understanding you better.
You can also continue reviewing the pull request in other areas. Again, thank you for looking into the code.

Almost all of the work in app/ts.c and crypto/ts was done by Zoltan Glozik of opentsa.org.

Yes, and the original contribution was done in 2006 in c7235be6e36c4bef84594aa3b2f0561db84b63d8, with the implementation dating back to 2002.

As @DDvO finding, I tweak the branching logic a bit to address RFC 5035, section 2.

If both attributes (signingCertificate and signingCertificateV2) exist in a single message, they are independently evaluated.

The original code before tweaking has been wrapped inside the loop.

Closed (the interpretation and supported reasons in favor of the former implementation already raised in S/MIME mailing list)
New interpretation provided by Russ Housley in favor of #14503
https://mailarchive.ietf.org/arch/msg/spasm/ORSSD8NzTWOI3QCB60zw3GBp1d4/
Errata to RFC 2634 for clarification is underway.


Avoid creating an illegal pointer

Found by tis-interpreter

+1

I actually pushed a new commit to this


Add new line to end of generated database.yml

Be a good Unix citizen and end with a newline - http://stackoverflow.com/a/729795/191127

@skinofstars thank you for that, but can you please have a look why all the tests have failed?

@skinofstars would you like to try again now that the tests are fixed?

I restarted the one failing test run. Let's see how it goes ...


Wrong smart contract address for RVL Token

address: "0x41f615e24fabd2b097a320e9e6c1f448cb40521c",
symbol: "RVL",
decimal: 18,
type: "default"

The given address seems to be wrong. It was a fund by accident, I assume they could be more. It would be nice to run a script and validate all addresses given the pattern

Does this address contain a smart contract?
Does this address contain at least a single ERC20 transaction

To clean it up.
WDYT?

@allquantor sounds like a good way to validate them. I'm unsure how to achieve the second part at the moment but I've created a nodejs script that checks whether the address is a smart contract or not. Here's the checker. Let me know what you think.

@gamalielhere There is a way to approximate the second.
a.) Fetch the ABI from Etherscan (if available) and check if Transfer, Approval.. events are included.
b.) If no ABI get a couple of Transactions from the smart-contract, get the TxReceipts, look into the logs of TxReceipts if they contain valid data e.g keccak256("transfer(address,amount)"...
Although this still does not give a 100% probability because it does not cover ERC20 contracts without transactions. Well than you can redeploy the bytecode on your private chain and try to fuzz the VM traces.
We developed an app that does it at @toknapp, I will look for a way to make it opensource.
Cheers


[openturns] update to 1.22

[X] Changes comply with the maintainer guide
[X] SHA512s are updated for each updated download
[ ] ~The "supports" clause reflects platforms that may be fixed by this new version~
[ ] ~Any fixed CI baseline entries are removed from that file.~
[ ] ~Any patches that are no longer applied are deleted from the port's directory.~
[X] The version database is fixed by rerunning ./vcpkg x-add-version --all and committing the result.
[X] Only one version is added to each modified port's versions file.

hi @jiayuehua, maybe you would want to retry for 1.23 ?


Error when merging Accounts

Getting the following error when attempting to merge two Accounts:

We couldn't merge these accounts.
ApexRollupAccountTrigger: execution of AfterDelete caused by: System.IllegalArgumentException: Where clause entered incorrectly: (Age2__c IN ('0-Current', '1-30 Days', '31-60 Days')) AND AcctSeed__Customer__c = :recordIds AND Age2__c IN ('0-Current', '1-30 Days', '31-60 Days') Exception: List index out of bounds: 19 Class.RollupEvaluator.WhereFieldEvaluator.recursivelyCreateConditions: line 396, column 1 Class.RollupEvaluator.WhereFieldEvaluator.createConditions: line 294, column 1 Class.RollupEvaluator.WhereFieldEvaluator.: line 239, column 1 Class.RollupEvaluator.getWhereEval: line 30, column 1 Class.Rollup.getWrappedMeta: line 2169, column 1 Class.Rollup.processCustomMetadata: line 2065, column 1 Class.Rollup.runFromApex: line 1762, column 1 Class.Rollup.runFromTrigger: line 1690, column 1 Trigger.ApexRollupAccountTrigger: line 3, column 1 Class.RollupEvaluator.WhereFieldEvaluator.createConditions: line 298, column 1 Class.RollupEvaluator.WhereFieldEvaluator.: line 239, column 1 Class.RollupEvaluator.getWhereEval: line 30, column 1 Class.Rollup.getWrappedMeta: line 2169, column 1 Class.Rollup.processCustomMetadata: line 2065, column 1 Class.Rollup.runFromApex: line 1762, column 1 Class.Rollup.runFromTrigger: line 1690, column 1 Trigger.ApexRollupAccountTrigger: line 3, column 1
What's also odd is that on both Accounts, there are no child billing records (which is what this rollup is referencing). We have v1.6.33 installed of ApexRollup.

Also confirmed it is not limited to these specific Accounts.  Any Accounts I attempt to merge get this error.

@baobao917 good to hear from you, though I'm sorry it's under these circumstances. at the moment you can disable by setting Is Merge Reparenting Disabled to true on the org default rollup control record. I am trying to wrap up work on a few other reported issues at the moment so I won't get the chance to look at this issue this week. If it's alright with you, hopefully we can coordinate a time that I can take a look once I've finalized v1.6.34!

@jamessimone No worries.  When you get a chance to look at it.  I think you mean 'Is Merge Reparenting Enabled' = TRUE.  It is already set to that.

@baobao917 my mistake - you can uncheck that to unblock yourself in the meantime


add ContentMimeType.bytes to display slice of bytes

about slow down of compilation:

I'll make an other PR to display timing in Jupyter also for command like :dep (and in jupyter is take time to run first :dep, maybe because of download time).
on my desktop including base64 into evcxr_runtime is +0.25s (or +100% of the time)

➜  evcxr_runtime git:(runtime-bytes) ✗ cargo clean
➜  evcxr_runtime git:(runtime-bytes) ✗ time cargo build
   Compiling byteorder v1.2.7
   Compiling base64 v0.10.0
   Compiling evcxr_runtime v1.1.0 (/Users/davidb/src/github.com/davidB/evcxr/evcxr_runtime)
    Finished dev [unoptimized + debuginfo] target(s) in 1.88s
cargo build  0.50s user 0.42s system 47% cpu 1.951 total

vs
➜  evcxr_runtime git:(master) ✗ cargo clean
➜  evcxr_runtime git:(master) ✗ time cargo build
   Compiling evcxr_runtime v1.0.0 (/Users/davidb/src/github.com/davidB/evcxr/evcxr_runtime)
    Finished dev [unoptimized + debuginfo] target(s) in 0.90s
cargo build  0.28s user 0.28s system 59% cpu 0.953 total

feel free to merge or reject.

I move the code behind a features "bytes"
➜  evcxr_runtime git:(runtime-bytes) ✗ cargo clean
➜  evcxr_runtime git:(runtime-bytes) ✗ time cargo build
   Compiling evcxr_runtime v1.1.0 (/Users/davidb/src/github.com/davidB/evcxr/evcxr_runtime)
    Finished dev [unoptimized + debuginfo] target(s) in 0.86s
cargo build  0.29s user 0.28s system 62% cpu 0.912 total
➜  evcxr_runtime git:(runtime-bytes) ✗ cargo clean
➜  evcxr_runtime git:(runtime-bytes) ✗ time cargo build --features bytes
   Compiling byteorder v1.2.7
   Compiling base64 v0.10.0
   Compiling evcxr_runtime v1.1.0 (/Users/davidb/src/github.com/davidB/evcxr/evcxr_runtime)
    Finished dev [unoptimized + debuginfo] target(s) in 1.50s
cargo build --features bytes  0.45s user 0.36s system 52% cpu 1.552 total


new docs theme has lost the next&prev navigation links

which is a bit of a shame

@spf13 : I don't think this is a novice/beginner issue, neither a kind/writing. It requires understanding and making changes to the https://github.com/docker/docs-base project to autogenerate next/prev navigation links in the docs

Fair point. We probably need a new label for what kind this is. I'll move it to intermediate in the meantime.

I think that this issue belongs here : https://github.com/docker/docs-base/issues

@ankushagarwal I agree. No way to easily move it though. We just need to recreate it over there and then close this. @SvenDowideit Do you agree?

@spf13 yup, moved as https://github.com/docker/docs-base/issues/7


Read article "Event-sourcing and the event-replay mystery"

https://dev.to/boostercloud/event-sourcing-and-the-event-replay-mistery-4cn0

Nothing here
The author just does an event replay with a snapshot instead of a replay from the beginning of event


Engine Revs Conversion Incorrect

Engine Revs Conversation Incorrect
0503CBh is 328651 decimal. Decimal point is in the wrong place.
14:29:13.3561 Destination Specific for PGN 65253 for SPNs  Request to Engine #1 (0)
14:29:13.3577 18EA00F9 [3] E5 FE 00 (TX)
14:29:13.3661 18FEE500 [8] A2 90 01 00 CB 03 05 00
Engine Hours, Revolutions from Engine #1 (0):
 SPN   247, Engine Total Hours of Operation: 5128.100 h
 SPN   249, Engine Total Revolutions: 328651000.000 r

I wish you cared…mmsOn Apr 29, 2024, at 4:14 PM, ericthomasswenson @.***> wrote:
Engine Revs Conversation Incorrect
0503CBh is 328651 decimal. Decimal point is in the wrong place.
14:29:13.3561 Destination Specific for PGN 65253 for SPNs  Request to Engine #1 (0)
14:29:13.3577 18EA00F9 [3] E5 FE 00 (TX)
14:29:13.3661 18FEE500 [8] A2 90 01 00 CB 03 05 00
Engine Hours, Revolutions from Engine #1 (0):
 SPN   247, Engine Total Hours of Operation: 5128.100 h
 SPN   249, Engine Total Revolutions: 328651000.000 r
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you are subscribed to this thread.Message ID: @.***>

The J1939DA SLOT (id 34) for SPN 249 has a scale factor of 1000, should this be changed?
@ericthomasswenson


offline install

I want to install the following package from github. I tried offline install
First, I download with  git clone https://github.com/JuliaRegistries/General.git
when I add ./General in REPL.
But I get the following error,
could not find project file in package at ../../registries/General maybe subdir needs to be specified

The issue tracker is for reporting bugs.
Please ask questions on Julia Discourse: https://discourse.julialang.org/


Write proper tests using mox library for macro

https://github.com/plataformatec/mox
Jose Valim's post about behaviours will be helpful - http://blog.plataformatec.com.br/2015/10/mocks-and-explicit-contracts/

Hello there.
Yes, I am working, but cannot finish it, as of now. Please allow me some
more time for the same.
Thanks,
Aman Singh
On Sun, Sep 16, 2018 at 9:45 PM Gitcoin.co Bot<EMAIL_ADDRESS>wrote:

@aman935 https://github.com/aman935 Hello from Gitcoin Core - are you
still working on this issue? Please submit a WIP PR or comment back within
the next 3 days or you will be removed from this ticket and it will be
returned to an ‘Open’ status. Please let us know if you have questions!

warning (3 days)
escalation to mods (6 days)

Funders only: Snooze warnings for 1 day
https://gitcoin.co/issue/exthereum/ethereumex/25/668?snooze=1 | 3 days
https://gitcoin.co/issue/exthereum/ethereumex/25/668?snooze=3 | 5 days
https://gitcoin.co/issue/exthereum/ethereumex/25/668?snooze=5 | 10 days
https://gitcoin.co/issue/exthereum/ethereumex/25/668?snooze=10 | 100
days https://gitcoin.co/issue/exthereum/ethereumex/25/668?snooze=100
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/exthereum/ethereumex/issues/25#issuecomment-421789639,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHdXlu5ZfQBlmCx5uuE03Xq41r5LnsP6ks5ubnkegaJpZM4UohLF
.

@ceresstation - is this bounty still active (shows up as open but expired on Gitcoin explorer)?

@ceresstation - is this bounty still active (shows up as open but expired on Gitcoin explorer)?


Update some more benchmarks to use correct evaluation context (PLT-9713)

This updates the BLS12-381 and Marlowe benchmarks to use the more precise evaluation strategy introduced in #5867.
Don't review it yet: I want to update some of the benchmarks but before I do that I want to get a fair comparison with the old versions.

/benchmark bls12-381-benchmarks

/benchmark marlowe

/benchmark bls12-381-benchmarks

/benchmark bls12-381-benchmarks

/benchmark validation

/benchmark marlowe

/benchmark marlowe

/benchmark validation

/benchmark validation

/benchmark bls12-381-benchmarks

/benchmark validation

/benchmark bls12-381-benchmarks

/benchmark marlowe

I''m going to close this in favour of #5892 .  That makes the same changes but has less noise from the benchmarking. Also this one seems to be broken for some reason.


loki.rules.kubernetes: Add support for clustered mode

PR Description
This change adds support for updating Loki rules based on PrometheusRule objects when running in clustered mode. It does this by picking a single instance to be the leader responsible for making changes using the Loki API. Other non-leader instances will not process events or make calls to the Loki API.
Which issue(s) this PR fixes

Fixes #976
Notes to the Reviewer
PR Checklist

[x] CHANGELOG.md updated
[ ] Documentation added
[ ] Tests updated
[ ] Config converters updated

@thampiotr Thanks for running the tests, I adapted the code according to the results. can you please run them again?
Thanks

Did a new commit with fixes. @thampiotr, let's hope it's better now.

use sync loki instead of eventprocessor. I hope this solves it @thampiotr

@thampiotr Thanks for running the tests, made some mistakes I tried to solve now, can you run them again for https://github.com/grafana/alloy/pull/1057 and https://github.com/grafana/alloy/pull/1058? Thanks


Fix linter

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 88.499%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1562

Relevant Lines:
1765

💛  - Coveralls


Allow minimizing Ambie Mini

Ambie Mini uses the CompactOverlay feature provided by uwp. This currently does not support minimizing, but I will try to find a contact to request this feature.

Would it be possible to provide a fake minimize button that first exists compact overlay and then enters back into it when restored?

@JaiganeshKumaran I don't think it'll look perfect with the offset on the left of the caption buttons (which is reserved as a drag area by the system by default).
I doubt there's an existing API for minimizing on compact overlay mode either.


OpenGL Tutorials

Summary of the PR
This PR adds OpenGL tutorials to the Silk.NET website, using the code provided by the existing samples.
Related issues, Discord discussions, or proposals
https://discord.com/channels/521092042781229087/587346162802229298/1037331531619905596
Further Comments
I'd like to add a couple more tutorials before merging the PR, just so that there is enough to get started with.

Thanks for the contribution! I like what you've written, but I will be leaving a few comments 👀

Nicely done!

I like the friendly writing
You explain what each line of code does instead of just it, letting readers better understand
Nice to mention the "next tutorial", so readers know what to do next
Nice to link the discord server!

I've added most of the suggested changes - just left a couple that I will wait on your response for before I add them.
I was originally going to change the > [!Note] stuff, but seems like you're planning to add that? It would be very handy (my tutorials will make heavy use of them), as will warnings too.

Looking great!

I was originally going to change the > [!Note] stuff, but seems like you're planning to add that? It would be very handy (my tutorials will make heavy use of them), as will warnings too.

I mean, I did intend on adding it at some point. Don't know when I'll get a chance, but essentially it'll just end up being similar to the FancyImage shortcode (implemented in FancyImageShortCode.cs) to output something like
<div class="alert alert-info">
Content...
</div>

Adding a shortcode is very easy, tbh the Silk.NET.Statiq project is super easy to navigate so if you wanted to give it a go by all means do! If not, just leave it as is for now and hopefully someone gets round to it.

Giving @ThomasMiz authority over this one given Thomas is probably the best maintainer for documentation/OpenGL user experience (and given I don't have anything to add :))

Adding a shortcode is very easy, tbh the Silk.NET.Statiq project is super easy to navigate so if you wanted to give it a go by all means do! If not, just leave it as is for now and hopefully someone gets round to it.

I'll take a look at adding it, it will be very handy to have for the tutorials.

I will get back to the tutorial shortly, just juggling various projects and some irl issues. I'd like to complete the tutorial I'm currently working on and then I'll probably send a review request so it can potentially be merged! Ultimately I'd like to cover all existing samples, including OpenAL, before I branch out into more advanced topics and I'd also like to do D3D ones as well if someone doesn't start that before I do.

Okay, both tutorials should finally be complete. The site builds fine, and if all is well I am happy for this to be merged if you wish to.
I'll PR in the next set of tutorials later down the line.

Excellent work on the hello quad tutorial! I like it a lot. The tutorial is mostly straightforward, but mentions technical bits and pieces along the way as to not turn into a "just copy code, don't understand it". There is good pacing by interlacing code and theory.
I've come to appreciate how long these can take to write when I started writing some myself, so we're very grateful you've taken the time to make these.

I appreciate the comments & suggestions! And yeah, it was a lot more effort than I was expecting too. Many tutorials just seem to be the "here copy this code and it works and you don't need to know why" sorta thing and I absolutely hate that, so I made sure to explain exactly what was going on.
I've committed most of the suggestions, I've left a couple open since I won't commit that exact suggestion but I'll write close to it, and a couple have been left open as I don't agree with a couple of changes, but if you wish I am happy to change them too.
I'll make the finishing touches tomorrow, and then if all is good it should be complete!

Seems like everything has now been resolved, so if all is good then this this PR should be ready.
I'll get to the next set of tutorials soon and submit a new PR for those. Trying to write at least two at a time, depending on their complexity, and more if possible.


Add help/usage logic to runme

rume.sh should check for arguments and print usage if none, or on --help

Addressed in #14


Workload identity federation permission boundary problem with AWS ECS

All containers running in an AWS ECS Cluster have permissions to make Google Cloud API calls as opposed to just the one required task.
To configure the workload identity federation for making Google Cloud API calls from AWS, we bind an AWS role ARN to a Google Service account. And the Google cloud SDK uses the AWS metadata endpoint to retrieve the current active role. When we run this inside an AWS ECS task, the metadata endpoint returns the underlying EC2 node role instead of the Task role. This forces the user to bind the underlying node role, thereby providing expanding the permission boundary more than desired. This also hinders least privileged access - meaning provide Tasks with their own level of permissions.
There is some inconsistency in the AWS metadata endpoint (when running inside EC2 or Lambda vs ECS) and the way the Google Cloud SDK retrieves the active AWS role.
https://github.com/googleapis/google-auth-library-java/blob/1149581e63267e3553c74ba2114d849c5b24f27b/oauth2_http/java/com/google/auth/oauth2/AwsCredentials.java#L107

Updated assignee internally

@lsirac

Hey @ColeSiegelTR can you clarify what the inconsistency is here?

Hi @bojeil-google, the metadata endpoint returns the underlying EC2 node role instead of the current active Task role, which forces us to provide a larger scope of permissions than required when configuring workload identity federation with GCP. I would expect that when binding an AWS role with GCP workload identity, we can specify the AWS role of the task rather than the AWS role of the node.

This is what is made available by AWS. We need the ability to generate signed requests for the desired AWS role. We can either do it via AWS metadata server directly or via AWS environment variables. Basically we use the AWS security credentials to create the signed requests and verify them on our end.
You can't just specify a role explicitly as we cannot trust that. We can only trust signed requests.
Maybe you should reach out to AWS support about this. Perhaps they have some other endpoint or ability to generate signed requests using the current active task role.

Hi @bojeil-google
I did some research and they do have an endpoint for receiving ECS task metadata as opposed to the fetching the underlying EC2 node's metadata.
https://docs.aws.amazon.com/AmazonECS/latest/developerguide/task-metadata-endpoint.html
I think this library should be using the task metadata endpoint <IP_ADDRESS>, but it is instead using the underlying EC2 metadata endpoint <IP_ADDRESS>. This means we need to expand permissions more broadly than we would've liked.
Let me know if it makes sense or if you need more clarification.

The library is doing as expected. We are not going to change the existing behavior. However, we will do more research on supporting this use case (and what the ECS task metadata provides) and treat it as a feature request. Customers may end up choosing which one to use.

Hey @bojeil-google
Thanks for your response, that makes sense. I am quite new to this library myself so I need to dig in a bit more on our use case and also understand how these metadata endpoints are retrieved by the library. We appreciate you taking a look and I will provide more information if I have any.

I'm going to close this, feel free to reopen or ask us to if you have additional questions.

Hey @lesv and @bojeil-google
Is there any ticket we can track for the feature request? I took a closer look at the code and it doesn't look there is anything we can do on our end to better support this use case. Thanks a lot.


[DRAFT][FLINK-33734] Merge unaligned checkpoint state handle

What is the purpose of the change
Merge and serialize the state handles of unaligned checkpoint on TaskManager to potentially reduce checkpoint production time. Details in FLINK-33734.
Brief change log

Extract interface ChannelState,InputStateHandle,OutputStateHandle as mark of state handle of unaligned checkpoint
Introduce merged channel state handle
Extract interface ChannelStateHandleSerializer
Introduce MetadataV5Serializer for merged channel state handle
Merge and serialize channel state handle before send checkpoint ack to JobManager

Verifying this change
Please make sure both new and modified tests in this PR follows the conventions defined in our code quality guide: https://flink.apache.org/contributing/code-style-and-quality-common.html#testing
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end deployment with large payloads (100MB)
Extended integration test for recovery after master (JobManager) failure
Added test that validates that TaskInfo is transferred only once across recoveries
Manually verified the change by running a 4 node cluster with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and killing one JobManager and two TaskManagers during the execution, verifying that recovery happens correctly.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)

@flinkbot run azure


Is there some way to get the softmax (probability values) from the saved models using the repos code.

Hi, is there some way to get the softmax probability values from the saved models instead of the final class predictions.

Yes, of course. You just need to modify code a little bit and fetch required values under the session scope. For example if you want to fetch logits you need:
modify those lines - https://github.com/ikhlestov/vision_networks/blob/master/models/dense_net.py#L343-L344 with code like: self.logits = logits
and later on provide some additional method:
def fetch_logits(self, inputs):
    feed_dict = {self.images: inputs}
    logits_res = self.sess.run([self.logits], feed_dict=feed_dict)
    return logits_res

With such approach actually you can get values for any tensor, from saved or newly initialized model


Accidentally send SOL to my USDC address in sollet instead of my SOL address

Hi. I accidentally sent SOL to my sollet.io wallet USDC deposit address instead of my sollet.io wallet SOL deposit address. May I request assistance to recover the funds? Or simply move them to my SOL address instead?
Transaction link:
https://explorer.solana.com/tx/LyN4AkGEvWjFS6Dix4EKJ69fV9BPYQLMRk6KdjCEUjZJvcatNmdJqcgB18X8eAjzRc71eLVeWoHrwegP1eBUvW8

@jaymapss if you send SOL to your own SPL token address. You can get the SOL back by "closing' the account. This is a very dangerous thing to do. If you ever send tokens to this address again, you will incinerate them. If you do indeed choose to delete the address to recover your SOL, I recommend making a new wallet. If you really want to delete your spl token account for USDC here are instructions:

go to sollet.io
open the console
type localStorage.setItem('warning-close-account', true)
open up your usdc token in sollet
send all the tokens to a new usdc account
close the old account account by clicking Delete

Please join discord for further assistance.


Fix liked state on new public pages

Fixes #2380
Was faulty getting liked state from viewed user instead of checking it once verified there is a authenticated user (which corresponds to the current user).

please review @javierarce @xavijam

Frontend tests were OK :+1: (details)

sounds good :+1:


Model structure visualization using dot

Hey Francois,
I wrote a small utility to visualize the network structure using pydot. For example, the follow code:
ent_lookup = Sequential()
ent_lookup.add(Embedding(10, 2))
ent_lookup.add(Flatten())

rel_lookup = Sequential()
rel_lookup.add(Embedding(20, 2))
rel_lookup.add(Flatten())

word_sequence = Sequential()
word_sequence.add(Embedding(10, 5))
word_sequence.add(GRU(5, 2))

model = Sequential()
model.add(Merge([word_sequence, ent_lookup, rel_lookup], mode='concat'))
model.add(Activation('relu'))
model.add(Dense(6, 2))
model.add(Activation('softmax'))

g = Grapher()
g.plot(model, 'mymodel.png')

generates something like:

Let me know if you want to merge this. If so, I can polish up the code, add comments and docs etc...

This looks great. Having a paragraph about it in the docs would be neat, certainly. I'll merge this when you tell me it's ready : )

Cool! Good catch on the reserved word :+1: I've changed the reserved word and added some documentation. I wasn't sure where to put the documentation because we don't have one for utils, so I've gone ahead and made one. I put this class inside "Visualization Utilities", which itself is under "Utils". Please feel free to change this.

Should we add some more explicit support for naming layers? I see thats where we get the names on the graph here. Also might be useful for logging...

Actually the way this works right now, it assigns generic names for all instance based on the rule <class_name><number_of_class_intances_seen>. If the model has a name attribute, then that name will be used in the graph.
I agree that supporting explicit names may be useful. It would probably be useful for logging, visualization, and debugging (eg. we can annotate the Theano graph with names).

Indeed, it could be nice to have an optional name argument that could be passed to any layer, and would then be reused in layer visualizations / debugging. I'll look at that very soon...