Built-in datasets: Convert fails

Hey,
I just started playing with this (good work btw).
I have managed to sort out/get working the mnist, cifar10, and silhouette datasets. However, the rest seem to give me some sort of error when I try to convert them, after downloading.
For example I get;

Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py", line 76, in main
output_paths = convert_function(**args_dict)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/adult.py", line 60, in convert_adult
output_path = os.path.join(output_directory, output_filename)
File "/Users/act65/anaconda/lib/python3.5/posixpath.py", line 89, in join
genericpath._check_arg_types('join', a, *p)
File "/Users/act65/anaconda/lib/python3.5/genericpath.py", line 143, in _check_arg_types
(funcname, s.class.name)) from None
TypeError: join() argument must be str or bytes, not 'NoneType'

when I try fuel-convert adult
and

Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py", line 76, in main
output_paths = convert_function(**args_dict)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 198, in convert_celeba
directory, output_directory, output_filename)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/base.py", line 45, in wrapped
return f(directory, *args, **kwargs)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 139, in convert_celeba_64
h5file = _initialize_conversion(directory, output_path, (64, 64))
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 41, in _initialize_conversion
skiprows=2, usecols=tuple(range(1, 41))) +
File "/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py", line 921, in loadtxt
vals = [vals[i] for i in usecols]
File "/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py", line 921, in
vals = [vals[i] for i in usecols]
IndexError: list index out of range

when I try fuel-convert celeba 64
Help??
Also, what are your guys plans for adding more data sets? I wouldnt mind a bit more diversity, eg sequences, audio, even something more exotic like DNA?? I wrote a downloader for some jane austen books, so ill see if i can get those working in the converter although i am sure that is tricky.

Please update your Fuel installation, I believe this was fixed yesterday.
On Apr 8, 2016 2:48 AM, "Alex"<EMAIL_ADDRESS>wrote:

Hey,
I just started playing with this (good work btw).
I have managed to sort out/get working the mnist, cifar10, and silhouette
datasets. However, the rest seem to give me some sort of error when I try
to convert them, after downloading.
For example I get;
Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py",
line 76, in main
output_paths = convert_function(**args_dict)
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/adult.py",
line 60, in convert_adult
output_path = os.path.join(output_directory, output_filename)
File "/Users/act65/anaconda/lib/python3.5/posixpath.py", line 89, in join
genericpath.
*check_arg_types('join', a, p) File
"/Users/act65/anaconda/lib/python3.5/genericpath.py", line 143, in
check_arg_types (funcname, s.__class.name)) from None
TypeError: join() argument must be str or bytes, not 'NoneType'
when I try fuel-convert adult
and
Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py",
line 76, in main
output_paths = convert_function(*
*args_dict) File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py",
line 198, in convert_celeba directory, output_directory, output_filename)
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/base.py",
line 45, in wrapped return f(directory, *args, **kwargs)
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py",
line 139, in convert_celeba_64
h5file = _initialize_conversion(directory, output_path, (64, 64))
File
"/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py",
line 41, in _initialize_conversion
skiprows=2, usecols=tuple(range(1, 41))) +
File
"/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py",
line 921, in loadtxt
vals = [vals[i] for i in usecols]
File
"/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py",
line 921, in
vals = [vals[i] for i in usecols]
IndexError: list index out of range
when I try fuel-convert celeba 64
Help??
Also, what are your guys plans for adding more data sets? I wouldnt mind a
bit more diversity, eg sequences, audio, even something more exotic like
DNA?? I wrote a downloader for some jane austen books, so ill see if i can
get those working in the converter although i am sure that is tricky.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
https://github.com/mila-udem/fuel/issues/341

Ok,
it worked for adult and iris.
still not working for celeba and others?
e.g. i get

Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py", line 79, in main
output_paths = convert_function(**args_dict)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/svhn.py", line 365, in convert_svhn
directory, output_directory, output_filename)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/base.py", line 45, in wrapped
return f(directory, *args, **kwargs)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/svhn.py", line 109, in convert_svhn_format_1
[(split, extract_tar(split)) for split in splits])
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/svhn.py", line 109, in
[(split, extract_tar(split)) for split in splits])
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/svhn.py", line 97, in extract_tar
members = f.getmembers()
File "/Users/act65/anaconda/lib/python3.5/tarfile.py", line 1752, in getmembers
self._load()        # all members, we first have to
File "/Users/act65/anaconda/lib/python3.5/tarfile.py", line 2344, in _load
tarinfo = self.next()
File "/Users/act65/anaconda/lib/python3.5/tarfile.py", line 2275, in next
self.fileobj.seek(self.offset - 1)
File "/Users/act65/anaconda/lib/python3.5/gzip.py", line 366, in seek
return self._buffer.seek(offset, whence)
File "/Users/act65/anaconda/lib/python3.5/_compression.py", line 143, in seek
data = self.read(min(io.DEFAULT_BUFFER_SIZE, offset))
File "/Users/act65/anaconda/lib/python3.5/gzip.py", line 480, in read
raise EOFError("Compressed file ended before the "
EOFError: Compressed file ended before the end-of-stream marker was reached

for fuel-convert svhn 1
and

Traceback (most recent call last):
File "/Users/act65/anaconda/bin/fuel-convert", line 9, in
load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/bin/fuel_convert.py", line 79, in main
output_paths = convert_function(**args_dict)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 198, in convert_celeba
directory, output_directory, output_filename)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/base.py", line 45, in wrapped
return f(directory, *args, **kwargs)
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 139, in convert_celeba_64
h5file = _initialize_conversion(directory, output_path, (64, 64))
File "/Users/act65/anaconda/lib/python3.5/site-packages/fuel-0.2.0-py3.5-macosx-10.5-x86_64.egg/fuel/converters/celeba.py", line 41, in _initialize_conversion
skiprows=2, usecols=tuple(range(1, 41))) +
File "/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py", line 921, in loadtxt
vals = [vals[i] for i in usecols]
File "/Users/act65/anaconda/lib/python3.5/site-packages/numpy/lib/npyio.py", line 921, in
vals = [vals[i] for i in usecols]
IndexError: list index out of range

for fuel-convert celeba 64

Not sure why this was closed when it still seems to be an unsolved problem. I am also getting this outcome
Traceback (most recent call last):
  File "/usr/local/bin/fuel-convert", line 11, in <module>
    load_entry_point('fuel==0.2.0', 'console_scripts', 'fuel-convert')()
  File "/usr/local/lib/python2.7/dist-packages/fuel/bin/fuel_convert.py", line 79, in main
    output_paths = convert_function(**args_dict)
  File "/usr/local/lib/python2.7/dist-packages/fuel/converters/celeba.py", line 198, in convert_celeba
    directory, output_directory, output_filename)
  File "/usr/local/lib/python2.7/dist-packages/fuel/converters/base.py", line 45, in wrapped
    return f(directory, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/fuel/converters/celeba.py", line 139, in convert_celeba_64
    h5file = _initialize_conversion(directory, output_path, (64, 64))
  File "/usr/local/lib/python2.7/dist-packages/fuel/converters/celeba.py", line 41, in _initialize_conversion
    skiprows=2, usecols=tuple(range(1, 41))) +
  File "/usr/local/lib/python2.7/dist-packages/numpy/lib/npyio.py", line 923, in loadtxt
    vals = [vals[i] for i in usecols]
IndexError: list index out of range

This is with the latest versions of Theano, Blocks and Fuel


[Onboarding]: Explore Open Resource Library

Select the onboarding task
Explore Open Resource Library
Comments
No response

Finished MDP 9/14/2024


How to communicate with DeviceHive using curl

I refer to deployment-with-docker and use docker-compose up -d to successfully execute DeviceHive.
I can log in with dhadmin:dhadmin_#911.
Next, I want to test the ApiInfo API
I use the HTTP tool curl to command:
curl -v -X GET http://localhost/admin/admin/info
The returned result is not as shown by the ApiInfo API, the LOG is as follows:
D:\devicehive-docker-3.5.0\rdbms-image>curl -v -X GET http://localhost/admin/admin/info
Note: Unnecessary use of -X or --request, GET is already inferred.
*   Trying <IP_ADDRESS>...
* TCP_NODELAY set
* Connected to localhost (<IP_ADDRESS>) port 80 (#0)
> GET /admin/admin/info HTTP/1.1
> Host: localhost
> User-Agent: curl/7.55.1
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.14.0
< Date: Fri, 09 Apr 2021 08:17:50 GMT
< Content-Type: text/html
< Content-Length: 694
< Last-Modified: Mon, 04 Jun 2018 10:54:51 GMT
< Connection: keep-alive
< ETag: "5b151a7b-2b6"
< Accept-Ranges: bytes
<
<!doctype html><meta charset="utf-8"><title>Devicehive Admin Panel</title><base href="/admin/"><meta name="viewport" content="width=device-width,initial-scale=1"><link rel="icon" type="image/x-icon" href="favicon.ico"><link href="styles.d6b41c382247cdab36d9.bundle.css" rel="stylesheet"/><dh-root></dh-root>* Connection #0 to host localhost left intact

D:\devicehive-docker-3.5.0\rdbms-image>

Is my communication format wrong?
May you provide practical examples?
Thank you.

curl -X GET --header "Accept: application/json" --header "X-Forwarded-Proto: http" "http://localhost/api/rest/info"


frontend ingress: Fix showing ingresses with different kinds of backend

A backend for an Ingress resource may represent a service with a port number, a port name, or it can be a resource reference.
This patch fixes displaying an Ingress for different types of backend and adds also stories to it.
fixes #1323

How to test?

follow this tutorial https://kubernetes.io/docs/tasks/access-application-cluster/ingress-minikube/
change the example-ingress to use name: http instead of port: 8080.

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: example-ingress
  annotations:
    nginx.ingress.kubernetes.io/rewrite-target: /$1
spec:
  rules:
    - host: hello-world.info
      http:
        paths:
          - path: /
            pathType: Prefix
            backend:
              service:
                name: web
                port:
                  name: http


This PR may have to wait as the stable release requires Go 1.18, not sure if that is a hard or soft requirement.

See notes in https://github.com/fluxcd/flux2/issues/2696

@hiddeco always one step ahead. I was doing this work for the Thanos project so though why not just continue as the information was fresh in my head.

@phillebaba please rebase with main where we have Go 1.18

@stefanprodan so I have had the same issues with CodeQL in the Thanos project. It also started happening when I updated the Azure SDK. I don't no if you immediately see what is wrong but I have spent some time trying to figure this out now without any luck.

We can't merge this as the scanning is critical in our release workflow and this week we want to release OCI.

@stefanprodan seems like the issue was not Azure SDK related but rather caused by CodeQL not using the correct Go version. Specifically setting the Go version has solved this issue.
I found this issue which seems to cover the issue we are seeing.
https://github.com/github/codeql-action/issues/1059#issuecomment-1185036511


Job watcher isn't cluster aware

Scenario: Shutdown a VM and then switch the ganeti cluster. Clicking on the job in the watcher now tries to open the job in the currently selected cluster instead of the cluster, where the job was initiated.
Expected behaviour: The job watcher should be cluster aware. It should display the cluster, where the job is running. Also clicking on the job should jump to the correct cluster.

fixed in #62


I am trying to connect a simple app to the hapi fhir, however the class I imported such as AsyncTask and Activitity.java seems to include errors. How can I fix it because it seems that the libraries are recognised but not their path.

NOTE: Before filing a ticket, please see the following URL:
https://github.com/jamesagnew/hapi-fhir/wiki/Getting-Help
Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Environment (please complete the following information):

HAPI FHIR Version
OS: [e.g. iOS]
Browser [e.g. chrome, safari]

Additional context
Add any other context about the problem here.

https://github.com/jamesagnew/hapi-fhir/wiki/Getting-Help


Add support for replacing types in a constructed type/method

This is deep replacement, not a shallow operation
Does not work on types with an Instantation that do not derive from InstantiatedType
Helper for finding if a type is present in constructed type also added

@MichalStrehovsky Michal, could you look at this?

👍


Add MATE.

This commit adds the Hungarian University of Agriculture and Life Sciences to the list.

@g0mb4 First stage of verification passed, official domain is uni-mate.hu as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@g0mb4 Pull request merged. Thank you!

Thank you!


Fix #591 Add HNil ZipConst

Added the HNil case and ran the tests, seems fine.

LGTM. Many thanks ... merging :-)


Adding support for analogwrite values

The code and library work, but it would be nice if the values in analogwrite were also shown, right now the pins set that way always seem to be off

Support of analog values are now supported in the latest release.


Deployment groups: Page breaks on clicking on Show source info

Checklist:

[x] I've searched in the docs and FAQ for my answer
[x] I've included steps to reproduce the bug.

Describe the bug
Page breaks on clicking on show source info while triggering deployment via deployment groups
To Reproduce

Create a deployment group
Click on [Deploy]
Click on 'Show source info' against any image
Page breaks

Expected behavior
The page should not break and required details should be available.
Screenshots

AB#216

This is duplicate of https://github.com/devtron-labs/devtron/issues/2299 ,so closing it.


Update ne-fwpsk-fwps_fields_ale_auth_recv_accept_v6_.md

Removing preclassify layer info.

Hi @MihaiSP, thanks for the PR. The changes look good, so I'll go ahead and get this merged for you. Should be live shortly.


About pcore number and documentation

Hello, thank you for your hard work and open source code
I see that the readme description of tensor has 28 Pcores, but I found in the documentation and code that 2 cells are instantiated, each cell has 4 Pcores, and there are only 8 Pcores in total, am I wrong?
And could you please update all the documents? Thank you for your hard work.

ztachip design supports a large number of pcores.
It is currently limited to 8 due to FPGA resources available of Artix-7

From: KalamataTech @.>
Sent: July 28, 2024 5:49 AM
To: ztachip/ztachip @.>
Cc: Subscribed @.***>
Subject: [ztachip/ztachip] About pcore number and documentation (Issue #23)
Hello, thank you for your hard work and open source code
I see that the readme description of tensor has 28 Pcores, but I found in the documentation and code that 2 cells are instantiated, each cell has 4 Pcores, and there are only 8 Pcores in total, am I wrong?
And could you please update all the documents? Thank you for your hard work.
—
Reply to this email directly, view it on GitHubhttps://github.com/ztachip/ztachip/issues/23, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACSDUFUE2BFTNFJTHEW77TTZOS5BHAVCNFSM6AAAAABLSU4N4OVHI2DSMVQWIX3LMV43ASLTON2WKOZSGQZTGOBUHAYDGMI.
You are receiving this because you are subscribed to this thread.

Thank you for your response.
Do you have any plans for updating the document? Thank you once again.

There are several documents available at https://github.com/ztachip/ztachip under Documentation section.


Slow performance comparing to the "previous" build

Hello,
I created an app based on the Slideshow UWP app. I was using the CompositionImage that was built-in directly in the DLL.
Now, I converted the application with the "new" CompositionImage in the Toolkit.
The big difference between the two version is if you reload the page of the application, in the previous version, for the second time, the image load very quickly (as if the images still in a cache). Now, the second load of the page takes the exact same time for the image to load as the first time (it downloads again the images).
Is there a difference when downloading the images? The previous version was very useful and the user experience increase a lot if the images are somehow "cache" along the way.
Thanks, Adrien.

Hey Adrien, sorry for slow response.  Yes, the toolkit doesn't currently provide any caching for CompositionImage.  Image caching policy is often customized for the individual needs of the application but we are thinking about adding some basic support for it at some point in the future.  For now, if you need caching you should be able to build your own on top of CompositionImage in the Toolkit.
Thanks, Rob.

My point was that the previous version is far more "optimized" in term of "perceived performance" that the current one. I know that there is no caching in the toolkit. I was not able to run again the previous version again (wrong win10 insider version or whatever). Is there any chance you could check that performance fact when you load the page a second time?
I think the new CanvasBitmap.LoadAsync is slow. I'm creating an app that displays multiples tile images to make one big image and the download of each tile images is very problematic. Compare to a web based version the download of images is very very slow. I don't know if this problem is linked to the previous one.

I may have a local repro of what you are seeing.  We'll investigate and reply back with what we find.  Thanks!

Do you have any news regarding this issue ?
Thanks.

We've identified a couple of bugs in the image loader sample code that may be causing the perceived perf issues.  We don't yet have fixes available but will post back here as soon as we do.
One option for you to consider if you are blocked by this is to try using Win2D for image loading for now.
thanks

Thanks @robald.
We are currently iterating on our loading story.
@pellea we have some more questions on your specific scenario:

Have you tried using CanvasBitmap.LoadAsync? If so, when you say compared to a web version, do you mean compared to loading images in a browser or using something like HttpClient.GetBufferAsync to download the image?
In your scenario, are you interested in applying image effects during load time?
Have you tried using XAML image loading and using interop to manipulate the visuals that way using ElementCompositionPreview.GetElementVisual(imageControl)?

There are lots of ways to load images in the system today and we're working to get a good mix of feature for folks specifically targeting Windows.UI.Composition.

Based on all the test I have made, the HttpClient.GetBufferAsync is the better choice to quickly load images. But currently I load them with the imageFactory of the toolkit (because I need to use the UI Composition).
I do not need image effect. I only need to place them in a "grid-like control" and wrap them of a specific-colored border. I do not know how many columns/rows the "grid" will have in advance. And yes, I did try to load image in XAML but it's too "difficult" to place them dynamically where I want with XAML only.
Please do not forget that the first load of images isn't the initial problem. The problem is when I load a second time the same page, the images were loaded very quickly (as if images were cached somewhere) and it's not anymore the case.

Thanks for the feedback. We are definitely looking into this.
Just out of curiosity, what are the aspects of Windows.UI.Composition are you using for your scenario?

I'm trying to make my inventory of Guild Wars 2 into an app.  That part works really fine.
I can give you (in private) my solution if you want to see which crappy things I'm doing :)

@pellea this has been super helpful.
What I'm going to do now start breaking down this big issue into smaller issues to have some folks address certain parts of it.
Just to recap the main issue we've been talking about this - is that correct?:

Second load of the image seems to take the same amount time as the first time loading an image

Outside of that, have you looked at using image loading in XAML with something like Image, BitmapImage or BitmapSource? There are many case where displaying a grid of images might be more well suited using a GridView and Image controls.
And then lastly what were the aspects of Windows.UI.Composition you wanted to use in your example?

Just to recap the main issue we've been talking about this - is that correct?:
 Now in later build it take the same amount of time.
I used the Toolkit for loading images asynchronously using the CompositionImage.ImageLoaded (like the gallery example).

Perfect thanks for the clarification.

Closing. Have a look at the new ImageLoader in the SampleCommon's project for loading image data into CompositionDrawingSurfaces.


Not loading

I believe this started after last update. Getting two errors:
This error originated from a custom integration.
Logger: homeassistant.config_entries
Source: custom_components/flichub/init.py:81
Integration: Flic Hub (documentation, issues)
First occurred: May 8, 2023 at 7:49:07 PM (4 occurrences)
Last logged: 10:10:27 AM
Error setting up entry <IP_ADDRESS> for flichub
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
result = await component.async_setup_entry(hass, self)
File "/config/custom_components/flichub/init.py", line 81, in async_setup_entry
hass.config_entries.async_setup_platforms(entry, [BINARY_SENSOR])
AttributeError: 'ConfigEntries' object has no attribute 'async_setup_platforms'
And
Logger: pyflichub.client
Source: runner.py:179
First occurred: 4:25:26 AM (4 occurrences)
Last logged: 8:14:02 AM
Failed to connect to socket at ('<IP_ADDRESS>', '8124')

I'm getting the same error:
2023-05-14 00:01:00.725 ERROR (MainThread) [homeassistant.config_entries] Error setting up entry <IP_ADDRESS> for flichub
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/config_entries.py", line 387, in async_setup
result = await component.async_setup_entry(hass, self)
File "/config/custom_components/flichub/init.py", line 81, in async_setup_entry
hass.config_entries.async_setup_platforms(entry, [BINARY_SENSOR])
AttributeError: 'ConfigEntries' object has no attribute 'async_setup_platforms'

It's working now with the new version! Thank you

Sorry that it took me a while to fix. I'm glad to hear that it is working now again!


自动化测试体系

Scala Unit Test:
http://www.scalatest.org/
https://alvinalexander.com/scala/writing-tdd-unit-tests-with-scalatest
https://semaphoreci.com/community/tutorials/a-hands-on-introduction-to-scalatest

Spark Unit Test:
https://semaphoreci.com/community/tutorials/a-hands-on-introduction-to-scalatest
http://mkuthan.github.io/blog/2015/03/01/spark-unit-testing/
https://github.com/bosea/spark-unit-testing
https://stackoverflow.com/questions/43729262/how-to-write-unit-tests-in-spark-2-0
https://www.slideshare.net/knoldus/unit-testing-of-spark-applications
https://www.linkedin.com/pulse/unit-testing-apache-spark-applications-scala-python-choudhary/
http://www.jesse-anderson.com/2016/04/unit-testing-spark-with-java/
https://blog.knoldus.com/2017/12/25/spark-streaming-unit-testing-dstreams/
https://dzone.com/articles/testing-spark-code
https://blog.cloudera.com/blog/2015/09/making-apache-spark-testing-easy-with-spark-testing-base/
https://codurance.com/2016/08/02/testing-spark-streaming-unit-testing/
https://conferences.oreilly.com/strata/big-data-conference-ny-2015/public/schedule/detail/42993
https://fifthelephant.talkfunnel.com/2017/39-beyond-unit-tests-deployment-and-testing-for-hadoo
http://googlielmo.blogspot.hk/2017/06/unit-testing-spark-applications-in.html
https://www.supergloo.com/fieldnotes/spark-streaming-testing-scala/
https://engblog.nextdoor.com/unit-testing-apache-spark-with-py-test-3b8970dc013b
http://tech.ovoenergy.com/spark-streaming-in-production-testing/
https://nuinublog.wordpress.com/2016/04/20/spark-job-unit-testing/


[GSSoC'21] Matching Github links of two different projects in Gssoc website under project

Above projects have the same links.  Kindly check.

can I work on this?

Its working fine for me....

I dont think its an issue now, @ArchishmanSengupta you can close this

sure @ArunTeltia


[WIP] Automated provisioning

[x] Install girder stack
[x] Install rabbitmq as task broker
[x] Install girder worker
[x] Create admin user and worker robot user
[x] Install and run service scripts for girder and the worker
[x] Install HistomicsTK, DSA, and large_image plugins into girder
[x] Enable all required plugins
[x] Configure system settings for the worker and homepage text
[x] Create filesystem assetstore
[ ] Ensure existence of TCGA collection in girder
[ ] Upload sample image file?

@zachmullen If possible, it would be nice if you could put in the instructions that build ITK with python wrapping within the deployment scripts.
Right now ITK is available for use in CLIs that are run within docker via this base image. But if we want to use ITK while running outside docker, we are required to build ITK on our machine and add it to python path.

Going forward, we will start using ITK within the core functions of HistomicsTK whenever needed.
If we want to let developers use this infrastructure to setup a common development environment, then i think it would be nice if it installs of python wrapped ITK as well. Maybe make it optional to be used only to setup development environment?

Ok, I'll make it into its own role in ansible so we can easily choose whether or not to deploy it.

I think that's a good solution to maintain the possibility of a fast & lightweight deployment.

Since the Vagrant file is using trusty as the base, we'll need to build our own OpenJPEG, then build libtiff and OpenSlide to use the correct versions.  It is possibly that if we switched to xenial as the base we could avoid having to do that, but I haven't tested that (I've tested building our own OpenJPEG on xenial, and that works.

Is OpenSlide something that should be in its own role also, or do our girder plugins' server side code depend on it?

The server doesn't strictly depend on it.  We need it to read certain files (including the ones from the TCGA archive), but one could avoid those files.

OpenSlide has a couple possible important uses - providing uniform access key image metadata like magnification (regardless of vendor) and enabling access to unadulterated pixel data.

Everything is here now except an "upload a sample image" step, which I'm not sure exactly how to handle at this point.
Be warned, the ITK build step takes multiple hours on my laptop inside vagrant. We may be able to optimize it a bit by turning off more components, but I wasn't sure exactly which configure definitions to use, so for now it's just -DBUILD_TESTING:BOOL=OFF -DITK_WRAP_PYTHON:BOOL=ON.

Do we care about ansible warnings?  For instance, I get [WARNING]: Consider using get_url or uri module rather than running curl as I run this.

Good point, I'll switch to using get_url so we don't download the file if we already have it.

Very good.  The ITK build time is tedious -- is there a way to ask not to build it during the vagrant up/provision command?  Or, do you need to log into the VM and run ansible manually to skip the ITK build?
I'd like to include a few sample images, so one could run at least one of the HistomicTK analyses without any further downloads or work.  @cdeepakroy, @cooperlab, and @dgutman are there some good sample images we should use (and have appropriate license terms for us to distribute them in this way)?  We could, at least, include a folder in the TCGA collection called 'demo' or 'test' and place the images we use for testing (Easy1.png and L1.png).

This morning, I get an error:
WARNING: The following packages cannot be authenticated!
  mongodb-org-shell mongodb-org-server mongodb-org-mongos mongodb-org-tools
  mongodb-org

though it looks like the GPG key for mongo was added properly.

David M.,
This is a great idea - I can pick a couple that have some interesting cells. All TCGA images are public and unrestricted.
We can either have them run at install or have DSA download and insert pre-run results with the images.
Lee Cooper, Ph.D.
Assistant Professor of Biomedical Informatics
Assistant Professor of Biomedical Engineering
Emory University School of Medicine - Georgia Institute of Technology
<EMAIL_ADDRESS>tel:<PHONE_NUMBER>

From: David Manthey<EMAIL_ADDRESS>Sent: Wednesday, August 3, 2016 8:17:30 AM
To: DigitalSlideArchive/HistomicsTK
Cc: Cooper, Lee; Mention
Subject: Re: [DigitalSlideArchive/HistomicsTK] Automated provisioning (#138)
Very good. The ITK build time is tedious -- is there a way to ask not to build it during the vagrant up/provision command? Or, do you need to log into the VM and run ansible manually to skip the ITK build?
I'd like to include a few sample images, so one could run at least one of the HistomicTK analyses without any further downloads or work. @cdeepakroyhttps://github.com/cdeepakroy, @cooperlabhttps://github.com/cooperlab, and @dgutmanhttps://github.com/dgutman are there some good sample images we should use (and have appropriate license terms for us to distribute them in this way)? We could, at least, include a folder in the TCGA collection called 'demo' or 'test' and place the images we use for testing (Easy1.png and L1.png).

You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/DigitalSlideArchive/HistomicsTK/pull/138#issuecomment-237221058, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ABXuke_ZNB0WNAoj6xPVLw-cFLgn1X-Kks5qcIbagaJpZM4JXqth.

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.
If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).

Very good. The ITK build time is tedious -- is there a way to ask not to build it during the vagrant up/provision command?

Sure, we just exclude it from the list of roles in vagrant.yml.

WARNING: The following packages cannot be authenticated!
mongodb-org-shell mongodb-org-server mongodb-org-mongos mongodb-org-tools
mongodb-org

I'm seeing that as well, must have been a remote change in the last day or so. I'll look into it.

It seems the mongo failure is just a mistake by the package managers, hopefully they will have it resolved soon. I'll try again later today and see.

So I think it would be nice to have a script that pulls test data.. but ideally the data would live outside of the VM per se... like in a "local" directory on the machine that is actually hosting the vagrant file..

By default, vagrant maps the top-level directory into the VM under the directory /vagrant, so we could have a step that does a local import from within that directory to expose files from the host in girder.

LGTM
We should add the test data script and linkage in another PR.

@zachmullen
I just tried:

download and install vagrant
pip install ansible
git clone git@github.com:DigitalSlideArchive/HistomicsTK.git
git checkout ansible-provisioning
vagrant up
vagrant ssh

I was able to generate the vagrant box and ssh into it smoothly.
Where in the vagrant box are all the repos (HistomicsTK, girder, large_image etc) clones?

Pretty much everything gets placed under the path specified by the root_dir variable, which right now is set as /opt/histomicstk.
I'll merge this and commit the sample image stuff on a subsequent PR.


vscode not start

The window opens and then closes immediately.
Here are some details
$ lsb_release -a
Description:	Ubuntu 22.04.4 LTS

$ code --version
1.90.0
89de5a8d4d6205e5b11647eb6a74844ca23d2573
x64

$ code --verbose
[0607/043112.785497:ERROR:directory_reader_posix.cc(43)] opendir HOME/.config/Code/Crashpad/attachments/e69b0a9f-e782-42f3-ae05-800ff544c0d1: No such file or directory (2)
Gtk-Message: 04:31:12.791: Failed to load module "appmenu-gtk-module"
[34662:0607/043112.929711:WARNING:bluez_dbus_manager.cc(248)] Floss manager not present, cannot set Floss enable/disable.
libGL error: MESA-LOADER: failed to open iris: /usr/lib/dri/iris_dri.so: impossibile aprire il file oggetto condiviso: File o directory non esistente (search paths /usr/lib/x86_64-linux-gnu/dri:\$${ORIGIN}/dri:/usr/lib/dri, suffix _dri)
libGL error: failed to load driver: iris
libGL error:
MESA-LOADER: failed to open iris: /usr/lib/dri/iris_dri.so: impossibile aprire il file oggetto condiviso: File o directory non esistente (search paths /usr/lib/x86_64-linux-gnu/dri:\$${ORIGIN}/dri:/usr/lib/dri, suffix _dri)
libGL error: failed to load driver: iris
libGL error: MESA-LOADER: failed to open swrast: /usr/lib/dri/swrast_dri.so: impossibile aprire il file oggetto condiviso: File o directory non esistente (search paths /usr/lib/x86_64-linux-gnu/dri:\$${ORIGIN}/dri:/usr/lib/dri, suffix _dri)
libGL error: failed to load driver: swrast
............................
............................
............................

Why?

#212494

Merging to https://github.com/microsoft/vscode/issues/212494
You can start the application with --use-angle=swiftshader as workaround until fix is released.

--use-angle=swiftshader

NOT WORK :(

Hello @deepak1556 what is the plan to release an update to Ubuntu 22.04?

@leocostaba, he said in a week. Source.


api changed in 1.4.2

I tried
diff --git a/blue-app-samplesign/Makefile b/blue-app-samplesign/Makefile
index e5a885e5c7225..5d3f91cd63831 100755
--- a/blue-app-samplesign/Makefile
+++ b/blue-app-samplesign/Makefile
@@ -33,6 +33,7 @@ SDK_SOURCE_PATH += lib_stusb lib_stusb_impl

 DEFINES += APPVERSION=\"$(APPVERSION)\"

+DEFINES += CX_COMPLIANCE_141
 DEFINES += OS_IO_SEPROXYHAL IO_SEPROXYHAL_BUFFER_SIZE_B=128
 DEFINES += HAVE_BAGL HAVE_SPRINTF
 DEFINES += PRINTF\(...\)=

as suggested in #8 but doesn't work for me :/

Should not be necessary with the latest commit


Disable aos-delay for mobile layout

Love how easy this is to implement and use, the only issue I'm having is that if I want to use data-aos-delay to offset the timing of animations to create a more unique experience on desktop, I don't want this to happen on mobile.
For instance, I might have three images in a single row on desktop, and I use delay so that the first image animates, the second one does shortly after, and the third one last. However, on mobile, these images are now stacked instead of side by side, so now I want them to animate without delay since they won't all be on screen at the same time.

Hey, sorry for late answer. I get your point here, however this library was specifically made using CSS, so that you can override whatever you need dynamically. In your case you could just add:
@media screen and (max-width: 480px) {
  [data-aos-delay] {
    transition-delay: 0 !important;
  }
}

and it should work as you expect :) Let me know if this works for you.

For me it works if you and s, i don't know why. Without it it doesn't change.
[data-aos-delay] {
transition-delay: 0s !important;
}

Good point @zzseba78, I did a mistake there :)

How about offset?

is there any way to disable aos-delay for specific classes and NOT the whole page entirely?

For me it works if you add s, i don't know why. Without it it doesn't change.
[data-aos-delay] {
    transition-delay: 0s !important;
}

@zzseba78 You are correct. It doesn't work without adding 's' as suffix along with 0.

For me it works if you add s, i don't know why. Without it it doesn't change.
[data-aos-delay] {
    transition-delay: 0s !important;
}

@zzseba78 You are correct. It doesn't work without adding 's' as suffix along with 0.

@lorynchen As such:
[data-aos-delay] {
   &.yourclass{
          transition-delay: 0s !important;
   }
}


Add avalon kars epic theme by sameul kim

Song Name
avalon kars epic theme
Artist Name
sameul kim
Source
Direct file download
Youtube Link
No response
Direct File Link
https://app.mediafire.com/hda26486j4kx1
Song ID
63082
Start Offset [ms]
5
Extra
Created from Auto Nong.
Created for level: 108712788

reject
non-YouTube sources are not supported, unless it is a permanent direct download link from a CDN that has given permission for Auto Nong to download from


fix: types

This PR includes:

add package manager to root package.json
add unbuild dev dependency in library package.json
build valibot using unbuild instead Vite: Vite still there, if you want still use it (you can remove the dependency)
exports all submodules
added dts file per submodule for node10: included in dist package entry
tsc will be only used to copy source files to dist folder once built
udpated playground script to generate also stubs

If you want to only export the index module:

remove all library d.ts files from library folder, remove also d.cts ones, don't remove index.d.cts
remove all exports from library package.json (keep only ".")
remove "resolveJsonModule": true  from library tsconfig file: only used to read the import entry from the package exports
remove all code from build.config.ts file, keep only the import and the default export using defineBuildConfig (remove also the type from the import)
replace entries with entries: ['src/index'], in build.config.ts file
remove *.d.ts from library package.json dist option, don't remove *.d.cts

You can build and pack valibot: pnpm build && pnpm pack and upload generated tgz file to https://arethetypeswrong.github.io/
closes #7

Thanks for your research and technical implementation! What is the advantage of the submodules and the .d.ts and .d.cts files in the library directory? I have not fully understood this yet.

About submodules, here none. About d.cts and d.ts, you need to add both to allow use valibot in CJS and ESM, check typescriptlang link, TypeScript requires both.

Do these files have to be in the library directory or can they also be in dist?

Must be on root, ts resolution will lookup them for node10, dist folder will be regenerated on each build.
Check the resolutions entries in https://arethetypeswrong.github.io/ wirh the tgz file

Would we save all the hassle if we generated a single .mjs, .cjs, .d.ts and .d.cts from the many files in the build step? I don't want to complicate the repository unnecessarily. Currently I am a bit averse to the many files in the library directory.

Yes, we only need the index.d.cts and the unbuild.config.ts module, we can remove all the submodules, check first comment about removing submodules.
I'll cleanup the PR tmr.


How to have overlapping elements?

Hi, I'm trying to create a cell that looks like

and I need some help getting the small circle into position. Could someone point me in the right direction?

Help me @joshaber, you're my only hope🔰

Sorry, I've been out of town! Try using a negative margin or padding. I'll try recreating that tomorrow.

Yup, a negative margin will do the right thing. Here's a rough version of that layout:
Element()
	.direction(.Column)
	.justification(.Center)
	.children([
		Element().height(90).children([
			View(backgroundColor: .grayColor()).width(32),
			View(backgroundColor: .blackColor(), cornerRadius: 20).width(40).height(40).margin(Edges(left: -10)).selfAlignment(.Center),
			Element().selfAlignment(.Center).direction(.Column).flex(1).children([
				Label("Lorem Ipsum"),
				Label("Dolor"),
			]),
			View(backgroundColor: .blackColor()).width(30).height(30).selfAlignment(.Center).margin(Edges(right: 10))
		])
	])

Beautiful, thanks.


Handle CTRL-D in REPL

Turns out that's the code path with "curious about why this would happen"!

Done in #178


Service creation / activation fails to json unmarshall when referencing external_link that is of type "service".

Rancher Version: 0.59.1
Docker Version: 1.10.2
OS: Ubuntu 14.04.4 LTS
Steps to Reproduce:

create an applications stack with a service
(eg. Stack called Data, service is consul )
create a new stack with a container that references an external_link that exists in the first "Data" stack that is of type "service".
eg.

my-portal:
    restart: always
    tty: TRUE
    image: some.registry.com:5000/dev/myportal:v2
    expose:
     - "8443"
    external_links:
        - Data/consul:consul
    environment:
        NODE_ENV: "staging"
        MY_BRANCH: "master"

Results:
level=error msg="Failed Creating portal : json: cannot unmarshal number into Go value of type string"
level=error msg="Stack Create Event Failed: json: cannot unmarshal number into Go value of type string" eventId=27b40da6-04b6-4271-911c-cb7fbf1a3fb1 resourceId=1e44
level=info msg="[bugtest:]: Project created " eventId=27b40da6-04b6-4271-911c-cb7fbf1a3fb1 resourceId=1e44

Service never gets activated and hangs indefinitely because external_link doesn't get created.
Expected:
Service gets activated and has access to external_link reference.
Notes: If the external_link is of type "External" instead of "Service", there is no issue.

How are you creating the stack? Through the UI or Rancher-compose?
Duplicate of https://github.com/rancher/rancher/issues/2501
But I still haven't been able ot reproduce

Also, could you share your docker-compose.yml of your other stack that you are linking the service to?

I'm using the Rancher UI + private catalog. Though I've confirmed the same happens if I  just drop in a docker-compose.yml contents into the "Add Stack -> docker-compose.yml dialog box".
For the first (external) Stack, I just created it via the "Data" stack via the U/I but I'll attach the exported config.
compose.zip

Also, I just want to emphasize (because I think it may help), when I cross-stack link to a type "external" service like IP / DNS, it works fine. It's only when I cross-stack link to a type "service" do I run into the issue.

I created your Data stack (with no issues), I then copied and pasted your new stack in the UI and no issues in my setup.
Is this a fresh install or upgraded setup? I have never been able to reproduce and it's not a rancher-compose specific error, since it's json unmarshalling error.

It's a fresh install.
Are you using the same version of Docker?
Maybe it's a regression or similar occurrence of this bug and I need to re-open / open a new issue in the Docker project?
What do you think? I'm hanging out in #rancher on freenode if you want to chat. nick: skel

I created a private repo to test this issue against, https://github.com/Verikon/rancher-test-catalogue.
In theory you should be able to add this github repo as a private registry, and deploy the container, pinging a hostname of "mongo" from within.

FYI, I completely blew away my rancher setup, and installed v0.63.0 fresh and I can no longer create this issue. When I have some time, I'll go back and try again with v0.59.1

@prelegalwonder , thanks - i'll give that a try then.

Confirm that, I do NOT experience a problem when running v0.63.0.

@prelegalwonder @Verikon I'd be surprised if it was a version issue as we didn't make any changes in rancher-compose between the 2 releases.
Would you be okay with closing this and we can re-open if you can reproduce?

Sure np. Thanks for taking the time to look at this!

I was able to recreate this in v0.63.
When the target service has deployed scheduling rules then we can recreate this issue.

thanks @deniseschannon - hope that helps catching the bug.

I am going to try and reproduce shortly cause this bug drives me crazy!

Thank you @Verikon!! I was able to reproduce with your detailed steps. :)

Create a service scheduled on a specific host using the option in the Scheduling tab. "Run All containers on one host"
Add catalog  https://github.com/Verikon/rancher-test-catalogue
Add template and select service from step 1.

great @deniseschannon ; thanks for all your hard work :)

This is occurring due to #3970. Once that is fixed, this use case will be fixed as well.

Closing in favor of https://github.com/rancher/rancher/issues/594


fix typo in default config

change add_id in player.default to app_id

Oh, Thank you so much! I didn't notice that I made a typo.


How to compute derivative with respect to q

Hi I am trying to compute Lie derivatives of some task space variables (for example y_com(q), y_foot(q)),  this requires computing derivatives with respect to q, does Pinocchio have such a functionality?

You can access them from two sides:

autodiff thanks to the support of CppAD (not yet available in Python)
or analytical derivatives that are available for some quantities. For instance, the dy_com/dq corresponds to the Jacobian of the com quantity (you can call jacobianCenterOfMass(model,data,q)), and dy_foot/dq is the Jacobian of the frame attached to the foot, and provide by computeJointJacobian(model,data,q,joint_id)`

Hi @jcarpent , thanks! Any ways to get second order derivatives with respect to q, in the way of getting analytical derivatives? Because the algorithm requires second-order Lie derivative

Also, is there any example code on CppAD? Fortunately I am using C++ now

@WangKeAlchemist
Alternatively, you could always use the Gauss-Newton approximation, i.e.:
  Fxx = Fx.transpose() * Fx;

We use extensively in our optimal control software called Crocodddyl. The main benefits is fast computation.

@WangKeAlchemist
Alternatively, you could always use the Gauss-Newton approximation, i.e.:
  Fxx = Fx.transpose() * Fx;

We use extensively in our optimal control software called Crocodddyl. The main benefits is fast computation.

That is a good idea, thanks! @cmastalli

Yes, you can access at least kinematics directivities at both first and second orders analytically.

For the CppAD example, please refer to the unit tests or examples.

@WangKeAlchemist Which optimization solver do you use as backend?

@WangKeAlchemist Which optimization solver do you use as backend?

I am using QPOASES

@cmastalli Gauss-Newton is only valid for residual quantities, where at optimum, the residual is close to zero. Otherwise, it is a very poor approximation which will to bad behaviours.

Are you doing Inverse Kinematics? or are you solving nonlinear optimization problems?

Are you doing Inverse Kinematics? or are you solving nonlinear optimization problems?

I am solving dynamics, I have already implemented a task space inverse dynamics controller using Pinocchio for the bipedal robot in my lab (https://www.imperial.ac.uk/robot-intelligence/robots/slider/). Now I find another inverse dynamics algorithm using Control Lyapunov Functions (https://arxiv.org/pdf/1910.10824.pdf). And their method requires second order Lie derivatives.

OK. If you need specific features, we may think to implement them if we think they might useful for other people.

OK. If you need specific features, we may think to implement them if we think they might useful for other people.

Hi @jcarpent , for our case, it is enough for now to get kinematics directivities at both first and second orders analytically, If my derivation about the algorithms is correct.

OK. So referring to the unit test is currently the best choice, as we don't have enough human power to set examples. If you would like to contribute, providing examples would very useful for everyone ;)

I will close this issue as it seems to be solved. Feel free to reopen it if needed.


Unique coloured chat channels (set per player)

Summary
Each channel with its own configurable chat colour rather than just &f.
How to
Cloth Config
Motivation
QoL

What happens when SS+ use chat colours?

Ignore the colour overrides for senior staff/admin only maybe? I'm not sure


Make test.dart support Emacs buffers better

In particular, if stdout.supportsAnsiEscapes is false, don't output ANSI.
Also, output stdout/stderr of tests that are normally silenced, if they fail.
Also, update the output to be more convenient when debugging.
Also, expand some abbreviations.

Fantastic! LGTM


refactor: clean out prover instance

Moves sorted_polynomials out of prover instance.
and some other stuff (wip).
Please read contributing guidelines and remove this line.

Benchmark results
Metrics with a significant change:

note_trial_decrypting_time_in_ms (64): 133 (+138%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit 640c89a0 and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
5,668
18,820
36,356

l1_rollup_calldata_gas
66,364
239,080
469,772

l1_rollup_execution_gas
647,462
929,438
1,305,952

l2_block_processing_time_in_ms
1,298 (-3%)
4,726 (-1%)
9,489 (+4%)

note_successful_decrypting_time_in_ms
169 (-28%)
524 (-5%)
1,011 (-1%)

note_trial_decrypting_time_in_ms
71.3 (+67%)
43.1 (-40%)
:warning: 133 (+138%)

l2_block_building_time_in_ms
17,973 (-4%)
68,469 (-1%)
135,943 (-2%)

l2_block_rollup_simulation_time_in_ms
8,026 (-2%)
28,755 (-1%)
56,549 (-1%)

l2_block_public_tx_process_time_in_ms
9,926 (-4%)
39,658 (-2%)
79,293 (-2%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
14,048 (-1%)
27,151 (-1%)

note_history_successful_decrypting_time_in_ms
1,233 (-2%)
2,469 (-4%)

note_history_trial_decrypting_time_in_ms
60.0 (-40%)
154 (+20%)

node_database_size_in_bytes
18,628,688
35,065,936

pxe_database_size_in_bytes
29,859
59,414

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
280 (-1%)
44,366
28,244

private-kernel-ordering
215 (-1%)
52,868
14,326

base-parity
1,822 (-2%)
128
311

base-rollup
719 (-1%)
165,787
925

root-parity
1,542 (-2%)
1,244
311

root-rollup
51.8
4,487
725

private-kernel-inner
641 (-1%)
73,771
28,244

public-kernel-app-logic
444 (-2%)
35,260
28,215

public-kernel-tail
173 (-1%)
40,926
28,215

merge-rollup
8.27 (-2%)
2,696
925

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.1
16.0 (-1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.6
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.590 (+1%)
0.494 (-1%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
45.8
72.2 (-1%)
229 (-2%)
445
883 (-1%)
1,721 (-1%)
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
96.0
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.470
0.445 (-1%)
0.419 (-2%)
0.416
0.419
0.413 (-1%)
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
53.9
107 (-2%)
336 (-1%)
660
1,310 (-1%)
2,605 (-1%)
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
104
207
691
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.480
0.484 (-1%)
0.458
0.455
0.454
0.453
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
61.2

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
109

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.535

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes

tx_size_in_bytes
22,012

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes

tx_pxe_processing_time_ms
3,203 (-5%)
1,753 (-1%)

Metric
0 public data writes
1 public data writes

tx_sequencer_processing_time_ms
11.4 (+6%)
1,241 (-2%)


Ensure database socket connections are cleaned up

What was wrong?
We use a socket to connect to the base database.  This socket was not being closed anywhere which resulted in a number of warnings during shutdown.
How was it fixed?
Convert to use context management API to ensure that the database gets closed down as expected.
Cute Animal Picture

I'm moving forward with this as-is.  I generally agree on your points about this being able to be used incorrectly but I'm not overly concerned about it right now and it's something I can cleanup in a subsequent sweep.

I'm moving forward with this as-is. I generally agree on your points about this being able to be used incorrectly but I'm not overly concerned about it right now and it's something I can cleanup in a subsequent sweep.

Mind adding a tracking issue?


u-law encoding

Paper indicates wavenet encodes waveform in u-law encoding. :)
https://github.com/ritheshkumar95/WaveNet/blob/master/dataset.py#L177

That is implemented in https://github.com/ibab/tensorflow-wavenet/blob/master/wavenet/ops.py#L44.

Oh, I didn't know that. Closing issue.


accounts: password hashing

Problem
Invenio password hashing is based on MySQL's AES encryption of the email address using the password as secret key.
This means e.g. that if the email address of a user is changed their password is invalidated.
Proposal

Explicitly store password salt instead of relying on email address.

Support multiple hashing algorithms concurrently.

Support automatic deprecation and migration of hashes when user signs in.

Support for overlay specific algorithms for password hashing.

Deprecate Invenio's hashing algorithm in favour of SHA512.

Implementation wise this will add two columns to user table: password_salt and password_scheme. Additionally password hashing will rely on passlib library for all the low-level machinery.

Implementation
See PR #2873

cc @jmartinm @jalavik @kaplun @ludmilamarian @egabancho @tiborsimko @jirikuncar

I like the proposed implementation. I guess this superseeds #1529

I'll consider this RFC as accepted, since nobody complained so far and IRL discussions have agreed to it. I'll close it via commit message from PR #2873

Sad, I just saw it but why SHA-2 ? I know that SHA-3 is young but SHA-1 has been compromised, SHA-2 is basically based on the same principle as SHA-1.
http://competitions.cr.yp.to/sha3.html
Password hashing :
https://password-hashing.net/timeline.html
It could be cool to always be on top of the art in terms of security solution.

Sad, I just saw it but why SHA-2 ? I know that SHA-3 is young but SHA-1 has been compromised, SHA-2 is basically based on the same principle as SHA-1.

Firstly, the RFC makes sure that we can use any hashing algorithm in the future and automatically migrate existing hashes. Hence, you just need implement your SHA3 hasher , and then we can support SHA3.
I.e. we'll always be on top of the latest hashing solution :-)

Why not SHA3

Simply because passlib does not support it. See https://code.google.com/p/passlib/issues/detail?id=42
Argument is that it's easier to make brute force attacks.

Okay, it makes sense. Thanks for the answer.

I'll consider this RFC as accepted, since nobody complained so far and IRL discussions have agreed to it. I'll close it via commit message from PR #2873

Yes.  We should probably remove the RFC label in cases like this, when the matter was agreed upon but takes some time to implement, so that the issue would be better label-separated from the other outstanding RFCs.

@tiborsimko @jirikuncar  :+1:


Set a jump point when using imenu

:ghost: :lollipop:

This sets a jump point before jumping, which is what was missing.  It seems we already set a jump point after, somehow.

Good point! Thanks again for the help!


Refactor common code for checking if a directory is templated

Just filing an issue so that we don't lose track...
@michaeljoseph had some suggestions about this as part of his #260 proposal:

c804ead460d1691f317327b7ea1d5cf96f3d8430
1023b7dedbc16ac9dece2798c5bfbcfa27392e3b
42a2811aa78da6f13e62860c3cb003d6edd170b3
and possibly other commits from #260, which I'll list as I find them

To keep my merging work on #260 manageable for myself, I skipped addressing these and didn't merge them, but it would be good to revisit this.
Some thoughts:

Since the code for this can be hard to read, keeping it in a function would probably be good
I'm not entirely sold on refactoring the function's code into a list comprehension, seems a bit hard to read, debug via breakpoints, and enhance with more logic in the future as edge cases are found. (just thinking aloud here)

Closing this issue as it's been inactive for several months. Please feel free to open a new issue or reopen this issue. Thanks! 👋


File versioning in the windows installer zip file?

For the 1.30.1 release, the Windows installer is released as crc-windows-installer.zip
This archive contains these files:
cab1.cab
cab2.cab
cab3.cab
crc-windows-amd64.msi

I think these files should be in their own directory (crc-windows-1.30.1-amd64/)? Maybe we could also version the msi name?

When we only ship the installer, the zip could be renamed to crc-windows-amd64.zip for consistency with the other platforms.

is the naming of the file something we control ?

We control the name of the unsigned tarball, dunno how the signed tarball is generated. Might need sync with the team doing the signing.

Let's revisit this when we start shipping the electron installer.


Make the WebAssembly runtime configurable

Right now the WebAssembly runtime is initialized with default settings only:
https://github.com/libsql/libsql/blob/bd68c17adf23c038fcfc44813ea2a943b423ca63/src/rust/wasmtime-bindings/src/lib.rs#L80-L90
It would be nice to have a way of modifying the defaults, e.g. the WebAssembly stack size, various time limits, profiling, preemptions, etc. Here's how Wasmtime can be configured: https://docs.wasmtime.dev/api/wasmtime/struct.Config.html
libsql_wasm_engine_new function does not take parameters now, but we could extend it with a configuration struct, that can be used to pass custom options, e.g. passed as preprocessor macros or a custom PRAGMA statement.

@psarna I claim the issue. I was waiting for someone to do so, but since no one yet, this issue interests me.

Thanks for volunteering! If you need any guidance, feel free to ask

@psarna Does this looks like something good to start? P.s. i am super new to Rust.
pub fn libsql_wasm_engine_new<Struct>(configs: Option<Struct>) -> *const c_void {
     let engine = match Engine::new(&Config::new()) {
         Ok(eng) => eng,
         Err(_) => return std::ptr::null() as *const c_void,
     };

 }

Also, in the docs i can only see methods. Where are we passing the option params next?


Add toleration helm

could you please also change the caching node's node selection at these 2 places also please
https://github.com/simplyblock-io/spdk-csi/blob/master/charts/latest/spdk-csi/templates/caching-node.yaml#L49-L50
https://github.com/simplyblock-io/spdk-csi/blob/master/deploy/kubernetes/caching-node.yaml#L49-L50

Done


[#1645] feat(server): Add gauge metrics for reading data

What changes were proposed in this pull request?
Add two metrics for each reading memory/index/local files:

Add a gauge metric for its threads number.
Add a gauge metric for its reading size.

Why are the changes needed?
Fix https://github.com/apache/incubator-uniffle/issues/1645.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Existing UTs.

@zuston @jerqi PTAL.


Mine new genesis block

https://en.bitcoin.it/wiki/Testnet

Also see https://github.com/gavinandresen/bitcoin-git/commit/feeb761ba07af74a7cd78b8c8f7c2a961fd9ea1c


DAO attacker did nothing wrong.

DAO attacker did nothing wrong.

This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a temporary error. The following address(es) deferred:
<EMAIL_ADDRESS>Domain rtfs.hu has exceeded the max emails per hour (156/150 (104%)) allowed.  Message will be reattempted later
------- This is a copy of the message, including all the headers. ------
Received: from github-smtp2-ext1.iad.github.net ([<IP_ADDRESS>]:35195 helo=github-smtp2a-ext-cp1-prd.iad.github.net)
by cp5.ezit.hu with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256)
(Exim 4.88)
(envelope-from<EMAIL_ADDRESS>id 1csDbW-001vdT-03
for<EMAIL_ADDRESS>Sun, 26 Mar 2017 21:13:30 +0200
Date: Sun, 26 Mar 2017 12:11:48 -0700
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=github.com;
s=pf2014; t=1490555508;
bh=Sz7FvkIEUoKaJhMTrwORTszwOttZdFr4DqJq6M1c0qg=;
h=From:Reply-To:To:Cc:In-Reply-To:References:Subject:List-ID:
List-Archive:List-Post:List-Unsubscribe:From;
b=EpHpg53mnrPIBojjM79QuOjuLW43xBIPwLVC3r25Xan3H9T5D0+ZsnjCXt7vditPz
1hZmbgKxa9QOUpnjqw53MxWOFxtzXlzKJWhXqhLNtFg1eFas2zoGv+D1FvsS8CpeEM
yCwv27mQPACrJdZ8/OabFGpHDgRHL2JsALh7Hx/I=
From: Martin Holst Swende<EMAIL_ADDRESS>Reply-To: ethereum/remix<EMAIL_ADDRESS>To: ethereum/remix<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Message-ID<EMAIL_ADDRESS>In-Reply-To<EMAIL_ADDRESS>References<EMAIL_ADDRESS>Subject: Re: [ethereum/remix] DAO attacker did nothing wrong. (#387)
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="--==_mimepart_58d81274d9ed7_78ed3ff68032dc304154d0";
charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
X-GitHub-Sender: holiman
X-GitHub-Recipient: axic
X-GitHub-Reason: subscribed
List-ID: ethereum/remix <remix.ethereum.github.com>
List-Archive: https://github.com/ethereum/remix
List-Post<EMAIL_ADDRESS>List-Unsubscribe<EMAIL_ADDRESS>https://github.com/notifications/unsubscribe/AABPdDHFYo07Y3WCOHpc2uagzfaIADYjks5rprh0gaJpZM4MpiWC
X-Auto-Response-Suppress: All
X-GitHub-Recipient-Address<EMAIL_ADDRESS>----==_mimepart_58d81274d9ed7_78ed3ff68032dc304154d0
Content-Type: text/plain;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Closed #387.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/ethereum/remix/issues/387#event-1015781797
----==_mimepart_58d81274d9ed7_78ed3ff68032dc304154d0
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Closed #387.
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.

----==_mimepart_58d81274d9ed7_78ed3ff68032dc304154d0--


Handle non-Lustre files gracefully in dstripe

While filtering a list of files in dstripe, if a file
is not part of a lustre file system, simply skip it
for now.
I figure skipping the file would be appropriate since
we can't obtain lustre striping information and it clearly
states in the man pages that this tool only works for
lustre files. If it doesn't show up in the report, then
it should be assumed it's not a candidate for restripe.
Thoughts on that?

Thanks, @dinatale2.  Sounds reasonable to me.  In keeping with the (verbose) coding style, please update the if/continue blocks to have braces, then go ahead and merge in.


Add 'query' support to Contact data object

I've added a wrapper for the contact/query route to the Contact data object.
.search and .emarsys_id return an error (2010) when there are duplicates (mail address e.g.).
Please consider merging this feature. Let me know if can improve this PR.
Signed-off-by: Henning Vogt<EMAIL_ADDRESS>

@henvo looks good.  Will merge and create a new release shortly.

@henvo released as part of gem version 0.3.9


Improve error reporting

This PR adds an additional check to the event handlers for unhandledrejection and error to improve error reporting.
This should be an improvement over the last version, as it should not allow for Cannot assign to read only property 'name' of object

Do you think that that code would ever execute, though? event.error instance of Error did not evaluate to true in that case.

@nibhar is right, only Error have stacks, thus if the reason is not instanceof Error, there is no stack. Thus this special handling is only for all values passed into a reject(), that are not errors, and which will be processed correctly with these changes.

Next time, you can merge single-commit PRs with the "Rebase and merge" option, to not clutter the graph with merge-lines


Getting wrong outcome name in Bell message when disputing scalar market to "0"

Create a scalar with range -10 to 30 (can be any positive number
Report any positive number
Then dispute and enter 0
Bell message says I disputed on "invalid" instead of saying to 0 (and the denomination)

The first and thirs messages were disputed to settle at 0 degrees fahrenheit...instead showing rep dded to invalid
They should show the rep amount added to "0 degrees Fahrenheit"

fixed - closing


FIX/issue-#7

fixes https://github.com/types/npm-node-noop/issues/7

Thanks. Given the special use case for noop, we can do that.
Can you add the argument types (any[]) in there? So that it is more complete and won't trigger any issue when user use it with --strict

Thanks!


Custom templates for blobfinder

Include utility functions to generate advanced templates
The combination of background subtraction, radial gradient, antialiased border and elliptical distortion to match the CBED disk as closely as possible gives outstanding results with CBED strain maps at higher convergence angles recorded with fine detector resolution.
Fix a typo in function name. This might break examples or downstream code, should be included in release 0.2.
Closes #392

Thanks!


Number overlaps edge of bar graph making it illegible

The number of queued jobs overlaps the edge of the corresponding bar making it hard to read:

That image shows 127 jobs queued, but at first glance it looks like 12 jobs queued.

The fix should be to add the total number after the bar on the right. The fix might require modifying the html of the entire "row".
http://www.perceptualedge.com/example1.php


Incompatible with v2.9.1 (latest)

This package is incompatible with<EMAIL_ADDRESS>which is the latest version.
It gives the following error: CocoaPods could not find compatible versions for pod "Adapty"
If I downgrade the package to 2.7.0 then it works. According to Discord this is a known issue.
When will this be fixed?

hi @ansh, working on it

@ansh approximately late Jan – early Feb

Hello,
Is there any update about this?

@vladd-g Hi! Is there any update now? Reaching out since this was the timeline I was given.

@hasanfd @ansh @StCyr please update to the 2.9.3 and 2.1.0 respectively

@vladd-g Thank you! 🙌

iOS is working. However, in android, I am getting this error on startup,
IllegalStateException: TypeToken must be created with a type argument: new TypeToken<...>() {}; When using code shrinkers (ProGuard, R8, ...) make sure that generic signatures are preserved.
I am using proguard. So, I gave this config to proguard,
-keep class com.adapty.** { *; }
Is there any config you are aware that I should put for proguard?


Help - Keys not registering

Hi there!
This is my first keyboard and i have very little experience soldering, so I'm pretty sure I'm missing something or even doing something wrong, but I cant see what it is.
I started with the right keyboard, so I soldered all the diodes, the jack and the two resistors. I don't know i the two resistors are needed because I will not put any LED.
The black part of all the diodes is facing left (except 3 that is facing down because they are vertical)
Back

Front

Now i wanted to test the ProMicro USB-C that I've got, so i flashed and put it with the pins. I did not want to solder the ProMicro until i could test everything works.
So i put it like so, and "some" keykcaps on the other side. All keycaps are hotswapable, but they are not solded at the moment.
(The plastic is to tilt it a bit for the picture. I'm sure i doesn't work even when all the pins are full in the ProMicro)
I also tried to fllip the ProMicro and face it the other way

With all this, i plug it to the PC and it's picked up, but it's not registering any key on qmk configurator or PC :(

The ProMicro is workinig, if i short two pins, it shows a key on qmk, but it's not working if i click a key mounted on the pcb
I haven't soldered the Reset button, I plan to do it, but it's required?
Do i need to solder the ProMicro to test if it's working?
Do i need to solder all the Mill-max pins to see if it's working?
Did i something wrong? Do i need to do something different?
Thanks!

It seems I needed to solder the ProMicro 😁


Have installation scripts fetch go depenencies

We need to run this during the install:
go get github.com/shenwei356/xopen
go get github.com/shenwei356/bio/seq

As of November 2019, the installation script does not fetch these dependencies.
causing this error:
Processing dependencies for dashit-filter==2.0
Finished processing dependencies for dashit-filter==2.0
cd misc && go build -o score_guides
score_guides.go:6:2: cannot find package "github.com/shenwei356/bio/seq" in any of:
	/usr/local/Cellar/go/1.13.4/libexec/src/github.com/shenwei356/bio/seq (from $GOROOT)
	/Users/arkadiygarber/go/src/github.com/shenwei356/bio/seq (from $GOPATH)
score_guides.go:7:2: cannot find package "github.com/shenwei356/bio/seqio/fastx" in any of:
	/usr/local/Cellar/go/1.13.4/libexec/src/github.com/shenwei356/bio/seqio/fastx (from $GOROOT)
	/Users/arkadiygarber/go/src/github.com/shenwei356/bio/seqio/fastx (from $GOPATH)
score_guides.go:8:2: cannot find package "github.com/shenwei356/xopen" in any of:
	/usr/local/Cellar/go/1.13.4/libexec/src/github.com/shenwei356/xopen (from $GOROOT)
	/Users/arkadiygarber/go/src/github.com/shenwei356/xopen (from $GOPATH)
make: *** [build-score-guides] Error 1

Thus, before running make, users must run the following three commands:
go get github.com/shenwei356/xopen
go get github.com/shenwei356/bio/seq
go get github.com/shenwei356/bio/seqio/fastx
Thanks,
Arkadiy

This is fixed in ae22f55c9a4a9b4f442ec3d86fd7cdeba4515b7b


Markdown - Orchestra - Markdown round trip reveals inconsistent behaviour

Given that

o2m = orchestra2md using the latest reference file
m2o = md2orchestra without further options

then the following round trips create strange results IMHO.
Lets start with minimal content, .ie. the definition of the Heartbeat message as file0
### Message Heartbeat type 0 category Session (1)

#### Synopsis

The Heartbeat monitors the status of the communication link and identifies when the last of a string of
messages was not received.

| Name            | Tag       | Presence | Documentation                                                        |
|-----------------|-----------|----------|----------------------------------------------------------------------|
| StandardHeader  | component | required | MsgType = 0                                                          |
| TestReqID       | 112       | optional | Required when the heartbeat is the result of a Test Request message. |
| StandardTrailer | component | required |                                                                      |

o2m file0 file1 adds the missing definitions of the mentioned components and tags to the Orchestra XML:

The repository attribute is generated with name="Repository" version="1.0".
But the name should be "Repository version 1.0".

m2o file1 file2 updates the Markdown with the missing definitions:

The title "Repositoy" is added. But it lacks the version 1.0 as well.
The section "Actors and Flows" is added - with content "None" - huh?

o2m file2 file3: Now I would expect that the XML has somewhat stabilized but somehow this differs from file1.
m2o file3 file4: Comparing to previous Markdown in file2:

The header gets 1.0 but without version before -- seems to be a bug.
Missing fields for the HopGrp are added. This expected and explains the updates to the XML.
For some reason, all category markers are dropped -- seems to be a bug.
The Synopsis of the MsgTypeCodeSet changes in funny ways --
Note: A "U" as the first character  is duplicated together with the new line character.

Next round of o2m file4 file5; m2o file5 file6:

The headings gets another 1.0 -- obviously a bug.
The miracle of multiplication of trailing Synopsis text continues -- I regards this as a bug as well.

etc. etc. etc.

I know that this "workflow" is not intended but it reveals some nice issue, IMHO.

@donmendelson I think the bug related to the version keyword starting at 1. is the simplest to correct.

@JThoennes with "o2m" you mean the conversion from XML to markdown, correct? Then I do not understand why file0 is in markdown to begin with.

@kleihan because this is "my workflow". I am lazy and let md2orchestra do the tedious work of adding all those fields, groups, components, codesets etc.
This is not (yet) intended but was the easiest way to describe two bugs found.
Looking forward to @donmendelson ´s findings.

@JThoennes So it should say m2o and not o2m in step 1?

@kleihan So for the confusion, I just updated my description.

o2m = orchestra2md using the latest reference file
m2o = md2orchestra without further options

This can also not be correct. A reference file only applies to md2orchestra. The concept behind this is that markdown is intended for manual authoring and the reference file save people some time typing stuff in markdown. Please switch comments between the two to read:

o2m = orchestra2md without further options
m2o = md2orchestra using the latest reference file

If you use orchestra2md without further options then a number of elements/attributes added by md2orchestra due to the reference file will not make it back into markdown.


application migration to another node

Hi,
It's possible to make a soft migration of some applications of one node to another specific node?

Hi @arkkanoid!
You could do this in a funky way through deis tags, but there is no "soft migration" from one node to another as node logic is not built into Deis (or Workflow). This is handled by the scheduler.


[DDO-2759] Show user list for environment owner field

Technically independent of https://github.com/broadinstitute/sherlock/pull/145 because the API didn't change.

Is "no" the default option for the "Name Prefixes Domain" option? Wouldn't we want that to always be yes? The way I understand that option is that it would allow you to choose between, e.g. sam.<bee-name>.bee.envs-terra.bio and sam.bee.envs-terra.bio (which I don't image we want to do). Am I missing something here?

Is "no" the default option for the "Name Prefixes Domain" option? Wouldn't we want that to always be yes? The way I understand that option is that it would allow you to choose between, e.g. sam.<bee-name>.bee.envs-terra.bio and sam.bee.envs-terra.bio (which I don't image we want to do). Am I missing something here?

The screenshot is showing me editing dev. Dev does not have its name prefixing the domain.

I see. I didn't realize that there's a *.dev.bee.envs-terra.bio env. Is that new? Or am I just mistaking regular dev for bees?

I see. I didn't realize that there's a *.dev.bee.envs-terra.bio env. Is that new? Or am I just mistaking regular dev for bees?

Environment names are globally unique. The "Now Editing dev" at the top of the screenshot shows that the page I'm linking to is normal dev. https://broad.io/beehive/environments/dev/edit


More PageEvent Triggers

I think we need more ways to trigger PageEvents like

OnPageLoad
OnFormSubmit
FromJSScript?

on page load should be covered by the FireEvent component:
https://github.com/pydantic/FastUI/blob/6b7c7cba5250eaf044bc312199fd877878334087/src/python-fastui/fastui/components/__init__.py#L240-L243
on form submit was done in #93:
https://github.com/pydantic/FastUI/blob/6b7c7cba5250eaf044bc312199fd877878334087/src/python-fastui/fastui/components/forms.py#L78
from JS should be pretty easy since page events are just CustomEvents called on the document itself:
https://github.com/pydantic/FastUI/blob/6b7c7cba5250eaf044bc312199fd877878334087/src/npm-fastui/src/events.ts#L57
I guess we could export a wrapper for this?

Uhh nice thanks! Was searching in the .venv/lib but its not yet released so I will pull from git and try to implement streaming responses to fastui-chat!


Docs: attrs tag default value

I found that we can provide a default value to attrs tag values using the var tag
I'm not sure if it was initially designed to work like that.
This PR is about documenting that find.

Thank you @luanfonceca
I have made the necessary updates to the PR following your feedback.


MaskableTrialEvalCallback - where to contribute

Hi,
I've created MaskableTrialEvalCallback, which combines TrialEvalCallback and MaskableEvalCallback. Those 2 are in different repositories, so I don't know in to which one I could contribute this one?
Does it makes sense to move callbacks.py and wrappers from rl-baselines3-zoo to the contrib repo? I think there is a consensus that hyper-parameter search is essential in RL. Then it'd make sense to contribute MaskableTrialEvalCallback to this repo.

Hello,
good question.
I think this is related to https://github.com/DLR-RM/rl-baselines3-zoo/issues/249.
For now, I think I would welcome a PR in the RL Zoo (otherwise, we would need to add optuna as dependency for SB3 contrib).

Does it makes sense to move callbacks.py and wrappers from rl-baselines3-zoo to the contrib repo?

Originally, I had the plan to do that, but some wrappers/callbacks are very specific, so  now I'm not sure about that.
But if you think some of them must be part of SB3 contrib, I would welcome a PR that moves them to this repo ;) (we can discuss which ones here).

TrialEvalCallback only makes sense with Optuna and I don't know the rest.
Do you consider Optuna as a dependency problematic? If so, what's the biggest issue with that?

Do you consider Optuna as a dependency problematic? If so, what's the biggest issue with that?

I mostly prefer to have minimal dependencies (and Optuna has many dependencies too). We could add optuna via an optuna keyword in the package installation.
The other thing is that for now, the optuna callback only makes sense with the RL Zoo infrastructure (all the optuna code that goes with it).

Hmm, yeah, you're right. TrialEvalCallback alone may not be a good enough reason to have Optuna as dependency. If some wants to use both Maskable and Optuna, he will just have to replicate MaskableTrialEvalCallback.
You probably also wouldn't want RL-zoo to be dependant on Contrib, right?

RL Zoo already depends on SB3 and contrib.

Oh, ok then.


Compresses the binaries with gzip

Changes in Makefile, travis.yml, and get.sh makes sure
that the binary sizes are drastically reduced for downloads.
Closes: #30
Signed-off-by: Utsav Anand<EMAIL_ADDRESS>Description
The PR when merged will enable to reduce the download times on the inletsctl binary by compressing the binaries for each platform with gzip compression format
How Has This Been Tested?
It seems like I cannot perform a test with travis.
Maybe merging the PR and monitoring the logs might help.

How are existing users impacted? What migration steps/scripts do we need?

Checklist:
I have:

[x] updated the documentation and/or roadmap (if required)
[x] read the CONTRIBUTION guide
[x] signed-off my commits with git commit -s
[ ] added unit tests

I think it might be better as can't expand archive: %

@alexellis Is this looking good?

@alexellis Is there a way I can test this out myself before we merge this? Since get.sh is expecting to download a tgz compressed file, which is not present in the releases already. It's hard for me to think of a way to fix this

Yes, just enable Travis CI for your own account and re-encrypt the release token. That should be it.
http://travis-ci.com
https://docs.travis-ci.com/user/deployment/releases/
I'm not keen on merging it until we have some confidence that it works.

I've been wrong in the past and will be wrong about a bunch of things again, but I think that this workflow should work as follows:
create binaries
create SHA of each binary
compress each binary to an archive
Upload the SHA and binary
get.sh -> downloads archive
extracts archive
checks SHA of resulting binary matches uploaded SHA
Why? We can then verify a binary at any time in the future, after it has been uncompressed. We also don't tie ourselves to the compressed archive, which isn't what we are going to be running.

@alexellis Experience speaks! I hope you're never wrong! At least when it comes to me, I've seen myself always screw up and your point making sense in the end. And I know this before asking a question. Knew here too that maybe I'm messing something up! You're thinking about the long run here, the tar file will be deleted after decompression and there will be no way to check the SHA again

I noticed you were having some issues with this on Slack. How are things now? What can we help with?

I need these vars set to my repo before my get.sh scripts works. I would need some help with that @alexellis

@alexellis I see that the echo is printing the -n on my Mac for some reasone, didn't get this behaviour on the Linux box
MacOS :
bash-3.2# sudo curl -sLSf https://raw.githubusercontent.com/utsavanand2/inletsctl/v0.5.1/get.sh | sudo sh
Downloading package https://github.com/utsavanand2/inletsctl/releases/download/v0.5.1/inletsctl-darwin.tgz as /tmp/inletsctl-darwin.tgz
-n Download Complete, extracting /tmp/inletsctl-darwin.tgz to /tmp/ ...
OK
SHA256 fetched from release: c46aa43d940eb4242f29d9788574490dc42dc6fb7aeecd2e0ff33c174e5ed6d2
SHA match!

Running with sufficient permissions to attempt to move inletsctl to /usr/local/bin
New version of inletsctl installed to /usr/local/bin
 _       _      _            _   _
(_)_ __ | | ___| |_ ___  ___| |_| |
| | '_ \| |/ _ \ __/ __|/ __| __| |
| | | | | |  __/ |_\__ \ (__| |_| |
|_|_| |_|_|\___|\__|___/\___|\__|_|

Version: v0.5.1
Git Commit: d503747fca0db0608bda0c06360d71117b78b3c9

Linux :
utsav@cloudshell:~$ curl -sLSf https://raw.githubusercontent.com/utsavanand2/inletsctl/v0.5.1/get.sh | sudo sh
x86_64
Downloading package https://github.com/utsavanand2/inletsctl/releases/download/v0.5.1/inletsctl.tgz as /tmp/inletsctl.tgz
Download Complete, extracting /tmp/inletsctl.tgz to /tmp/ ...OK
SHA256 fetched from release: a27c71b5733c454b440f5b0737139e878701b85d12a4570e02a569f9311df358
SHA match!
Running with sufficient permissions to attempt to move inletsctl to /usr/local/bin
New version of inletsctl installed to /usr/local/bin
 _       _      _            _   _
(_)_ __ | | ___| |_ ___  ___| |_| |
| | '_ \| |/ _ \ __/ __|/ __| __| |
| | | | | |  __/ |_\__ \ (__| |_| |
|_|_| |_|_|\___|\__|___/\___|\__|_|
Version: v0.5.1
Git Commit: d503747fca0db0608bda0c06360d71117b78b3c9

Ok let's leave it out. Let's remove the log for sha match too


Check for empty table

This plugin is absolutely great, thank you for sharing it!
One suggestion I have is to add a way to check if the table is actually used. Right now the default state of the columns and rows are such that empty data is saved with the entry even if nothing is entered so there is no good way (that I can tell) to check for the field in a template conditional.
Even if you delete the columns and rows the next time the publish form is loaded it defaults back to one empty row for each and would be saved again that way.
Again, this is a great plugin! Perhaps I'm just missing something obvious being fairly new to Craft/Twig.

Aha, well I had not thought to check that, which is a bit of a big oversight!
Thanks for updating me - I will try and take a look soon, but if you can and fancy it feel free to submit a PR :)

I got around it for now with this (super ugly) template check to see if the first row is empty {% if entry.demographics.rows[0][0] is defined and entry.demographics.rows[0][0]|length %}.
If I dig deeper I'll definitely submit a PR. Thank you!

Has this enhancement ever been worked on?
I now have the same issue and using the above workaround...


[Feature Request] - Add filter for thumbnail generation based on presets

For more consistant html I suggest you can add something like this.:

@register.filter(name='thumb')
def thumb(value, preset):
    '''
    Template filter for fast template generation using image persets so we
    can have consistent image sizes across the size.

    Input:
        value: an image field, file field or URL string
        preset: a name of preset to use for this image (defined in settings.py)

    Exmaple:
        <img src='{{img.image|thumb:"large"}}' alt='{{img.name|default:"Image"}}' width="100%">
    '''
    presets = settings.IMAGE_PRESETS + \
               {
               'default' : {'size': '1920','colorspace': 'RGB', 'quality': 95, 'crop': 'noop', 'upscale':False, }
               }
    options = presets[preset]
    return get_thumbnail(value, options.pop('size'), **options).url

I made this to address that: https://github.com/jjdelc/sorl-defined-thumbnails

@jjdelc These package could be included in this package.

@levynir Why did you close this issue?

@SalahAdDin this is a 3-4 years old feature request with an external workaround. I don't think anyone would implement this in the next 3 years.. no need to spam the repo with irrelevant feature requests


Remove unused dependency

I distinctly remember George's pragma-adjusting PR having done this, but I distinctly remember a lot of things that didn't happen.

@NiloCK you are correct. I accidentally added the openzeppelin dependency back in during the merge https://github.com/statechannels/exit-format/pull/45/commits/8f7cb75bd59cd334d6f2cc0dc138a81600ae8921.


Added ruby 2.3 and ruby 2.4 support

previously, ruby 2.4 rspecs wouldn't run, due to some changes to Net::HTTP, I presume;  updating WebMock to a current version (3.x) resolves this and is backwards compatible to ruby 2.1

@kris-lab - hoping this change makes sense.  I have a few more proposed changes, but this seems like a no-brainer.

Thanks!


Combining extensions with the model

It would be very useful to have (at least) the option of bundling the extensions with the model file so that it's a single object that can be shared across architectures. Related, but separate, is how to set up the extensions/ folder to run on a different architecture. Maybe the best way would be to have metatensor-model build-extensions model.pt

My take on this: I think it would be great to choose one option and stick with it. Having both model.pt with the extensions inside and model.pt without the extensions + the extensions/ directory is a recipe for disaster, because you can never tell which model.pt you're dealing with (does it contain the extensions or not?). Changing the suffix wouldn't make this much more convenient either.
Since the extensions are never meant to be used on their own (and neither is model.pt to be fair), I think the best option would be to bundle the two, and have something like python -m metatensor.torch.atomistic.re_export model.pt -> model.pt to re-build the extensions in a new environment, if needed.

I see the convenience of having everything bundled in a single file. The main additional issue I see on top of the current setup is the size of the model will grow quite a lot, so if you have many variations of the same model it can become an issue.
The other point to consider is security: if we want people to share trained models, having opaque binary blobs inside is not a great security practise, as someone could very easily add malware inside. This can be somehow alleviated by giving the ability to re-create the extensions, but this does not solve everything.
Finally, another point to consider is long-term archival of pre-trained models. Bundling extensions or not does not change the issue too much, but I think this should be part of the discussion.

and have something like python -m metatensor.torch.atomistic.re_export model.pt -> model.pt to re-bundle the extensions in a new environment

This is a bit hard, since we don't know which Python import are loading which extensions. So this could not be a command line script and would have to be called from Python with all the right packages imported. metatrain could provide something nicer. If we say that this function/cli is supposed to fix most of the issues above, this should be carefully designed to work in all cases (including non-metatrain cases).


Added blackjack game project

@gantavyamalviya @Adarsh-jaiss @TKirtan kindly review and merge the push request #397 under the Hacktoberfest tag


Fixes waitTime loses unit when passed to tryLockInnerAsync

In the methods tryAcquireAsync and tryAcquireOnceAsync, when leaseTime<=0, the waitTime with the original time unit is passed in without tranforming with the new timeunit TimeUnit.MILLISECONDS.

Thanks for contribution!


Persistent service update

change to updater to support local container registries better
improvements to scaler's support for dependency containers

TODO:

[ ] Bug: Updates to service doesn't propagate PSU-specific env to service instance
[ ] Cleanup code due to changes in base odm

Codecov Report

Merging #283 (1c67354) into master (8a0d794) will decrease coverage by 0.50%.
The diff coverage is 18.01%.

@@            Coverage Diff             @@
##           master     #283      +/-   ##
==========================================
- Coverage   42.79%   42.28%   -0.51%
==========================================
  Files          33       33
  Lines        4730     4813      +83
==========================================
+ Hits         2024     2035      +11
- Misses       2706     2778      +72

Impacted Files
Coverage Δ

assemblyline_core/updater/helper.py
17.30% <0.00%> (-3.87%)
:arrow_down:

assemblyline_core/updater/run_updater.py
27.24% <0.00%> (-0.49%)
:arrow_down:

assemblyline_core/workflow/run_workflow.py
0.00% <0.00%> (ø)

...mblyline_core/scaler/controllers/kubernetes_ctl.py
12.52% <16.94%> (-0.78%)
:arrow_down:

assemblyline_core/scaler/scaler_server.py
31.00% <21.05%> (+0.21%)
:arrow_up:

assemblyline_core/alerter/run_alerter.py
56.14% <50.00%> (-1.01%)
:arrow_down:

assemblyline_core/expiry/run_expiry.py
68.64% <50.00%> (-0.59%)
:arrow_down:

assemblyline_core/server_base.py
75.47% <61.11%> (-1.46%)
:arrow_down:

assemblyline_core/ingester/ingester.py
75.78% <100.00%> (ø)

assemblyline_core/dispatching/dispatcher.py
76.67% <0.00%> (+0.65%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8a0d794...1c67354. Read the comment docs.


Create vm instance failed.

I tried to test ZStack exactly with the tutorial Amazon EC2 classic EIP zone(Web UI version), but it failed: failed to start vm... libvirt error: XML error: invalid security type. Due to my limited and initial time with IaaS software, I could not locate the fault point. Could you please figure it out? Thank you!
Here is REQUEST:
{
  "org.zstack.header.vm.APICreateVmInstanceMsg": {
    "name": "VM1",
    "description": null,
    "instanceOfferingUuid": "210482bc4df74f3d9fccecda27d3656a",
    "imageUuid": "2ac1f23ffbf9456dba9f4625f0c43200",
    "l3NetworkUuids": [
      "8bcbb77396504fb6ab3cc8ec076b1101"
    ],
    "rootDiskOfferingUuid": null,
    "dataDiskOfferingUuids": [],
    "zoneUuid": "ba0a0a9974e748f49b5973cb95fca22a",
    "clusterUuid": "cecb2bfe36cd4a62ab3c6bcabfcb4d07",
    "hostUuid": "e9cc51c75d924ba18fc1f32686fcd5e4",
    "resourceUuid": "49586ab4913e473694a9ca1eca7859b8",
    "defaultL3NetworkUuid": "8bcbb77396504fb6ab3cc8ec076b1101",
    "systemTags": [
      "hostname::vm1"
    ],
    "session": {
      "uuid": "d8a5f06b78254fa98f647d64e8db869c"
    }
  }
}

Here is the RESPONSE:
{
  "org.zstack.header.vm.APICreateVmInstanceEvent": {
    "success": false,
    "apiId": "6fd10a2f617f493db7916c9298491708",
    "headers": {
      "schema": {}
    },
    "error": {
      "code": "SYS.1006",
      "cause": {
        "code": "HOST.1005",
        "description": "Failed to start vm on hypervisor",
        "details": "failed to start vm[uuid:b692dd0dbfca4da9a547b9fd003dd5d9 name:virtualRouter.l3.8bcbb77396504fb6ab3cc8ec076b1101] on kvm host[uuid:e9cc51c75d924ba18fc1f32686fcd5e4, ip:<IP_ADDRESS>], because unable to start vm[uuid:b692dd0dbfca4da9a547b9fd003dd5d9, name:virtualRouter.l3.8bcbb77396504fb6ab3cc8ec076b1101], libvirt error: XML error: invalid security type"
      },
      "description": "An operation failed",
      "details": "failed to start vm[uuid:b692dd0dbfca4da9a547b9fd003dd5d9 name:virtualRouter.l3.8bcbb77396504fb6ab3cc8ec076b1101] on kvm host[uuid:e9cc51c75d924ba18fc1f32686fcd5e4, ip:<IP_ADDRESS>], because unable to start vm[uuid:b692dd0dbfca4da9a547b9fd003dd5d9, name:virtualRouter.l3.8bcbb77396504fb6ab3cc8ec076b1101], libvirt error: XML error: invalid security type"
    },
    "createdTime":<PHONE_NUMBER>778,
    "type": {
      "_name": "key.event.API.API_EVENT"
    },
    "id": "0ffcb46a2e5745db9bf7566bde564522"
  }
}

Hi, what's your Host's operation system?
ZStack would prefer to choose CentOS 7.2

Well, Ubuntu 12.04.5 LTS.
Speaking frankly, there were so many faults when installing and deploying ZStack on Ubuntu 12.04. I spent two days solving them with Google. Now it comes to the last step, Create VM Instance, and I failed to solve this fault.
I do believe that CentOS would be the best choice for ZStack. I remember that ZStack uses command ip netns set in some step, while the subcommand set only works in CentOS, not Ubuntu(WHY?)...
However, my company has no physical machine with CentOS installed...that's the key.
Anyway, I would install CentOS on my machine if I failed to handle ZStack on Ubuntu.

Ok. Look forward your experience on CentOS 7.2 system.
BTW, we also have a QQ group (410185063) for Chinese communication. Your question should be timely addressed there.

Well, everything is fine in CentOS 7.2~~~
Thank you.