Python binary wheel - issues with rpath

There is a problem with the way we are currently building out Python binary wheel files for ngraph.
The ngraph Python wrappers are compiled into _pyngraph.so, which is linked dynamically with libngraph.so and other library files.
_pyngraph.so uses an rpath value of ../../ to find libngraph.so 2 directory levels up from its own location. This works fine in most cases, because after installation of the Python binary wheel into a virtualenv files are stored in the following way:
$ find venv -name *ngraph*
venv/lib/python2.7/site-packages/_pyngraph.so
venv/lib/python2.7/site-packages/ngraph
venv/lib/libngraph.so

Unfortunately, if we try to install the same package in the sytem Python of CentOS, we get a different directory layout:
/usr/lib64/python2.7/site-packages/_pyngraph.so
/usr/lib64/python2.7/site-packages/ngraph
/usr/lib/libngraph.so

Steps to reproduce:

You can build a Python binary wheel using the attached Dockerfile Dockerfile.zip

$ docker build -t ngraph_dist_centos .

You can test the wheel in a container using the built Docker image

$ docker run ngraph_dist_centos bash
[docker] # cd /root/ngraph/python/dist
[docker] # pip install ngraph-*-cp27-*.whl
[docker] # python
>>> import ngraph
(...)
ImportError: libngraph.so: cannot open shared object file: No such file or directory

Possible solutions
There are a number of alternative apporaches we can take to solve this issue:

modify setup.py to copy library files into a Python module directory e.g. ngraph/impl/ change rpath value accordingly

currently setup.py stores library files in data_files. After installation they get placed in a path relative to sys.prefix, which can be different system to system.
We could set os.environ['LD_LIBRARY_PATH'] = sys.prefix + 'path/to/libs' at runtime (specifically during import of ngraph.impl module or its submodules).

This might be a good job for auditwheel.
I found some other comments in that StackOverflow thread to be helpful  as well.


feat(datepicker): add readOnly input

I can see a few potential issues (especially with regards to a11y and UI consistency - "why can't I type in this one, but I can type in this other one?")

I am very inclined to agree with that... It wouldn't make sense for an input to not allow a user to type something without the input being disabled since that's how every other input is within the library.

If we can make the whole component read only and non-interactive then we can totally do that ... We may still want to open an issue on the Carbon side anyway, to make sure we're not going too far into the weeds

If we can make the whole component read only and non-interactive then we can totally do that ... We may still want to open an issue on the Carbon side anyway, to make sure we're not going too far into the weeds

The original request was to make it so that manually entering a date wasn't possible and the only way to change the date would be through the calendar. I'm not sure what benefits/use cases that can be gained from making it completely non-interactive.

The original request was to make it so that manually entering a date wasn't possible and the only way to change the date would be through the calendar.

That seems unnecessarily user hostile 😛 I can't imagine a good reason for wanting to do that, especially since it doesn't seem to be supported by Carbon.

I'm not sure what benefits/use cases that can be gained from making it completely non-interactive.

Me neither! But that's what readonly is 😆

That seems unnecessarily user hostile 😛 I can't imagine a good reason for wanting to do that, especially since it doesn't seem to be supported by Carbon.

Yeah 😆 although it seems to be supported on vue http://vue.carbondesignsystem.com/?path=/story/components-cvdatepicker--single

Yeah 😆 although it seems to be supported on vue http://vue.carbondesignsystem.com/?path=/story/components-cvdatepicker--single

I think that's a bug on Vue's side though 😉 Vanilla/React is the reference implementation, so it's safe to assume deviations by anyone else is a bug 😛

I'm going to close this since we don't have clear support from Carbon or a well defined usecase. This is something that really needs to be discussed with the Carbon design team.


Implement construct_runtime! macro

The macro currently does not support renaming of types. So only Module, Call, etc are required.
Progress on: https://github.com/paritytech/substrate/issues/669

@gavofyork now it also compiles :)


Add Microsoft.DotNet.InternalAbstractions to fix tests

cc @bricelam \ @divega. There's a change in DependencyModel 1.1-* that removed this dependency. Thish causes dotnet-test-xunit to fail. dotnet-test-xunit will fix it once the 1.1 build is available on NuGet.org. In the meanwhile, tests that reference DependencyModel (transitively) will require InternalAbstractions to continue working.
This was the fix we did in Mvc. However this fix would require users consuming Microsoft.EntityFrameworkCore.Relational.Design.Specification.Tests to also do something similar. Do you want me to change the test specification instead?

@pranavkm if I understand correctly what you are saying it seems that adding the dependency to Microsoft.EntityFrameworkCore.Relational.Design.Specification.Tests would lead to less changes and less pain (in this case to external provider writers) without any drawback. Does that sound right?
cc @bricelam

would lead to less changes and less pain (in this case to external provider writers) without any drawback.

Essentially. We didn't make an equivalent change in Mvc because it's a runtime package. But since this is a test specification, this should be pretty safe to do.

Regardless of how we do this, we should encourage consumers of your package not to rely on Microsoft.DotNet.InternalAbstractions in their code. It's being deprecated and replaced by Microsoft.DotNet.PlatformAbstractions

Regardless of how we do this, we should encourage consumers of your package not to rely on Microsoft.DotNet.InternalAbstractions in their code. It's being deprecated and replaced by Microsoft.DotNet.PlatformAbstractions

Ok. Is it feasible to swap now?

🆙 📅

LGTM


[Sprint: 41] XD-2611: Missing Log Config for throughput-sampler

JIRA: https://jira.spring.io/browse/XD-2611
http://stackoverflow.com/questions/28019801/how-to-read-throughput-sampler-sink-values-in-spring-xd/28027544#28027544

LGTM


Allow for custom characters and classes

for example remove the text-padding: 10 and use a font-awesome  tag:
$.ScrollUpToTop({   "scrollText": '<i class="fa fa-arrow-circle-o-up"></i>',   "scrollClass": "", });
Defaults to the same functionality previously available ( ^ with padding-top:10px)

Hi, thanks you for your contribution. I merge your pull request.


Add composer files resolver

Well done! Looks great! I just have one more important question in the comments


chore(caraml): bump up common chart version

Motivation
In #254, a tiny change was made to one of the comments in the templates of the common chart, though the overall chart version was not updated. This caused an error to occur in the CD job to release a new chart version: https://github.com/caraml-dev/helm-charts/actions/runs/5342383824/jobs/9684150972#step:6:58.
This PR simply bumps up the common chart version to fix the issue above.
Modification
Checklist

[x] Chart version bumped
[x] README.md updated

Thanks for the quick review!


Update Cargo.toml add repository

to allow crates.io, rust-digger and others to link to it

You are welcome. BTW here is the list of your crates on Rust digger that I hope will help me contribute to the Rust ecosystem.


Update MSBuild.Sdk.Extras

what is this for?

This updates msbuild.sdk.extras. That update allows usage of visual studio 2019 preview.
global.json sets the version of nuget packages or sdks globally in the repository.
You can read more about msbuild.sdk.extras here:  https://github.com/onovotny/MSBuildSdkExtras
The way this sdk was referenced caused it to not being picked up by the dependency bot.

Good to know. It seems we can also move the sdk version to the globals.json file, rather than specifying in each project. May be something to consider.


Ejecting should ensure you have clean git status

#2090
sorry about last PR, I had accidentally pushed commit to build.js and couldn't solve merge conflict.
so I made another branch.

Thanks!


Ranlvor travis rework

Fixed build by outputting stuff all the time
Migrated to sudo: false causing our build to be executed on the new docker-infrastructure giving advantages like more CPU-Power for the build
Enabled caching of .cabal and .ghc to improve build-times by one order of magnitude when idris does not need a recompile.
Deprecates #5 / fixes #5

Looks good though the line that does a hack to not let cabal run into timeouts looks pretty long and unobvious. Could you refactor it?

Looks good. Merge, @relrod?

+1


Added az 9 breaking change migration guide

Learn Build status updates of commit d744e4b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-conceptual/azps-8.3.0/migrate-az-9.0.0.md
:white_check_mark:Succeeded
View (azps-8.3.0)

docs-conceptual/azps-8.3.0/toc.yml
:white_check_mark:Succeeded
View (azps-8.3.0)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel


Added supports for Apple Silicon chips with MPS devices optional

Some device-related ops have to change order.
Also some ops from torch is not well supported yet so had to rearrange those

Hi @RuiWang1998
I'm interested in the protein structure prediction and found this program.
I try to run omegafold in M2 macbookPro.
First, when I run usual way(python main.py INPUT.fasta OUTPUT_DIR), the error "AssertionError: Torch not compiled with CUDA enabled" was occured.
error log(some directory replace to ----):
Traceback (most recent call last):
File "----/OmegaFold/main.py", line 105, in
main()
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "----/Desktop/omega fold/OmegaFold/main.py", line 55, in main
model.to(args.device)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/nn/modules/module.py", line 927, in to
return self._apply(convert)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/nn/modules/module.py", line 579, in _apply
module._apply(fn)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/nn/modules/module.py", line 579, in _apply
module._apply(fn)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/nn/modules/module.py", line 602, in _apply
param_applied = fn(param)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/nn/modules/module.py", line 925, in convert
return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
File "----/.pyenv/versions/3.10.5/lib/python3.10/site-packages/torch/cuda/init.py", line 211, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled
So I change args.device to 'mps' (I think this variant is reffered only at line 55 and line 63 of main.py).
Then, re-running occur "The operator 'aten::glu.out' is not current implemented for the MPS device" error.
error log:
INFO:root:Failed to generate OUTPUT.pdb due to The operator 'aten::glu.out' is not current implemented for the MPS device. If you want this op to be added in priority during the prototype phase of this feature, please comment on https://github.com/pytorch/pytorch/issues/77764. As a temporary fix, you can set the environment variable PYTORCH_ENABLE_MPS_FALLBACK=1 to use the CPU as a fallback for this op. WARNING: this will be slower than running natively on MPS.
I'm sorry that I'm not familiar to Python, to machine learning, to github, and to english.
So please request any information to solve these problemes.
my environment is:
MacBook Pro（13inch, M2, 2022）
memory 24GB
Python3 3.10.5
Pytorch 1.12.0 (about MPS, torch.backends.mps.is_available() is True)
Biopython 1.79

Hi @S-Shimo,
Thanks for reaching out!
To run on CPU, you need to add an argument '--device cpu'.
However, to run on mps, you will need to use this pull request to be able to run as mps support is in its prototype stage and some operators are not supported. Once you checkout this pull request, you can similarly add '--device mps' as an argument and it will run with Metal acceleration.
Or you could wait for this pull request to be merged in a short while!

Thank you very much.
I just retry with merged code.
With "--device cpu", it seems to be run(It takes long time, so calculation is not finished).
However, with "--device mps", the same error is occred.
INFO:root:Failed to generate OUTPUT.pdb due to The operator 'aten::glu.out' is not current implemented for the MPS device. If you want this op to be added in priority during the prototype phase of this feature, please comment on https://github.com/pytorch/pytorch/issues/77764. As a temporary fix, you can set the environment variable PYTORCH_ENABLE_MPS_FALLBACK=1 to use the CPU as a fallback for this op. WARNING: this will be slower than running natively on MPS.

Hi @S-Shimo ,
Just a sec we'll look into it

Hi @S-Shimo,
It seems that we are currently only supporting PyTorch nightly built of torch-1.13.0.dev20220805, which you can install with pip3 install --pre torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/nightly/cpu or conda install pytorch torchvision torchaudio cpuonly -c pytorch-nightly per official site of PyTorch.
As for 1.12, it might take us some more time to figure it out.
Best,
Rui

Hi @RuiWang1998
I got it. That probleme depend on my mistake.
I have already installed PyTorch ver 1.12, and try to update. But I use pip3 install command without -U option, this is my mistake.
Now I use Pytorch 1.13.0.dev20220806, the different error is occured.
Error: buffer is not large enough.
I googled it, and I found this issue https://github.com/pytorch/pytorch/issues/77851.
Best,
Shimo

85d123297578c303801aa41de480b459e69058b5

85d123297578c303801aa41de480- - [ ] [ ] b459e69058b5


Importing modules using Rollup.js fails

import { Vector3 } from "babylonjs";

... while this works fine using Webpack, it fails using Rollup:
src/main.js → public/bundle.js...
[!] Error: 'Vector3' is not exported by node_modules/babylonjs/babylon.js
https://github.com/rollup/rollup/wiki/Troubleshooting#name-is-not-exported-by-module
src/main.js (1:9)
1: import { Vector3 } from "babylonjs";
            ^

How to reproduce
git clone https://github.com/kraftwer1/rollup-starter-app
npm install
npm run build

This is because rollup expects the module to be es6, and not umd (commonjs or amd). Babylon doesn't fully support es6 yet, and the js files don't export anything other than a namespace.
Maybe try using this - https://github.com/rollup/rollup-plugin-commonjs
You can follow the es6 progress here - https://github.com/BabylonJS/Babylon.js/issues/3314

Still doesn't seem to work with StencilJs


Unable to install npm package

Hi,
Thanks for creating this.
When running npm install @playwright-testrail-reporter I'm getting an error:
npm ERR! code EINVALIDTAGNAME
npm ERR! Invalid tag name "@playwright-testrail-reporter" of package "@playwright-testrail-reporter": Tags may not have any characters that encodeURIComponent encodes.
I also tried to wrap the package in quotes like npm install "@playwright-testrail-reporter" but it also has the same error.

I was able to fix this by cloning the package locally and linking without the '@':
from root directory of playwright-testrail-integration:

npm link
npm install
npm run build

Playwright Project:

npm link playwright-testrail-reporter


liteLLM issue

Describe the bug
liteLLM is installed on my windows local machine. and I can access it with the link http://localhost:4000.
I added this to the .env file as below.
OPENAI_LIKE_API_BASE_URL=http://localhost:4000
I see the model in the OpenAILike section of the models, but when I type prompt. I get the following error.
Messages: [ [Object] ],
vehicles: undefined,
tool_choice: undefined,
flow: right
},
statusCode: 401,
responseHeaders: {
'cf-cache-status': 'DYNAMIC',
'cf-ray': '8de466b78e69ca29-OTP',
connection: 'keep-alive',
'content-length': '97',
'content-type': 'application/json',
date: 'Wed, 06 Nov 2024 10:29:13 GMT',
'request-id': 'req_017a4hYd66XdNsKbTKkkcRAjx',
server: “cloudflare”,
via: '1.1 google',
'x-robots-tag': 'none',
'x-should-retry': 'false'
},
responseBody: '{“type”: “error“, ‘error’:{”type": “authentication_error”, ‘message’: “x-api-key header is required"}}',
isRetryable: false,
Data: {
type: 'error',
Error: {
tip: 'authentication_error',
message: 'x-api-key header required'
}
},
[Symbol(vercel.ai.error)]: true,
[Symbol(vercel.ai.error.AI_APICallError)]: true
}
Link to the Bolt URL that caused the error
http://localhost:5173/
Steps to reproduce
iteLLM is installed on my windows local machine. and I can access it with the link http://localhost:4000.
I added this to the .env file as below.
OPENAI_LIKE_API_BASE_URL=http://localhost:4000
I see the model in the OpenAILike section of the models, but when I type prompt. I get the following error.
Expected behavior
How do I connect to openAILike url without auth?
Screen Recording / Screenshot
No response
Platform

OS: [e.g. macOS, Windows, Linux]
Browser: [e.g. Chrome, Safari, Firefox]
Version: [e.g. 91.1]

Additional context
No response

I think if you set the KEY it should work, the KEY should not be blank. I could get it working. Be careful to use a model name that is unique else use
TommyHolmberg:respect-provider-choice

#testing Litellm
OPENAI_LIKE_API_BASE_URL=http://<IP_ADDRESS>:4000
Get your OpenAI Like API Key
OPENAI_LIKE_API_KEY=doesnotmatter

@nandan121 just running in virtual env made the suggested changes but getting the same error,

Thanks @nandan121
tried your suggestion "litellm --config config.yaml --detailed_debug" , my API_KEY was empty, fixed it.

@nushret Does this fix your issue as well?

my .env
You only need this environment variable set if you want to use OpenAI Like models
OPENAI_LIKE_API_BASE_URL=http://<IP_ADDRESS>:4000
Get your OpenAI Like API Key
OPENAI_LIKE_API_KEY=

put
OPENAI_LIKE_API_KEY=dsdfsadad
and it should work
You should not leave it empty, though it does not matter what you put. UNLESS you have set the api key in litellm .env as
LITELLM_MASTER_KEY=sk-34....

@nushret tag me when you get to try this out after setting your .env file as @nandan121 has suggested.
the open AI like key cannot be blank enough though its value does not matter.
Basically, it still needs an API key, you just make up your own and provide it through the .env file.
I will give this another try this afternoon myself and make double sure to repeat every step I can as per your details.


The ability to swap out the little ipod icons for something custom.

Add as new setting.

Added in 2022.1.5


Question about resuming from checkpoint

Hey there,
so I have this one colab of mine with a command of:
command = "python main.py" +\             " --base " + model_config +\             " --actual_resume " + model_checkpoint +\             " -t " +\             " -n " + name +\             " --gpus 0, "+\             " --data_root " + train_images +\             " -l logs " +\             " --embedding_manager_ckpt " + train_checkpoint_file
where I load up a present model, checkpoint file and try to resume from that point of time.
train_checkpoint_file = logs/<custom_logs>/checkpoints/embeddings_gs-2499.pt
model_checkpoint = ldm/stable-diffusion/model.ckpt
Now my question is: Is it normal for when trying to resume from checkpoint that the epoch starts at 0 with 0 steps?
How do I know if previous run was being continued on.
Is there an example command that can be used?
Thanks in advance and for this awesome project. :)

Your command looks fine.
It's normal that the counters start again from 0, yes. Our checkpoint doesn't store any information about the training step.
Easiest way to verify that the checkpoint is loaded correctly is to just look at the output images during training.
(If it didn't load correctly, your images should look like they did at the start of training).

Ah thanks a lot :)


how to import encoded model onnx?

Please take a look at this notebook.
ONNX Guide
Thank you.

Only the decoded onnx here, not the image encoded onnx

You can find the converter for the encoding part to the onnx format in the repository Segment Anything CPP Wrapper.


Rename iotnxp to iotnxp.md

OPS Build status updates of commit f5b4ec8:
:warning: Validation status: warnings

File
Status
Preview URL
Details

windows-iotcore/learn-about-hardware/iotnxp.md
:warning:Warning

Details

windows-iotcore/learn-about-hardware/iotnxp.md

Line 0: [Warning] Invalid file link:(~/learn-about-hardware/dreamku@via.com.tw).

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Heating time showing wrong data

Heating time chart seems to be showing wrong data or Y label should not be in hours. There is no way I could be heating 80 hours per day. The same issue seems to be with Away chart.

Hi @shaman79,
I'll check this issue and keep you in touch.
Thanks,
Guillaume

Hi @gchenuet, can it be that the problem is caused by different sampling period? I am polling every 5 minutes, not every minute as suggested in install procedure. Thanks.

This is due to the 24 hour polling period being assumed in the PHP files such as getHeat.php and getPresence.php
Example line of code is
 $sql_array["rows"][] = array("c" => array(array("v" => $date_array), array("v" => intval($row["auto_away"])), array("v" => (24 - $row["auto_away"]))));
which if you are polling every 5 minutes like myself and shaman79 are then you need to divide $row["auto_away"] by 12 so it turns into
$sql_array["rows"][] = array("c" => array(array("v" => $date_array), array("v" => round($row["auto_away"] / 12, 2)), array("v" => (24 - round($row["nest_heat_state"] / 12, 2)))));
A proper way would be to have the polling period set in the config file and then do a calculation for how many polling intervals go into 24 hours then divide the value by that calculated number.

I haven't time (and Nest Thermostat) to maintain this project.
Feel free to open a PR to fix it :)
Thanks.


Make C# Enums available for Javascript .

As I was trying to easily manage getting my Enums into the javascript , I came across a nifty article with code. While I am going to put this piece of code in my project - I thought it was nifty enough that perhaps it can be added to Serenity. Here is the link:
making-c-enums-available-within-javascript/

Serenity already transfers enums to typescript

Is there any way to make it so I can get the Enum Description Attribute via the type script ?
I am trying to enumerate my enum descriptions so I can add it to the hardcodedvalues via  .addOption("key", "text") - but I do not see how to do this in typescript.
Could you provide a link or an example where I can find this?

Look source of how enum editor does it


Remove the Analyzer Unused Variables and updated fix

Coverage increased (+0.01%) to 89.95% when pulling dd794a460032f37a0dce720522babfb0cc63bb2c on julianosaless:RemoveUnusedVariables into 5afa55145763923865849633fd3d9b344fafe5af on code-cracker:master.

Updates #23.


Feat : add pan and vertical scale

closes : https://github.com/zakodium/react-plot/issues/251

there is two problems
1- when we have axis padding the zoom is not perfect (we cannot calculate the plot width ...)
2- plot drag is slow

All functionalities are working perfectly now. Thanks !

could you please try it with padding (grab functionalty need to initialise max and min )

It doesn't work for me.


Allow for equals in background hash

In a recent use case we needed to have query parameters for the background. Something like:
background=custom:http://a.tiles.mapbox.com/v4/astrodigital.LC81170532015080LGN00_bands_432/{z}/{x}/{y}.png?access_token=token_here

If you insert this string as a custom background source it works flawlessly but when it needs to be parsed from the url it breaks.
This happens because the .split('=') would convert this string to a 3 element array and that doesn't meet the criteria. This PR fixed the problem by allowing everything after the first = sign.

I believe if you URL-encode the background value, i.e. use %3d instead of =, this won't be necessary. Can you try that?

That won't do it. The url gets decoded before reaching the function.
When you use location.hash the url is automatically decoded.

Ah, that's the Firefox bug described in #2406. Looks like there's been some movement on that and it will be fixed in FF 41: https://www.fxsitecompat.com/en-US/docs/2015/urlutils-hash-no-longer-decodes-fragment/

Ok, but shouldn't you be looking at supporting "older" browsers as well?

For "evergreen" (autoupdating) browsers like Chrome and Firefox, we only support the most recent release -- supporting out-of-date releases when new ones are coming on a monthly basis would be prohibitively expensive.

Ok, fair enough. Closing


[Feature Request]: I want that ragflow integrate  huggingface space interface endpoint

Is there an existing issue for the same feature request?

[X] I have checked the existing issues.

Is your feature request related to a problem?
No response
Describe the feature you'd like
for example deploy qwen2-vl-72 model, and ragflow integrat it  by api,  now can do it ?  I wonder your response.
Describe implementation you've considered
No response
Documentation, adoption, use case
No response
Additional information
No response

thank your response, I will try it in some time


Add XmlFile support

Parse simple/common XML files into a DOM-like structure
Base on StAX, but hidden from regular use
Avoid exposing comments, PIs and mixed content
Enhance Guavate to check a stream contains a single element

That's everything from me.


VirtualBox network service is broken?

Issue description
One day I've booted non-reconfigured NixOS, and it suddenly became broken. 1 and a half minute of plain wait for nothing, but fortunately networking is still functional (when set to "Bridged Adapter" mode).
Yes, it worked before, no refreshes or upgrades were made.
апр 27 19:59:38 ckopo-nix systemd[1]: Timed out waiting for device sys-subsystem-net-devices-vboxnet0.device.
апр 27 19:59:38 ckopo-nix systemd[1]: Dependency failed for Link configuration of vboxnet0.
апр 27 19:59:38 ckopo-nix systemd[1]: network-link-vboxnet0.service: Job network-link-vboxnet0.service/start failed with result 'dependency'.
апр 27 19:59:38 ckopo-nix systemd[1]: Dependency failed for Address configuration of vboxnet0.
апр 27 19:59:38 ckopo-nix systemd[1]: network-addresses-vboxnet0.service: Job network-addresses-vboxnet0.service/start failed with result 'dependency'.
апр 27 19:59:38 ckopo-nix systemd[1]: sys-subsystem-net-devices-vboxnet0.device: Job sys-subsystem-net-devices-vboxnet0.device/start failed with result 'timeout'.

UDP: Also, got systemd logs, hope it would help.
● vboxnet0.service - VirtualBox vboxnet0 Interface
   Loaded: loaded (/nix/store/1z3mi0m860bghxs8axz9pw6if2n8ss7a-unit-vboxnet0.service/vboxnet0.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Sat 2018-04-28 23:23:52 +08; 2min 36s ago
  Process: 908 ExecStopPost=/nix/store/69sdla5sqzhc0p05pq661zdsmmzllxcq-unit-script/bin/vboxnet0-post-stop (code=exited, status=1/FAILURE)
  Process: 841 ExecStart=/nix/store/y5ip6qrc0jm1a7n4wi1dnn019i0sx8av-unit-script/bin/vboxnet0-start (code=exited, status=1/FAILURE)
 Main PID: 841 (code=exited, status=1/FAILURE)

апр 28 23:23:52 ckopo-nix vboxnet0-start[841]: VBoxManage: error: Code NS_ERROR_SOCKET_FAIL (0xC1F30200) - IPC daemon socket error (extended info not available)
апр 28 23:23:52 ckopo-nix vboxnet0-start[841]: VBoxManage: error: Most likely, the VirtualBox COM server is not running or failed to start.
апр 28 23:23:52 ckopo-nix systemd[1]: vboxnet0.service: Main process exited, code=exited, status=1/FAILURE
апр 28 23:23:52 ckopo-nix vboxnet0-post-stop[908]: VBoxManage: error: Failed to create the VirtualBox object!
апр 28 23:23:52 ckopo-nix vboxnet0-post-stop[908]: VBoxManage: error: Code NS_ERROR_SOCKET_FAIL (0xC1F30200) - IPC daemon socket error (extended info not available)
апр 28 23:23:52 ckopo-nix vboxnet0-post-stop[908]: VBoxManage: error: Most likely, the VirtualBox COM server is not running or failed to start.
апр 28 23:23:52 ckopo-nix systemd[1]: vboxnet0.service: Control process exited, code=exited status=1
апр 28 23:23:52 ckopo-nix systemd[1]: Failed to start VirtualBox vboxnet0 Interface.
апр 28 23:23:52 ckopo-nix systemd[1]: vboxnet0.service: Unit entered failed state.
апр 28 23:23:52 ckopo-nix systemd[1]: vboxnet0.service: Failed with result 'exit-code'.

Steps to reproduce

have VirtualBox installed
try rebooting or abnormal poweroffs

Technical details
Please run nix-shell -p nix-info --run "nix-info -m" and paste the
results.

system: "x86_64-linux"
host os: Linux 4.9.83, NixOS, 17.09.3047.8bce347f02f (Hummingbird)
multi-user?: yes
sandbox: no
version: nix-env (Nix) 1.11.16
channels(root): "nixos-17.09.3047.8bce347f02f"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos/nixpkgs

@Infinisil You mean, switching channel to 18.03? Gonna try it, when I get off mobile network.
Again, it's a generation-independent issue. Maybe 18.03 rebuild would fix that, who knows. But I'm afraid that reinstall is inescapable.
I've tried nixos-rebuild with --repair flag. It doesn't fix this issue, setting a warning:

● vboxnet0.service - VirtualBox vboxnet0 Interface
   Loaded: loaded (/nix/store/1z3mi0m860bghxs8axz9pw6if2n8ss7a-unit-vboxnet0.service/vboxnet0.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Mon 2018-04-30 13:03:04 +08; 1min 30s ago
  Process: 28871 ExecStopPost=/nix/store/69sdla5sqzhc0p05pq661zdsmmzllxcq-unit-script/bin/vboxnet0-post-stop (code=exited, status=1/FAILURE)
  Process: 28840 ExecStart=/nix/store/y5ip6qrc0jm1a7n4wi1dnn019i0sx8av-unit-script/bin/vboxnet0-start (code=exited, status=1/FAILURE)
 Main PID: 28840 (code=exited, status=1/FAILURE)

апр 30 13:03:04 ckopo-nix vboxnet0-start[28840]: VBoxManage: error: Code NS_ERROR_SOCKET_FAIL (0xC1F30200) - IPC daemon socket error (extended info not available)
апр 30 13:03:04 ckopo-nix vboxnet0-start[28840]: VBoxManage: error: Most likely, the VirtualBox COM server is not running or failed to start.
апр 30 13:03:04 ckopo-nix systemd[1]: vboxnet0.service: Main process exited, code=exited, status=1/FAILURE
апр 30 13:03:04 ckopo-nix vboxnet0-post-stop[28871]: VBoxManage: error: Failed to create the VirtualBox object!
апр 30 13:03:04 ckopo-nix vboxnet0-post-stop[28871]: VBoxManage: error: Code NS_ERROR_SOCKET_FAIL (0xC1F30200) - IPC daemon socket error (extended info not available)
апр 30 13:03:04 ckopo-nix vboxnet0-post-stop[28871]: VBoxManage: error: Most likely, the VirtualBox COM server is not running or failed to start.
апр 30 13:03:04 ckopo-nix systemd[1]: vboxnet0.service: Control process exited, code=exited status=1
апр 30 13:03:04 ckopo-nix systemd[1]: Failed to start VirtualBox vboxnet0 Interface.
апр 30 13:03:04 ckopo-nix systemd[1]: vboxnet0.service: Unit entered failed state.
апр 30 13:03:04 ckopo-nix systemd[1]: vboxnet0.service: Failed with result 'exit-code'.
warning: error(s) occurred while switching to the new configuration

I can't now upgrade other than reinstalling #39730

Just here to confirm this issue; it has been broken since at least 17.09.

So to be clear, this is a MacOS Host & a NixOS Guest?
Could you try the solution here:
https://forums.virtualbox.org/viewtopic.php?f=8&t=87275

Even without a guest this problem happens on various versions of NixOS.

I think you can disable this with options.virtualisation.virtualbox.host.addNetworkInterface = false;.
It must have been broken between VirtualBox updates. I wonder if this interface works for anyone? We could try making the default false. Someone will have to take the time to fix it.

Actually is this a dupe of https://github.com/NixOS/nixpkgs/issues/6037?

I haven't seen it happen during boot myself, but perhaps I lowered the timeout at some point. It could be a dupe.

I seem to remember I had this issue for a while and it vanished after either the switch to 18.09 or to 19.03. So I guess the problem is now fixed. Feel free to reopen if you're still having this issue.


Use URL instead authentication and connectivity options for PostgreSQL

Instead of specifying separte options and credentials:
  database PostgreSQL do |db|
    db.name               = "database_name"
    db.username           = "username"
    db.password           = "password"
    db.host               = "localhost"
    db.port               = 5432
  end

users may user just one -- url:
  database PostgreSQL do |db|
    db.url = "postgres://my_username:password@localhost:5432/my_database_name"
  end

Fixes https://github.com/backup/backup-features/issues/39

Any chance to have this soon? @mrrooijen

He doesn't do anything with backup anymore.


Find out how to store the RGB color code database

TODO: Check if this workaround solution is feasible: https://github.com/vercel/vercel/discussions/3716#discussioncomment-84458
For the time being, we .gitignore the SQLite database (and its original CSV file).

Each has more than 500MB, jointly exceeding the GitHub account's 1GB free disk space.
Git LFS is not compatible with Vercel.

When we deploy our app, decide how to store the database.

See https://github.com/vercel/vercel/discussions/3716#discussioncomment-84458 for a possible workaround to use Git LFS with Vercel.


[REQ] 2015(v1+New ui) if its possible

Acknowledgement of preliminary instructions

[X] I have read and acknowledged the preliminary instructions.

What idea do you have?
like 2023(v4+new ui)  like have 2015 esc menu and rest new ui stuff

Not possible.


Add Screenshot generation via Archive Build Phase

The idea here is to generate App Store screenshots from designated views in the app
Steps:

Bash script that runs the swift file on archive
Swift file that takes in views, device, and locale, then screenshots the views + adds device frame or outline
Save the images to the downloads directory or within the project directory
Use GPT to generate mock data for the screenshots?
Integrate with Xcode Cloud somehow?

Should be it's own repository, will close this


[docs] Fix the scroll functionality of the mini drawer demo

In this commit, we are changing the CSS for the mini drawer demo so to separate the vertical scroll of the drawer to be independent of the window scroll.
Credits for @oliviertassinari that came up with these changes, I tested it locally and it works perfectly.
Fixes #13412

[x] I have followed (at least) the PR section of the contributing guide.

Annoyingly I was just working on this after @arxenix not replying to my comment on the issue. After playing around with the widths. I think:
    width: theme.spacing.unit * 9.5,     [theme.breakpoints.up('sm')]: {       width: theme.spacing.unit * 11.5,     }, looks better

@joshwooding I gave your comment a look. I agree I think that the width was off by 1px due to the border:

Thank you guys for looking into it :)


[ENH] Aggregator remove index naming requirement

Reference Issues/PRs

This PR removes the index naming requirement in the code completely, after the workaround by @fkiraly. This is linked to issue #2433
What does this implement/fix? Explain your changes.

Changes to the code to allow for non-named indexes and a bug fix as well for flattening single indexes in complicated hierarchies. I didn't implement the second bullet in #2433, but can give it a go with a pointer to start me off?
Does your contribution introduce a new dependency? If yes, which one?

No

@fkiraly just three tests

the output of fit_transform() with named and unnamed indexes are equal
fit_transform() fails when __total is already present in the index
the flatten_single_levels argument for a fixed example returns the right number of unique indexes

fit_transform() fails when __total is already present in the index

I'm wondering about the behaviour here - what I would do if __total is already in the index is to recompute/overwrite, instead of raising an error?

More generally, how about an inverse_transform that removes all levels that contain __total?
for i in range(X.index.nlevels-1):
    X = X.drop(index=`__total`, level = i)
return X

(done)

Included the inverse transform now 👍
Also, I made some minor changes to the panel convert_to() functions, because some of the inverse transformation tests were failing. The "__total" in the index was being overwritten to a number during conversion to nested-univ and so the transform -> inverse transform test wasn't returning the same object. Should be fine now (hopefully)...
from sktime.transformations.hierarchical.aggregate import Aggregator
from sktime.utils._testing.scenarios_getter import retrieve_scenarios
from sktime.datatypes import convert_to

# this was the test that failing
test = retrieve_scenarios(Aggregator)[4]
X = test.args["transform"]["X"]
agg = Aggregator()
Xt = test.run(agg, method_sequence=["fit", "transform"])

X_long = convert_to(X, to_type="pd-multiindex")
Xt_long = agg.fit_transform(X_long)

# this is the problem, "__total" needs to be tracked to this index
convert_to(Xt_long, to_type="nested_univ")

in the index was being overwritten to a number during conversion to nested-univ

Good find! Indeed, the conversion was incorrectly assuming integer indices.
In case it is not too much of a hassle, would it be possible to include one example in _panel._examples to prevent this from happening in the future? Perhaps worth doing this in a separate PR as it may dredge up further bugs.
Perhaps one example that, in its pd-multiindex incarnation, has no index level names, and the time index is datetime?

Should be good to go now @fkiraly

@ciaran-g, would you mind quickly checking whether https://github.com/sktime/sktime-tutorial-pydata-berlin-2022/blob/main/notebooks/3_hierarchical_global_forecasting.ipynb still runs with the changes?

all good 👍


chore: update outdate links

What ❔
There are a lot of redirects on the old link. Here is the main link that immediately leads to the necessary resource.

Why ❔

Checklist

[ ] PR title corresponds to the body of PR (we generate changelog entries from PRs).
[ ] Tests for the changes have been added / updated.
[ ] Documentation comments have been added / updated.
[ ] Code has been formatted via zk fmt and zk lint.
[ ] Spellcheck has been run via zk spellcheck.

@Deniallugo and @perekopskiy

Thank you, though at this moment we don't merge small contributions (see contributing FAQ).


No Subscribe causes high usage of cpu

I write a SSDP demo and receive data from UdpClient. In method GetIncommingMessagesSequence, I try 3 ways to create an Observable. The 1st and 2nd way will cause high usage of CPU. Only the 3rd way works well.
I'm wondering why. Thanks.

.Net Core 2.0
System.Reactive.Linq  Version="4.0.0-preview00001"

using System;
using System.Net;
using System.Net.Sockets;
using System.Reactive.Linq;
using System.Text;

namespace RxDemo
{
    class Program
    {
        private const string MulticastAddress = "<IP_ADDRESS>";

        private const int MulticastPort = 1900;

        private const string MSearchRequestFormattedString =
            "M-SEARCH * HTTP/1.1" + "\r\n" +
            "HOST: <IP_ADDRESS>:1900" + "\r\n" +
            "MAN: \"ssdp:discover\"" + "\r\n" +
            "ST: {0}" + "\r\n" +
            "MX: {1}" + "\r\n" +
            "Content-Length: 0" + "\r\n\r\n";

        static void Main(string[] args)
        {
            var localEndPoint = new IPEndPoint(IPAddress.Parse("<IP_ADDRESS>"), 0);
            var searchTarget = "urn:schemas-upnp-org:device:MediaServer:1";

            Search(localEndPoint, searchTarget, 5)
                .Subscribe(m => System.Console.WriteLine(m)); ;

            Console.ReadLine();

        }

        private static IObservable<string> GetIncommingMessagesSequence(UdpClient socket)
        {
            var searchStream = Observable
                                // 1. causes high usage of cpu
                                //  .FromAsync(socket.ReceiveAsync)

                                // 2. causes high usage of cpu
                                // .Create<UdpReceiveResult>(obs => Observable.FromAsync(socket.ReceiveAsync).Subscribe(obs))

                                // 3. no problem
                                .Create<UdpReceiveResult>(obs => Observable.FromAsync(socket.ReceiveAsync).Subscribe(x =>
                                {
                                    obs.OnNext(x);
                                }))

                                .Repeat()
                                .Retry()
                                .Publish()
                                .RefCount();

            var searchHttpMessages = from receiveResult in searchStream
                                     select System.Text.Encoding.UTF8.GetString(receiveResult.Buffer);

            return searchHttpMessages;
        }

        private static IObservable<string> Search(IPEndPoint localEndPoint, string searchTarget, int timeForResponse)
        {
            return Observable.Create<string>(
                observer =>
                {
                    var multicastEndPoint = new IPEndPoint(IPAddress.Parse(MulticastAddress), MulticastPort);
                    var request = string.Format(MSearchRequestFormattedString, searchTarget, timeForResponse);
                    var buffer = Encoding.UTF8.GetBytes(request);

                    UdpClient searchClient = null;
                    IDisposable timerSubscription = null;

                    try
                    {
                        searchClient = new UdpClient(localEndPoint);

                        // Stop listening for a devices when timeout for responses is expired
                        timerSubscription = Observable.Timer(TimeSpan.FromSeconds(timeForResponse)).Subscribe(s =>
                            {
                                searchClient?.Close();
                                observer.OnCompleted();
                            });

                        var responses = GetIncommingMessagesSequence(searchClient);
                        responses.Subscribe(observer);

                        searchClient.SendAsync(buffer, buffer.Length, multicastEndPoint);

                        System.Console.WriteLine($"Sent M-Search request from local endpoint '{localEndPoint}' to a multicast endpoint '{multicastEndPoint}' with search target '{searchTarget}'.");
                    }
                    catch (SocketException ex)
                    {
                    }
                    catch (ObjectDisposedException)
                    {
                    }

                    return () =>
                        {
                            timerSubscription?.Dispose();

                            searchClient?.Close();
                        };
                });
        }
    }
}

I'd think the reason for the high cpu usage is the tight-loop Repeat() you get because .FromAsync(socket.ReceiveAsync) completes with a single item almost immediately.
In contrast, the 3rd option never completes and thus it is never repeated and the whole sequence hangs.


gcc 7 compilation error

When I try to compile VAST with GCC 7 I get the following error:
vast/libvast/vast/concept/printable/numeric/integral.hpp:49:12: error: cannot convert ‘vast::integral_printer<long unsigned int>’ to const long unsigned int’ in initialization
 auto const integral = integral_printer<T>{};
            ^~~~~~~~
In file included from vast/libvast/vast/concept/printable/vast/bitmap.hpp:6:0,
                 from vast/libvast/test/bitmap.cpp:5:
vast/libvast/vast/concept/printable/vast/bits.hpp: In instantiation of ‘vast::bits_printer<T, Policy>::print(Iterator&, const vast::bits<T>&) const::<lambda(auto:22, auto:23)> [with auto:22 = bool; auto:23 = long unsigned int; Iterator = std::back_insert_iterator<std::__cxx11::basic_string<char> >; P = vast::policy::rle; T = long unsigned int; Policy = vast::policy::rle]’:

GCC version:
gcc (GCC) 7.1.1 20170528

It works with clang on the same system.

I wish I knew what was going here, but no clue why GCC doesn't like one form over the other.

Just a heads up, the High Sierra clang compiler, doesn't like the fix. Since this is a still a beta, I didn't reopen the issue. The previous implementation (commented out) works fine. Here is the compiler version, not sure what "other" clang version that is based on:
$ clang++ -v
Apple LLVM version 9.0.0 (clang-9<IP_ADDRESS>)
Target: x86_64-apple-darwin17.0.0
Thread model: posix

A warning:
$HOME/vast/libvast/vast/concept/printable/numeric/integral.hpp:55:27: warning: variable 'vast::printers::integral<unsigned long>' has internal linkage but is not defined [-Wundefined-internal]
const integral_printer<T> integral;
                          ^
In file included from $HOME/vast/libvast/test/coder.cpp:5:
$HOME/vast/libvast/vast/concept/printable/vast/coder.hpp:21:26: note: used here
    auto key = printers::integral<size_t> ->* [&] { return i++; };
                         ^
1 warning generated.

And a linker error:
Undefined symbols for architecture x86_64:
  "vast::printers::integral<int>", referenced from:
      (anonymous namespace)::test20::run() in printable.o
      (anonymous namespace)::test169::run() in printable.o
      (anonymous namespace)::test183::run() in printable.o
      (anonymous namespace)::test194::run() in printable.o
      (anonymous namespace)::test224::run() in printable.o
  "vast::printers::integral<unsigned int>", referenced from:
      (anonymous namespace)::test32::run() in printable.o
  "vast::printers::integral<unsigned long>", referenced from:
      bool vast::vector_coder_printer<vast::null_bitmap, vast::policy::expanded>::print<std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::equality_coder<vast::null_bitmap> >(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >&, vast::equality_coder<vast::null_bitmap> const&) const in coder.o
  "vast::printers::integral<unsigned long long>", referenced from:
      auto std::__1::enable_if<std::is_same<vast::policy::rle, vast::policy::rle>::value, bool>::type vast::bits_printer<unsigned long long, vast::policy::rle>::print<std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle>(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >&, vast::bits<unsigned long long> const&) const::'lambda'(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle)::operator()<bool, unsigned long long>(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle) const in bitmap.o
      auto std::__1::enable_if<std::is_same<vast::policy::rle, vast::policy::rle>::value, bool>::type vast::bits_printer<unsigned long long, vast::policy::rle>::print<std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle>(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >&, vast::bits<unsigned long long> const&) const::'lambda'(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle)::operator()<bool, unsigned int>(std::__1::back_insert_iterator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >, vast::policy::rle) const in bitmap.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

I get the warning also with Clang 4.0.1 on macOS Sierra. (FYI: the Homebrew package llvm ships with this version of Clang in /usr/local/opt/llvm/bin/clang++.)
This one puzzles me. Am misusing variable templates?

Got the same linker error on macOS Sierra with clang version:
Apple LLVM version 8.1.0 (clang-802.0.42)
Target: x86_64-apple-darwin16.7.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

Configure options CAF: ./configure --generator=Ninja --build-type=debug --with-log-level=debug --no-opencl
Configure options VAST: ./configure --generator=Ninja --with-caf=$HOME/actor-framework/build/ --build-type=debug --log-level=debug

Sigh...I cannot reproduce it, even though I have the exact same compiler and started with a fresh clone of the repo.

I've just pushed another attempt to fix it. In this current version, I no longer get the warnings. Would you mind checking whether this solved it?

Looks good to me! No warning, no linker error.

Compiled successfully for me.


Description field on resources not parsing/ignoring certain unicode symbols

Hi, it looks like the API is storing the description for resources in unicode, and its not being properly translated (or ignored) in Terraform. Could we maybe ignore certain symbols on a diff? Thanks!
Terraform Version
Terraform v0.12.28
provider.cloudflare v2.9.0
Affected Resource(s)

cloudflare_firewall_rule
cloudflare_filter

Terraform Configuration Files
resource "cloudflare_filter" "botnet_le_10" {
  zone_id    = "yy"
  description = "Botnet Score < 10"
  expression = "(cf.bot_management.score lt 10)"
}

resource "cloudflare_firewall_rule" "botnet_lt_10" {
  zone_id     = "yy"
  description = "Botnet Score < 10"
  filter_id   = cloudflare_filter.botnet_le_10.id
  action      = "log"
}

Expected Behavior
No change after creation
Actual Behavior
Upon successful creation, apply again and you'll always get the diff
  # cloudflare_firewall_rule.botnet_lt_10 will be updated in-place
~ resource "cloudflare_firewall_rule" "botnet_lt_10" {
        action      = "log"
      ~ description = "Botnet Score < 10" -> "Botnet Score < 10"
        filter_id   = "123"
        id          = "xx"
        paused      = false
        products    = []
        zone_id     = "yy"
    }

  # cloudflare_filter.botnet_lt_10 will be updated in-place
~ resource "cloudflare_filter" "botnet_lt_10" {
      ~ description =  "Botnet Score < 10" -> "Botnet Score < 10"
        expression  = "(cf.bot_management.score lt 10)"
        id          = "xx"
        paused      = false
        zone_id     = "yy"
    }

Steps to Reproduce

terraform apply

Important Factoids
I'm seeing from the API a similar issue with symbols being stored as "description": "Botnet Score \u0026lt; 10"
I know I can ignore it with an ignore_changes block but thought I'd create a ticket anyway for visibility. Thanks!!

This was fixed in #758 and is pending a release. You're welcome to use master for now if you need it.

Ah awesome! great timing, thanks!! :)


Investigate application commands

Context
With nessie in the process of getting verified and the deadline for priviliged message intent is looming, I've decided to prioritise migrating nessie and yagi to application commands in the next 2 weeks. Nessie should be straightforward enough, Yagi on the other hand I'm a bit concerned. Granted looking at this codebase hurts me and I should really put aside time in cleaning this mess up, Nessie is still far better than the clownfest I made in Yagi.
In terms of implementing application commands, it doesn't look too hard. Going with the approach of duplicating commands and supporting both for now. I'll slowly deprecate prefix commands a week before the deadline comes
oh and I changed info to about since I'm adopting that methodology from here on out as well as switching to use Shizuka Test for all development needs. Bisolen served me well but I realised scalability-wise it's better to have one main testing bot for all my projects

Change

Install application commands dependencies
Change development bot to use shizuka instead of bisolen
Create app_commands
Add registration and initialisation of app commands
Change info command to about

Release Notes
Investigate application commands

prettier going absolutely bonkers again


Question: load Atari emulator memory snapshots

I have found in po that GDash is able to load levels from Atari emulator memory snapshots.

#: src/misc/helptext.cpp:77
msgid ""
"The game comes with many built-in and pre-installed cave sets, and you can "
"also make up your own levels. Just use the options in the title screen. You "
"can load caves stored in the BDCFF format, but GDash is able to load levels "
"from C64 and Atari emulator memory snapshots as well."

Could somebody explain how to do this?
Or was this functionality eliminated at some moment, leaving the rudiments of it in the helptext?
If this functionality really exists, I have an idea to convert some Atari Boulder Dash clones, that are not present in GDash, to GDash cavesets.

Never tried myself, but @cwscws told me it works for C64 dumps:
$ gdash in.vsf --save-gds out.gds -q

@cwscws told me it does not produce log messages, so he prefers any2gdash, which I also never used.

Ok, very good.
The original gdash-20130427unstable says me what to do, there appeared a file stderr after some attempt to run
$ gdash in.vsf --save-gds out.gds -q

terminate called after throwing an instance of 'std::runtime_error'
  what():  Memory map file should be 65536+2 bytes long or 65536 bytes long. Use save "filename" 0 0000 ffff in vice monitor. Use write 0000 ffff filename in atari800 monitor.

So, I used Atari800Win monitor for memory dump:
write 0000 ffff bobo1

After that I was able to convert it using gdash-20130427unstable and gdash-export as well:
$ gdash bobo1 --save-gds Bobo1.gds -q

After that I opened it in the GDash Cave Editor and made some changes: added info about author, renamed caves.
After that I saved it in BDCFF format as Bobo1.bd and tried to Export CrLi cave pack as GDash_Bobo1.gds.
After that the file in BDCFF format Bobo1.bd is loaded successfully. But I got a message "Cannot determine file format" on try to load GDash_Bobo1.gds saved by "Export CrLi cave pack".
Bobo1.zip
What am I doing wrong?

Ok, how can I make some changes and save the caveset back as gds?

gdash Bobo1.bd --save-gds GDash_Bobo1.gds

does nothing

Hmm, in this case how @Dustin974 is going to fix caves ( #22 ) ?
The fix will result in gds, right?

Ok, @revvv , are you interested in getting cavesets from Atari Boulder Dash clones, that aren't in GDash?
If yes, what format should they be? gds as a result of gdash --save-gds or BDCFF as a result of editing gds?
Maybe there are / should be some naming conventions, for example we need to add Atari_ as a prefix to all cavesets?
What can be the result of my activity? Would you like a ZIP with .db sorted in directories by authors?
I thought to minimize your efforts of adding new cavesets to GDash caves... but if the feature of export to gds is not implemented... we have to come to some agreement before I begin.

Sure, I'm interested. I personally prefer BDCFF, but I see there are already a lot of caves in both formats. I don't know the reason, but maybe the BDCFF was modified to be compatible with GDash?
You can give me a ZIP file or do a PR whatever you like...
A prefix sounds reasonable.

Successfully imported cavesets:
../caves/Bobosoft/Bobo1_Atari.bd
../caves/Bobosoft/Bobo3_Atari.bd
../caves/Bobosoft/Bobo4_Atari.bd
../caves/Max/Max1.bd -- from C64
../caves/Max/Max2.bd -- from C64
../caves/Persoft/HOP_1_Atari.bd
../caves/Persoft/HOP_2_Atari.bd
../caves/Persoft/HOP_3_Atari.bd
../caves/Persoft/HOP_4_Atari.bd
../caves/Iron_Soft/Iron_Soft_1_Atari.gds == ../caves/various/Boulder_Dash_9.gds
../caves/Iron_Soft/Iron_Soft_2_Atari.gds == ?
../caves/Iron_Soft/Iron_Soft_3_Atari.gds == ../caves/various/Boulder_Dash_5_Artur_Losinski.gds
../caves/Iron_Soft/Iron_Soft_4_Atari.gds == ?
../caves/LTL_Soft/LTL_Soft_1_Atari.bd
../caves/LTL_Soft/LTL_Soft_2_Atari.bd
../caves/Mapasoft/Mapasoft_Atari.gds == ../caves/various/Boulder_Dash_11.gds
../caves/various/Boulder_Dash_8_Atari.gds == ../caves/various/Boulder_Dash_8_Artur_Losinski.gds
../caves/various/Boulder_Dash_20_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Bee_001_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Birds_001_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Dig_Dug_001_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Fire_Ant_001_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Ninja_001_Atari.bd
../caves/Scserbin_Zoltan/Boulder_Dash_Pacman_001_Atari.bd
../caves/various/Dotter_Dash_07_Atari.bd
../caves/Alex_Zop/Rocki_im_Lolliland_Atari.bd
../caves/various/Walace_Glazy_Atari.gds
btw
../caves/Marc_Pierau/Rockford_in_Nimmerland_2.gds belongs to Alex_Zop
Unfortunately could not import the next Atari memory dumps:
-- Could not import cave data -- unknown cave format!

Boulder_Dash_a_la_JD
Boulderdan_1
Boulderdan_2
BSM_Boulder_Dash
Kendallsoft_Kaverns
Lighting_Dash
Boulder_Dash_+1
Boulder_Dash_+2
Boulder_Dash_+3
Boulder_Dash_+4
Cuevas_Dr_Mugen_1
Cuevas_Dr_Mugen_2
Cuevas_Dr_Mugen_3
Cuevas_Dr_Mugen_4
Cuevas_Dr_Mugen_4_First_Edition
Cuevas_Dr_Mugen_4_Second_Edition
Cuevas_Dr_Mugen_4_Third_Edition
Cuevas_Dr_Mugen_5
Cuevas_Dr_Mugen_6
Cuevas_Dr_Mugen_7
Cuevas_Dr_Mugen_8
Cuevas_Dr_Mugen_9
Cuevas_Dr_Mugen_10
Cuevas_Dr_Mugen_11
Cuevas_Dr_Mugen_11B
Cuevas_Dr_Mugen_12
Cuevas_Dr_Mugen_13
Cuevas_Dr_Mugen_14
Cuevas_Dr_Mugen_15
Cuevas_Dr_Mugen_16
Cuevas_Dr_Mugen_17
Boulderdash_Mugen_18
Cuevas_Dr_Mugen_19
Cuevas_Dr_Mugen_20
Cuevas_Dr_Mugen_21
Mugen_Challenger
Dr Mugen Extra Caves

GREAT! :)
You forgot to add _Atari to Max1.bd and Max2.bd
Can you include the missing Atari Boulder Dashes which can not be converted as memory dumps AND the original Atari files (to load on an emulator) to the caves.zip file?

I didn't forget to add _Atari to Max1.bd and Max2.bd because I could not import them from Atari memory dumps, but I found the same games for C64 and converted them from VICE memory dump. So I decided do not add "_C64".

Can you include the missing Atari Boulder Dashes which can not be converted as memory dumps AND the original Atari files (to load on an emulator) to the caves.zip file?

Added many new cavesets exported from C64, reviewed and catalogued exisiting.
remote: Permission to revvv/gdash-export-CrLi.git denied to renyxadarox.
So I just add caves catalogue as a zip for complete replacement.
caves.zip

Please coordinate your work with Dustin - he is updating and correcting the caves folder!

I don't know how to coordinate my work with Dustin, I have no permissions to create a new branch in this project.
All I can, I can just upload files. Do I have to wait for Dustin to make changes and update the caves folder after that? Ok, I will.

I just had no time to have a look at your work. And you don't need write permission, just make a PR or wait until I check it in...
Thank you for the new caves!

@revvv Ok, I got it. There exists an opportunity to create PR based not only on comparison of two branches, but also across two forks. Nice.
https://github.com/revvv/gdash-export-CrLi/pull/28

I would recommend to put all official Boulder Dashes into a "FirstStarSoftware" folder and not a "Peter_Liepa" folder.

Had to rename The_Bremer_Town-Musicus to The_Bremer_Town_Musicus. A dash - is not allowed in variable names in Makefiles.

What about files? Is - allowed in file names?

Yes, that's ok.

mea culpa, @revvv thanks


Does this lib work?

Hi,
We've spent quite some time today looking around to find potential issue with the input we've provided to generateTOTPCodeString but eventually failed. All the test passes, but seems that the generated codes do not match. We did the comparison against https://github.com/bellstrand/totp-generator/blob/master/test/index.spec.js#L6 .

It should, give me some time to run some tests and see what I find.At a quick glance at their code, it could be the algorithm. They default to SHA1, and I default to SHA256 to be more compatible with Google Authenticator and most modern authenticator apps that default to SHA256. Maybe try setting the NodeJS one to SHA256, or this one to SHA1 when you make the call?

Thanks for reply.
Tried to mimic test https://github.com/bellstrand/totp-generator/blob/master/test/index.spec.js#L31 so having:
    test(
        '',
        () {
      final code = OTP.generateTOTPCode('JBSWY3DPEHPK3PXP',<PHONE_NUMBER>000, algorithm: Algorithm.SHA1, interval: 60);
      expect(code, equals(345785));
    });

it gets:
  Expected: <345785>
    Actual: <34108>

Ok, for your first example, pass in isGoogle: true the reason being is Google pads the secret to the right length by copying the secret over and over until all the spots in the array are taken. the RFC spec pads with 0s. Most OTP libraries default to Google's padding, while others don't. To support both, I added this flag. When I take your first non-working example and use isGoogle: true it matches.
I also encourage using OTP.generateTOTPCodeString() as then you wont lose leading 0s that get removed when keeping it as an integer. unless you want to keep it an integer.
As for your second example, setting isGoogle didnt make it work, so I am not sure if its my library or theirs that isn't doing something right.

Looks like its something with the way they use the DateTime.parse() function. If i take that same time as milliseconds<PHONE_NUMBER>000 and enter it into my function, i get the right code.
final code6 = OTP.generateTOTPCodeString(
      'JBSWY3DPEHPK3PXP',<PHONE_NUMBER>000,
      interval: 60, algorithm: Algorithm.SHA1, isGoogle: true);
  print(code6);

  final code7 = OTP.generateTOTPCodeString('J22U6B3WIWRRBTAV',<PHONE_NUMBER>000, algorithm: Algorithm.SHA1, interval: 30, isGoogle: true);
  print(code7);```

```sh
~/workspace/dart-otp/example on   master !1 ?1                                             at  14:58:38
❯ dart example.dart
313995
793957```

This is my nodejs code for testing the same, using 2 different libraries.:

```js
const totp = require("totp-generator");
const OTPAuth = require("otpauth");

global.Date.now = () => { return<PHONE_NUMBER>000; };
// Keys provided must be base32 strings, ie. only containing characters matching (A-Z, 2-7, =).
const token = totp("J22U6B3WIWRRBTAV", {algorithm: "SHA-1", period: 30});

console.log("TOTP-Generator: " + token); // prints a 6-digit time-based token based on provided key and current time

// Create a new TOTP object.
let otp = new OTPAuth.TOTP({
    issuer: 'ACME',
    label: 'AzureDiamond',
    algorithm: 'SHA1',
    digits: 6,
    period: 30,
    secret: 'J22U6B3WIWRRBTAV' // or "OTPAuth.Secret.fromBase32('NB2W45DFOIZA')"
});

// Generate a token.
let token2 = otp.generate();

console.log("OTPAuth: " + token2)

~/workspace/totpjs                                                                           at  14:58:40
❯ node index.js
TOTP-Generator: 793957
OTPAuth: 793957

Ya, the datetime.parse is off.
print(DateTime.parse('2019-01-01 00:00:00.000').millisecondsSinceEpoch);

results in<PHONE_NUMBER>000 which is not the same as<PHONE_NUMBER>000 and I think its because that library isn't setting the timezone (or UTC) correctly.
print(DateTime.parse('2019-01-01 00:00:00.000 Z').millisecondsSinceEpoch);

this results in the proper<PHONE_NUMBER>000, just needs that Z in the time string.

Closing this for now, if you are still having issues, please reopen and we can go from there.


combine ManagedExecutorBuilder and ThreadContextBuilder into main spec interfaces

This pull fixes #41 which asks for the ManagedExecutorBuilder and ThreadContextBuilder to become Builder interfaces under  their respective ManagedExecutor and ThreadContext interfaces.
Signed-off-by: Nathan Rauh<EMAIL_ADDRESS>

@manovotn @aguibert could you review this pull to combine the builders as requested under #41 ?


Add Function Name to C# compile error logs

When we log compile errors (the ones that show up in FunctionLogs in Kusto), we don't include the Function name that failed to compile, which means it doesn't show up when you filter on just Function Name (you have to look at the whole Function app and guess which errors belong to which Functions).
We should correlate the name with the errors in FunctionLogs.

Seems it's missing from a number of other entries. e.g. the following don't have a FunctionName:

Executing 'Functions.HttpOrders' (Reason='This function was programmatically called via the host APIs.', Id=47bc2761-3581-4990-8dde-c739149e9d2a)
Exception while executing function: Functions.HttpOrders
Executed 'Functions.HttpOrders' (Failed, Id=47bc2761-3581-4990-8dde-c739149e9d2a)

Maybe it's because some are targeting the host log instead of the function log? But then why have nearly identical entries in both? If something is specific to one function, it shouldn't go to the host log at all.

Fix checked in V1. Tracking issue here for V2


How to connect to a provider that only answers one GetDirectory request per message?

Some providers seem to have issues with answering the requests sent by the Ember+ Sharp Library. The library typically sends messages containing many GetDirectory requests, but said providers only ever answer the first one. As a result, Consumer.CreateAsync fails with a TimeoutException.

To work around this issue, call the Consumer.CreateAsync overload that accepts a ChildrenRetrievalPolicy parameter and pass ChildrenRetrievalPolicy.DirectOnly. As a result, only the direct children of the root node are requested from the provider and the method returns as soon as they have been received. Client code can now inspect the root children and set INode.ChildrenRetrievalPolicy of the first node to ChildrenRetrievalPolicy.DirectOnly and call Consumer.SendAsync. As soon as that method has completed the process can be repeated for the remaining nodes and recursively for any children of interest.
This approach ensures that each consumer message contains at most one GetDirectory request and will thus lead to many more messages being sent by the consumer.

It seems as if I am having difficulties wrapping my head around thes asynchronous thingies. I tried to implement the suggestion like this:
                ...                 using (Consumer<MyRoot> consumer = await Consumer<MyRoot>.CreateAsync(client, 1000, ChildrenRetrievalPolicy.DirectOnly))                 {                     await consumer.SendAsync();                     INode root = consumer.Root;                     await RetrieveChildren(root, consumer);                     ...
where RetrieveChildren looks like this:
`
protected static async Task RetrieveChildren (INode root, Consumer consumer)
{
if (!root.IsRoot)
{
root.ChildrenRetrievalPolicy = ChildrenRetrievalPolicy.DirectOnly;
await consumer.SendAsync();
}
        foreach (IElement child in root.Children)
        {
            if (child is INode)
            {
                INode node = (INode)child;
                await RetrieveChildren(node, consumer);
            }
        }
    }

`
This, however gives me System.Threading.Tasks.TaskCanceledException in the AsyncPump.
I would appreciate an example of how to actually implement the work-around.

I removed the recursion like this:
        protected static async Task RetrieveChildren(INode root, Consumer<MyRoot> consumer)
        {
            int i = 0;
            List<INode> nodes = new List<INode> {root};
            while (nodes.Count != 0)
            {
                INode node = nodes[0];
                nodes.RemoveAt(0);

                Console.WriteLine((i++) + ": " + node.Identifier + " (" + node.Number + ")");
                node.ChildrenRetrievalPolicy = ChildrenRetrievalPolicy.DirectOnly;
                await consumer.SendAsync();

                foreach (IElement child in node.Children)
                {
                    if (child is INode)
                    {
                        nodes.Add((INode)child);
                    }
                }
            }
        }

Then I get a "System.Threading.Tasks.TaskCancelledException" with the following stack trace:
   vid System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter`1.GetResult()
   vid Lawo.EmberPlusSharp.Model.Consumer`1.<SendAsync>d__13.MoveNext() i C:\Storage\Development\Libraries\EmberPlus\ember-plus-sharp\Lawo.EmberPlusSharp\Model\Consumer`1.cs:rad 183
--- Slut på stackspårningen från föregående plats där ett undantag utlöstes ---
   vid System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   vid System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   vid SimpleTest.Program.<RetrieveChildren>d__1.MoveNext() i C:\SVN\metodutv\NG\Lawo-EmberPlusSharp-Test\SimpleTest\SimpleTest\Program.cs:rad 56
--- Slut på stackspårningen från föregående plats där ett undantag utlöstes ---
   vid System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   vid System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   vid System.Runtime.CompilerServices.TaskAwaiter.GetResult()
   vid SimpleTest.Program.<>c.<<Main>b__0_0>d.MoveNext() i C:\SVN\metodutv\NG\Lawo-EmberPlusSharp-Test\SimpleTest\SimpleTest\Program.cs:rad 28

I apologise for the swedish text in the stack trace, but I hope that you can decipher it anyway.
Curiously enough, this happens on the same node as the earlier crash even though I do the traversal in the other direction, meaning that a lot more nodes are traversed before the crash, this time.

Have you tried to increase the timeout to say 10000? 1000 seems a little low.

Wouldn't I get timeout exceptions if that was the case? I still get TaskCancelledExceptions, even with much longer time-outs. In addition, my code as it is  written now, sometimes simply freezes. There must be something wrong with it. I just can't see what.

Wouldn't I get timeout exceptions if that was the case?

You should, but I had the suspicion that there might be a bug that would prevent you from getting a proper TimeoutException, see below.

In addition, my code as it is written now, sometimes simply freezes. There must be something wrong with it. I just can't see what.

While I can't reproduce the TaskCancelledException, I do get the freezes. It appears that this is a bug (#40), I'm sorry for the inconvenience. I'll keep you posted.


Can't update using brew

Tried today to get 0.2.0:
[~]% brew install Virtuslab/scala-cli/scala-cli
scala-cli 0.1.16 is already installed but outdated (so it will be upgraded).
==> Fetching virtuslab/scala-cli/scala-cli
==> Downloading https://github.com/Virtuslab/scala-cli/releases/download/v0.2.0/scala-cli-x86_64-apple-darwin.gz
curl: (22) The requested URL returned error: 404

@adamw Hi, thanks for reporting. We encountered a bug during the release of version 0.2.0, but we fixed it now and it should no longer occur. However, if you tried to upgrade scala-cli with brew before our fix to 0.2.0, you have to run the following command to update:
brew upgrade Virtuslab/scala-cli/scala-cli --fetch-HEAD

if above command doesn't work you can try to run the following commands:
brew uninstall scala-cli
brew untap virtuslab/scala-cli
brew install Virtuslab/scala-cli/scala-cli

The first method did not work:
[~]% brew upgrade Virtuslab/scala-cli/scala-cli --fetch-HEAD
==> Upgrading 1 outdated package:
virtuslab/scala-cli/scala-cli 0.1.16 -> 0.2.0
==> Fetching virtuslab/scala-cli/scala-cli
==> Downloading https://github.com/Virtuslab/scala-cli/releases/download/v0.2.0/scala-cli-x86_64-apple-darwin.gz
==> Downloading from https://objects.githubusercontent.com/github-production-release-asset-2e65be/366035268/799b1004-fd9a-447f-aad1-c69b10fde489?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJ
######################################################################## 100.0%
Error: SHA256 mismatch
Expected:<PHONE_NUMBER>3e79915fcf139fff17c12f4263dea43f0de72a6b8254bb2e8ef5c6
  Actual: 3c707fe1b4a83baf3baac814475a89a51ed7b4b5c09c330953ac68b7e09b8fdc
    File: /Users/adamw/Library/Caches/Homebrew/downloads/0adb5cd4afdd221eb72469fb0a95555c16c0ab8cdcb65419eca9eb3745a177e3--scala-cli-x86_64-apple-darwin.gz
To retry an incomplete download, remove the file above.

but the second did, thanks! :)


Initial subscribe email is sent form verificationemail.com

Not sure if this is intended or not, but after setting up email notifications with a custom source email address the original subscribe email is still sent from<EMAIL_ADDRESS>The emails after that for the actual notifications are indeed sent from the correct email address however.

Yes, it's definitely better to use custom email address there, but I'm not very sure how to do that. This doc says the SES-verified email address can be specified as FROM email address, but no descriptions about the SES-verified domain. As the aws console has the UI only for the SES-verified email address (like below), maybe there is no way to do that so far?


Resolve code actions

In last version of the lsp specification, the edit field in a CodeAction is not mandatory anymore.
In such case, the client is supposed to call the server to resolve it when it needs to.
Unfortunately, the monaco api doesn't provide the way to do it properly.
As soon as https://github.com/microsoft/monaco-editor/issues/2663 is resolved, it will need to be properly implemented, this is a temporary "hack"

@mofux still counting on you ;)


Separate Resources component

@sprjr made a compelling case for a separate resources component. It turns out that I basically already have one implemented!
The current implementation is like this:

ComponentA
Fetch
ComponentB

ComponentA+Fetch here maps to your action creators. It manages everything network related.
The result of these is then passed to ComponentB, which is really just some sugar around mapStateToProps.
If a user doesn't want to use ComponentA+Fetch, which feels more framework-y, then they can start by just using ComponentB.

Resolved in #16


Update Fortran combinational logic openmp-primes sample

Existing Sample Changes
Description

Update sample to work with ifx
Formatting updates
Minor editorial updates

Type of change

[X] Bug fix (non-breaking change which fixes an issue)

Thanks for the review @jimmytwei  - updates applied.

@krisdale Approved. Sample works with the latest (7/31/23) 2024.0 BaseKit and HPCKit. Merging into development branch.


Model save/load

Ability to save the model and anchors will be necessary and allow copying anchor sets between models

Closed in https://github.com/ORNL/icat/commit/6699843eb1bf3733a26081b8cc71a68bff94b8c1


Feat/migrate v3 onboarding

📝 Description
Migrate v3 onboarding to the main repository
Figma Link
❓ Context

Impacted projects: ledger-live-desktop
Linked resource(s): FAT-104

✅ Checklist

[x] Test coverage
[x] Atomic delivery
[x] No breaking changes

📸 Demo
https://user-images.githubusercontent.com/29443638/179195973-2570ffb3-70eb-4e79-b734-be0adac11f9a.mp4

🚀 Expectations to reach
Please make sure you follow these Important Steps.
Pull Requests must pass the CI and be internally validated in order to be merged.

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

@pierrelouis-c seems like the e2e tests are still failing?

@pierrelouis-c Hi, it seems like there are some errors, could you check? (and merge develop)

@gre I rebased develop. E2E tests will fail, because we have to re generate screenshots. We will do it right before merging into develop.

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots

/generate-screenshots


Issue solving

@KristianMSchmidt would it make sense to merge what's in this branch so far? Then you can continue working on the new Student view?

I will merge this branch now, and then merge the deployment branch as well, then we can create new issues for any smaller issues which are yet to be solved.


How to add thermostat

Please tell me how to add thermostat

Hello some one please reply

Hi Harymk, it doesn't sound like ESPAlexa would work in your case. But, could you explain a little more about what you want to do?

I need to change device models. Like fan, thermostat,

Changing the device type as displayed in the Alexa app is not possible.
However, Alexa will still recognize e.g. "Set heater to 21 degrees" and set the Espalexa device to 21%.
You can get this value using espalexa.toPercent(brightness); and just use it as the degrees input value for your thermostat.

Ok thanks

How can i set device status on/off and brightness suparated. Now there is one option i see in code Setvalue().

setState() should work fine for on/off

There is a problem. I changed on off state, brightness value be changed. is there any solution for that


Table Function Invocation Arguments Rehash

Background
The current argument signature for a table function is:
SELECT * FROM python_table('<module>', '<callable>',
  // Output schema
  {'columnA': 'VARCHAR', 'columnB': 'VARCHAR', 'columnC': 'VARCHAR'},
  // Python Function Arguments
  ['arg1', 2, 'arg3']);

There are a number of issues with this:

It's tedious as noted in Issue #9 which pertains to scalar function, which has a similar argument signature.
There is planned future work to make the output schema optional by leveraging Python type hints to infer the schema. This will necessitate making this an optional named argument rather than a fixed required one.
Python function arguments are passed in using a list data structure. DuckDB lists can only hold a single data type, and in practice quietly convert each entry to the same type as the first element. In the above example, the 2 would be converted to a string containing the character "2".

Note that this original argument signature was not thoughtfully considered as it was defined while still in a proof of concept stage. Coming out of this stage, my hope is to fix current issues while also accommodating future work that wasn't originally foreseen.
Proposal
I am proposing a single set of changes which will enable two different options, one I'll dub "compact" and another "explicit".
Explicit
SELECT *
FROM python_table(
  module='<module>', func='<callable>',
  columns = {'columnA': 'INT', 'columnB': 'VARCHAR'},
  'arg1', 2, 'arg3')

In this invocation, module, function, and columns are all named arguments. Any unnamed argument is treated a an input to the Python function, and they are passed in the order in which they appear. Making columns a named argument allows us to make it optional in the future (it will be required for now). Making module and function named arguments makes it clear that these are not arguments to the python function, a potential short fall with the Compact style you'll see next.
Compact
SELECT *
FROM python_table('<module>:<callable>', 'arg1', 2, 'arg3',
  columns = {'columnA': 'INT', 'columnB': 'VARCHAR'})

In this invocation, Columns is still a required named argument but can be made optional in the future. A big different however is that because module and function are not explicitly specified via named arguments, it's assumed that the first argument is a string referring to these values, with a semicolon separating them. I will refer to this as a "function specifier" going forward. This results in a more compact invocation and less typing for those would like to avoid naming every argument. However, the potential negative side effect is it could create confusion around what values end up being passed to the underlying Python function. In this case, it would be all unnamed values except for the first value (which is assumed to be the function specifier).

Underlying changes:

Dropping the positional columns, module, and function arguments in favor of positional one.
Dropping the args list positional argument in favor of varargs.
Adding logic around processing varargs which also checks if module and callable where specified, assuming the first argument is a function identifier if not.

Note, one hiccup with this is that any argument signature that uses varargs will require DuckDb v0.7.2 which has yet to be released. There was a bug in the way table functions handle varargs that causes a segfault any time varargs are specified. A fix was recently merged so the above changes would work when using a pre-release version of DuckDB, but the extension would basically be a brick with v0.7.1 (most recent version) or earlier.


initialSelected is not working

I am getting weirded activity, initial selected is not working on load or before click. After click its working good

Can you see my demo page here
https://mazipan.github.io/vue-select-image/
It's working, you can see on multiple selection

how it works, how can i make it happen? I have tried but did not work, but its working after i click.

Here the code in demo page
https://github.com/mazipan/vue-select-image/blob/master/demo/app.js#L68

here the code how i set initial selection
https://github.com/mazipan/vue-select-image/blob/master/src/VueSelectImage.vue#L149

wow, let me check

I have tried initialSelected with your example, its working on load not but not with other event.  I am getting image data from server and pushing it to initialSelected but this not working, I am using vue-dropzone.
here is my code sample,
//template
<vue-select-image :dataImages="userFiles"
                                                  :is-multiple="true"
                                                  :selectedImages="initialSelected"
                                                  :useLabel="true"
                                                  @onselectmultipleimage="onSelectMultipleImage">
                                </vue-select-image>

// methods
vsuccess(file, response){

                response.src = '/storage/' + response.path + '/' + response.original_file_name
                response.alt=response.original_file_name
                this.userFiles.push(response)
                this.initialSelected.push(response)
                // console.log(this.initialSelected)
            },

Yes, because initialselsection is on mounted hook.
And not sync with props value.
Need to revisit my code if wanna support async loading initialselsection.
Thanks for reporting this case

even initialSelected is not working in created() method.

check that your ID matches
check that your ID is a string
check that your src matches
If all of those are equal in dataImages & selectedImages it will reactively select images even on a async api request

I would actually extend this issue to allow for setting the initial value only by the true "value", which in this component is "id". It's not often that you'd be storing whole objects in your DB, so having to rehydrate an entire object just to get pre-selection working is problematic. Ideally an array of objects just with "id" props would be enough.

Hi,
How I can use the this.$refs with this pluggin? I'm trying to use the next script but it's not working since userImageSelectis not defined:
let component = this.$refs.userImageSelect

Hi,
How I can use the this.$refs with this pluggin? I'm trying to use the next script but it's not working since userImageSelectis not defined:
let component = this.$refs.userImageSelect

You should define a ref value to the component. In your case, it look like this:
<vue-select-image         ref="userImageSelect" />
If you do that, then you can reference the component.


code check

@yasmensarhan27 please check the milestone and read the description. Let me know if anything is not working.

I'll do

I think I've cleared it by mistake

can you check please ??

Checked and it works well

Yes, it is working.

I think you should create another milestone. Because the deadline is approaching.

Yes
We will thank you for notifying us

Thanks. @yasmensarhan27


chore: Update cloud-provider-azure as of 2022-01-05

What type of PR is this?

/kind cleanup
What this PR does / why we need it:
Updates the cloud-provider-azure package to current as of 2022-01-05.
Which issue(s) this PR fixes:

Fixes #
Requirements:

[x] uses conventional commit messages

[ ] includes documentation
[ ] adds unit tests
[ ] tested upgrade from previous version

Special notes for your reviewer:
Release note:
none

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
7 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-1.7%) to 42.925%

Files with Coverage Reduction
New Missed Lines
%

pkg/azdiskschedulerextender/azdiskschedulerextender.go
7
55.02%

Totals

Change from base Build<PHONE_NUMBER>:
-1.7%

Covered Lines:
182

Relevant Lines:
424

💛  - Coveralls


[FLINK-25223][connectors/elasticsearch] Limit Elasticsearch testcontainer memory allocation

What is the purpose of the change
This PR limits the memory allocation of the Elasticsearch testcontainers to prevent them getting OOM killed in the CI
Brief change log
TODO
Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure


Rag Pro Retriever Community Integration

[ ] PR title: "RAG Pro Retriever: LLM Based Web Retriever with Domain Filtering"

Example Usage
from langchain_community.retrievers import RAGProRetriever

retriever = RAGProRetriever(
    api_key="RAG-PRO-API-KEY",
    # Choose between small, medium, or large model sizes depending on your use case
    model="small",
    include_sources=True
)

# Define your query and source filter
query = "How can I create a react agent graph with openai as the llm?"
source_filter = ["https://python.langchain.com/api_reference/", "https://langchain-ai.github.io/langgraph/#example"]

# Retrieve documents
docs = retriever.get_relevant_documents(query, urls=source_filter)

# Print the full content of each document
for i, doc in enumerate(docs):
    print(f"\nDocument {i+1}:")
    print(doc.page_content)  # This will print the entire content
    print(f"Sources: {doc.metadata.get('source', 'Not available')}")

Response
Document 1:
To create a ReAct agent graph using OpenAI as the Large Language Model (LLM) in LangGraph, you can follow these steps:

## Install Required Packages
Ensure you have the necessary packages installed. You can do this using the following command:

\```python
%pip install -U langgraph langchain-openai
\```

## Set Up API Keys
Set your OpenAI API key as an environment variable:

\```python
import getpass
import os

def _set_env(var: str):
    if not os.environ.get(var):
        os.environ[var] = getpass.getpass(f"{var}: ")

_set_env("OPENAI_API_KEY")
\```

## Initialize the Model
Initialize the OpenAI model you want to use:

\```python
from langchain_openai import ChatOpenAI

model = ChatOpenAI(model="gpt-4", temperature=0)
\```

## Define Tools (Optional)
If you want to use tools with your agent, define them using the `@tool` decorator:

\```python
from typing import Literal
from langchain_core.tools import tool

@tool
def get_weather(city: Literal["nyc", "sf"]):
    """Use this to get weather information."""
    if city == "nyc":
        return "It might be cloudy in nyc"
    elif city is "sf":
        return "It's always sunny in sf"
    else:
        raise AssertionError("Unknown city")

tools = [get_weather]
\```

## Create the ReAct Agent Graph
You can either create the graph from scratch or use the prebuilt `create_react_agent` function. Here is how to do it using the prebuilt function:

\```python
from langgraph.prebuilt import create_react_agent

graph = create_react_agent(model, tools=tools)
\```

### Creating from Scratch
If you prefer to create the graph from scratch, here is an example:

\```python
from langgraph.graph import StateGraph, END
from langchain_core.messages import BaseMessage
from langgraph.graph.message import add_messages
from typing import Annotated, Sequence, TypedDict

class AgentState(TypedDict):
    """The state of the agent."""
    messages: Annotated[Sequence[BaseMessage], add_messages]

workflow = StateGraph(AgentState)

# Define the nodes
workflow.add_node("agent", model)
workflow.add_node("tools", ToolNode(tools))

# Set the entry point
workflow.set_entry_point("agent")

# Define conditional edges
def should_continue(state):
    # Implement logic to decide whether to continue or end
    # For example:
    last_message = state["messages"][-1]
    if "tool" in last_message.content:
        return "continue"
    else:
        return "end"

workflow.add_conditional_edges(
    "agent",
    should_continue,
    {
        "continue": "tools",
        "end": END,
    }
)

# Add edge from tools to agent
workflow.add_edge("tools", "agent")

# Compile the graph
graph = workflow.compile()
\```

## Visualize and Use the Graph
You can visualize the graph and use it to process inputs:

\```python
from IPython.display import Image, display

display(Image(graph.get_graph().draw_mermaid_png()))

def print_stream(stream):
    for s in stream:
        message = s["messages"][-1]
        if isinstance(message, tuple):
            print(message)
        else:
            message.pretty_print()

inputs = {"messages": [("user", "what is the weather in sf")]}
print_stream(graph.stream(inputs, stream_mode="values"))
\```

This setup allows you to create a ReAct agent using OpenAI as the LLM and integrate tools if necessary, all within the LangGraph framework[2][4][5].
Sources: ['https://langchain-ai.github.io/langgraph/how-tos/react-agent-from-scratch/', 'https://langchain-ai.github.io/langgraph/how-tos/create-react-agent/', 'https://langchain-ai.github.io/langgraph/how-tos/create-react-agent-memory/', 'https://langchain-ai.github.io/langgraph/how-tos/streaming-tokens/', 'https://python.langchain.com/docs/how_to/migrate_agent/']

[ ] PR message:

Description: Added RAG Pro Retriever Community Integration: an LLM-based web search retriever that allows users to filter by root domains (up to 3) and return information in a higher-quality format than just chunks of text.
Issue: This Retriever solves 2 issues:

Domain Filtering allows builders to not have to worry about setting up their own web scrappers and RAG pipelines for specific sites (e.g., documentation sites)

Higher Quality Data is retrieved due to the fact that we first send the retrieved data from the web to a fine-tuned LLM that then generates a response to the search query as the "retrieved context" to your app.  This means that you no longer have to worry about non-relevant tokens being sent into your LLM because we handle the RAG for you!

Dependencies: no additional dependencies were added
Twitter handle: X

[ ] Add tests and docs:

Integration Test: located at libs/community/tests/integration_tests/retrievers/test_rag_pro.py
Example Notebook: located at docs/docs/integrations/retrievers/ragpro.ipynb

If no one reviews your PR within a few days, please @-mention one of baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.

Hi @baskaryan  @efriis  @eyurtsev  @ccurme  @vbarda  @hwchase17  can you guys take a look at this when you get a chance? Thanks

Hey! This adds a net-new community integration or feature, which has been replaced by dedicated integration packages. I'll close this PR, and would recommend reopening with just docs updates, as well as registering your package in libs/packages.yml! We'll be able to review simple PRs that only modify these two things much faster :)
Here's the guide, and if you have questions, feel free to leave them in the comments on those pages so others can see them! https://python.langchain.com/docs/contributing/how_to/integrations/


coverage of unit test

Pull Request Test Coverage Report for Build 313

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 7.893%

Totals

Change from base Build #1:
0.0%

Covered Lines:
655

Relevant Lines:
8299

💛  - Coveralls


Remove skip-tz-utc parameter

First-time contributors' checklist

[ ] I've signed Contributor License Agreement that's required for repo owners to accept my contribution.

What is changed, added, or deleted? (Required)

Which DM version(s) do your changes apply to? (Required)

[x] master (the latest development version, including v3.0 changes)
[x] v2.0 (TiDB DM 2.0 versions)
[ ] v1.0 (TiDB DM 1.0 versions)

What is the related PR or file link(s)?

This PR is translated from:
Other reference link(s):

Do your changes match any of the following descriptions?

[ ] Delete files
[ ] Change aliases
[ ] Need modification after applied to another branch
[ ] Might cause conflicts after applied to another branch

@lance6716

/cc @lichunzhu

/label needs-cherry-pick-2.0
/translation doing
/cc @CharLotteiu
/assign

/lgtm

/lgtm

/merge

/remove-translation doing
/translation done


Arbitrary class training in Pytorch #5

Summary
This PR adds support for declaring number of clasees for Image Classification Pytorch models.
Details

Adds a parameter in the sidebar below the "Use pre-trained model" checkbox
Default value is 1000 (what torchvision uses)
If pre-trained is True, imagenet weights are loaded and last fc layer is redefined

Checklist

[X] all tests are passing (see README.md on how to run tests)
[ ] if you created a new template: it contains a file test-inputs.yml, which specifies a few input values to test the code template (the test is then automatically run by pytest)
[X] you formatted all code with black
[X] you checked all new functionality live, i.e. in the running web app
[X] any generated code is formatted nicely, both in .py and in .ipynb ("nicely" = comparable to the existing templates)
[X] you added comments in your code that explain what it does
[X] the PR explains in detail what's new

Looks good! Merging for now, will do a few minor changes and let you know in the issue when it's deployed :)

Looks good! Merging for now, will do a few minor changes and let you know in the issue when it's deployed :)