Preflight checks, RHEL9 support, potential Jammy fix, RHEL8/9 tests, specify required ruby version dynamically, always pull latest stable dependencies

Did some work as promised in my yesterday's previous PR.
I'm unable to test Jammy due of MacOS Ventura and VirtualBox issues, but with RHEL9 support added it should be potentially fixed as well.

For Bootstrapping, set everything to skip if Python3 is detected as installed
Added ability for user to pick if they want to install a specific Mastodon version, latest stable Mastodon version or pull latest Mastodon versions including release candidates
Added preflight check role that halts the playbook when it detects that either the folder defined for Mastodon installation already exists but its not a valid git folder, trying to do a major upgrade (3.5.x to 4.x.x) or trying to do minor upgrade (3.4.x to 3.5.x) and redirected the user to do the upgrade manually from the instructions in release notes
Made Ruby automatically pick the required Ruby version for Mastodon, but this required to split the mastodon.yml file to mastodon-preflight.yml (Download Mastodon only) and mastodon-postflight.yml (rest of the setup). This is because ruby-build pulls the required ruby version from the downloaded Mastodon files
Moved Powertools repository enablement from bootstrapping to the repos yaml file
rbenv and ruby-build now always pull the latest stable tagged release instead of locking the version
Added RHEL9 support with OpenSSL 1.1 backwards compatibility, OpenSSL 3.0 support is an upstream issue. Potentially fixes Jammy as well
Updated tests to now test rhel8 and rhel9 and updated the Vagrant file as well
Added VMware Fusion provider config to expand RAM to 4GB
Replaced geerlingguy/rockylinux8 vagrant box with rockylinux/8 which has additional support for different providers (Sorry Jeff)
Added Perl as dependency for RHEL9 and Jammy for building OpenSSL 1.1
Updated documentation to reflect changes

Could only test RHEL8 and RHEL9 due of the previously mentioned provider issues.

Appears that the official Rocky 8 Vagrant box I switched to doesn't work properly during testing and will have to switch back to geerlingguy/rockylinux8 vagrant box, will wait for the 3 tests to finish and create a new commit to switch back if there are no other issues.
  config.vm.synced_folder '/host/path', '/guest/path', SharedFoldersEnableSymlinksCreate: false
==> rhel8: Clearing any previously set network interfaces...
==> rhel8: Found default DHCP server from initial VirtualBox install. Cleaning it up...
==> rhel8: Preparing network interfaces based on configuration...
    rhel8: Adapter 1: nat
    rhel8: Adapter 2: hostonly
==> rhel8: Forwarding ports...
    rhel8: 22 (guest) => 2222 (host) (adapter 1)
==> rhel8: Running 'pre-boot' VM customizations...
==> rhel8: Booting VM...
==> rhel8: Waiting for machine to boot. This may take a few minutes...
    rhel8: SSH address: <IP_ADDRESS>:2222
    rhel8: SSH username: vagrant
    rhel8: SSH auth method: private key
    rhel8:
    rhel8: Vagrant insecure key detected. Vagrant will automatically replace
    rhel8: this with a newly generated keypair for better security.
    rhel8:
    rhel8: Inserting generated public key within guest...
    rhel8: Removing insecure key from the guest if it's present...
    rhel8: Key inserted! Disconnecting and reconnecting using new SSH key...
==> rhel8: Machine booted and ready!
==> rhel8: Checking for guest additions in VM...
    rhel8: No guest additions were detected on the base box for this VM! Guest
    rhel8: additions are required for forwarded ports, shared folders, host only
    rhel8: networking, and more. If SSH fails on this machine, please install
    rhel8: the guest additions and repackage the box to continue.
    rhel8:
    rhel8: This is not an error message; everything may continue to work properly,
    rhel8: in which case you may ignore this message.
==> rhel8: Configuring and enabling network interfaces...
==> rhel8: Mounting shared folders...
    rhel8: /vagrant => /Users/runner/work/mastodon-ansible/mastodon-ansible
Vagrant was unable to mount VirtualBox shared folders. This is usually
because the filesystem "vboxsf" is not available. This filesystem is
made available via the VirtualBox Guest Additions and kernel module.
Please verify that these guest additions are properly installed in the
guest. This is not a bug in Vagrant and is usually caused by a faulty
Vagrant box. For context, the command attempted was:

mount -t vboxsf -o uid=1000,gid=1000,_netdev vagrant /vagrant

The error output from the command was:

mount: /vagrant: unknown filesystem type 'vboxsf'.
Error: Process completed with exit code 1.

Currently only blocker for Jammy is that for unknown reason NODE_OPTIONS=--openssl-legacy-provider is not allowed when passed to precompiling, but can't do testing to fix it due of the reason mentioned above.
But with the example for RHEL9/Rocky 9 that also has OpenSSL 3.0 shipped with it, once that's fixed it should work. Should be able to merge now.

I just saw that the tests aren’t even run properly on any RHEL variant. It’s some sort of sed issue. Can you take a look at that?

Was using an older version of Vagrant that didn't have this problem (and why it worked before)
Changed the Ruby delimiter so that sed works correctly now based on this snipped:
https://stackoverflow.com/a/1644223
This hopefully fixes the issue. Odd that this did not cause the Github checks to fail
thunderysteak@Thunderys-MacBook-Pro mastodon-ansible % vagrant provision --provision-with shell
==> focal: VM not created. Moving on...
==> jammy: VM not created. Moving on...
==> rhel8: VM not created. Moving on...
==> rhel9: Running provisioner: shell...
    rhel9: Running: inline script
thunderysteak@Thunderys-MacBook-Pro mastodon-ansible %

Hm, if I compare the output from the successful focal run and both rhel runs it would appear the tests still aren’t run properly 🤔

Seems to be an issue relating to Vagrant again, running the commands manually works. Putting shell.inline = "echo 'this is a test!'" works but nothing else prints output.
Maybe saving the output into a file and echoing them?
[root@rocky9 vagrant]#   echo "The target is $TARGET" && \
  curl -Lo /tmp/goss https://github.com/aelsabbahy/goss/releases/download/v0.3.16/goss-linux-amd64 && \
  echo "827e354b48f93bce933f5efcd1f00dc82569c42a179cf2d384b040d8a80bfbfb  /tmp/goss" | sha256sum -c --strict - && \
  sudo install -m0755 -o root -g root /tmp/goss /usr/bin/goss && \
  rm -rf /tmp/goss
The target is rhel
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11.8M  100 11.8M    0     0  5795k      0  0:00:02  0:00:02 --:--:-- 12.2M
/tmp/goss: OK
[root@rocky9 vagrant]# cd /vagrant
[root@rocky9 vagrant]# sudo -E goss --vars vars.yaml validate
.............................................

Total Duration: 0.562s
Count: 45, Failed: 0, Skipped: 0

But why would it work on Ubuntu but not on RHEL?

Okay so turns out this is some weird issue with Vagrant
We can't have two shell.inline in the same vm.provision because whatever is the first thing does straight up just not execute. The reason why it works for Ubuntu is because we only have single shell.inline in the vagrantfile.
Splitting it fixes it
thunderysteak@Thunderys-MacBook-Pro mastodon-ansible % vagrant provision --provision-with shell
==> focal: VM not created. Moving on...
==> jammy: VM not created. Moving on...
==> rhel8: VM not created. Moving on...
==> rhel9: Running provisioner: shell...
    rhel9: Running: inline script
    rhel9: Running PostgreSQL commands required for testing
==> rhel9: Running provisioner: shell...
    rhel9: Running: inline script
    rhel9: The target is rhel
    rhel9:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
    rhel9:                                  Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11.8M  100 11.8M    0     0  4735k      0  0:00:02  0:00:02 --:--:-- 8092k
    rhel9: /tmp/goss: OK
    rhel9: .............................................
    rhel9:
    rhel9: Total Duration: 0.541s
    rhel9: Count: 45, Failed: 0, Skipped: 0

Thanks, great work!


Publish plugin to PhoneGap Build

+1 please!

<gap:plugin name="phonegap-plugin-push" source="npm" />


React-Native Android Image Size issue

Description
When running the app on android the images get oversize when installed for the first time,but after running the adb shell input keyevent 82 command it automatically resizes to its desired size .
Additional Information

React Native version: 0.29.2
Platform:  Android
Operating System:MacOS
"react": "15.2.1",

We're cutting down on the number of outstanding issues, in order to allow us to focus. I'm closing this issue because it has been open for over 60 days with no activity. If you think it should still be opened let us know why. PRs are always welcome.


Intermittent "connection refused on port 80" errors

Every few minutes or so, sites on drupal-vm will stop responding for me. and curl'ing them returns:
curl: (7) Failed to connect to sitename.vm port 80: Connection refused

Then about 30 seconds later things start working again. Also, restarting apache manually fixes it.
I can still ping the IP just fine, and sitename.vm URL resolves to the correct IP while it's broken, and iptables looks good, and I can still SSH in, it's just that apache seems to stop accepting requests. Apache still says it's running during this time though.
Have you seen this before? Any tips on where I might go to debug?

I haven't seen this behavior, but it sounds more like a routing issue than necessarily something with Apache... Is the URL actually sitename.vm?
Also, for your internal DNS routing, are you using a symlinked hosts file, or the standard one? I know you can end up with weird behaviors like this depending on how that's configured.

Thanks @geerlingguy -- if it's not behavior that you've seen before then I won't waste your time trying to help me track it down. Just wanted to make sure it was just me.

For anyone who may see this in the future, I spent a good bit of time on this and never could figure it out, but sysadmin isn't really my expertise so it may have been obvious still.
I saw the same issue with Vlad, but not with puphpet VMs or Dashbrew (which is what I ended up sticking with). If anyone comes along and sees this issue and is able to figure it out, please do comment here, but it's no longer relevant for me.

I'm seeing this same error, albeit consistently, on a fresh install of Kubuntu 15.10.

I have the same problem now.
Is there any solution in the meantime?

I have the same problem now.
Is there any solution in the meantime?


Why so strict? (RN 0.57...0.59)

Question
In peerDependencies it requires react-native up to 0.59 version. Is there any option to adapt it for 0.60+? I can make a PR but I don't really understand is there any known problems with RN version

I agree, the peerDependencies ceiling can be removed, #40 should resolve the issue :)

Solved with #40


FindGit: add support for SourceTree on Windows

Fixes Mantis bug #15758

Thanks.  Applied with minor tweaks as commit 57f701a7f045fc13807933860bad22fa405c6621.  Please verify that it still works for you.


Combine visit-build-open and visit-build-closed

Description
Resolves #19397

The two scripts are unified into one. Down the road, when we are trying to use this again, we will likely make further choices about how to streamline things further, and decide what must be different for open and closed builds, if anything. This is as much progress as I'd like to make on this before we do another release.

Type of change

[ ] Bug fix
[ ] New feature
[ ] Documentation update
[x] Other~~
simplification of scripts

How Has This Been Tested?

N/A - will test when our release cycle begins again.
Reminders:

Please follow the style guidelines of this project.
Please perform a self-review of your code before submitting a PR and asking others to review it.
Please assign reviewers (see VisIt's PR procedures for more information).

Checklist:

[x] I have commented my code where applicable.~~
[ ] I have updated the release notes.
[ ] I have made corresponding changes to the documentation.
[ ] I have added debugging support to my changes.
[ ] I have added tests that prove my fix is effective or that my feature works.
[ ] I have confirmed new and existing unit tests pass locally with my changes.
[ ] I have added new baselines for any new tests to the repo.
[x] I have NOT made any changes to protocol or public interfaces in an RC branch.~~

I notice default value for emailName is Eric's email. Maybe we should change that?

Probably. My inclination is to make more changes once it's time to use these scripts again. I expect to be doing many of the builds on LC myself along with probably Cyrus again so I figure we will simplify things further when we get there. Maybe we will remove the email logic entirely?
If you feel strongly about this I can change the default email now.

Merge w/ develop in #19603


Improve JSON scan and from_json

This implements a few improvements for JSON scan and from_json:

For both JSON scan and from_json: support disabling allowSingleQuotes option.
For from_json with map<string, string> schema:

Add the ability to pass down options for turning on/off allowSingleQuotes, allowNumericLeadingZeros, allowNonNumericNumbers, and allowUnquotedControlChars, along with the corresponding tests.
Add more tests.

Depends on:

https://github.com/NVIDIA/spark-rapids-jni/pull/2562

build


Improperly formatted UUID results in "Internal Server Error" rather than 404

Steps to Reproduce

Navigate to https://www.atom-tweaks.com/users/lee-dohm/tweaks/d580ee67-57a9-417b-bbd0-7a0ab61079e5
Use Cmd+L to go to the address bar in the browser
Delete the 5 off the end of the URL
Press Enter

Expected: 404 Error
Actual: Internal Server Error message

Still reproducible.

Should probably return a 422 Unprocessable Entity rather than a 404.

Sentry issue: ATOM-TWEAKS-3


add c-j and c-k to quick info?

Can we/I add c-j and c-k so I can navigate using these?
Might also be advantageous to add up and down for new users
Hell... we could make this a setting too?
else if (key === "<C-n>" || key === "<C-j>" || key === "<down>") {
                    UI.Actions.nextMenuItem()
                } else if (key === "<C-p>" || key === "<C-k>" || key === "<up>") {
                    UI.Actions.previousMenuItem()
```}

Also c-w to delete prev word, c-u to delete entire line etc...

We're working on a way currently to make keybindings much easier, but it's going to take a while.
Bear with us :)

Definitely! There are a few open issues in terms of key bindings:
#20 , #366, #404
But the case where the keybindings go through Oni (and don't round-trip through Neovim) is actually the simplest.
Exposing this as a setting would be a good solution in the interim while that's being worked out. Perhaps something like keybindings.nextMenuItem and keybindings.previousMenuItem would be reasonable for now? I definitely see these hardcoded keybindings as being an annoyance, so having a short-term solution that we can iterate on seems reasonable to me.

Just to give some ideas of what I'm thinking in terms of input, longer-term, is something a bit more general, like for this case:
Oni.map("<C-n>", "menu.nextItem")
But also be able to map to arbitrary functions:
Oni.map("<C-Left>", () => Oni.windows.focusLeft())
And access functions exposed by plugins:
Oni.map("<C-Enter>", () => Oni.plugins.orgModeForOni.toggleTodo())
And give some helpers to make doing transformations easier, something like:
(this is a pointless example,
Oni.map("<C-J>", Oni.helpers.transformLine((line) => line.toLowerCase())
A few other considerations I'm thinking about:

Exposing Oni commands to Neovim (and vice-versa) - the interop between Oni/Neovim is the most interesting piece (#20 touches on this)
Handling commands for non-Vim/Neovim features (#366)
Handled chorded commands in Oni
Handling different modes / filters for commands
How these are specified in existing config.js

Performance is critical, and I want to spend some time looking at how Emacs/VSCode/Atom/Sublime handle key bindings.  In my opinion the Vim-way of handling keybindings is confusing... it took me longer than I would like to admit to understand noremap vs nmap 😄  Another goal is to make it easy to iterate - create very light-weight plugins in my config.js that I can extract out as plugins to share with others.
Sorry for the wall of text, just wanted to share what I was thinking at the moment

@extropy I will definitely research this after working on the quickopen issues

@extr0py
An idea I had instead of putting it in the oni config, what if we having a keybindings.js and we can have a menu link to open it as well?
I will test in a bit and see how it flows with our code.
But reason being is for my suggestion, my init.vim has all my vim stuff, and then I source plug.vim for all my plugins, I don't like them being all in the same file, because it gets messy.
Key bindings don't feel like a config thing to me, it feels like something separate.

Sure, keybindings.js sounds like a good place for it!

Now that #633 is in, this should be enabled by  adding:
// menu bindings...
oni.input.bind("<c-j>", "menu.next")
oni.input.bind("<c-k>", "menu.previous")

// completion too
oni.input.bind("<c-j>", "completion.next")
oni.input.bind("<c-k>", "completion.previous")

To the activate method of your config.js. I'll close this for now, but let me know if it doesn't work for you @cyansprite


Tell our ruby mongodb connection to not support rewrites

I rule and have completed some work on Case Manager that's ready for review!
Not sure this will work but when I shipped rails 6 to prod it got mad about this:
Mongo::Error::OperationFailure (Mongo::Error::OperationFailure: Transaction numbers are only allowed on storage engines that support document-level locking (20) This MongoDB deployment does not support retryable writes. Please add retryWrites=false to your connection string or use the retry_writes: false Ruby client option):

This seems to be because mlab doesn't support this; hopefully this is as simple as changing the database connection and not indicative of a bigger, prod-only problem!
This pull request makes the following changes:

adds a mongoid connection option: retry_writes: false

no view changes
It relates to the following issue #s:

Bumps #1589

godmode-ing this since it's prod-only config garbage


Extending Lucid to return custom collection

I would like to replace the _toCollection or similar to replace the way collections are made.
Recently collect.js was released that has most of the methods I am used to using and would like to implement it.
So, basically this :
const posts = collect( Posts.query().where({...}).fetch() )
becomes this:
const posts = Posts.query().where({...}).fetch()
Is this possible ? Extending collections...?

Within the post model something like this might work, (unless I'm misunderstanding how the fetch method is chained)
static * fetch () {
  return collect(yield super.fetch())
}

So I have removed the collections concept completely from the ORM in 4.0 and instead introduced serializers. I full info will be available on docs, but here is a brief.
Everytime you fetch any database record using Lucid ORM, you get an instance of a serializer, which has the actual data inside it.
Now serializers needs to have some methods on them, this is required to be API compatible and one of them is toJSON.
The toJSON method simply takes the raw output of database query and converts it to a representable form in which it should be.
The representable form is subjective to the serializer. For example the http://jsonapi.org/ serializer will convert it as per the JSON API spec
Also closing the issue


I can't start any games.[Bug] ...

Platform

Device: Phone
OS: Android
Browser: Kiwi
Browser Version: 124.0.6327.1
Better xCloud Version:3.2.4

Describe the bug
Any game that I open, I enter the queue when the game starts, the Xbox logo appears but the game closes and it looks like this screen.

Screenshots/Videos
If applicable, add screenshots/videos to help explain your problem.

I've already tried uninstalling and installing kiwi and better xcloud but it's still on this screen

It's xCloud bug, not Better xCloud

It's probably from better xcloud, if I open it from another browser or through the app it works normally

It's kiwi's problem. Install version 120 and try again.


S03-117.paul new jenkinsfile

WELCOME TO DEVOPS-EASY-LEARNING PULL REQUEST SYSTEM
Description of the change

new jenkinsfile

Checks and balances

[ ] Tests added and run
[ ] (External) Interfaces documented
[ ] Has security implications (describe below)

Type of change

[ ] Bug fix (non-breaking change that fixes an issue)
[ x] New feature (non-breaking change that adds functionality)
[ ] Breaking change (fix or feature that would cause existing
functionality to not work as expected)

Related stories, issues and pulls

Links to Pivotal Tracker stories, JIRA tickets or other pull requests here

Security considerations

non

looks good

good

yes


Call to a member function getDomain() on null

When i tried to call localhost it gives error

@maulik41 follow this guy https://www.youtube.com/watch?v=YepqHFryFN0&t=951s

Facing same error.

Laravel app can not get session token. Actually there is a code block which integrates with shopify via App bridge and from there I could manage to send shopfiy session token to the middleware.

So as you see if there is a session-token class, it will write the session value inside it. If you send your requests with that input there won't be a problem.

@ugurmuslim you added this to your middleware?

I created a PR for adding a login page to fix this issue: https://github.com/osiset/laravel-shopify/pull/1121

Closing as issue is potentially resolved in another PR. Reopen if still and issue.


(SERVER-887) Implement get-code-content

This implements the open source half of get-code-content. This work is very similar to the current-code-id work with the important caveat that it switches ShellUtils's ExecutionResult to using a ByteArrayInputStream internally for stdout instead of a string.
There is some minor refactoring of the current-code-id stuff to have it share error message code with get-code-content.

This looks awesome.

This looks totally reasonable to me. I'm :+1:.
I do think the commit message could probably use a little more detail before merging.

Updated the commit message to have words.

:see_no_evil:


Not able to remove FusionChartsXT Trial lable

i using it in my local server try to remove FusionCharts XT Trial lable but cant. Please help me out

Hi Kishanlos007, FusionCharts is a proprietary software. The trial version has the watermark embedded. If you want to remove the watermark, please procure a license.

    <style type="text/css">
        g[class$='creditgroup'] {
             display:none !important;
        }
    </style>

This worked for me and I guess it's simple and will work for all.
You can make it even more specific.
    <style type="text/css">
        g[class^='raphael-group-'][class$='-creditgroup'] {
             display:none !important;
        }
    </style>

Enjoy illegality ;)

Thanks it works 👍  @DNTech

nice!

where to place the code

I just tried this..but not working

Thanks, works great!

Guys, to remove the watermark, you'll have to procure the licensed version of the product. Removing the watermark using some code/hacks are illegal.

not working


How to properly train the exact same pretrained model from the published dataset?

Hello. I checked https://github.com/DoubangoTelecom/tesseractMRZ/issues/2 issue and used https://github.com/tesseract-ocr/tesstrain project to train the model from your dataset. I also used the exact same neural network architecture, but the resulting accuracy of the trained model is rather poor and totally incomparable with this pretrained_model: https://github.com/DoubangoTelecom/tesseractMRZ/blob/master/tessdata_best/mrz.traineddata (40% accuracy against 94% in my test environment).
The training script I use:
make training MODEL_NAME=mrz_new NET_SPEC="[1,36,0,1 Ct3,3,16 Mp3,3 Lfys64 Lfx96 Lrx96 Lfx512 O1c39]"

and the dataset I use is the dataset from this project.
I understand that some variations in accuracy are inevitable due to the random nature of training data shuffling for train / eval division, but the error cannot be that big.
I feel like I'm missing something crucial, so is the training script invocation looks valid enough?

Okay, I think I know where is the problem. I didn't generate .box files with correct coordinates of each symbol while tesstrain generates .box files with 0-0 coordinates because it obviously doesn't know their coordinates. Closing, thanks for the model! :smile:


docs: migrating from v3 translation in zh-CN

What kind of change does this PR introduce? (check at least one)

[ ] Bugfix
[ ] Feature
[ ] Code style update
[ ] Refactor
[x] Docs
[ ] Underlying tools
[ ] Other, please describe:

Does this PR introduce a breaking change? (check one)

[ ] Yes
[x] No

Other information:
translation done

close this PR due to so outdated


sensor: overflow in sensor_value from double

Fixes #39176
Signed-off-by: Simon Frank<EMAIL_ADDRESS>

Not sure why Documentation build was cancelled? I doesn't look like it relates to any of the changes in this PR?

Not sure why Documentation build was cancelled? I doesn't look like it relates to any of the changes in this PR?

Just rebase, the doc issue was fixed a few weeks ago.

@5frank, can you resolve the conflict?

@5frank Please rebase on main, fix the merge conflicts, and we'll see if that fixes the CI issue as well.


Updated file names and locations in auto-generator and tag-generator

Great! Thanks @aroraakshit ;)
F:)


[Cache] Added size property to get the total size of cache located on…

… disk
Description:
Although both DiskCache and its size property are marked as "public", for now there is no way to get the total size of disk space used by Cache. I propose adding public property size to fix this issue.
Related issues:
https://github.com/Haneke/HanekeSwift/issues/219 - describes the same problem.
https://github.com/Haneke/HanekeSwift/pull/292 - being able to use custom DiskCache will also allow to get the total size of space being used on disk.
Looking forward for any comments and suggestions.

@hpique is there any chance of getting this PR merged?
Thank you!


Out of memory error on GPU 0.

本地虚拟环境运行
(DeepSpeech) root@pc:/opt/PaddlePaddle-DeepSpeech# CUDA_VISIBLE_DEVICES=0,1 python train.py
-----------  Configuration Arguments -----------
augment_conf_path: ./conf/augmentation.config
batch_size: 16
dev_manifest: ./dataset/manifest.test
init_from_pretrained_model: None
learning_rate: 5e-05
max_duration: 15.0
mean_std_path: ./dataset/mean_std.npz
min_duration: 1.0
num_conv_layers: 2
num_epoch: 200
num_rnn_layers: 3
output_model_dir: ./models
rnn_layer_size: 2048
share_rnn_weights: False
shuffle_method: batch_shuffle_clipped
test_off: False
train_manifest: ./dataset/manifest.train
use_gpu: True
use_gru: True
vocab_path: ./dataset/zh_vocab.txt
------------------------------------------------
dataset/manifest.noise不存在，已经忽略噪声增强操作！
[2021-08-10 10:52:37.536839] 训练数据数量：141316

W0810 10:52:37.726949 31179 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 6.1, Driver API Version: 11.4, Runtime API Version: 10.2
W0810 10:52:37.729698 31179 device_context.cc:422] device: 0, cuDNN Version: 7.6.
W0810 10:52:50.697477 31331 operator.cc:242] mul raises an exception paddle::memory::allocation::BadAlloc, ResourceExhaustedError:

Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866455GB memory has been allocated and available memory is only 67.937500MB.

Please check whether there is any other process using GPU 0.
1. If yes, please stop them, or start PaddlePaddle on another GPU.
2. If no, please decrease the batch size of your model.

 (at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
W0810 10:52:50.698271 31332 operator.cc:242] mul raises an exception paddle::memory::allocation::BadAlloc, ResourceExhaustedError:

Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866455GB memory has been allocated and available memory is only 67.937500MB.

Please check whether there is any other process using GPU 0.
1. If yes, please stop them, or start PaddlePaddle on another GPU.
2. If no, please decrease the batch size of your model.

 (at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
Traceback (most recent call last):
  File "train.py", line 94, in <module>
    main()
  File "train.py", line 90, in main
    train()
  File "train.py", line 85, in train
    test_off=args.test_off)
  File "/opt/PaddlePaddle-DeepSpeech/model_utils/model.py", line 316, in train
    return_numpy=False)
  File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1110, in run
    six.reraise(*sys.exc_info())
  File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/six.py", line 719, in reraise
    raise value
  File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1108, in run
    return_merged=return_merged)
  File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1252, in _run_impl
    return_merged=return_merged)
  File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 913, in _run_parallel
    tensors = exe.run(fetch_var_names, return_merged)._move_to_list()
RuntimeError: ResourceExhaustedError:

Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866455GB memory has been allocated and available memory is only 67.937500MB.

Please check whether there is any other process using GPU 0.
1. If yes, please stop them, or start PaddlePaddle on another GPU.
2. If no, please decrease the batch size of your model.

 (at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)

pci信息 NVIDIA Corporation GP104 [GeForce GTX 1060 6GB]
(DeepSpeech) root@pc:/opt/PaddlePaddle-DeepSpeech# lspci
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers (rev 05)
00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 05)
00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th Gen Core Processor Gaussian Mixture Model
00:14.0 USB controller: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller
00:14.2 Signal processing controller: Intel Corporation 200 Series PCH Thermal Subsystem
00:16.0 Communication controller: Intel Corporation 200 Series PCH CSME HECI #1
00:17.0 SATA controller: Intel Corporation 200 Series PCH SATA controller [AHCI mode]
00:1c.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #7 (rev f0)
00:1f.0 ISA bridge: Intel Corporation 200 Series PCH LPC Controller (B250)
00:1f.2 Memory controller: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller
00:1f.3 Audio device: Intel Corporation 200 Series PCH HD Audio
00:1f.4 SMBus: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller
01:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1060 6GB] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)

这是用docker测试的
root@pc:~# sudo docker run --rm --gpus all nvidia/cuda:11.0-base nvidia-smi
Tue Aug 10 01:06:29 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.57.02    Driver Version: 470.57.02    CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
| 35%   37C    P8     9W / 180W |    224MiB /  6075MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
+-----------------------------------------------------------------------------+

请问为什么会这样

CUDA_VISIBLE_DEVICES=0也是一样的结果
(DeepSpeech) root@pc:/opt/PaddlePaddle-DeepSpeech# CUDA_VISIBLE_DEVICES=0 python train.py
-----------  Configuration Arguments -----------
augment_conf_path: ./conf/augmentation.config
batch_size: 16
dev_manifest: ./dataset/manifest.test
init_from_pretrained_model: None
learning_rate: 5e-05
max_duration: 15.0
mean_std_path: ./dataset/mean_std.npz
min_duration: 1.0
num_conv_layers: 2
num_epoch: 200
num_rnn_layers: 3
output_model_dir: ./models
rnn_layer_size: 2048
share_rnn_weights: False
shuffle_method: batch_shuffle_clipped
test_off: False
train_manifest: ./dataset/manifest.train
use_gpu: True
use_gru: True
vocab_path: ./dataset/zh_vocab.txt
dataset/manifest.noise不存在，已经忽略噪声增强操作！
[2021-08-10 11:03:20.146732] 训练数据数量：141316
W0810 11:03:20.336999  6913 device_context.cc:404] Please NOTE: device: 0, GPU Compute Capability: 6.1, Driver API Version: 11.4, Runtime API Version: 10.2
W0810 11:03:20.339776  6913 device_context.cc:422] device: 0, cuDNN Version: 7.6.
W0810 11:03:33.292879  7077 operator.cc:242] mul raises an exception paddle::memory::allocation::BadAlloc, ResourceExhaustedError:
Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866577GB memory has been allocated and available memory is only 67.812500MB.
Please check whether there is any other process using GPU 0.

If yes, please stop them, or start PaddlePaddle on another GPU.
If no, please decrease the batch size of your model.

(at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
W0810 11:03:33.293866  7076 operator.cc:242] mul raises an exception paddle::memory::allocation::BadAlloc, ResourceExhaustedError:
Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866577GB memory has been allocated and available memory is only 67.812500MB.
Please check whether there is any other process using GPU 0.

If yes, please stop them, or start PaddlePaddle on another GPU.
If no, please decrease the batch size of your model.

(at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)
Traceback (most recent call last):
File "train.py", line 94, in
main()
File "train.py", line 90, in main
train()
File "train.py", line 85, in train
test_off=args.test_off)
File "/opt/PaddlePaddle-DeepSpeech/model_utils/model.py", line 316, in train
return_numpy=False)
File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1110, in run
six.reraise(*sys.exc_info())
File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/six.py", line 719, in reraise
raise value
File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1108, in run
return_merged=return_merged)
File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 1252, in _run_impl
return_merged=return_merged)
File "/opt/anaconda3/envs/DeepSpeech/lib/python3.7/site-packages/paddle/fluid/executor.py", line 913, in _run_parallel
tensors = exe.run(fetch_var_names, return_merged)._move_to_list()
RuntimeError: ResourceExhaustedError:
Out of memory error on GPU 0. Cannot allocate 165.586182MB memory on GPU 0, 5.866577GB memory has been allocated and available memory is only 67.812500MB.
Please check whether there is any other process using GPU 0.

If yes, please stop them, or start PaddlePaddle on another GPU.
If no, please decrease the batch size of your model.

(at /paddle/paddle/fluid/memory/allocation/cuda_allocator.cc:79)

@YYJavaGit 你自己都包错误找出来了，显存不足。

设置更小的batch_size

好的我试试

你的显存有点小，才6G

add_arg('batch_size',       int,    4,     "训练每一批数据的大小")

至少11才行，这个分支，

add_arg('batch_size', int, 4, "训练每一批数据的大小")

batch_size太小容易导致模型梯度爆炸。

呃呃那我好像搞不了啦，工作站都在跑别的数据

好吧，感谢感谢 @yeyupiaoling

新分支显存需求低一些，但是文档还没完成

我只是想弄个语音识别服务器，不想训练模型

我没找到比较好的方案

@YYJavaGit 那你就不训练啊，我都提供了模型下载的。

我以为需要先训练一遍才能用文末的模型，我下载一个试试


Refactor: Better handling of SpanGroup.text vs SpanGroup.symbols

See this PR https://github.com/allenai/mmda/pull/115 for example of trying to stitch the two together.
We need something that's a bit more baked-into SpanGroups. For example, possibly SpanGroup.text is a property that wraps SpanGroup.symbols and postproceses using a particular .join() logic, but it can be overwritten with data, when available?

Ok this makes sense to me. I'll have the following behavior:

If .text does not exist, use ''.join(self.symbols)
If .text has been provided, return that.
SpanGroup.text property can be subclassed to implement more specific behavior.


Features/walkscore

Location:

notebooks/datasets/data/walk_score
notebooks/datasets/datasets_to_merge/labs2

Details

request information from walkscore api and put in csv
merge walkscore csv to final csv from labs

Committed Features

add walk, transit, and bike score for users

 As a user, I want to know how I can travel throughout the city. Is it pedestrian friendly? Do I need a car?


Ask gettext to return UTF-8

By default, gettext converts messages to current locale charset. This doesn't sit well with Newsboat's default of UTF-8 for all internal strings. I don't remember any bugs that got tracked down to this, but it's better to fix it anyway.
I'm surprised this didn't manifest in bugs yet, so I'm going to dogfood on this for a week and see if I spot any problems. If your locale is not en_US.UTF-8, please build this branch and see if anything breaks!

Coverage remained the same at 58.712% when pulling 45e75513fc6fe25c7b07dda1b60486785810dbb2 on feature/request-utf8-from-gettext into 351fd40d6baa31bb1d7b24cacb0e8b0ad7928fe9 on master.

This works fine on my system, my LANG is set to it_IT.UTF-8.

Thanks @scompo!
My own testing didn't turn up anything either, so I'm merging this.


Qolssys sending UTF-16 but qolsqw looking for UTF8 maybe?

Before submitting this form

[X] I have checked that there hasn't been a similar issue submitted in the past

[X] I have updated the issue title to something relevant and clear to understand the bug I'm facing

Description of the bug
Should be able to decode the messages, but it seems IQ Panel 4 might be sending it in UTF-16.   MQTT Broker isn't seeing any of this.
Expected behavior
Should see actual MQTT messages
DEBUG logs
2024-09-08 23:42:48.858152 INFO MQTT: Unable to decode MQTT message
2024-09-08 23:42:48.858522 ERROR MQTT: Unable to decode MQTT message, with Traceback: Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/appdaemon/plugins/mqtt/mqttplugin.py", line 271, in mqtt_on_message
payload = payload.decode()
^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
2024-09-08 23:42:49.119569 INFO MQTT: Unable to decode MQTT message
2024-09-08 23:42:49.120493 ERROR MQTT: Unable to decode MQTT message, with Traceback: Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/appdaemon/plugins/mqtt/mqttplugin.py", line 271, in mqtt_on_message
payload = payload.decode()
^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xff in position 0: invalid start byte
Additional context
Issuing commands in the panel and getting these errors.  Looking to decipher the payloads.

According to the error message, these seem to be raised directly in the MQTT plugin of AppDaemon ?

AppDaemon

I posted the issue at AD just recently because I noticed this also in the AD logs.
https://github.com/hassio-addons/addon-appdaemon/issues/350

just curiious, has the new AD update to 0.16.7 solved this for you? I'm not seeing these in my logs anymore but i just updated 20 minutes ago so perhaps its to early to tell....


doesn't work on python3

it doesn't support python3?

Currently no, but i'm planning to add support for python3, check todo list.
If you have the time you can create a new pull request.


Add -OnlyMatching switch param to Select-String cmdlet

PR Summary
The OnlyMatching switch is similar to Raw, in that the cmdlet outputs string objects instead of MatchInfo, but instead of returning the whole matched line, it only returns the actual matched values.
It is equivalent to grep -o.
PR Context
Implements request from #7712.
PR Checklist

[X] PR has a meaningful title

Use the present tense and imperative mood when describing your changes

[X] Summarized changes
[X] Make sure all .h, .cpp, .cs, .ps1 and .psm1 files have the correct copyright header
[X] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: or [ WIP ] to the beginning of the title (the WIP bot will keep its status check at Pending while the prefix is present) and remove the prefix when the PR is ready.

Breaking changes

[X] None
OR
[ ] Experimental feature(s) needed

[ ] Experimental feature name(s):

User-facing changes

[ ] Not Applicable
OR
[X] Documentation needed

[ ] Issue filed:

Testing - New and feature

[X] N/A or can only be tested interactively
OR
[ ] Make sure you've added a new test if existing tests do not effectively test the code changed

Tooling

[X] I have considered the user experience from a tooling perspective and don't believe tooling will be impacted.
OR
[ ] I have considered the user experience from a tooling perspective and enumerated concerns in the summary. This may include:

Impact on PowerShell Editor Services which is used in the PowerShell extension for VSCode (which runs in a different PS Host).
Impact on Completions (both in the console and in editors) - one of PowerShell's most powerful features.
Impact on PSScriptAnalyzer (which provides linting & formatting in the editor extensions).
Impact on EditorSyntax (which provides syntax highlighting with in VSCode, GitHub, and many other editors).

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ovidiufelixb sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

@ovidiufelixb Thank you for your contribution!
It looks like we already have a PR open for this specific feature (#10696). Might I suggest you look at one of the other issues marked as Up For Grabs? 😊
https://github.com/PowerShell/PowerShell/issues/8106
https://github.com/PowerShell/PowerShell/issues/7768
https://github.com/PowerShell/PowerShell/issues/7640
https://github.com/PowerShell/PowerShell/issues/5331
(There are many others, these are just some brief suggestions that I think shouldn't be too complicated on the whole, and most of these indicate in the issue threads where to look at for solutions already.)
If you find an issue you'd like to tackle, but aren't sure where to start -- just ask in the issue thread! We're happy to point you in the right direction and help you find any resources you need! 💖

@vexx32 Sorry, this was actually my first pull request on GitHub and I thought that since #7712 is tagged Up-For-Grabs, it is still accepting PRs. I also didn't notice the PR that was already submitted.
So, for future reference: should I tackle only issues that are tagged Up-For-Grabs AND that do not have any submitted PRs? Is there anything else that I should maybe take into account?
And finally, in regards to the current PR, should I close it personally?

You're totally fine!
Perhaps we as the maintainers could try to keep slightly closer tabs on Up-for-Grabs issues and remove the label when someone submits a PR, but I'd have to convene with the others and see what they think. It is a bit of additional overhead, but we may want to be doing that during Hacktoberfest where it's more a possibility that we'll get collisions like this.
In general, it's probably best to comment on the issue and ask -- just in case. 🙂 Usually those PRs will reference the issue and become visible in the issue thread itself. In most cases, authors will comment in the issues themselves and ask if they can take care of it / mention that they're working on it so that folks know. But we're all human, and things can be overlooked! So it doesn't hurt to check, even if you don't see such a comment / PR reference.
There's a good handful of us keeping a watchful eye, so in most cases we'll jump in with an answer within a day or two at most. I can close this one for now, no worries. 😊

Alright. Thanks for your help! 🙂


Record persistence on restart

Hi all,
Trying to figure out whether this is expected behaviour. Basically when I have two nodes and one of them goes down then the writes to the remaining one don't seem to persist.
These are my steps using version  0.50.6 :

Start two nodes A and B, wait for them to join up.

Open Console via web interface on node A and run:

CREATE TABLE my_table (id integer, primary key (id));`
INSERT INTO my_table (id) values (1);
INSERT INTO my_table (id) values (2);
INSERT INTO my_table (id) values (3);

Stop node B

Still on node A:

INSERT INTO my_table (id) values (4);
INSERT INTO my_table (id) values (5);

Stop node A with Ctrl+C.

Start node B and wait for it to start up.

Start node A and wait for it to join

Again on node A:
SELECT * FROM my_table limit 100; returns records 1-3 only
The same result after running REFRESH TABLE.

All input appreciated
Andrejs

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/27176684-record-persistence-on-restart?utm_campaign=plugin&utm_content=tracker%2F505659&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F505659&utm_medium=issues&utm_source=github).

I think the problem in the case you described is that B is recovering it's cluster state immediately - without waiting for A to join - because it isn't aware that there should be other nodes joining. It will take the lead and since it never received the records 4 and 5 the won't appear.
Once A joins B already has a "newer" cluster state and the data from A is discarded.
In order to prevent this from happening you can set the gateway recovery settings described in https://crate.io/docs/en/latest/best_practice/multi_node_setup.html?highlight=gateway#gateway-configuration
This way if you start up B it will wait for node A before recovering the cluster state - this way you won't lose the data.the data.

Btw. in the next feature release we'll display warnings in the Admin UI and within crash if you connect to a cluster that isn't configured properly to prevent such misconfigurations from occuring.

Yepp, gateway recovery settings did the trick.
Though having default configuration that can discard data seems undesirable. Admin UI warnings will help but only if you are looking at it.

I fully agree that it is undesirable. But automatically setting a default is kinda tricky as without explicit configuration it is a unknown how many nodes there are supposed to be.
I'm closing this as the original question/problem is solved. But feel free to open another issue regarding the default configuration if you want to discuss it or have a concrete suggestion how it could be improved.

Fair enough, I might just do that. Thank you!


Major LSP refactoring

There were multiple race-conditions between Language Client, Server, Monaco Editor and React state, which lead to a series of tricky to debug errors.

[x] Client/Server communication is moved into separate context for dissecting the problem and later ease of use
[x] Automatically update code, when switching between editors to pickup latest changes in contracts and pass them to Language Server for verification
[x] Refactored data handling, styles and components into separate files for better DevEx

Planned for next release:

[ ] Updated Language Server package, which now does not cache

can we provide a test plan in the PR description? such a big change deserves thorough testing

can we provide a test plan in the PR description? such a big change deserves thorough testing

That's a really good point. I will provide test plan, when I finish last two issues I've spotted:

for some reason language server is taking old code to get a list of arguments
sometimes we see that LS can't find model on the editor (probably some severed link during updated)

Alright!
The issues should be resolved now :)


feat: Bump hive_metastore to use pure rust thrift impl volo

Close https://github.com/apache/iceberg-rust/pull/155

cc @Xuanwo Any updates?

cc @liurenjie1024, please review again. Sorry for the late.


Rewrite Release Checklist

Browsers

[ ] Chrome
[ ] Firefox
[ ] Opera
[x] Edge
[x] Safari

Things to check

Adding files via drag-and-drop
Adding files via button
PAA Test Data.zip (each file should behave according to its name)
Look at all Warnings / Errors
Downloading a single file
"Download all Files"-Button
Delete all files
Delete single file
"Report Error" button within error / some warning popups
Feedback popup
Adding files with same name as existing files (even multiple)
Offline capabilities

Pre-Release Checklist

[x] Fix robots.txt
[x] Fix CNAME input for GitHub action
[x] Restrict "Deploy" step in GH Actions workflow to master branch
[ ] Test all relevant browsers
[x] Update discord link in feedback popup
[ ] Merge rewrite branch (only after all above are done)
[ ] Update DNS entries
[ ] Change "Custom Domain" in GitHub Pages settings

Post-Release Checklist

[ ] Tweet

@nomisum tested Safari Version 13.1.3 (15609.4.1)
Everything seems to be working fine after the fixes we've made.

Edge Version 91.0.864.64

Tested Opera Version 77.0.4054.172 👍

Teste Firefox Version 89.0.2 👍

Tested Chrome Version 91.0.4472.124 👍


Removed parameter.h

removed List and Map implementations
disabled model selection for now

@karlnapf the gp is stuff is working but the API is quite ugly now. But at least the unittests pass!

@karlnapf the gp is stuff is working but the API is quite ugly now. But at least the unittests pass!

this is fantastic! GPs unit test coverage is extensive so we can be confident there.
There are model selection unit tests ..I assume you disabled them? What about the gradient unit tests? They do work (i.e. your refactoring of the gradient extraction does the job)?

this is fantastic! GPs unit test coverage is extensive so we can be confident there.
There are model selection unit tests ..I assume you disabled them? What about the gradient unit tests? They do work (i.e. your refactoring of the gradient extraction does the job)?

model selection unit tests are disabled, the rest is working-ish. There are a couple of issues, but should be all good soon.
@vigsterkr The problem i have now is with swig. It is generating weird code, with std::shogun::shared_ptr instead of std::shared_ptr...

@vigsterkr so close!

@vigsterkr if you cherry pick, the last two commits fix swig


all messages are 'Other'

https://github.com/Boddlnagg/midir/issues/89#issue-941309769
I'm not sure, but maybe it is something wrong with my keyboard (its support on Linux).

The reason is that the midi-keyboard you are using does not use the standard midi NoteOn and NoteOff channel (144 and 128) but by the looks of it 156 and 140.
I'm not an expert, but my suggestion is to look at the manual that comes with the keyboard and check if there is a setting to change the channel of the notes on the keyboard. Might be called remap or the like. Otherwise you might need to use a 3th-party midi software to map it to the correct channels. That is if you want it to work with SunVox (Guessing, haven't used SunVox before).

If you're out of luck with any of it, I can implement a midi channel remap override. Which would be a good feature to have nonetheless.

Some debug view on those 'channel' things would be nice I guess

if there is a setting to change the channel of the notes on the keyboard. Might be called remap or the like.
there is a possibility to switch midi channel on the keyboard (1-16) but I don't think that that's what we need (mb I'm wrong)

Yeah, my mistake, the correct term is Midi Event Message. Though, I haven't seen many midi keyboards that can to change it.

@adsick If you checkout to the adsick branch, then see if it works with the adsick example that I made :)

I'll try

does it duplicating messages or smth?

That is most likely just a bug due to the way input is handled via threading currently. Implementing crossbeam (See issue #5) should fix it.


Loading Local ZIP File Breaks

Console errors produced:
[WDS] Disconnected!
...
TypeError: NetworkError when attempting to fetch resource.
It tries to get the API details from beatsaver.com but when it fails does not fall back correctly to the local ?zip parameter.
Since the API changes went in using the /?zip=song.zip parameter no longer works.
I found a work-around by telling fetchData to just return fetchZip directly instead of doing the network call, and removing the "Already fetching" check of the fetchZip method.
This wouldn't affect most people, since it's probably not a highly used feature. I'm using it because I've been working on an auto-map generator (based on an audio file and peek times). It produces the zip with files and use beatsaver-viewer to quickly iterate and see results.
Thanks, I've been following your updates to this and really appreciate this tool!

Thanks! Yeah, I had to quickly update and forgot to test that part. I’ll patch it later today.

https://github.com/supermedium/beatsaver-viewer/commit/4c1940cfe9bf3903ba5c97462805c61ec8d9eccf


InvalidNameException(Parent traversal in paths is not allowed) is thrown when trying to extract directory archive with RootPath

Steps to reproduce

Create archive from /some/directory using SharpZipLib: recursive, set RootPath to /some/directory
Extact this archive using SharpZipLib

Expected behavior
Archive should be extracted
Actual behavior
InvalidNameException(Parent traversal in paths is not allowed)
Version of SharpZipLib
1.3.3
Obtained from (only keep the relevant lines)

Package installed using NuGet

Example
using System.Text;
using ICSharpCode.SharpZipLib.GZip;
using ICSharpCode.SharpZipLib.Tar;

var directory = $"/tmp/{Guid.NewGuid()}";
Directory.CreateDirectory(directory);
File.WriteAllText($"{directory}/1.txt", "1");

var archiveFilePath = $"/tmp/{Guid.NewGuid()}.tar.gz";

using (var archiveStream = new GZipOutputStream(File.Create(archiveFilePath)))
{
    using (TarArchive tarArchive = TarArchive.CreateOutputTarArchive(archiveStream, Encoding.UTF8))
    {
        tarArchive.RootPath = directory;
        // this is workaround for another issue: tarArchive.RootPath is ignored otherwise
        while (tarArchive.RootPath.StartsWith("/", StringComparison.Ordinal))
        {
            tarArchive.RootPath = tarArchive.RootPath.Substring(1);
        }
        var entry = TarEntry.CreateEntryFromFile(directory);
        // ExtractContents fails without this line of code below:  Parent traversal in paths is not allowed
        //entry.Name += "./";
        tarArchive.WriteEntry(entry, true);
    }
}

using (var archiveStream = File.OpenRead(archiveFilePath))
{
    using (var gzipStream = new GZipInputStream(archiveStream))
    {
        using (var tarArchive = TarArchive.CreateInputTarArchive(gzipStream, Encoding.UTF8))
        {
            tarArchive.ExtractContents($"/tmp/{Guid.NewGuid()}");
        }
    }
}

Console.WriteLine("Done");

If you want to allow path traversal, you need to explicitly allow it using ExtractContents(String, Boolean).
To log the actual internal file paths of the tar archive (on either extract and/or create), use:
tarArchive.ProgressMessageEvent += (archive, entry, message) => {
	Console.WriteLine($"{entry.Name}: {message}");
}

I think the core of this issue was what #582 fixed. The sample above works as expected in v1.4+:
https://dotnetfiddle.net/TDSoGn


improve handling of non-object errors thrown in endpoint handlers

oh boy, i just spent the last couple hours running in circles trying to figure this one out. my API endpoint was returning {"status":"success"} with no data, which was then causing errors when my generated client was assuming "status":"success" means data should be present
the culprit is this:

the error is only passed to the result handler if it's instanceof Error - https://github.com/RobinTail/express-zod-api/blob/721a41e2f762a9f0a524fc111549c461d9057462/src/endpoint.ts#L333-L335
if there's no error passed to the result handler, it returns a 200 and a success status regardless of whether there's any real data or not - https://github.com/RobinTail/express-zod-api/blob/721a41e2f762a9f0a524fc111549c461d9057462/src/result-handler.ts#L83-L89
turns out that running prettier programmatically throws a string 😅 - this was in my code

I was about to open a PR up but I'm actually not really sure how you want to handle this since this will be a breaking change, albeit a needed one IMO (probably before the v8 release?). the two obvious choices seem to be:

widening the typings on the ResultHandler so you can pass in any kind of error (thus passing the onus to the default handler or the downstream consumer to handle more error cases)
just stringify any non-object error and create an Error object out of it

the latter seems way easier and with less breaking changes, whereas the former will certainly break any custom result handler implementations. but if you're gonna make a breaking change anyway, I think the former is the way to go because if you just coerce everything into a string then it gives downstream consumers no way to implement custom error handling based on the type of the error
so my suggestion is to change the error type in the ResultHandler to unknown, then check if it's !== undefined (or != null to handle both undefined & null?) rather than just checking if it's falsey like you currently do. but not sure if you've got some other thoughts on how to better handle this?

throwing a string, wow... I didn't know that is possible.

I think I'm going to go with the second approach

just stringify any non-object error and create an Error object out of it

There is no need to widen the signature of ResultHandler, we just need to handle more throwing cases in endpoints (and probably middlewares).

sgtm, makes sense!! my main reasoning for option 1 is if you want to do some kind of global custom error handling that can handle weird error types. but I suppose that it makes sense that you demand users handle this in a try/catch in the endpoint/middleware itself, since throwing anything other than an Error is an antipattern 😅
I left some comments on the PR, but otherwise seems great to me! tysm for addressing this so quickly!

It's ok, @rayzr522 , you can still throw anything in Endpoint's handler and within a Middleware — it will be catched and converted to an Error by makeErrorFromAnything, then handed over to ResultHandler as usual. Check out the implementation in my PR :)
And thank you again for all your help, love and support :)

🚀 The fix released in version 7.9.2.
Thank you so much @rayzr522


Adding CHANGELOG

Is it possible to maintain a CHANGELOG for each release (or just use the github's builtin feature to describe what's new in each release)?

This would be really good for major releases that aren't drop-in upgrades for the old version. See hapi as an example of a project that does this well.

Yeah, we're going to have proper api releases with documentation in the future. But, in the next few days after the announcement it's better to move fast and ship often to fix critical issues that people are facing.

:+1:

We have changelogs now here: https://github.com/facebook/react-native/releases

Better changlogs are on the way with the upcoming 2 week release process.


loader: infrastructure for attaching SKB programs using the tcx API

Split off from https://github.com/cilium/cilium/pull/30103, this pulls out the tcx infrastructure so it can be merged without enabling the feature.
@rgo3

/test

/test


the shoulder circumference is missing

Hello Carlos, thank you very much for the work you have done! Would it be possible to implement the shoulder circumference? Is it in your skills?
Thank you very much!

Hi Dreedzy, sorry for the delay in responding. I just updated the library with shoulder girth

thanks a lot for this feature! your project is great, I'm just struggling to create a 3D model from photos, I tried to use the STRAPS library, as you already recommended, but without success ... even with an NVIDIA card on a linux distribution, impossible to make the libraries work properly. Is there any other way to do this that you know of?

I see.  I was using the STRAPS project as a base architecture to estimate 3D bodies from an RGB image, I raised it on a linux distro with a 4gb nvidia card.  You tell me what problems you have, I could help you.


Update "Getting Help" page

There is a section that needs to be updated on the Getting Help page under "Delta User Slack Channel".
The #deltalake-databricks, #delta-sharing and #deltalake-oss channels no longer exist on Slack. It is now:

#deltalake-questions: Discuss topics about the Delta lake open source project and its development. https://www.delta.io
#events: Share information about Delta Lake meetups and conference talks.
#general: All things Delta Lake.
#random: Non-work banter and water cooler conversation.

Thanks @cakerly-lf - we will work on getting this fixed.  Thanks!

Resolved via #234 , thanks!


Fixes: Arrow, Flex. Docs: Grid, Group, Heading, Hidden

Codecov Report

Merging #81 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master    #81   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files          20     20
  Lines         232    232
  Branches       65     65
=====================================
  Hits          232    232

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 68221f9...455c548. Read the comment docs.


attMIL-regression breaks when adding cont_labels

Hi!
When I try to add a list of cont_labels to marugoto.mil crossval, the program breaks.
python -m marugoto.mil crossval \
    --clini-excel $cliniPath \
    --slide-csv $slidePath  \
    --feature-dir$featurePath \
    --target-label $target \
    --output-path $outPath \
    --n_splits 3 \
    --cont_labels "PLT,INR,aPTT,BILIRUBIN,gGT,CHE"

The error I get is: "AttributeError: 'tuple' object has no attribute 'shape'" (full error message below)
The point at which the program breaks is in marugoto/mil/_mil.py, line 146:
batch = train_dl.one_batch()
Some additional behaviors I noticed:

Adding --cont_labels to the main marugoto branch works fine.
The ds variable created in marugoto/mil/data.py, line 139 is differently formatted between main and attMIL branch.

def _make_multi_input_dataset(
    *,
    bags: Sequence[Iterable[Path]],
    targets: Tuple[FunctionTransformer, Sequence[Any]],
    add_features: Iterable[Tuple[Any, Sequence[Any]]],
    bag_size: Optional[int] = None
) -> MapDataset:
    target_enc, targs = targets
    assert len(bags) == len(targs), \
        'number of bags and ground truths does not match!'
    for i, (_, vals) in enumerate(add_features):
        assert len(vals) == len(targs), \
            f'number of additional attributes #{i} and ground truths does not match!'

    bag_ds = BagDataset(bags, bag_size=bag_size)

    add_ds = MapDataset(
        _splat_concat,
        *[
            EncodedDataset(enc, vals)
            for enc, vals in add_features
        ])

    targ_ds = EncodedDataset(target_enc, targs)
    ############ !!! Different behavior spotted here !!!
    ds = MapDataset(
        _attach_add_to_bag_and_zip_with_targ,
        bag_ds,
        add_ds,
        targ_ds,
    )
    ############
    return ds

Indexing ds[0] in attMIL gives [(features_tensor, int_ninstances), [[np.array]], [tensor_target]], where the np.array contains raw values of the cont_labels features

Indexing ds[0] in main gives (tensor_features, int_n_instances, tensor_target). Cont_labels are transformed and concatenated to tensor_features, resulting in shape n_instances * (n_features + n_cont_labels)

Error Message:
Traceback (most recent call last):
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 179, in create_batch
try: return (fa_collate,fa_convert)self.prebatched
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in fa_collate
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in fa_collate
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in fa_collate
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 52, in
else type(t[0])([fa_collate(s) for s in zip(*t)]) if isinstance(b, Sequence)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 51, in fa_collate
return (default_collate(t) if isinstance(b, _collate_types)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/_utils/collate.py", line 265, in default_collate
return collate(batch, collate_fn_map=default_collate_fn_map)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/_utils/collate.py", line 120, in collate
return collate_fn_map[elem_type](batch, collate_fn_map=collate_fn_map)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/_utils/collate.py", line 170, in collate_numpy_array_fn
raise TypeError(default_collate_err_msg_format.format(elem.dtype))
TypeError: default_collate: batch must contain tensors, numpy arrays, numbers, dicts or lists; found object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/mnt/bulk/tsorznechay/LiverHVPG/Python_Modules/marugoto-regression/marugoto/mil/main.py", line 5, in
Fire({
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fire/core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fire/core.py", line 466, in _Fire
component, remaining_args = _CallAndUpdateTrace(
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fire/core.py", line 681, in CallAndUpdateTrace
component = fn(*varargs, **kwargs)
File "/mnt/bulk/tsorznechay/LiverHVPG/Python_Modules/marugoto-regression/marugoto/mil/helpers.py", line 359, in categorical_crossval
learn = _crossval_train(
File "/mnt/bulk/tsorznechay/LiverHVPG/Python_Modules/marugoto-regression/marugoto/mil/helpers.py", line 420, in _crossval_train
learn = train(
File "/mnt/bulk/tsorznechay/LiverHVPG/Python_Modules/marugoto-regression/marugoto/mil/_mil.py", line 147, in train
batch = train_dl.one_batch()
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 187, in one_batch
with self.fake_l.no_multiproc(): res = first(self)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastcore/basics.py", line 660, in first
return next(x, None)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 127, in iter
for b in _loadersself.fake_l.num_workers==0:
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 628, in next
data = self._next_data()
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/dataloader.py", line 671, in _next_data
data = self._dataset_fetcher.fetch(index)  # may raise StopIteration
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/torch/utils/data/_utils/fetch.py", line 43, in fetch
data = next(self.dataset_iter)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 138, in create_batches
yield from map(self.do_batch, self.chunkify(res))
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 183, in do_batch
def do_batch(self, b): return self.retain(self.create_batch(self.before_batch(b)), b)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 181, in create_batch
if not self.prebatched: collate_error(e,b)
File "/mnt/bulk/tsorznechay/LiverHVPG/y/envs/MaruReg/lib/python3.10/site-packages/fastai/data/load.py", line 75, in collate_error
if i == 0: shape_a, type_a  = item[idx].shape, item[idx].class.name
AttributeError: 'tuple' object has no attribute 'shape'

hello！May I ask for your advice on the step of feature extraction
An error has occurred  TypeError: Object dtype dtype('O') has no native HDF5 equivalent
May I ask if you have encountered this situation before and how it was resolved

Hi,
Can I what is sample csv for clinical-data? does it contain columns with labels and slides?
Thanks,
Shubham

Hi Shubham,
I tested the workflow in deployment mode (i.e. using one of the pretrained models here: https://github.com/KatherLab/crc-models-2022/tree/main/Quasar_models on my input data) and, as far as understood, the clinical data should contain at least 1 column called "PATIENT" (with patient identifier) and 1 column called as the target label you are testing the model for (for those models that would be either BRAF or isMSIH). The slide csv file instead has to have a column called PATIENT with the same patient id as in clinical-data + an additional column called FILENAME where you put the name of the h5 file containing the feature vectors (but without the extension .h5). You can try and see if it works for you!
Best,
Miriam


maintainers/team: add home-assistant team

With #118503 alot of packages were left without maintainers. It is clear that an ecosystem like home-assistant should be maintained by multiple people, so a home-assistant team isn't too far fetched I hope.
This is purely opt-in, I haven't migrated anyone into the team yet, but I'd hope some of you might want to join me.
@globin
@Mic92
@fabaff
and possibly others I've missed.

@GrahamcOfBorg eval

https://github.com/nixos/nixpkgs/pull/110863 broke the home-assistant nixos test. I'm looking into it.

Feel free to add me, I don't have to much free time but I generally still use it.

Updated, I think we're fine. If someone agrees, please merge.


docs: Update changelog to cover changes staged for 8.0.

Made both changes and merged, thanks @alya and @alexmv!


feat: support bitswap over http

see https://github.com/ipfs-shipyard/helia-service-worker-gateway/pull/8
We need to move that code over here

Nice! I think usage should be pretty straightforward, but you may snag on edges that haven't been sanded down yet.

Do backend nodes support this today if we were to add a block-broker now?

It's a bit of a chicken and egg problem right now. But I think it makes sense to start on the client side first.


Step 13: Your App is crashing after uncommenting

Errors prevented startup:

While building for web.browser:
packages/getting-started/lib/components/movies/MoviesUsers.jsx:8:17: Unexpected token, expected "," (8:17)

While building for os.linux.x86_64:
packages/getting-started/lib/components/movies/MoviesUsers.jsx:8:17: Unexpected token, expected "," (8:17)

Your application has errors. Waiting for file change.

I get this error after following step 13, removing the /* and */ from the MoviesUser.jsx file

fixed

How was this fixed?


Added SoundCloud.
Added inline YouTube videos.
Made the Twitter attachments more complete.

/cc @atmos


  Conda may not use the correct pip to install your packages, and they may end up in the wrong place.  Please add an explicit pip dependency.  I'm adding one for you, but still nagging you.

There were some more pip errors, and then when I tried to activate the environment, I got:

Could not find conda environment: stat-rethink-pymc3
You can list all discoverable environments with conda info --envs.

Should I try to install PyMC3 in my deafult environment instead?

OK, I think that problem is because the environment name is different from what it says on the homepage.

Hi @adamcc sorry about the confusion. I have just created a Pull request to have one environment file per folder/book and remove the central environment (pymc3_resources). This should help people in the future.
Regarding your current problem. You could try with this environment.yml file. Or you could run conda install mkl-service  to fix the "theano is not compiled" error.

Thanks Ozvaldo, very rapid turnaround! Much appreciated. I can get back to it later this week and update you.

Hi @aloctavodia
Sorry this took a long time to come back to.
I cloned the full pymcresources repo and tried to create the environment:
`➜  pymc-resources git:(main) cd Rethinking_2
➜  Rethinking_2 git:(main) ls
Chp_02.ipynb            Chp_09.ipynb            Chp_16.ipynb
Chp_03.ipynb            Chp_10.ipynb            Data
Chp_04.ipynb            Chp_11.ipynb            End_of_chapter_problems
Chp_05.ipynb            Chp_12.ipynb            README.md
Chp_06.ipynb            Chp_13.ipynb            environment.yml
Chp_07.ipynb            Chp_14.ipynb            environment_v4.yml
Chp_08.ipynb            Chp_15.ipynb
➜  Rethinking_2 git:(main) conda env create -f environment.yml
Collecting package metadata (repodata.json): done
Solving environment: - - failed
CondaError: KeyboardInterrupt
➜  Rethinking_2 git:(main)`
I ended up interrupting conda as it was Solving environment for a very long time.
Do I just need to be more patient, or is something wrong?

Update, I tried the environment_v4.yml file instead and it worked!
The Chp_02.ipynb notebook works fine, only the warning below.
Thanks for making this collection!
/Users/mycomputer/opt/anaconda3/envs/stat-rethink2-pymc_v4/lib/python3.10/site-packages/scipy/__init__.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.23.3
  warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"


Consume body before the connection is closed

This change consumes the response body in case of an error with a non-json content-type for debugging purposes. Without this, it's not possible to see what the server returned on non 200 http responses. We had multiple instances where we needed this (401s, 500s, etc).
Note: If the proposed change makes sense, I can add them to other transports

Hey @Reflejo, apologies for the late review. While I understand the problem, we can't read the response with res.text, it expects the body to be valid utf-8. The problem your facing is specific to debugging in a local session, but this change affects all scenarios.
Unfortunately I don't have a good solution. I'm closing this PR, feel free to open an issue to track this.


About Docs description correction

The features described in this Docs page are currently not supported.
In fact, operations from the Form customization section will not result in the same form as in Docs.
As a result, we will not be able to display a form with location information on the portal as described in the public information.
If a feature is listed as public article without stating that it is unsupported, users will not notice it and will assume that it is available.
To prevent confusion among users, please consider reviewing or removing the following public article.
Title : Adding location information
URL : https://docs.microsoft.com/en-us/powerapps/maker/portals/configure/add-geolocation

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 28b6f5c0-06ea-6234-b4ef-aabd11a127fc
Version Independent ID: 3d4bcfcc-290c-d084-422e-e8ed8192ca4f
Content: Add geolocation - Power Apps
Content Source: powerapps-docs/maker/portals/configure/add-geolocation.md
Service: powerapps
Sub-service: portals
GitHub Login: @sandhangitmsft
Microsoft Alias: sandhan

Thank you for bringing this to our attention. This is a supported feature but there is a bug when rendering the map using a form on a web page. The map will appear when displaying the form in a modal window. The bug has been logged.


Problems if you don't stop a video before selecting a new one

If you play a video, then select another video, the UI correctly displays the name of the new video and says "Playing". But the old video continues to play.
Perhaps the UI needs to send the "Stop" command to omxplayer before starting to play a new video. If you do this manually it works OK.

I guess you using this all with nginx? There a problems when you using this gui not in the recommended way via the php command line. As you can see in the following file, on every video start, it will already kill all omxplayer instances. The problem you describe doesn't happen on all my tested instances.
https://github.com/brainfoolong/omxwebgui-v2/blob/master/omx-start.sh


Y24-171 - Driver file: PBMC pools --> 10x chip

User story
As a user of the scRNA Core pipeline, I would like a csv driver file for the robot transfer from the PBMC pools plate to the 10x chip.
(We do not need a csv for the transfer out of the chip)
Who are the primary contacts for this story
Abby, Andrew, Katy
Who is the nominated tester for UAT
Abby
Acceptance criteria
To be considered successful the solution must allow:

[x] Robot driver file for transfer from LRC PBMC Pools Input --> LRC GEM-X 5p Chip
[x] Robot driver file for transfer from LRC PBMC Pools --> LRC GEM-X 5p Chip
[x] Columns:

Source Plate ID (= plate barcode)
Source Plate Well (= map description e.g. 'A1')
Destination Plate ID (= plate barcode - using a normal plate barcode even though it's a 10x chip)
Destination Plate Well (= numbers 17-24 as this is how the robot will label the chip's 8 wells)
Sample Vac Tube ID (held in sample metadata supplier name for this pipeline)
Sample Name (= sample.name)

[x] Driver file name to include the barcode of the source plate at the start of the file (see https://github.com/sanger/limber/issues/1521 for how).

Updates 10 July:

[x] 1. Sharing the same button for both LRC PBMC Pools and LRC PBMC Pools Input is fine. [Button: Download Hamilton LRC PBMC Pools (or Input) to LRC GEM-X 5p Chip CSV]
[x] 2.a. Change Workflow header to 'scRNA Core GEM-X 5p Chip Loading'
[x] 2.b The filename is too long (>60 characters); shorten it to 'SQPD-9144_hamilton_gem_x_5p_chip_loading.csv
[x] 2.c At this stage we just need to list the pools on the pool plate i.e. up to 8 lines. If we don't have any identifying information for these (that could be captured as 1 name per pool/well) then we could leave out the sample name/vac tube columns. [Removed the sample name/vac tube columns columns]
[x] 2.d As mentioned at c., we would actually omit the vac tube column now they are pools of various ones. [Removed the sample name/vac tube columns columns]
[x] 2.e we will be loading variable volumes of sample onto the chip so we would like a volume column to be included in this csv. This volume will be decided by the pooling strategy which is still not yet finalised however [Created Story: #1779]

Additional context
See Slack thread About Y24-171 - Driver file: PBMC pools --> 10x chip

See also GitLab Integration Suite branch Y24-171 Driver file PBMC Pools to 10x Chip


Building a .proto with an underscore/dot in its name is removed from the generated module.

I have a proto file at proto/hello_world.proto and after the build using tower_grpc_build a module helloworld.rs is generated skipping any underscores.
I also tried it with hello.world.proto and it is also removed.
I am trying to follow rust naming schemes for module names and the proto files. Is this an intended behavior?

I believe the name is taken from the package line in the .proto file. For example, in the route_guide.proto, since it has package routeguide, the generated file is routeguide.rs: https://github.com/tower-rs/tower-grpc/blob/fe2c454cb7e486b75310c13b59306e4e1d3625f3/tower-grpc-examples/proto/routeguide/route_guide.proto#L21

Yeah, that was it. Thanks!


MP4 link doesn't work because of url unescaping

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.05.30. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[X] I've verified and I assure that I'm running youtube-dl 2018.05.30

Before submitting an issue make sure you have:

[X] At least skimmed through the README, most notably the FAQ and BUGS sections
[X] Searched the bugtracker for similar issues including closed ones
[X] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[ ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[X] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):

C:\Users\lol\Downloads>youtube-dl -v "https://zoom.us/recording/play/SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'https://zoom.us/recording/play/SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.05.30
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.16299
[debug] exe versions: ffmpeg N-90710-gaedbf1640c
[debug] Proxy map: {'http': 'http://<IP_ADDRESS>:8888', 'https': 'https://<IP_ADDRESS>:8888'}
[generic] SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK: Requesting header
WARNING: Falling back on generic information extractor.
[generic] SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK: Downloading webpage
[generic] SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK: Extracting information
[download] Downloading playlist: Video Conferencing, Web Conferencing, Webinars, Screen Sharing
[generic] playlist Video Conferencing, Web Conferencing, Webinars, Screen Sharing: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://ssrweb.zoom.us/cmr/replay/2018/01/31/627969148/F85683EA-FC4D-47B8-AC75-278AA849BD2A/GMT20180131-020020_GAZ-Transf_1920x1050.mp4?response-content-type=video/mp4&Expires=1527847067&Signature=Y5R1LVfnStShrH2ceHsIhBlvkpzo3UOOKy~RFEsUzkaIq1hA~Q5AeH0U6Dc-RfZcvTJaBvqpGgEXxVrIzLBER2W-Bu~yblrtagAVg7PTI5xqbdZqcUow~dCEY6rrydv~58FiQaK3XuEbT68M-g9cyVRw5dQHCpmOkHfBAFCGGOKHfoMmb8fermpP5nDafKWXWdUSWpE1QF1bG05eQUIgNktezUX3N5yqoMno7PTNuu5zc8bjY-kqBljFEnaHIcShnLFUjWZpIKkqE~bPJsmAF7CavWGcB9eKxAlb2vv60RVDcP7bMe3~hRF-RaNpEtiHiWoDqxVuYAo7sLIHUsWuOw__&Key-Pair-Id=APKAJFHNSLHYCGFYQGIA'
ERROR: unable to download video data: HTTP Error 403: Forbidden
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\YoutubeDL.py", line 1908, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\YoutubeDL.py", line 1847, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\downloader\common.py", line 364, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\downloader\http.py", line 340, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\downloader\http.py", line 109, in establish_connection
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpreyzoe3x\build\youtube_dl\YoutubeDL.py", line 2211, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
urllib.error.HTTPError: HTTP Error 403: Forbidden

...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):
https://zoom.us/recording/play/SILVuCL4bFtRwWTtOCFQQxAsBQsJljFtm9e4Z_bvo-A8B-nzUSYZRNuPl3qW5IGK
Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
Alright so I was trying to download zoom.us videos with youtube-dl. The generic extractor seems to catch the mp4 that sits rights on the video page, good. I've already pin pointed the problem and it seems to be how youtube-dl deals with this mp4 url.
This is a working mp4 downloading link:
https://ssrweb.zoom.us/cmr/replay/2018/01/31/627969148/F85683EA-FC4D-47B8-AC75-278AA849BD2A/GMT20180131-020020_GAZ-Transf_1920x1050.mp4?response-content-type=video%2Fmp4&Expires=1527847190&Signature=ULt3jXlNndjtf9fZYIRrDQZ3DyYg7PRdFk0DveEJtJf6TeQBbZ~uVLdelnuzqrlI49ZfUgyMDbtYJFVPloScMaX-i13fF7wpFOVzTMpZBVujJkAsBepDTpbBuzGB5~qh7HQjvBUc9aAnKlbkocdVtF6k7m8lIYN1XP~Tf-v~MEwVJBr0adVXDb7z7gaC93ay8shf9PTBdAm55bNXFx9m1Hf0ZocW2uCMGIUFp3xOV5pj2vjzBdkUAM3s~1KCFtN9TxmXy7qIBhCSJ6TOLoN3V8uBSfiLAs2EEzJ4T9eA4a6CaBRkuZn~K8WLPpxSQGep4vuwU4vjlqM0Vho3BaNYGA__&Key-Pair-Id=APKAJFHNSLHYCGFYQGIA
This whoever is the link youtube-dl tries to download:
https://ssrweb.zoom.us/cmr/replay/2018/01/31/627969148/F85683EA-FC4D-47B8-AC75-278AA849BD2A/GMT20180131-020020_GAZ-Transf_1920x1050.mp4?response-content-type=video/mp4&Expires=1527847286&Signature=DxESyu-oMskZ2UWEDOPMN3RYdxqoaigeyzEHiMYCyWJU~44aM1JWhkPuUDkMjzYEt2lfrkZ7jhvFMi3xyjrgJ5AUyQWREPNiUqgEwJBT8YHD-bU3PbIgi~esaWIZffp~3RuVSn0PRqmrraXwoszEJljJsKjV1yMCMjsNYo67SzH5dCOfYPn18K-jWhZ1qZ7ROC8GX~aWvCftq3FgY8fiv2KuP3M~ptdsUJ0ALf9BIfKWaNq0vFfcEob8duJcOMabw4ccG9~qj9-mxj0mN5KG90qdLl-i0MKOXJAirb6TAhyJ0dWzHVUe3jN9is7hfrNO2x96gleIU9kjgLSoQfEdtg__&Key-Pair-Id=APKAJFHNSLHYCGFYQGIA
Seems like youtube-dl unescapes a character (=video%2Fmp4 vs =video/mp4) which transforms the URL into something else. Just escaping that slash makes the non working link work but I don't know to change this behaviour with youtube-dl, I've already tried --encoding UTF-8 and nothing. Any help is appreciated.

On this link youtube-dl last version of 30-5 gave this error
HTTP Error 403: Forbidden
https://cp450888-vh.akamaihd.net/i/mtviestor/_!/intlod/MTVInternational/MBUS/TACTIC/201805/VIAMTVIPYC0259OHDL9/IT_INGOODCOMPANY_QNG000619_,384x216_400_m30,512x288_750_m30,640x360_1200_m30,768x432_1700_m30,960x540_2200_m31,1280x720_3500_h32,.mp4.csmil/master.m3u8?hdnea=st%3D1527863866~exp%3D1527878266~acl%3D%2Fi%2Fmtviestor%2F_*%2Fintlod%2FMTVInternational%2FMBUS%2FTACTIC%2F201805%2FVIAMTVIPYC0259OHDL9%2FIT_INGOODCOMPANY_QNG000619_%2C384x216_400_m30%2C512x288_750_m30%2C640x360_1200_m30%2C768x432_1700_m30%2C960x540_2200_m31%2C1280x720_3500_h32%2C.mp4.csmil%2F*~hmac%3D645ff56fc636861c84c1813abac438d00b0bfbf5053b025a88fd3d20792ecd67&__a__=off&__b__=450&__viacc__=NONE

On this link youtube-dl last version of 30-5 gave this error
HTTP Error 403: Forbidden
https://cp450888-vh.akamaihd.net/i/mtviestor/_!/intlod/MTVInternational/MBUS/TACTIC/201805/VIAMTVIPYC0259OHDL9/IT_INGOODCOMPANY_QNG000619_,384x216_400_m30,512x288_750_m30,640x360_1200_m30,768x432_1700_m30,960x540_2200_m31,1280x720_3500_h32,.mp4.csmil/master.m3u8?hdnea=st%3D1527863866~exp%3D1527878266~acl%3D%2Fi%2Fmtviestor%2F_*%2Fintlod%2FMTVInternational%2FMBUS%2FTACTIC%2F201805%2FVIAMTVIPYC0259OHDL9%2FIT_INGOODCOMPANY_QNG000619_%2C384x216_400_m30%2C512x288_750_m30%2C640x360_1200_m30%2C768x432_1700_m30%2C960x540_2200_m31%2C1280x720_3500_h32%2C.mp4.csmil%2F*~hmac%3D645ff56fc636861c84c1813abac438d00b0bfbf5053b025a88fd3d20792ecd67&__a__=off&__b__=450&__viacc__=NONE

On this link youtube-dl last version of 30-5 gave this error
HTTP Error 403: Forbidden
https://cp450888-vh.akamaihd.net/i/mtviestor/_!/intlod/MTVInternational/MBUS/TACTIC/201805/VIAMTVIPYC0259OHDL9/IT_INGOODCOMPANY_QNG000619_,384x216_400_m30,512x288_750_m30,640x360_1200_m30,768x432_1700_m30,960x540_2200_m31,1280x720_3500_h32,.mp4.csmil/master.m3u8?hdnea=st%3D1527863866~exp%3D1527878266~acl%3D%2Fi%2Fmtviestor%2F_*%2Fintlod%2FMTVInternational%2FMBUS%2FTACTIC%2F201805%2FVIAMTVIPYC0259OHDL9%2FIT_INGOODCOMPANY_QNG000619_%2C384x216_400_m30%2C512x288_750_m30%2C640x360_1200_m30%2C768x432_1700_m30%2C960x540_2200_m31%2C1280x720_3500_h32%2C.mp4.csmil%2F*~hmac%3D645ff56fc636861c84c1813abac438d00b0bfbf5053b025a88fd3d20792ecd67&__a__=off&__b__=450&__viacc__=NONE


Advice for vue-cli and webpack usage

Hello,
I've faced the issue this morning (and avoided putting some tags in the html). I thought this could help others using vuikit.
Kind regards,
Guillaume

Thanks for your suggestion, @iiome. That plugin seems very handy, I wasn't aware of it. The issue is not strictly vue-cli related and giving some tips about it is a good idea. Will try it out and get back to you asap :)

I have reviewed your suggestions more deeply and would discourage its usage. Magic assets resolving can seem a good idea, but at the end will lead to more confusions than solutions. It's wiser to resolve your assets dependencies on each file individually and set as external in the Webpack configuration the ones you don't want in your bundle. This is how is done in Vuikit core which used vue-cli as starting point.
Anyway I have updated the readme adding more information about dependencies when working with NPM.


Error is reported about Doctrine Paginator getIterator method returning Traversable, on which getArrayCopy metho does not exist

I have a method like this in my code.
function paginate(
Doctrine\ORM\Tools\Pagination\Paginator $paginator,
int $page,
int $perPage): array
{
    $paginator
        ->getQuery()
        ->setFirstResult(($page - 1) * $perPage)
        ->setMaxResults($perPage);

    /** @var \ArrayIterator $paginatorIterator */
    $paginatorIterator = $paginator->getIterator();

    return array_values($paginatorIterator->getArrayCopy());
}

PHPStan reports an error telling:

Call to an undefined method Traversable<mixed, mixed>::getArrayCopy().

This is because getIterator method of Doctrine\ORM\Tools\Pagination\Paginator class is marked to inherit doc from \IteratorAggregate interface where
the PHPDoc of getIterator method tells to return Traversable<TKey, TValue>, but Doctrine\ORM\Tools\Pagination\Paginator class getIterator method actually returns ArrayIterator object. So can the PHPStan error reporting be fixed in this package?

Try /** @var, not just /* @var.

@ondrejmirtes  But I have written /** @var and not /* @var

In the first version of the OP there isn't /** and that's what I got in my email inbox. Anyway, this hsould always work:
    /** @var \ArrayIterator $paginatorIterator */
    $paginatorIterator = $paginator->getIterator();

So I don't know what's going on. Are you on PHPStan 0.12?

@ondrejmirtes I am using PHPStan version 0.12.2 and phpstan/phpstan-doctrine version 0.12.1

Try to upgrade to latest versions, but this simply should work.

Maybe this is because my method is defined in a trait which is included in controller. I tell this as I had such error reported in another method which was directly defined in controller and /** @var helped to solve the problem.

Yeah, in that case upgrading PHPStan might help. I'm not aware about any bugs related to traits anymore.

@ondrejmirtes you were correct upgrading to latest versions helped to solve the problem. So I close this issue.


feat(router): introduce server support for form actions

PR Checklist

Closes #935
What is the new behavior?
In .server.ts files, an action function can be defined to be used with forms to progressively enhance forms and build the foundation for handling form actions on the server.
// newsletter.server.ts
import {
  type PageServerAction,
  redirect,
  json,
  fail,
} from '@analogjs/router/server/actions';
import { readFormData } from 'h3';

export function load() {
  return {
    loaded: true,
  };
}

export async function action({ event }: PageServerAction) {
  const body = await readFormData(event);
  const email = body.get('email') as string;

  if (!email) {
    return fail(422, { email: 'Email is required' });
  }

  if (email.length < 10) {
    return redirect('/');
  }

  console.log({ email: body.get('email') });

  return json({ type: 'success' });
}

A follow-up PR will land to add a form directive to bridge the form to the form server action.
Does this PR introduce a breaking change?

[ ] Yes
[x] No

Other information
[optional] What gif best describes this PR or how it makes you feel?

whahoo!


new line characters do not work

following issue #24
with 1.3.x version
  and  \u000A  do not work, to have breaking line.
Help me please to have new line in hint working again !

FYI, starting v2.2.0, there are 3 size variations available: hint--small, hint--medium & hint--large. This should help make the situation better where long texts break out instead of spanning across multiple lines.


C syntax highlighting breaks vim

Hi,
when I recently opened .c file, C syntax highlighting does not work and vim's command line does not work properly (when I try to scroll, it only adds numbers to command line with actual scrolling, or if I enter :q! , it appends it to the end of CL, and after 'Enter' it closes VIM but file contents are still visible in terminal). Would you mind fixing this issue? I will look into which patchlevel caused it.

I guess there would be a million users complaining about this issue.
vim + c = broken? = world world war 3.

Yes, you are right, config issue.

On 2017-01-17, zdohnal wrote:

Hi,
when I recently opened .c file, C syntax highlighting does not work and vim's
command line does not work properly (when I try to scroll, it only adds numbers
to command line with actual scrolling, or if I enter :q! , it appends it to the
end of CL, and after 'Enter' it closes VIM but file contents are still visible
in terminal). Would you mind fixing this issue? I will look into which
patchlevel caused it.

As Ismael wrote, if this was a common problem, we would have heard
about it from many people long before now.  That we haven't suggests
that the problem is unique to your environment.  That doesn't mean
that it's not due to a bug in Vim, but it does mean that we will
need more information about the specifics of the problem you're
observing and the conditions under which it occurs.
To me, the most telling symptom is that the file contents are still
visible on the terminal screen after you've quit vim.  That suggests
that the terminal isn't responding to the t_ti and t_te escape
sequences.  That could be because vim doesn't know from the terminfo
or termcap database which sequences to use for t_ti and t_te, or
that it has the wrong sequences for the terminal you are actually
using.  It could also mean that the terminal you're using doesn't
support the alternate screen.
What does the following show?
:verbose set term? t_ti? t_te?

As an example, in the vim instance I'm using for this reply, I see
this:
term=screen
t_ti=^[[?1049h
t_te=^[[?1049l

See also:
:help xterm-screens
:help raw-terminal-mode
:help 'restorescreen'

I suspect that the other symptoms stem from the same cause:  that
vim thinks it's using a terminal type different from the one it's
actually using.
Regards,
Gary

Thanks Gary for your help. When I removed plugin folder from .vim, it started to work. It seems I forgot to lock my PC and colleague installed some funny plugin, which breaks C syntax highlighting (clang-complete). It forces me to lock my PC properly.