Chromium headless / chromedriver (Selenium) does not work inside nix sandbox

Running
chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"

(or any other use of headless Chromium for the purpose of Selenium / chromedriver headless testing) does not work in the Nix build sandbox.
This makes it impossible to package software that does Selenium or similar tests in their test suites.
This is even though Chromium's sandbox is disabled with --no-sandbox. It works fine when run outside the Nix build sandbox.
This issue is to figure out how that can be fixed.

@NorfairKing and I have tested it only on top of NixOS 20.09 and 21.05. Minimal repro test.nix:
let
  pkgs = import <nixpkgs> {};
in
  pkgs.runCommand "chromium-headless-invocation" {} ''
    ${pkgs.chromium}/bin/chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"
  ''

(Obvious from the sandbox https://github.com cannot be reached, but this URL is just an arbitrary example, it fails also for localhost.)
It always errors, but the error message output is nondeterministic: sometimes the error
[0100/000000.301456:ERROR:zygote_linux.cc(608)] Zygote could not fork: process_type gpu-process numfds 3 child_pid -1

(which we believe to be the key error) is there, sometimes not:
$ nix-build test.nix
these derivations will be built:
  /nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv
building '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv'...
Fontconfig error: Cannot load default config file: No such file: (null)
[0830/171215.175304:ERROR:bus.cc(393)] Failed to connect to the bus: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory
[0830/171215.175789:WARNING:headless_browser_main_parts.cc(106)] Cannot create Pref Service with no user data dir.
/build/.attr-0: line 1:     6 Trace/breakpoint trap   (core dumped) /nix/store/73q3z4039cqip8zsrsi43inaw56fvk8f-chromium-91.0.4472.164/bin/chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"
builder for '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv' failed with exit code 133
error: build of '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv' failed

$ nix-build test.nix
these derivations will be built:
  /nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv
building '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv'...
Fontconfig error: Cannot load default config file: No such file: (null)
[0830/171218.212738:ERROR:bus.cc(393)] Failed to connect to the bus: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory
[0830/171218.213202:WARNING:headless_browser_main_parts.cc(106)] Cannot create Pref Service with no user data dir.
[0100/000000.301456:ERROR:zygote_linux.cc(608)] Zygote could not fork: process_type gpu-process numfds 3 child_pid -1
[0100/000000.301627:ERROR:zygote_linux.cc(640)] write: Broken pipe (32)
/build/.attr-0: line 1:     6 Trace/breakpoint trap   (core dumped) /nix/store/73q3z4039cqip8zsrsi43inaw56fvk8f-chromium-91.0.4472.164/bin/chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"
builder for '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv' failed with exit code 133
error: build of '/nix/store/1rzah3a68akgwcw0k9irr8nbgf9rhxyr-chromium-headless-invocation.drv' failed

CC @primeos @vcunat who helped a bit on Matrix with this issue.

I've successfully used the chrome from nixpkgs in docker containers made with dockerTools recently. I had to take the following two things into account to make it work. I'm not sure how well this will transfer to build sandboxes but it should be similar.
Chrome/chromium will crash if you don't specify FONTCONFIG_FILE. Even setting an an empty fontconfig avoids it. See here https://discourse.nixos.org/t/chromedriver-chromium-headless-in-a-docker-container-what-am-i-missing/5439
let
  pkgs = import <nixpkgs> {};
in
  pkgs.runCommand "chromium-headless-invocation" {} ''
    export FONTCONFIG_FILE=${pkgs.makeFontsConf { fontDirectories = [];}}
    ${pkgs.chromium}/bin/chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"
  ''

Another thing, iirc, is that recent chrome uses p11-kit via nss for ssl certs, which means you need to have ssl certs in /etc/ssl/certs/ca-certificates.crt . https://github.com/NixOS/nixpkgs/blob/7c38b03f742a657bf38e9579adeb608fc7cc5f1a/pkgs/development/libraries/p11-kit/default.nix#L34
Hope that helps

Holy :hankey: ! The FONTCONFIG_FILE thing works!

I suppose this issue can be closed?

@L-as It should probably be documented somewhere (but no idea where), and I should open an issue in the chromium tracker.

What would the Chromium bug be? That it doesn't work without fonts?

What would the Chromium bug be?

That the error message is Zygote could not fork: process_type gpu-process without detail (not making clear that lack of fontconfig is a problem).

You do get an error about fontconfig, but chromium doesn't make it at all clear that it's fatal.
The error is:
Fontconfig error: Cannot load default config file: No such file: (null)

Full output:
building '/nix/store/20rf4z3mgzx686pqbd92h8iizln5iy3j-chromium-headless-invocation.drv'...
Fontconfig error: Cannot load default config file: No such file: (null)
[0831/115840.025440:ERROR:bus.cc(393)] Failed to connect to the bus: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory
[0100/000000.034084:WARNING:vaapi_wrapper.cc(588)] VAAPI video acceleration not available for swiftshader
/build/.attr-0: line 1:     3 Trace/breakpoint trap   /nix/store/bmxdc9h4p6sj57s34s27rhl0p9xq85l2-chromium-92.0.4515.159/bin/chromium-browser --headless --no-sandbox --disable-gpu --screenshot "https://github.com"
[0100/000000.034911:ERROR:gpu_init.cc(441)] Passthrough is not supported, GL is swiftshader
[0100/000000.035713:ERROR:zygote_linux.cc(608)] Zygote could not fork: process_type renderer numfds 4 child_pid -1
[0100/000000.035808:ERROR:zygote_linux.cc(640)] write: Broken pipe (32)
builder for '/nix/store/20rf4z3mgzx686pqbd92h8iizln5iy3j-chromium-headless-invocation.drv' failed with exit code 133
error: build of '/nix/store/20rf4z3mgzx686pqbd92h8iizln5iy3j-chromium-headless-invocation.drv' failed

You do get an error about fontconfig, but chromium doesn't make it at all clear that it's fatal.

Aha, I also missed that to be honest :p

I opened a chromium bug here: https://bugs.chromium.org/p/chromium/issues/detail?id=1245258


Don't bundle unused lodash code

Transforms the imports so that the functions are cherry picked. From babel-plugin-lodash's README:
Transforms:
import _ from 'lodash';
import { add } from 'lodash/fp';

let add1 = add(1);
_.map([1, 2, 3], add1);

roughly to
import _add from 'lodash/fp/add';
import _map from 'lodash/map';

let add1 = _add(1);
_map([1, 2, 3], add1);

@dasilvacontin Is this different than https://github.com/OpenCollective/website/blob/master/frontend/src/components/ImageUpload.js#L3?

Sorry, I gave a quick look to https://github.com/OpenCollective/website/blob/a45f891fc0a81bae1585e0b6b007460a328208c0/server/utils/api_url.js#L1, didn't notice it was a server file, and assumed all imports were done like that, yay.
Still, with this you could forget about manually writing the import paths, since the plugin will do that for you, and just import _ from 'lodash'.

Good reminder and great to add that to Babel. Thanks David!

I have noticed that underscore is used as well https://github.com/OpenCollective/website/blob/5583e347eab3ffb1e0f4dce453c5893c5debe849/frontend/src/components/ImagePicker.js


[SPARK-8200] [MLlib] [WIP] Check for empty RDDs in StreamingLinearAlgorithm

Test cases for both StreamingLinearRegression and StreamingLogisticRegression, and code fix.
Edit:
This contribution is my original work and I license the work to the project under the project's open source license.

Can one of the admins verify this patch?

@pparkkin please review https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark Among other things this needs an actual title.

Thanks for the quick review and comments! Sorry about not following the guide completely.
I updated the PR title and description.
I'll make the code changes when I get back to work tomorrow morning.

Sorry, I merged another PR to fix the superfluous match construct here. You may need a rebase too now.

Done.

OK to test

Jenkins, test this please

Test build #894 has started for   PR 6713 at commit ff5cd78.

Merged build triggered.

Merged build started.

Test build #34587 has started for   PR 6713 at commit ff5cd78.

Test build #34587 has finished for   PR 6713 at commit ff5cd78.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test build #894 timed out     for PR 6713 at commit ff5cd78     after a configured wait of 175m.

Is this ready -- just checking since there is [WIP] in the title.

Changed title.


Test data for crypto library

We need to generate test data for our crypto library to make it easier for others to create third party implementations. The data should be in one or more JSON files (similar to existing Ethereum tests).
The functions we need to provide test inputs for are:

func Encrypt(message []byte, eonPublicKey *EonPublicKey, epochID *EpochID, sigma Block) *EncryptedMessage
func (m *EncryptedMessage) Decrypt(epochSecretKey *EpochSecretKey) ([]byte, error)
func VerifyEpochSecretKey(epochSecretKey *EpochSecretKey, eonPublicKey *EonPublicKey, epochIDBytes []byte) (bool, error)

Inputs and outputs should be hex encoded. In particular EpochIDs should be byte strings that first have to be run through ComputeEpochID.
Instead of generating the data manually, it is probably easier to write a simple generator executable. It could be a standalone program or a subcommand under rolling-shutter.

Closed through https://github.com/shutter-network/rolling-shutter/pull/416


Release version 2.0.4

Questions
Answers

Description?
Release version 2.0.4

Type?
bug fix / improvement / new feature / refacto / critical

BC breaks?
yes / no

Deprecations?
yes / no

Fixed ticket?
Fixes PrestaShop/Prestashop#{issue number here}.

How to test?
Please indicate how to best verify that this PR is correct.

Thanks @szavadskiy!!!


Cannot read property 'init'

Hi
I have the following error. Any idea why?
angular.js:13642 TypeError: Cannot read property 'init' of undefined
at Scope.init (http://localhost:9001/vendor/js/angular-addthis/angular-addthis.js:121:36)
at Object.link (http://localhost:9001/vendor/js/angular-addthis/angular-addthis.js:132:24)
at http://localhost:9001/vendor/js/angular/angular.js:1266:18
angular 1.5.6
angular-addthis 0.2.4

@tla-dev have you added the addthis library to your page?
<script src="//s7.addthis.com/js/300/addthis_widget.js#pubid={pubid}&async=1"></script>

Replace {pubid} with your publisher id from your addthis account

no, thank you, i'll do that.


Add a .devtools/license in order to maintain license headers.

The tool has a fix and a check command. The check command is added to the Jenkins build checks and to the pre-commit hook. The fix command can be used to automatically add headers whenever missing.
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Job PR-223/1 is complete.
Docs are uploaded to http://gluon-ts-staging.s3-accelerate.dualstack.amazonaws.com/PR-223/1/index.html

Job PR-223/2 is complete.
Docs are uploaded to http://gluon-ts-staging.s3-accelerate.dualstack.amazonaws.com/PR-223/2/index.html


Network is in a disconnected state when using cloudbase-init and Static IP network assignment

would appreciate any help from the cloudbase-init team on this .
Provisioning a VM from a template prepped with cloudbase-init and the OVF service on vSphere via an automation tool that maps userdata using CD-ROM mapped iso works fine if we use DHCP network assignment since in this use case there is no VM customization event which is again is not needed since the template is syspreped.
Problem is when we try to use a static IP the automation tool generate a dynamic customization Specification which forces VM Customization on the provisioned VM . in this use case the customization event fails with an error on the VM in vCenter:
"The customization component failed to set the required parameters inside the guest operating system"
looking in the c:/windows/temp/vmware-imc/guestcust.log I really cloudn't tell what is that required parameters its talking about.
Log Files attached
guestcust.log
cloudbase-init.log
because of this customization error the network adapter stays in a disconnected state which is problematic even though the IP is configured correctly within the GOS but whats strange cloudbase-init is clearing the gateway, so its not set.
Can cloudbase-init handle something like vSphere Customization ?

looks like i need to use this plug-in cloudbaseinit.plugins.common.networkconfig.NetworkConfigPlugin

Still got a customization error while usingcloudbaseinit.plugins.common.networkconfig.NetworkConfigPlugin
so i m not sure what else to do at this point

@vmwarelab I do not have much experience on how the VM Customization works, maybe the original patch owner (@jdillet) that added support for OVF can help on this matter.
What I can confirm is that cloudbase-init does not support static network configuration for OVF metadata service. See https://cloudbase-init.readthedocs.io/en/latest/services.html#open-virtualization-format-ovf
To move further, can you provide the config drive contents? The default OVF drive label is OVF ENV. If cloudbase-init can get the static network information from the metadata file, then support can be added for this feature.
Thank you,
Adrian Vladu

here is the off-env.xml that is mapped via the CD-ROD i have renamed it to .txt
ovf-env.txt
is that what your asking for ?

Majority of customers that i deal with don't use DHCP within their production networks .. which makes cloudbase-init really unusable at this point if it does't support static networking

I can't see within the ovf section based on the link you posted anything that says static networking isn't supported unless i m blind to see it :)
Majority of customers that i deal with don't use DHCP within their production networks .. which makes cloudbase-init really unusable at this point if it does't support static networking. Therefore this would be a very important feature to support.
also by the way the cloud config code i am testing simply to create a file with some sample text content did execute since the automation does pass the user data but the issue is the adapter again in disconnected state since the customization is failing after install cloudbase-init .. yes customization works fine if i dont prep the template with cloudbase-init

The OVF metadata service has currently only these capabilities:

instance id (hardcoded to iid-ovf if not present)
hostname
public keys
admin user name
admin user password
user data

From cloud-init, these patches were required to have the static networking configured:
https://github.com/canonical/cloud-init/commit/8844ffb5988bcfbb8cfbe57d9139c3dcb8b429cc#diff-bf224ee6b5520e1165bae72949491277
https://github.com/canonical/cloud-init/commit/39f668e5db8d09c46eee3a5df73a69f8d85ba489#diff-bf224ee6b5520e1165bae72949491277
In the best case scenario, the patches have to be made compatible with the Windows networking implementation (if not rewritten or heavily refactored).
Do you happen to have some details on how the VM configuration works on Windows, so that we can have an idea of what needs to be done. The main purpose would be to find how Cloudbase-Init should run at the proper time and consume the network information in order to set it correctly.

Any progress on this issue?
I had the same troubles with regular cloud-init on a CentOS 8.2.
The solution was to use a combination of vCenter Customization and cloud-init.
The first run handles the network configuration with DataSourceOVF [seed=vmware-tools].
This datasource contains the network configuration and is only available on the first boot of the cloned template after a Guest Customization Task in vCenter.
A second run of cloud-init picked the DataSourceOVF [seed=iso] with the above mentioned ovf-env.xml file from the ISO image. This includes some user-data but not the network configuration. The ISO image will stay for the whole lifetime of the VM in the drive.
The question is: Can we disable network and hostname configuration in cloudbase-init as VMware Tools did it already with the guest customization mechanism before?
Or can cloudbase-init use both datasources? vmware-tools AND iso? With a joined dataset of network config and user-data.
When vCenter starts a Customization it configures its own sysprep run and overwrites the cloudbase-init unattended run.
This results in a missing cloudbase-init-unattended log file.
It seems here are fighting two different customization processes! vmware-tools and cloudbase-init.
Tim

Hello @lapawa ,
Sorry for the late response. Currently, I do not have access to such an environment but it is clear that vmware-tools and cloudbase-init step on each other toes. What I can suggest is to tweak the cloudbase-init installation so that it sets the cloudbase-init service to automated start or even better, delayed start and disable / remove SetSetupComplete.cmd code. It is same behaviour used here: https://github.com/cloudbase/windows-openstack-imaging-tools/blob/master/UnattendResources/Logon.ps1#L611
Also, you can customize cloudbase-init by writing the code necessary for the use both datasources: vmware-tools AND iso. I can help with the review and testing of that code.
Thank you,
Adrian Vladu

I am having this issue, currently...  Has there been any update on if the OVF Service will allow Static Networking?
I'm using 1.1.2 stable.

I am also having the same issue, attempting to use cloudbase-init for guest actions. We are using the Infoblox IPAM plugin with static IP assignment, in our case the guest OS network settings are applied correctly and the cloudbase-init commands seem to be working fine for setting hostname/admin credentials, but the VM is left with the network adapter in a disconnected state.

check if the vCenter VM customization completed successfully . usually once the customization task is complete and the vm reboots it should connect the adapter

With VMware now recommending using CloudBase-Init for customization of Windows guest OSes, static networking is an absolute threadbare minimum it needs to support to properly replace Guest Customization and the vRA Agent.  more info  Has there been any movement toward supporting static network IP assignments as exists for Linux?

I just wanted to provide an update on this as to what I have figured out.  I found a way to work around this with a poorly documented option in vRA.  Here is the documentation.
The option is 'customizeGuestOs', which you can set to false, to keep vRA from generating and applying a dynamic customization specification.
I wrote up a blog post on it here.  Thanks to @vmwarelab for your blog posts, which pointed me in the right direction to get this figured out on my end.
For the record, this is not an issue with cloudbase-init so to speak, it is basically an unavoidable race condition, where the dynamic customization spec and cloudbase-init fight to complete their customizations at the same time.  The only real solution I have found, is to use one without the other.

Following up, this is how we made VMware's Guest OS Customization and cloudbase-init get along to avoid the original NIC disconnected issue, while still preserving as much of the intended functionality of both as possible.  Note that if you are not using vRealize Automation, vCloud Director, or another system mimicking them, you should not need this and should likely be looking into a more appropriate transport such as ConfigDrive.  Feel free to adjust locations and file names as you see fit, but ensure you are replacing them in all locations if you do.

In your template, create C:\opt\run_cloud-init_prep.ps1, containing the following:

Set-Service -Name 'cloudbase-init' -StartupType Manual
Start-Service -Name 'cloudbase-init'

In a UAC-elevated (run as administrator) PowerShell 5.1 window, download cloudbase-init and install it.  Adjust your administrator user account and the source URL as necessary.  Note that we are -not- sysprepping the machine, as Guest Customization will handle that for you.

$cbiinstaller = "https://github.com/cloudbase/cloudbase-init/releases/download/1.1.2/CloudbaseInitSetup_1_1_2_x64.msi"
$cbiinstallfile = ("C:\opt\"+(($cbiinstaller).Split('/')[-1]))
Invoke-WebRequest -Uri $cbiinstaller -UseBasicParsing -OutFile $cbiinstallfile

$cloudinitarguments = @(
    "/i",
    $cbiinstallfile,
    "SYSPREP=0",
    "SYSPREPSHUTDOWN=0",
    "RUN_SERVICE_AS_LOCAL_SYSTEM=1",
    "USERNAME=Administrator",
    "/qb"
)
Start-Process -FilePath 'msiexec.exe' -ArgumentList $cloudinitarguments -Wait
Set-Service -Name 'cloudbase-init' -StartupType Disabled

Modify the two configuration files as documented by VMware using your preferred method:  (external link)

Back in your elevated PowerShell window, create a scheduled task with highest privileges but no schedule to allow you to modify and start the cloudbase-init service after the machine finishes sysprepping:

$scheduledtaskaction = New-ScheduledTaskAction -Execute 'C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe' -Argument 'C:\opt\run_cloud-init_prep.ps1'
$principal = New-ScheduledTaskPrincipal -RunLevel Highest -UserId 'NT AUTHORITY\SYSTEM'
$st = New-ScheduledTask -Action $scheduledtaskaction -Description 'Starts cloudbase-init after VMware guest customization' -Principal $principal
Register-ScheduledTask -TaskName 'cloudbase-init' -InputObject $st

Take care of any other rollback steps you would normally handle, such as removing static IPs, old profiles, etc., shut the machine down and convert it to a template.

In your VM Customization Specification, add the following to RunOnce:
C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -NonInteractive -Command "Start-ScheduledTask -TaskName 'cloudbase-init'"

Cloudbase-init will now only run after VMware Guest Customization has completed all of its tasks, which prevents the race condition and also allows the image to be updated without running a cleanup phase for cloudbase-init.  You should now be able to deploy as normal, adding your cloudConfig block for user-data as documented, enjoying all of the benefits of vSphere customization with all of the post-provisioning of cloudbase-init.
For what it is worth, correcting my prior statement, we also had to do something similar in Linux with cloud-init, but that is another post for another place.


TagSet overflow menu can be shown over the all tags dialog

The TagSet presents an overflow menu which contains a "View all tags" link which opens a dialog to show all tags. In some circumstances, the overflow menu continues to show when the all tags dialog is opened. This shouldn't happen -- the overflow menu should close whenever the "View all tags" link is activated.
To reproduce:

Open a TagSet story, e.g. "Many tags".
Shrink the available space until at least eleven tags are not shown, so that both the overflow menu and the all tags dialog will be available.
Click on the overflow tag to display the overflow menu.
Now click somewhere within the overflow menu so as to remove focus from the "View all tags" link.
Click on the "View all tags" link. The all tags dialog opens, but the overflow menu is still showing over it.

@lee-chase

i took a look at this and this appears to be a problem with carbon. i've created a sandbox just using the carbon components and the buggy interaction continues to persist here https://codesandbox.io/s/cranky-haibt-onxwf?file=/index.js. it looks like when you click inside the tooltip and then click the link it causes an additional trigger of the tooltips onChange handler. i don't think this is something that we can bypass in our own components and needs to be handled by carbon.

Raised an issue https://github.com/carbon-design-system/carbon/issues/10040 having failed to spot David's sandbox until I scrolled down
https://codesandbox.io/s/hardcore-orla-yl9l0?file=/index.js

Hopefully, a fix to Carbon carbon-design-system/carbon#10040 will resolve this -- I've removed the v1 tag, but we can keep this issue open to track the issue.

Carbon has now fixed this, just waiting on a release.

This was resolved by Carbon


Improvement - Unbind event listeners after click

Hi @nashio,
I have another suggestion. In my plugin I do an Ajax request to save to rating to the database. After the user has clicked, the state should change to read-only.
I could solve it like this while testing:
removeListeners: function(){
    this.$stars.off();
},

then I call it in applyRating:
applyRating: function(e){
    var index = this.getIndex(e);
    var rating = index + 1;

    // paint selected and remove hovered color
    this.paintStars(index, 'active');
    this.executeCallback( rating, this.$el );
    this._state.rating = rating;

    this.removeListeners();
},

Could you add this feature to the script (controllable with a parameter)?
Thank you!
Viktor

Added, thanks for the suggestion
check option: "disableAfterRate"
its on by default

Wow, that was fast. Works great, thank you for the fast update!


Add constants and aliases to optparse.rbi

Just handling a few things I missed in the original creation of optparse.rbi. Hopefully this time nothing will break 🙇
I'm not sure if alias will work in a Sorbet stdlib RBI, none of the others seem to use it? I'm just using what's in the optparse.rb file in Ruby itself.
Motivation
There were still some methods and constants from OptionParser that , and the original RBI also missed the OptParse alias for OptionParser.
Test plan
See included automated tests.

The tests passed with the first commit, but I've replaced the aliases with normal methods 👍

Thank you!


FileNotFoundError requirements.txt

Initial checklist

[X] I read the support docs
[X] I read the contributing guide
[X] I agree to follow the code of conduct
[X] I searched issues and couldn’t find anything (or linked relevant results below)

Affected packages and versions
hatch-aws 1.0.0
Link to runnable example
No response
Steps to reproduce

update project setup to conform 1.0.0 (include -> tool.hatch.build.force-include)

Additional version info:
SAM CLI, version 1.73.0
pyenv 2.3.12
Expected behavior
Should create target directory before writing into target / "requirements.txt".
Actual behavior
$ hatch build -t aws
[aws]
Building lambda functions ...
<package> ... <class 'pathlib.PosixPath'> /<path>/.aws-sam/build/<package>/<lambda>/requirements.txt
Traceback (most recent call last):
  File "/<path>/.pyenv/versions/3.9.16/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/<path>/.pyenv/versions/3.9.16/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatchling/__main__.py", line 6, in <module>
    sys.exit(hatchling())
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatchling/cli/__init__.py", line 26, in hatchling
    command(**kwargs)
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatchling/cli/build/__init__.py", line 75, in build_impl
    for artifact in builder.build(
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatchling/builders/plugin/interface.py", line 158, in build
    artifact = version_api[version](directory, **build_data)
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatch_aws/builder.py", line 105, in build_standard
    self.build_lambda(aws_lambda=aws_lambda, shared_files=shared_files)
  File "/<hatchenvpath>/lib/python3.9/site-packages/hatch_aws/builder.py", line 61, in build_lambda
    requirements_file.write_text(data="\n".join(deps), encoding="utf-8")
  File "/<path>/.pyenv/versions/3.9.16/lib/python3.9/pathlib.py", line 1285, in write_text
    with self.open(mode='w', encoding=encoding, errors=errors) as f:
  File "/<path>/.pyenv/versions/3.9.16/lib/python3.9/pathlib.py", line 1252, in open
    return io.open(self, mode, buffering, encoding, errors, newline,
  File "/<path>/.pyenv/versions/3.9.16/lib/python3.9/pathlib.py", line 1120, in _opener
    return self._accessor.open(self, flags, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/<path>/.aws-sam/build/<package>/<lambda>/requirements.txt'

Affected runtime and version
<EMAIL_ADDRESS>Affected package manager and version
<EMAIL_ADDRESS>Affected OS and version
openSUSE Tumbleweed 20230221
Build and bundle tools
No response

Thanks @oniboni for the fix. It's released in 1.1.0.


Crash in a Timelane lane

Is there an existing issue for this?

[X] I have searched existing issues and found no similar bug report.

Description of the problem
Checking SRF News crash reports with Xcode we found a few issues related to Pillarbox. These should be further investigated.
This issue seems related to Timelane. Raises the question again whether we could simply get rid of Timelane now that we don't really use it anymore.
Crash logs are attached to this issue.
Relevant stack trace or log output
No response
Reproducibility
Difficult
Steps to reproduce
None yet.
Library version
2.0.0
Operating system
See logs
Code sample
No response

Timelane has been removed in #978. Let us see what happens with Pillarbox 3.0.0 in production.

Nowhere to be seen in recent SRF News crash logs, still we see a few publisher-related crashes reported elsewhere (#954). I guess we can close this issue.


Vignere Encryption.java

Not able to understand the use of so many empty commits

Make a new PR because on merging there will be more than files with the same name.


Merge changes from upstream

Coverage increased (+1.7%) to 40.067% when pulling 4ab9ff4420d7269d5bcac5a6e1bbd84fd5b6af06 on ethantkoenig:ufw_develop into 1c26f3460070dbf18601162dcfe68538c81632e4 on unfoldingWord-dev:develop.

Friendly ping. If I don't hear anything in a few days, I'll just merge (this won't affect the release, since it targets develop)


feature_column._is_v2_column always return true

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary): source
TensorFlow version (use command below): 2.1
Python version: 3.6.8
Bazel version (if compiling from source): bazel 2.0
GCC/Compiler version (if compiling from source):
CUDA/cuDNN version:
GPU model and memory:

Describe the current behavior
Upgrade me code from TF1.14 to TF2.0, I got the unexpected error:
  File "/use/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/canned/linear.py", line 432, in linear_logit_fn
    variables.remove(bias)
ValueError: list.remove(x): x not in list

Describe the expected behavior
It should works and train successfully.
Standalone code to reproduce the issue
import collections
import tensorflow.compat.v1 as tf

tf.disable_v2_behavior()
tf.disable_eager_execution()

INPUT = ["name", "id", "study"]
LABEL = ["label"]
ALL = LABEL + INPUT

def input_fn():
    def parse_data(value):
        input_defaults = [[" "] for i in range(1, 4)]
        label_defaults = [['0']]
        all_columns = collections.OrderedDict(zip(ALL, tf.io.decode_csv(value, record_defaults= label_defaults + input_defaults)))
        labels = all_columns.pop(LABEL[0])
        features = all_columns
        return features, labels
    # Extract lines from input files using the Dataset API.
    dataset = tf.data.Dataset.from_tensor_slices([['a', 'b', 'c', '0'], ['b', 'b', 'c', '1']])
    dataset = dataset.batch(1)
    dataset = dataset.map(parse_data)
    return dataset

def train():
    input_column = []
    for name in INPUT:
        input_column.append(tf.feature_column.categorical_column_with_hash_bucket(
            name, hash_bucket_size=3))
    model = tf.estimator.LinearClassifier(feature_columns=input_column)
    model.train(input_fn=lambda: input_fn())

if __name__ == "__main__":
    train()

Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.

Check the code in https://github.com/tensorflow/estimator/blob/7ec4e5d9160c8a924d50c062b38c5153c4c86f29/tensorflow_estimator/python/estimator/canned/linear.py#L418-L445
feature_column_lib.is_feature_column_v2(feature_columns) seems always return true in the
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/feature_column/feature_column_v2.py

The issue is fixed in TF2.2.0rc3 with tf-estimator-2.2


De novo rad seq

added tour

screenshot has wrong parameters (0.5 instead of 0.75 etc.)

ping @yvanlebras


Added batch task failure due to access denied

Pull request guidance
Thank you for submitting your contribution to our support content! Our team works closely with subject matter experts in CSS and PMs in the product group to review all content requests to ensure technical accuracy and the best customer experience. This process can sometimes take one or more days, so we greatly appreciate your patience.
We also need your help in order to process your request as soon as possible:

We won't act on your pull request (PR) until you type "#sign-off" in a new comment in your pull request (PR) to indicate that your changes are complete.

After you sign off in your PR, the article will be tech reviewed by the PM or SME if it has more than minor changes. Once the article is approved, it will undergo a final editing pass before being merged.

@microsoft-github-policy-service agree company="Microsoft"
From: microsoft-github-policy-service[bot] @.>
Sent: Tuesday, February 13, 2024 6:21 PM
To: MicrosoftDocs/SupportArticles-docs @.>
Cc: Nistha Singh @.>; Mention @.>
Subject: Re: [MicrosoftDocs/SupportArticles-docs] Added batch task failure due to access denied (PR #1374)
@nistha22https://github.com/nistha22 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]
Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term "You" includes me and my employer.

@microsoft-github-policy-service agree company="Microsoft"
Contributor License Agreement
Contribution License Agreement
This Contribution License Agreement ("Agreement") is agreed to by the party signing below ("You"),
and conveys certain license rights to Microsoft Corporation and its affiliates ("Microsoft") for Your
contributions to Microsoft open source projects. This Agreement is effective as of the latest signature
date below.

Definitions.
"Code" means the computer software code, whether in human-readable or machine-executable form,
that is delivered by You to Microsoft under this Agreement.
"Project" means any of the projects owned or managed by Microsoft and offered under a license
approved by the Open Source Initiative (www.opensource.orghttp://www.opensource.org/).
"Submit" is the act of uploading, submitting, transmitting, or distributing code or other content to any
Project, including but not limited to communication on electronic mailing lists, source code control
systems, and issue tracking systems that are managed by, or on behalf of, the Project for the purpose of
discussing and improving that Project, but excluding communication that is conspicuously marked or
otherwise designated in writing by You as "Not a Submission."
"Submission" means the Code and any other copyrightable material Submitted by You, including any
associated comments and documentation.
Your Submission. You must agree to the terms of this Agreement before making a Submission to any
Project. This Agreement covers any and all Submissions that You, now or in the future (except as
described in Section 4 below), Submit to any Project.
Originality of Work. You represent that each of Your Submissions is entirely Your original work.
Should You wish to Submit materials that are not Your original work, You may Submit them separately
to the Project if You (a) retain all copyright and license information that was in the materials as You
received them, (b) in the description accompanying Your Submission, include the phrase "Submission
containing materials of a third party:" followed by the names of the third party and any licenses or other
restrictions of which You are aware, and (c) follow any other instructions in the Project's written
guidelines concerning Submissions.
Your Employer. References to "employer" in this Agreement include Your employer or anyone else
for whom You are acting in making Your Submission, e.g. as a contractor, vendor, or agent. If Your
Submission is made in the course of Your work for an employer or Your employer has intellectual
property rights in Your Submission by contract or applicable law, You must secure permission from Your
employer to make the Submission before signing this Agreement. In that case, the term "You" in this
Agreement will refer to You and the employer collectively. If You change employers in the future and
desire to Submit additional Submissions for the new employer, then You agree to sign a new Agreement
and secure permission from the new employer before Submitting those Submissions.
Licenses.

Copyright License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license in the
Submission to reproduce, prepare derivative works of, publicly display, publicly perform, and distribute
the Submission and such derivative works, and to sublicense any or all of the foregoing rights to third
parties.
Patent License. You grant Microsoft, and those who receive the Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive, royalty-free, irrevocable license under
Your patent claims that are necessarily infringed by the Submission or the combination of the
Submission with the Project to which it was Submitted to make, have made, use, offer to sell, sell and
import or otherwise dispose of the Submission alone or with the Project.
Other Rights Reserved. Each party reserves all rights not expressly granted in this Agreement.
No additional licenses or rights whatsoever (including, without limitation, any implied licenses) are
granted by implication, exhaustion, estoppel or otherwise.

Representations and Warranties. You represent that You are legally entitled to grant the above
licenses. You represent that each of Your Submissions is entirely Your original work (except as You may
have disclosed under Section 3). You represent that You have secured permission from Your employer to
make the Submission in cases where Your Submission is made in the course of Your work for Your
employer or Your employer has intellectual property rights in Your Submission by contract or applicable
law. If You are signing this Agreement on behalf of Your employer, You represent and warrant that You
have the necessary authority to bind the listed employer to the obligations contained in this Agreement.
You are not expected to provide support for Your Submission, unless You choose to do so. UNLESS
REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING, AND EXCEPT FOR THE WARRANTIES
EXPRESSLY STATED IN SECTIONS 3, 4, AND 6, THE SUBMISSION PROVIDED UNDER THIS AGREEMENT IS
PROVIDED WITHOUT WARRANTY OF ANY KIND, INCLUDING, BUT NOT LIMITED TO, ANY WARRANTY OF
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
Notice to Microsoft. You agree to notify Microsoft in writing of any facts or circumstances of which
You later become aware that would make Your representations in this Agreement inaccurate in any
respect.
Information about Submissions. You agree that contributions to Projects and information about
contributions may be maintained indefinitely and disclosed publicly, including Your name and other
information that You submit with Your Submission.
Governing Law/Jurisdiction. This Agreement is governed by the laws of the State of Washington, and
the parties consent to exclusive jurisdiction and venue in the federal courts sitting in King County,
Washington, unless no federal subject matter jurisdiction exists, in which case the parties consent to
exclusive jurisdiction and venue in the Superior Court of King County, Washington. The parties waive all
defenses of lack of personal jurisdiction and forum non-conveniens.
Entire Agreement/Assignment. This Agreement is the entire agreement between the parties, and
supersedes any and all prior agreements, understandings or communications, written or oral, between
the parties relating to the subject matter hereof. This Agreement may be assigned by Microsoft.

Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/SupportArticles-docs/pull/1374#issuecomment-1941452033, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BGDY6PSJVD3QXNPLRFDNWWLYTNOU5AVCNFSM6AAAAABDGOP7LOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNBRGQ2TEMBTGM.
You are receiving this because you were mentioned.Message ID: @.***>

Looks good from my view.

@nistha22 The article submitted in this PR is created and published via the private PR https://github.com/MicrosoftDocs/SupportArticles-docs-pr/pull/5740. So, I close this PR.


Unexpected '.' when using .call()

/*jslint browser: true */

var admin = {};
(function (jQuery) {
	"use strict";
}).call(admin, window.jQuery);

Using the stripped sample above, the following warning is generated

Problem at line 6 character 3: Unexpected '.'.

I am using the pattern described in My Favorite JavaScript Design Pattern and The Anatomy of a JavaScript Design Pattern and use .call(context, arg1) to apply the encapsulated function to my single global object and pass in other global objects as parameters.
Unfortunately, this syntax is needed to evaluate the function before using .call and needs the wrapping parenthesis. At this time I am unsure of how to edit this design pattern that will pass validation.

This looks to me to be unnecessarily complicated. What are you really trying to do? Why don't you just do that instead?

Why should I do what instead? The purpose for using an anonymous function with a .call or .apply is to limit the scope of your functions to contain everything without polluting the global namespace. I cut out a lot of the code inside to just describe the underlying problem. Inside that function, after the "use strict"; there are private functions and code and access to them are controlled through public functions (assigned to the this object inside the function).
Because the context is changed when using .call, this refers to the admin global object.

You do not need to use .call or this to accomplish what you need. Your pattern is unnecessarily complicated. That is what JSLint is trying to warn you about. If you are smart you will heed its warning.

@gibwar: If you define function with
function myFunc (jQuery) {
    "use strict";
}

if doesn't support this, so you can't use this inside and so myFunc.call is wrong. If you use anonymout function you have the same problems. If you would define the function like
var myFunc = function (jQuery) {
    "use strict";
};

it will now supports this and you can use myFunc.call. The next code give you no error
/*global $ */
/*jslint browser: true, unparam: true */

var admin = {};
var myFunc = function (jQuery) {
    "use strict";
};
myFunc.call(admin, window.jQuery);

Regards
Oleg
it supports this

@OlegKi: I was trying to avoid polluting the global namespace with more variables than I actually need. If you look at the first example, you'll see the function itself is wrapped in parenthesis. I suppose this method might work (it does validate):
/*jslint browser: true */

var admin = {};
(function () {
    "use strict";
    function myFunc(jQuery) {
        jQuery(""); // example call to remove unused variable error.
    }
    myFunc.call(admin, window.jQuery);
}());

At the end of this script file loading, the only property added to the global window object is window.admin (or window["admin"]). Obviously, I use a less generic name when writing the actual script, as to avoid overwriting another variable from another file.
@douglascrockford: The goal of using the anonymous function and using .call on it is to point the this object way from the global window object to my own custom one. That way I can initialize and define functions while only adding one variable name to the host's window object. This workaround, to me though, is adding unnecessary complexity to an issue of valid JavaScript.

I am not recommending a workaround. All of these patterns are bloated and awful. And unnecessary.

@gibwar: What I mean is the restriction of the Strict Mode. In Annex C: The Strict Mode of ECMAScript of the ECMA-262 ECMAScript Language Specification 5.1 you can read

If this is evaluated within strict mode code, then the this value is not coerced to an object. A
this value of null or undefined is not converted to the global object and primitive values are
not converted to wrapper objects.  The this value passed via a function call (including calls
made using  Function.prototype.apply and  Function.prototype.call) do not
coerce the passed this value to an object (10.4.3, 11.1.1, <IP_ADDRESS>, <IP_ADDRESS>).

So in strict mode you can't use this inside of function if you define it as
 function myFunc(jQuery) {
    ... // no 'this' can be used here
 }

If you do try to use it you get an error. Just try the following
/*jslint browser: true */

var admin = {};
(function () {
    "use strict";
    function myFunc(jQuery) {
        jQuery(this); // !!! try to use 'this' and you will get an error in strict mode
    }
    myFunc.call(admin, window.jQuery);
}());

It should be a method of an object or defined in another way. Almost the same code
/*jslint browser: true */

var admin = {};
(function () {
    "use strict";
    var myFunc = function (jQuery) {
        jQuery(this); // example call to remove unused variable error.
    };
    myFunc.call(admin, window.jQuery);
}());

has no errors. It's what I mean.
Best regards,
Oleg

Your code is horrible. I wish JSLint rejected all of that.

@douglascrockford: Thanks for the compliment! Your critic is very constructive!

@OlegKi Try JSHint...


Add some pollset benchmarks

Built on #9977

I added some _SpeedOfLight variants, that are the equivalent loops without our abstractions, in order to measure what those abstractions are costing us.

Jenkins: test this please

Jenkins: test this please

Failed: #9542 #9550


Enable binding CLI shortcuts when running vite programmatically

Description
When I create my own Vite server using createServer, I'd like to be able to call bindShortcuts on the server, the same way the vite CLI does:
https://github.com/vitejs/vite/blob/5a56941a895fd0ffdbdbf0094336fb7f0f4099c1/packages/vite/src/node/cli.ts#L171
Suggested solution
Suggestions:

Add bindShortcuts to the vite package exports
Make bindShortcuts a method on the server created with createServer
Other?

Alternative
Copy the bindShortcuts code into my own project and maintain my own copy of it.
Additional context
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

There is an open PR to expose bindShortcuts here:

https://github.com/vitejs/vite/pull/13675#issuecomment-1621410696

And we are discussing having it as a server method as you propose. The current API is:
export type BindShortcutsOptions<Server = ViteDevServer | PreviewServer> = {
  /**
   * Print a one line hint to the terminal.
   */
  print?: boolean
  customShortcuts?: (CLIShortcut<Server> | undefined | null)[]
}

export type CLIShortcut<Server = ViteDevServer | PreviewServer> = {
  key: string
  description: string
  action(server: Server): void | Promise<void>
}

If we expose this API, you would be able to add new shortcuts, but Vite's default one would always be active. The default shortcuts change between dev and preview, and it is good we have a standardized set so it could be ok. Another option would be to have a shortcuts array that doesn't extends the defaults.
Would you tell us more about your use case?

Supported in https://github.com/vitejs/vite/pull/13675


Start and stop charging not working in 0.25.0

Hello,
I get the following error when starting and stopping charging in 0.25.0. Climatisation still works.
weconnect-cli --username<EMAIL_ADDRESS>--password  yyy set /vehicles/WVWZZZE1ZMPxxxxxx/controls/charging start
Traceback (most recent call last):
  File "/Users/preventlow/Library/Python/3.8/bin/weconnect-cli", line 8, in <module>
    sys.exit(main())
  File "/Users/preventlow/Library/Python/3.8/lib/python/site-packages/weconnect_cli/weconnect_cli_base.py", line 236, in main
    element.value = args.value
  File "/Users/preventlow/Library/Python/3.8/lib/python/site-packages/weconnect/addressable.py", line 368, in value
    elif issubclass(valType, Enum):
TypeError: issubclass() arg 1 must be a class

Using macOS 12.2.1
Rolled back to 0.24.2 and charging works again.
Regards Peter

Can confirm, thanks for reporting!

Can you check if the error is fixed in 0.25.1?

Starting and stopping charging works now in my setup with 0.25.1 - thanks for the quick fix!


Fix a bug in reading users from custom table [1.2.x]

Purpose
$subject
Check List

[x] Read the Contributing Guide
[ ] Updated Change Log
[ ] Checked Tooling Support (#)
[ ] Added necessary tests

[ ] Unit Tests
[ ] Spec Conformance Tests
[ ] Integration Tests
[ ] Ballerina By Example Tests

[ ] Increased Test Coverage
[ ] Added necessary documentation

[ ] API documentation
[ ] Module documentation in Module.md files
[ ] Ballerina By Examples

Codecov Report

Merging #23534 into ballerina-1.2.x will not change coverage.
The diff coverage is n/a.

@@               Coverage Diff                @@
##           ballerina-1.2.x   #23534   +/-   ##
================================================
  Coverage            14.59%   14.59%
================================================
  Files                   51       51
  Lines                 1411     1411
  Branches               219      219
================================================
  Hits                   206      206
  Misses                1189     1189
  Partials                16       16

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ed39dbe...ec76088. Read the comment docs.


glTF support

I read somewhere that iTwin platform has an alternative to 3DFT, which is using glTF. I believe this might be more suitable for my Metaverse solution right now since I would be able to manipulate the model a little easier in Unreal Engine.
I'm not sure how to access the glTF alternative, is there some documentation for that?

We are deprecating glTF, as it can only support small 3d models (infrastructure models tend to be very big).


Reproducing IMDB results

Hi, I'm currently running the imdb experiments and trying to reproduce the PPO and NLPO results from the paper and though my PPO is close, NLPO is quite far from reported. Do you have any advice for reproducing NLPO results?
I'm running the default config (scripts/training/task_configs/imdb_text_continuation/gpt2_{ppo,nlpo}.yml) and the final test results compared to the results from the paper are below.

Sentiment Score
Fluency (Perplexity)

zero-shot (ppo)
0.486
32.4

ppo
0.604
33.0

zero-shot (nlpo)
0.497
32.7

nlpo
0.496
40.8

paper's zero-shot
0.489
32.2

paper's ppo
0.605
33.5

paper's nlpo
0.637
32.7

PPO results are similar and even slightly lower ppl but NLPO is not at all close. Here are the validation curves

NLPO also seems to improve in sentiment for a bit and then suddenly stops and decreases but all the while the perplexity is going up. Comparing the training curves, it seems that approx KL loss is much larger for NLPO but this could be reasonable given the changes in NLPO. Do you see similar curves?

Finally, in the paper's Appendix Table 4 it says that it runs for 10 epochs but in Figure 4 just below (and also based on the wandb logging) these experiments are for 50 epochs. Should I be running for 10 or 50 epochs?
Each experiment is being run on 4 A100 GPUs as per #12

@mnoukhov Hey, will get back to you after checking the configs. There could be config errors which made NLPO unstable.

@rajammanabrolu  Can you double-check the NLPO config?

Hey @rajammanabrolu have you had a chance to double-check the config and your results? Thanks

Thanks to @rajcscw and @rajammanabrolu, a better NLPO config should have a learning rate of 1e-6 not 1e-5 and update iters 50
This makes NLPO essentially match the performance of PPO (it is still slightly worse). Hope this helps others working with NLPO


Checksum mismatch for go 1.13 for ants Dependency

Seems that there is some problem with the checksum validation of the github.com/panjf2000/ants dependency.
Output of go get -u github.com/rsocket/rsocket-go:
go: finding github.com/rsocket/rsocket-go v0.3.2
go: downloading github.com/rsocket/rsocket-go v0.3.2
go: extracting github.com/rsocket/rsocket-go v0.3.2
go: downloading github.com/pkg/errors v0.8.1
go: downloading github.com/jjeffcaii/reactor-go v0.0.16
go: extracting github.com/jjeffcaii/reactor-go v0.0.16
go: downloading github.com/panjf2000/ants v1.2.0
go: extracting github.com/pkg/errors v0.8.1
verifying<EMAIL_ADDRESS>checksum mismatch
        downloaded: h1:Ufw4aDz9RqH1RVblx2W9L9Uv5vSX5apbX5+peR7LQ5k=
        sum.golang.org: h1:pMQ1/XpSgnWx3ro4y1xr/uA3jXUsTuAaU3Dm0JjwggE=

SECURITY ERROR
This download does NOT match the one reported by the checksum server.
The bits may have been replaced on the origin server, or an attacker may
have intercepted the download attempt.

For more information, see 'go help module-auth'.

Thanks for reporting this issue!
It seems that there are similar problems here: https://github.com/panjf2000/ants/issues/49

Yeah, but the suggested workaround  on that issue doesn't work for me

I did a test in go 1.13. Unfortunately, there is no recurring problem. https://asciinema.org/a/EfcpIz2uIJV89wZb7xjPrdkG7
I am so confused how the problem happened. 囧rz
Have you changed GOPROXY or GOSUMDB? Or try release v0.4.0?

My bad I was trying to install the dependency from the integrated terminal of IntelliJ and for some reason the IDE sets the GOPROXY  to "direct" into env variables, problem solved, thanks for the support!


Move Changelog to GitHub Releases

I will need to manually rebuild the changelog for commits before this change (tag resolution glitches), but it should work just fine for all further releases


Info on doing update and json config file

Hi , i need to know if we do the update of the firmware via the update button of wifimanager or via our ota process via LTE4 , we will loose the json config file saved into spiffs ?

SPIFF is where code gets stored so I think you will loose the data in that case.


Prosopo grant application

Project Abstract

Please provide a brief description of your project here summarising key points (1-2 paragraphs).

Prosopo is a human verification marketplace designed to help human blockchain users prove their humanness whilst remaining anonymous. Under the Prosopo model, Providers supply the market with captchas and are rated by their ability to prevent bots and permit humans. Distributed Apps (DApps) implement captchas as part of their contract interaction flow and their users receive reputation points for completing them. User reputation scores are stored on-chain and accessible to all Polkadot Dapps, for the benefit of the ecosystem.

If your application is a follow-up to a previous grant, please mention which one in the first line of the abstract and include a link to previous pull requests if applicable.

For which grant level are you applying?

[ ] Level 1:  Up to $10,000, 2 approvals
[x] Level 2:  Up to $50,000, 3 approvals
[ ] Level 3:  Unlimited, 5 approvals (for > $100k Web3 Foundation Council approval)

Application Checklist

[x] The application template has been copied, renamed ( project_name.md) and updated.
[x] A BTC or Ethereum (DAI/USDT) address for the payment of the milestones is provided inside the application.
[x] I have read and acknowledged the terms and conditions.
[x] The software delivered for this grant will be released under an open-source license specified in the application.
[x] The initial PR contains only one commit (squash and force-push if needed).
[x] The grant will only be announced once the first milestone has been accepted.

Hi @Noc2 @mmagician and @gautamdhameja, we wanted to let you know that it has taken longer than anticipated to hire the second FTE developer for our project - presumably because the blockchain space is going crazy at the moment. We have been making progress on development, which you can check in our repos, but wondered if we could request a 4 week extension to the dates? This would mean that Milestone 1 was due at approximately 25 Jan 2022 (16 Nov 2021 + 10 weeks, 4 weeks having passed since approval). Is this ok with you guys?

Yeah sure, thanks for the heads up. You can submit an amendment to the original contract if you wish, but given that you've provided us with an update and it seems the delay is under control, it's not strictly necessary.

Hi @Noc2 @mmagician and @gautamdhameja, I wanted to give a quick update that we expect to be on schedule for the coming MS1 delivery. I also wanted to ask you, thinking ahead somewhat; once the DCaptcha is finished, it obviously needs providers willing to provide this service. Would you have any suggestions on where/how to find these in the polkadot ecosystem? Would it possibly also make sense for us to apply to the Builders Programme and would they possibly be able to advise us on this as well?

Thanks for the update, @Gimly-Caspar. Glad to hear you are making progress. I will check with the colleagues from the Builders program to see what they think.

Hey @Gimly-Caspar of course you can apply to the SBP! In fact, one of the benefits of finish a Level 2 W3F Grant is that you get your application fast-tracked into the SBP. Just bear in mind that the SBP is designed to help teams develop their projects, starting from an MVP/POC all the way to a full fleshed out product.
What you're aiming for here sounds very interesting. In the meantime, if I can help with anything trying to get different teams to test our your solution, please do let me know. Happy to help out in that regard.

Thanks very much for the info @SBalaguer. We would love to make it as far as the builder's programme :)
@Noc2 @mmagician @gautamdhameja
We wanted to give you a quick status update and notification of a delay. We spent the last two week's fighting with storage deposit limit changes to polkadotjs and substrate and were lacking a key team member due to covid.
We spent the time upgrading ecosystem projects redspot and the substrate-contracts-node in an attempt to debug, creating the following PRs in the process:

https://github.com/patractlabs/redspot/pull/164 (merged)
https://github.com/patractlabs/redspot/pull/165 (merged)
https://github.com/paritytech/substrate-contracts-node/pull/24 (not merged)

We've had a new team member join us this week to help get things moving faster. However, we'd like to push the date 2 weeks from 25 Jan 2022 to 08 Feb 2022 to give us time to resolve the ongoing issues
Please let us know if this acceptable.

@forgetso This is not a problem. We usually only reach out to teams if a grant is delayed for multiple months. Thanks for the update.

@forgetso This is not a problem. We usually only reach out to teams if a grant is delayed for multiple months. Thanks for the update.

That's great. Appreciate the swift response.

Hi @Noc2 @mmagician @gautamdhameja
I've just submitted the PR for Milestone 1. Looking forward to your feedback.


Change from config.py to config.json broke all the externally-hosted models.

Before submitting your bug report

[X] I believe this is a bug. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that reports the same bug
[ ] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info
- OS:Mac OS whatever is the latest
- Continue:0.7.26

Description
There was a working installation with many models on our inference servers which had been configured in the config.py.
Given this is far from transparent, I simply copied the same config.py to all our users and they updated with their own api keys (our hosted models use api keys).
Now, it's broken.
Before we had something like this:
	GGML(
			title="Mistral helmholtz",
			model="Mistral-7B-Instruct-v0.1",
			api_key="gitlab_token",
			api_base="https://helmholtz-blablador.fz-juelich.de:8000"
		),

Now, I GUESS that something like this is similar on config.json:
    {
      "title": "Mistral helmholtz",
      "provider": "openai-aiohttp",
      "model": "Mistral-7B-Instruct-v0.1",
      "api_key": "glpat-NzVDGjV9CJLJq36Md_pY",
      "server_url": "https://helmholtz-blablador.fz-juelich.de:8000",
      "api_base=": "https://helmholtz-blablador.fz-juelich.de:8000"
    }

But what I get is:
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host localhost:8000 ssl:default [Connection refused]

To reproduce
Make a server on an inference server.
Create a connection config on config.json.
Log output
No response

This hopefully might be an easy fix. Here's what I would use in your config.json (just a couple of tweaks):
    {
      "title": "Mistral helmholtz",
      "provider": "openai-aiohttp",
      "model": "Mistral-7B-Instruct-v0.1",
      "api_key": "...",
      "api_base": "https://helmholtz-blablador.fz-juelich.de:8000"
    }

Since the issue looked like Continue was just calling the wrong URL, I do expect this would directly address the problem, but let me know how it works

Hum, seems like the pre-release version is broken. I came back to release and it works. Thanks!


Configure legacy UDs in EDA sites

This branch configures EDA sites to use the current ("legacy") version of UDs rather than VDI. Previous work duplicated the "legacy" version of the user-datasets package and named it user-datasets-legacy since VDI is being integrated into the user-datasets package.

@jernestmyers can this be merged?

@jernestmyers can this be merged?

Yes, though we may need to adjust the configs if VDI release plans change. But we can merge now and handle that minor adjustment if needed.


Not able to pass a background color as a prop to the Card Component.

We are not able to pass the background color as a prop to the Card component according to the design. So, we are unable to use the card component that we currently have.
We would like to have a feature to add background color to the card component accordingly.
As we are facing this issue with the existing card component we have built our custom code which is allowing us to add the background color.

Hi @prajani4!
First, the definition of colours, sizes, and shapes... is an intrinsic part of a design system. Since these parameters are essential for guaranteeing accessibility and a good user experience, having the ability to change them, might go frontally against the intentions of the design system. That's why we do not offer props related to the styling features of the components.
But, there are certain situations where it may be fair to change our design decisions. That's why we offer themes. Themes are custom-defined objects that allow users to override fundamental decisions of the Halstack Design System, as is your case.
Then, based on the number of decisions that can be overridden, Halstack Design System has two different theming strategies :

Opinionated theme. This theming strategy lets you change some decisions of the design system but is still opinionated about the ones we consider fundamental.
Advanced theme. This theming strategy lets you change most of the design decisions of the design system (all the design tokens), trying to be as little opinionated as possible.

About your use case, the theming strategy to use is the advanced theme. If you go to the specifications of the Card component you would see its design tokens, which can be changed throw this advanced theming strategy.

As you can see, to change the background-color of the Card you need to change it in the Box component. So, with all this information, the final code example would be:
const advancedTheme = {
  box: {
    backgroundColor: "#fabada",
  },
};

const App = () => (
  <DxcApplicationLayout>
    <DxcApplicationLayout.Main>
      <HalstackProvider advancedTheme={advancedTheme}>
        <DxcInset space="5rem">
          <DxcCard>
            <DxcInset space="1.5rem">
              <DxcFlex direction="column" gap="0.5rem">
                <DxcHeading text="Title" level={3} />
                <DxcParagraph>
                  Lorem ipsum dolor sit amet, consectetur adipiscing elit. Donec
                  maximus, metus ac iaculis lacinia, urna tellus efficitur
                  dolor, nec iaculis eros quam at ex.
                </DxcParagraph>
              </DxcFlex>
            </DxcInset>
          </DxcCard>
        </DxcInset>
      </HalstackProvider>
    </DxcApplicationLayout.Main>
  </DxcApplicationLayout>
);

For more information, please, check this:

The complete explanation of theming with examples of each possible strategy: https://developer.dxc.com/halstack/next/principles/themes/
Advanced theme generator: https://developer.dxc.com/halstack/next/theme-generator/advanced-theme/

Hello, The current DxcCard that we have is taking more space around the content inside the card. So, Is there any way to re-size the DxcCard according to the content we provide?
Please find the image below:

Hello @GomezIvann
Can we have an update on the above concern?

It has been some time since this issue was opened. Since no further comment has been made, we consider it answered and resolved. Thanks!


Better File checks.

Currently the file checking is not robust and allows short exp. and bad files to pass. May tie into SCREAMS file checking algorithm.

Fixed by adding exp-time greater than 1.85 and does not fail with bad files. Just skips.


MALA doesn't work with dictionary inputs

I apologize if I'm misunderstanding how the interface is supposed to work, but I tried the quickstart example using blackjax.mala instead of NUTS and I get the following error (blackjax version is 0.7.0).
File .../blackjax/mcmc/mala.py:65, in kernel.<locals>.transition_probability(state, new_state, step_size)
     63 def transition_probability(state, new_state, step_size):
     64     """Transition probability to go from `state` to `new_state`"""
---> 65     theta = new_state.position - state.position - step_size * state.logprob_grad
     66     return -0.25 * (1.0 / step_size) * jnp.dot(theta, theta)

TypeError: unsupported operand type(s) for -: 'dict' and 'dict'

The code to reproduce this is pasted below (it is essentially just the quickstart example in the README). Note that if I set initial_position to an array jax.numpy.array([1., 2.]) and modify the log probability function appropriately it seems to work. It would be nice if I could sample using MALA from a function that takes dict inputs.
import jax
import jax.numpy as jnp
import jax.scipy.stats as stats
import numpy as np

import blackjax

observed = np.random.normal(10, 20, size=1_000)
def logprob_fn(x):
  logpdf = stats.norm.logpdf(observed, x["loc"], x["scale"])
  return jnp.sum(logpdf)

# Build the kernel
step_size = 1e-3
mala = blackjax.mala(logprob_fn, step_size)

# Initialize the state
initial_position = {"loc": 1., "scale": 2.}
state = mala.init(initial_position)

# Iterate
rng_key = jax.random.PRNGKey(0)
for _ in range(100):
    _, rng_key = jax.random.split(rng_key)
    state, _ = mala.step(rng_key, state)

Thank you for opening an issue. The code indeed does not work for general PyTrees, but luckily it won't be difficult to fix.

The PR above should solve the issue. It looks like you will need to use a smaller step size however.


Do not toggle labels when the label to add is already set.

This prevents sending consecutive events saying "Added dco/yes, removed dco/no".
Signed-off-by: David Calavera<EMAIL_ADDRESS>

\o/


fix: don't show empty doc for lsp

Don't show empty docs.
This actually led to an error in the float module since we tried rendering a float of width 0

Thsnk you!


Kmers.jl

so I just found out about this neat in-development Kmers.jl package. It has this Kmer type, a very intricate type ecosystem, and fancy functions.
I did a microbenchmark on a k-mer counting vector function thing and the implementation was orders of magnitude slower than my implementation that looks at the data of the sequence directly.
function count_kmers2(seq::LongDNA{2}, k::Integer)
    kcv = KmerCountVector{4, k}()
    counts = kcv.counts
    for (i, kmer) in EveryKmer(seq, Val{k}())
        counts[kmer.data[1] + one(UInt)] += 1
    end
    kcv
end

Moreover, vectorized k-mer counting can only easily be done directly with Kmers.jl with 2-bits/base sequences, cause of how the data is stored when we allow for ambig nucs (4 bits/base). for my own implementation of vectorized k-mer counting on LongDNA{4}, I solve this by calling trailing_zeros on every 4 bits in the data vector, to get the 2-bit representations of each base (this also disambiguates the base to the first possible base in the order A, C, G, T). if this was done on 4-bits/base DNAKmers, it'd just be a sh*tshow really. a sliding window is the way to go. these Kmer thingies can probably be used for a generalized functional that applies to all BioSequences though. but i'm still not sure how to handle ambig sequences...
sorry about poorly structuring this issue. just wanted to get my thoughts out there. may also have f'd up the grammar, spelling, and capitalization a bit. heh.

Hey Anton,
Thanks for working on this package! There's been some discussion regarding  Kmers.jl in Discourse and Slack (would be nice if you could join and and help to improve the bioinformatics community), anyways the summary is that the package is still unfinished, but there is now a work in progress to finish it. My guess is that any discussion hopefully will be fruitful!


Mark Route53 as a supported service

Technically this is not true until we deploy prod?

Technically this is not true until we deploy prod?

We can wait 'til then, I suppose? But it's a weird grey area. Anyone that checks out the code and runs yarn docker-compose is gonna get Route53 support.


need help extending mongodb

Hi, I'm trying to give the patch method an append functionality. I first get the data by id and check if it has type === "cost_chart". If so, I append value and call _super.patch. My problem is probably lack of js knowledge, that said, here is what I tried
  //uberproto extend
  ChartMongoDB = mongodb.Service.extend({
    patch: function(id, data, params, callback) {
      // I don't know how to call this._super inside the next function. This is what I tried without success
      var outer;
      outer = this;
      return this.collection.findById(id, params.query || {}, function(error, val) {
        var i, j, ref;
        console.log(outer); // at this point, outer._super is `undefined`
        if (error) {
          outer(id, data, params, callback);
        }
        // I only append if `cost_chart`
        if ((val != null ? val.type : void 0) === 'cost_chart') {
          // value should be a nested array
          for (i = j = 0, ref = data.value.length - 1; 0 <= ref ? j <= ref : j >= ref; i = 0 <= ref ? ++j : --j) {
            console.log(i, val.value[i], data.value[i]);
            val.value[i] = val.value[i].concat(data.value[i]);
          }
          data.value = val.value;
          console.log('there', data); // right here I got exactly what I wanted, but how call _super with this new data?
        }
        return outer._super(id, data, params, callback);  // I got _super is not a function error
      });
    }
  });

If you read till this point first thank you and second do you have an idea on how to solve that problem?

I also tried this itself instead of creating that outer variable.

I think storing a bound reference to _super before should solve your problem. Try this:
//uberproto extend
  ChartMongoDB = mongodb.Service.extend({
    patch: function(id, data, params, callback) {
      // I don't know how to call this._super inside the next function. This is what I tried without success
      var outer = this;
      var _super = this._super.bind(this);

      return this.collection.findById(id, params.query || {}, function(error, val) {
        var i, j, ref;
        console.log(outer); // at this point, outer._super is `undefined`
        if (error) {
          outer(id, data, params, callback);
        }
        // I only append if `cost_chart`
        if ((val != null ? val.type : void 0) === 'cost_chart') {
          // value should be a nested array
          for (i = j = 0, ref = data.value.length - 1; 0 <= ref ? j <= ref : j >= ref; i = 0 <= ref ? ++j : --j) {
            console.log(i, val.value[i], data.value[i]);
            val.value[i] = val.value[i].concat(data.value[i]);
          }
          data.value = val.value;
          console.log('there', data); // right here I got exactly what I wanted, but how call _super with this new data?
        }
        return _super(id, data, params, callback);  // I got _super is not a function error
      });
    }
  });

Thanks a lot @daffl it did solve my problem


Adjusting docs

Adjusting docs to account for the new combined action.
Preview

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (86cf40f) 78.88% compared to head (5e85c04) 78.37%.
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #716      +/-   ##
==========================================
- Coverage   78.88%   78.37%   -0.52%
==========================================
  Files          85       85
  Lines        6035     6035
==========================================
- Hits         4761     4730      -31
- Misses       1068     1098      +30
- Partials      206      207       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Need updated repository information.

@another-rex Thanks for the new url. I have accepted the changes and used the new url in the other two spots you mentioned.
I'm not sure what is going on with the prettier check, I thought it would specify a line that was failing, but it doesn't. Otherwise I think this is ready.

Now Prettier will be unhappy about the final line ending - I tried to craft my suggestion to keep the right number of line endings, but not surprised it didn't work.
Best to run npx prettier --write docs/github-action.md and commit the result

@another-rex @G-Rath thank you both!


nvim-treesitter removed TS groups

https://github.com/nvim-treesitter/nvim-treesitter/pull/3656

https://github.com/Trard/tressty.nvim/commit/d9c6dedf558e5788f468b3644d9997e4224e7210


Encrypt passwords in config files (ETL-3148)

All password in config files should now be in the format of ENC(.*).
Also there should be a file containing the encryption key, in order to decrypt the passwords in the config files.

@chavdar please review. Thanks.

@chavdar updated. Replaced PasswordUtils with PasswordManager, which caches instances, and supports both encrypted and plain password.

We also need a simple command line tool that can encrypt/decrypt a password given a master password.

@chavdar updated. Added command line tool CLIPasswordEncryptor. After building gobblin there will be a gobblin-utility.tar.gz file in build/gobblin-utility/distributions. Unzip it and there will be a runnable jar.


Add external-ip annotation for ingress

Allow overriding the IP addresses used for ingress DNS records by
specifying an annotation.  This is intended to allow use with
keepalived-vip or other external (non-DNS) mechanisms for handling
failover between ingress instances.
This addresses #307.

/assign linki

This kind of conflicts with #285

I missed that PR.  I'll take a look at it and probably close this PR.

Closing in favor of #312.


Explore ways to generate a local archive of sites

It would be great if these could be exported in a helpful way to ensure users don't feel locked in.

Certainly not required for a v1. Putting into future.


Use GPTQModel for GPTQ quantization: 2x faster + better PPL

Great to see the HQQ team taking calibration-less quantization to the next level. The results are quite amazing and I can't wait to test it out.
However, using unoptimized GPTQ code for quantization and showing a 50x decrease in speed vs HQQ is inaccurate.  There are many toggles for GPTQ quant and GPTQModel, in my humble opinion, is the most efficient (in terms of speed and quality) tool for GPTQ quantization.
I can help since I have quantized hundreds of GPTQ models and full maintainer at GPTQModel and part-time maintainer at AutoGPTQ.
This is different from gptq_demo.py as it uses GPTQModel (instead of AutoGPTQ) to more efficiently quantize to GPTQ format while at the same creating a higher quality quant.
Diff vs AutoGPTQ code:

Batching
Bloat/Refractor: Pass dataset as simple str: no need for complicated and often incorrect tokenization/attention mask code
desc_act set to True (Using  GPTQModel default)
damp set to 0.005 instead of 0.01 (I never understood why 0.01 is used as default. I like to use as small value as possible)
change max_tokens to max_length (str length) for dataset filtering.

Result of this code on A100 80GB: PPL = 5.3972, Quantization Time (10m quant + 2m pack):  721 seconds. Roughly 2x faster than what HQQ is reporting on same A100 GPU with slightly lower PPL. Onpar with AWQ in terms of quantization speed. Cpu is Zen3 at 3.9Ghz.
Note: I made sure the code is as simple and as close to the original gptq demo as close as possible. Using C4 for calibration may not result in the best nor the current params. Quantization is hard and PPL score is only a rough indicator of how the model may perform. We have seen "good" PPL quants behave badly.
This code may not even be fastest code for a comparable GPTQ quant. Tweaking batching values, depending on gpu, may yield even more speed increases.

Hi @Qubitium , thanks a lot for the effort!
Note that the benchmark was done a little less than a year ago,  we used what was available at the time. The main problem I would say with GPTQ is the overfitting. So normally, you'll need to use a much larger calibration set to reduce overfitting, and that will actually make the calibration process even slower. You'll see this kind of problems with models that are difficult to quantize like Llama3-8B-Instruct.

@mobicham I think if the calib data is not extensive and not covering majority of tokens (callib of only English but model is multilingual) may have detrimental issues with overfitting.  Microsoft did a recent study about how how quants lke GPTQ are killing performance of non-primary (English) input/output. My response to them is that they maybe just quantization with a bad calib data. Quantizatin with calibration data is hard and there is where I see HGG has a huge impact. Especial for the multi-modal models where good calibration data is even harder to come by.
Also Intel is doing lots of quant research and they are very much against using PPL as judge of post-quant quality.
Btw, for this PR code base, if you do the following:

double size the max_length from 512 to 1024
reduce batch_size from 64 to 32

We get even faster quant time. 600s  and even lower PPL: 5.3776. Now faster and better than AWQ.


Crawl and fetch only resources with content-type

Hi.
Firstly this is awesome.  I am working on a small project and would like to use this package to only crawl and fetch html files, more specifically with content type text/html.
Is it possible to do this with this package?

It's indeed possible. Please refer to the docs. You want to edit the crawler properties supportedMimeTypes and downloadUnsupported :+1:


may help me? some one has this problem.

set <meta http-equiv="X-UA-Compatible" content="IE=EmulateIE7"  />, cannot open ws connection with any error.

But after I open the IE console devtool, realod the page, can open ws connection.

        self.__createTask = null;
        WebSocket.__flash.create(
            self.__id, url, protocols, proxyHost || null, proxyPort || 0, headers || null);

            alert('execute here'); // debugge the code ,not execute here
      });


v3.0.19 - backing up PHP 8.0

the script appears to have to stop multiple packages, however it only lists the name of one of the dependent packages, the others it does not list the names
there is also a typo, you have "dependant" when it should be "dependent"
root@DS-920_spare:/volume3/volume3_share# bash syno_app_mover.sh
Synology_app_mover v3.0.19
DS920+ DSM 7.2.1-69057-4

Running from: /volume3/volume3_share/syno_app_mover.sh

1) Move
2) Backup
3) Restore
Select the mode: 2
You selected Backup

Backup path is: /volume3/volume3_share/backup_before_move

[Installed package list]
***i truncated for brevity****
Select the package to backup: 44
You selected PHP 8.0 in /volume1

Destination volume is /volume3

Ready to Backup PHP 8.0 to /volume3/volume3_share/backup_before_move? [y/n]
y

Stopping dependant packages
Stopping IDrive
Stopping
Stopping
Stopping
Stopping

Stopping PHP 8.0

Backing up<EMAIL_ADDRESS>Backing up<EMAIL_ADDRESS>Backing up<EMAIL_ADDRESS>Backing up<EMAIL_ADDRESS>Backing up<EMAIL_ADDRESS>Backing up<EMAIL_ADDRESS>
Starting PHP 8.0

Starting dependant packages
Starting IDrive
Starting
Starting
Starting
Starting

Finished backing up PHP 8.0

there is also a typo, you have "dependant" when it should be "dependent"

There was 17 "dependant" typos. I had functions, arrays and variables with "dependant" in their name!
I'm not sure what my recent changes have broken. Stopping dependent packages used to show their names. I'll install some apps that need php do some tests.

I don't have any apps installed that depend on PHP 8.0
Can you tell me what the following command returns:
for p in /var/packages/*; do d=$(synogetkeyvalue "$p/INFO" install_dep_packages) && [ -n "$d" ] && echo "$(basename "$p") : $d"; done

v3.0.22 released

Fixed blank dependent package names if their INFO file has no displayname set.


Deploy + export AuctionProxy

Pull Request Test Coverage Report for Build 7183

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 7175:
0.0%

Covered Lines:
1279

Relevant Lines:
1279

💛  - Coveralls


[e2e]: generic tag branch1 default slsa3

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.488
Run: https://github.com/slsa-framework/example-package/actions/runs/6463945893
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.488
Date: Tue Oct 10 02:27:37 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.489
Run: https://github.com/slsa-framework/example-package/actions/runs/6477187873
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.489
Date: Wed Oct 11 02:27:53 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.490
Run: https://github.com/slsa-framework/example-package/actions/runs/6490460147
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.490
Date: Thu Oct 12 02:26:14 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.491
Run: https://github.com/slsa-framework/example-package/actions/runs/6503270177
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.491
Date: Fri Oct 13 02:32:28 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.492
Run: https://github.com/slsa-framework/example-package/actions/runs/6514999376
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.492
Date: Sat Oct 14 02:25:20 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.493
Run: https://github.com/slsa-framework/example-package/actions/runs/6521440620
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.493
Date: Sun Oct 15 02:30:27 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.494
Run: https://github.com/slsa-framework/example-package/actions/runs/6528230029
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.494
Date: Mon Oct 16 02:30:41 UTC 2023

Repo: https://github.com/slsa-framework/example-package/tree/v22.0.495
Run: https://github.com/slsa-framework/example-package/actions/runs/6541726452
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.generic.tag.branch1.default.slsa3.yml
Trigger: push
Branch: v22.0.495
Date: Tue Oct 17 02:55:41 UTC 2023
Tests are passing now. Closing this issue.


Automatic docs building messes up Mime types

When the docs are automatically built by travis, the mime-type of _static/css/theme.css is set to text/plain when it should be set to text/css. When I run the same load command
s3cmd -M -H sync docs/_build/ s3://deepchem.io/

on my laptop as I run on travis, the mime-type is set correctly. This is really strange the same command succeeds/fails in different environments. @rmcgibbo: Do you have any thoughts? I remember your mentioning something about mime-types for mdtraj.

I think there are some options to s3cmd about guessing the mime types.

You probably just have to fiddle with it. :(

I think that deepchem is going to use manual docs-building (fiddling with this issue sucked up a lot of time, and I don't think it's worth the hassle).


CustomRequirement %count% feature

What does your feature do?
QuestsAPI into CustomRequirement adding a option %count%.
How would people use it?
Adding Custom RPG Level requirements for plugin could be "RPGLevel: %count%"
Then rather just being "RPGLevel Requirement"

While a CustomRequirement doesn't guarantee a numeric count like a CustomObjective, it should still permit you to use string prompt titles as variables (see %Title% in the Rewards API example, or %Item Name% in Objectives API example 2). Let me know if this does not satisfy this issue.

While a CustomRequirement doesn't guarantee a numeric count like a CustomObjective, it should still permit you to use string prompt titles as variables (see %Title% in the Rewards API example, or %Item Name% in Objectives API example 2). Let me know if this does not satisfy this issue.


How to make chatbot do some tasks when asked a question(chatterbot)

I used chatterbot Api to create a chatbot. I was able to fetch data from a excel sheet and display it. But how to display an output (excel values and calculations done using excel values) when a question is asked? Normally we feed the question and answers. I need to get the results from excel file as an answer to a question to chatbot.
import xlrd  #import excel reader

from chatterbot import ChatBot
chatbot = ChatBot(
    'Charlie',
    storage_adapter='chatterbot.storage.SQLStorageAdapter',
    logic_adapters=[
        {
            "import_path": "chatterbot.logic.BestMatch"
        },
        {
            'import_path': 'chatterbot.logic.SpecificResponseAdapter',
            'input_text': 'Help me!',
            'output_text': 'Ok, here is a link: http://chatterbot.rtfd.org'
        },
        {
            'import_path': 'chatterbot.logic.LowConfidenceAdapter',
            'threshold': 0.65,
            'default_response': 'I am sorry, but I do not understand.'
        }
    ],
    trainer='chatterbot.trainers.ListTrainer'
)

#opening Excel
workbook = xlrd.open_workbook('D:\\chatbot\\Book1.xlsx')

#opening sheet
worksheet = workbook.sheet_by_name('Sheet2')

#for-loop for iteration
for row_idx in range(0, worksheet.nrows):
    #print ('-'*40)
    #print ('Row: %s' % row_idx)
    #for col_idx in range(0, worksheet.ncols):
    #    cell_obj = worksheet.cell(row_idx, col_idx).value
    #    print ('Column: [%s] cell_obj: [%s]' %(col_idx, cell_obj))
    ques=worksheet.cell(row_idx, 0).value
    ans=worksheet.cell(row_idx, 1).value
    chatbot.train([ques,ans])
response = chatbot.get_response('I would like to book a flight.')
print(response)

Did you treid pandas if you are dealing MS excel files it's worth, May be this reference will provide some information https://plot.ly/pandas/intro-to-pandas-tutorial/

Thanks for the reply. I'm able to read and write data. But my question is, how to output values from an excel file as an answer when a question is asked to chatbot? For example, assume I have a column called "cost" which contains several values. Of I ask chatbot 'what is the total cost?' it should give answer as the total cost. It's not about reading and writing, but it's about displaying values from a chatbot.
Regards.

@jithinolickal i did a workaround on this by building a hub method witch detect the "serviceable" requests from chatbot response:
example:

train bot with: ['what is total cost?', 'call totalcost()']
receive client side request
before reply with bot response, analyse it for 'call' responses
if the bot response is a call, then call the method and send method response back

@vkosuri @gunthercox , would be nice if Chatterbot have some sort of "call function logic adapter" to handle this from inside, like chatterbot.logic.specific_response but with a function output, instead of text.


enhancement ideas

got this nice list of enhancement ideas from @claudiug. I will try to go through the list when I have time, but @anyone please feel free to pick tasks ;-)

[x] will be great if we have some breadcrumb so we always know where we are.
[ ] http://tour.dlang.io/  —> does not have the dformat
[ ] http://tour.dlang.io/tour/en/basics/imports-and-modules  —> will great adagio if you will add comparasion with python module system OR d programming book chapter
[ ] http://tour.dlang.io/tour/en/basics/basic-types —< more information about d indexes.
[ ] http://tour.dlang.io/tour/en/basics/memory —> more information, when we should use pointers and when not.
[ ] http://tour.dlang.io/tour/en/basics/storage-classes —>  what is a storage class? When I should use it and why?.
[ ] http://tour.dlang.io/tour/en/basics/functions —> maybe here some information about variadic functions
[ ] http://tour.dlang.io/tour/en/basics/structs —> maybe example from here are more clear (https://developer.apple.com/library/ios/documentation/Swift/Conceptual/Swift_Programming_Language/ClassesAndStructures.html)
[ ] http://tour.dlang.io/tour/en/basics/slices  T[] —> maybe is to early for templates :) If slice and dynamic arrays are the same. what I should use?
[ ] http://tour.dlang.io/tour/en/basics/alias-strings —>more information about alias and maybe more from string reference library
[ ] http://tour.dlang.io/tour/en/basics/foreach —>also foreach_reverse here
[ ] http://tour.dlang.io/tour/en/basics/ranges —> more information about ranges. There is a small about of information here
[ ] http://tour.dlang.io/tour/en/basics/associative-arrays —> also here maybe similar stuff as in ruby hash and even more details from std library
[ ] http://tour.dlang.io/tour/en/basics/classes —> why and when we should pick classes over struct
[ ] http://tour.dlang.io/tour/en/basics/interfaces —> NVI - non virtual interface more details here
[ ] http://tour.dlang.io/tour/en/basics/delegates  —> is about delegate pattern here, maybe example from swift delegate pattern documentation :)
[ ] http://tour.dlang.io/tour/en/gems/uniform-function-call-syntax-ufcs —> why I should use this feature. what are the benefits?
[ ] http://tour.dlang.io/tour/en/gems/unittesting  —> more example here of testing. why we should do it. dlang idioms of do it.
[ ] http://tour.dlang.io/tour/en/gems/contract-programming found this chapter quite nice. but will be nice to have more details
[ ] http://tour.dlang.io/tour/en/gems/template-meta-programming —> for a ruby/java guy this looks complicated

As we have to discuss some of the issues, I opened them as single ones. Sorry for the noise.


Prototypes at top of file fail when functions use custom types

ino's preprocessor places function prototypes at the very top of the file, right below the includes. This means that any function that returns a custom type (struct, typedef, etc.) defined lower in the file will fail to compile due to the type being undefined at the prototype declaration. It also pays no attention to whether the prototypes have been manually added, resulting in multiple declarations in cases when they have been.

This is an Arduino IDE feature, see #224 for solution.


Latest liqwid-nix

This uses the latest liqwid-nix. A little fiddling with the flakefile was required to make it behave.

Need formatting!


Hazelcast Evaluation

Evaluate if Hazelcast [1] can be used for our purposes.
[1] http://www.hazelcast.com/

Preliminary Evaluation:

Hazelcast has a nice API
Documentation is lacking detail and context sometimes.
Easy to set up instances locally, somewhat more difficult for remote nodes.
Programmatic configuration possible.
Remote executor service seems to work well.

What is missing:

Does not seem to deploy classes to nodes. Libraries need to be deployed manually in node classpath.
What kind of management/statistics interface is available?


BUG: Missing id_field on values

Codecov Report
Base: 90.47% // Head: 90.52% // Increases project coverage by +0.05% :tada:

Coverage data is based on head (2087bcb) compared to base (f96fdc9).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master      #37      +/-   ##
==========================================
+ Coverage   90.47%   90.52%   +0.05%
==========================================
  Files          18       16       -2
  Lines        1029     1024       -5
==========================================
- Hits          931      927       -4
+ Misses         98       97       -1

Impacted Files
Coverage Δ

redbird/base.py
88.46% <100.00%> (ø)

redbird/__init__.py

redbird/logging/__init__.py

redbird/repos/sqlalchemy.py
95.17% <0.00%> (+0.03%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


As pycrypto is deprecated added its alternative pycrypto

As pycrypto is deprecated added its alternative pycryptodome.

@laodouya Merge it as soon as possible

**@laodouya  please update pypi package **
It gives error for pycrypto.


DB Full-Text search bug in new version

System information:

Operating system (distribution) and version: MS Win 11 Pro
DBeaver version: <IP_ADDRESS>207091909

Connection specification:

Database name and version: Oracle 11g
Driver name: Oracle
Do you use tunnels or proxies (SSH, SOCKS, etc)? : no

Describe the problem you're observing:
I noticed two problems after installing the latest version of DBeaver:

When trying to mark the objects in which want to search, there is no checkBox and cannot see which objects is (un)marked.
If I don't mark the objects and search through the entire database, I get an error (picture attached)

Hello @PliusMinus
Thanks for the bug report.
Now Full-text Search looks like Metadata Search, and we think it is better.
You can use Ctrl to select several objects at once.

Thanks for explanation.
It is better if I want to mark only one or several schemas. But I have many dozens of schemas and I want only few schemas to skip - in this case it is not better.

And what about Shift on all schemas and then Ctrl on these schemas, which you want to skip?

The bug is still not fixed, so I reopened this issue to fix the bug.