CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF

I agree to the following

[X] I have read the documentation right now
[X] I have read the FAQs right now
[X] I am aware of the latest release notes
[X] The Backend (CCU/Homegear/...) is working as expected and connected devices are controllable by its own UI.
[X] I am running the latest version of the custom_component (and Home Assistant)

The problem
Thermostats are no longer available in the Home Assistant overview and in the RaspberryMatic.

What version of HomematicIP (local) has the issue?
1.33.0
What was the last working version of HomematicIP (local)?
1.52.0
What type of installation are you running?
Home Assistant OS
What type of installation are you running for your homematic backend?
RaspberryMatic Standalone
Which version of your homematic backend are you running?
<IP_ADDRESS>31130
What hardware are you running for your system?
Pi4
Which config details do you use

[X] Username and password
[ ] TLS
[ ] callback data (see)

Which interfaces do you use?

[X] Homematic IP
[X] Homematic (Bidcos-RF)
[ ] Groups (Heating-Group)
[ ] BidCos-Wired (HM-Wired)

Diagnostics information
{
"home_assistant": {
"installation_type": "Home Assistant OS",
"version": "2024.1.2",
"dev": false,
"hassio": true,
"virtualenv": false,
"python_version": "3.11.6",
"docker": true,
"arch": "aarch64",
"timezone": "Europe/Berlin",
"os_name": "Linux",
"os_version": "6.1.63-haos-raspi",
"supervisor": "2023.12.0",
"host_os": "Home Assistant OS 11.4",
"docker_version": "24.0.7",
"chassis": "embedded",
"run_as_root": true
},
"custom_components": {
"hacs": {
"version": "1.33.0",
"requirements": [
"aiogithubapi>=22.10.1"
]
},
"alphaess": {
"version": "0.4.7",
"requirements": [
"alphaessopenapi==0.0.6"
]
},
"homematicip_local": {
"version": "1.53.0",
"requirements": [
"hahomematic==2024.1.5"
]
}
},
"integration_manifest": {
"domain": "homematicip_local",
"name": "Homematic(IP) Local",
"codeowners": [
"@danielperna84",
"@SukramJ"
],
"config_flow": true,
"dependencies": [],
"documentation": "https://github.com/danielperna84/custom_homematic",
"homekit": {},
"integration_type": "hub",
"iot_class": "local_push",
"issue_tracker": "https://github.com/danielperna84/hahomematic/issues",
"loggers": [
"hahomematic"
],
"requirements": [
"hahomematic==2024.1.5"
],
"ssdp": [
{
"manufacturer": "EQ3",
"manufacturerURL": "http://www.homematic.com"
}
],
"version": "1.53.0",
"zeroconf": [],
"is_built_in": false
},
"data": {
"config": {
"entry_id": "f3487de13fd1038b07de9939f94a7d7c",
"version": 2,
"minor_version": 1,
"domain": "homematicip_local",
"title": "RaspberryMatic",
"data": {
"instance_name": "RaspberryMatic",
"host": "de838cd8-raspberrymatic",
"username": "REDACTED",
"password": "REDACTED",
"tls": false,
"verify_tls": false,
"callback_host": null,
"callback_port": null,
"json_port": null,
"interface": {
"HmIP-RF": {
"port": 2010
},
"BidCos-RF": {
"port": 2001
},
"VirtualDevices": {
"port": 9292,
"path": "/groups"
}
},
"enable_system_notifications": true
},
"options": {},
"pref_disable_new_entities": false,
"pref_disable_polling": false,
"source": "user",
"unique_id": "1D89B554CC",
"disabled_by": null
},
"platform_stats": {},
"devices": [],
"system_information": {
"available_interfaces": [
"VirtualDevices"
],
"auth_enabled": true,
"https_redirect_enabled": false,
"serial": "REDACTED"
}
}
}
Anything in the logs that might be useful for us? The log (full log) is the best source to support trouble shooting!
Mounting /data as /usr/local (Home Assistant Add-On): OK
Starting watchdog...
Identifying host system: Raspberry Pi 4 Model B Rev 1.1 (oci), OK
Initializing RTC Clock: no hardware found
Running sysctl: OK
Checking for Factory Reset: not required
Checking for Backup Restore: not required
Running seedrng: OK
Initializing System: OK
Setup ca-certificates: OK
Starting logging: OK
Init onboard LEDs: init, OK
Starting irqbalance: OK
Starting iptables: OK
Starting network: eth0: link up, fixed, firewall, inet up, <IP_ADDRESS>, OK
Identifying Homematic RF-Hardware: HmRF: n/a, HmIP: n/a, OK
Updating Homematic RF-Hardware: no GPIO/USB connected RF-hardware found
Starting hs485dLoader: disabled
Starting xinetd: OK
Starting eq3configd: OK
Starting lighttpd: OK
Starting ser2net: disabled
Starting ssdpd: OK
Starting ha-proxy: OK
Starting NUT services: disabled
Initializing Third-Party Addons: OK
Starting LGWFirmwareUpdate: ...OK
Setting LAN Gateway keys: OK
Starting hs485d: disabled
Starting multimacd: not required
Starting rfd: no BidCos-RF hardware found
Starting HMIPServer: .........OK
Starting ReGaHss: .OK
Starting CloudMatic: OK
Starting NeoServer: disabled
Starting Third-Party Addons: OK
Starting crond: OK
Setup onboard LEDs: booted, OK
Finished Boot: <IP_ADDRESS>31130 (raspmatic_oci_arm64)

Additional information
Home Assistant Core
CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
18:24:42 – (WARNUNG) runner.py - Die Nachricht ist zum ersten Mal am 17:18:28 aufgetreten und erscheint 768 mal
Subscription to <IP_ADDRESS> failed, attempting to poll directly
17:19:26 – (WARNUNG) Sonos
No configuration for request_sync available
17:19:14 – (FEHLER) Google Assistant
Waiting on integrations to complete setup: synology_dsm
17:19:10 – (WARNUNG) bootstrap.py
ENERGY_KILO_WATT_HOUR was used from alphaess, this is a deprecated constant which will be removed in HA Core 2025.1. Use UnitOfEnergy.KILO_WATT_HOUR instead, please create a bug report at https://github.com/CharlesGillanders/homeassistant-alphaESS/issues
17:18:31 – (WARNUNG) helpers/deprecation.py - Die Nachricht ist zum ersten Mal am 17:18:31 aufgetreten und erscheint 2 mal
CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
17:18:28 – (WARNUNG) Homematic(IP) Local (benutzerdefinierte Integration) - Die Nachricht ist zum ersten Mal am 17:18:27 aufgetreten und erscheint 2 mal
Error while setting up mobile_app platform for sensor
17:18:27 – (FEHLER) Sensor
Error adding entities for domain sensor with platform mobile_app
17:18:27 – (FEHLER) Sensor
Host <IP_ADDRESS>:443, could not verify a working RTSP url
17:18:26 – (FEHLER) components/reolink/host.py - Die Nachricht ist zum ersten Mal am 17:18:26 aufgetreten und erscheint 2 mal
Using slower stringprep, consider compiling the faster cython/libidn one.
17:18:22 – (WARNUNG) components/harmony/data.py
Home Assistant Core
2024-01-11 17:17:54.740 WARNING (SyncWorker_4) [homeassistant.loader] We found a custom integration hacs which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2024-01-11 17:17:54.744 WARNING (SyncWorker_4) [homeassistant.loader] We found a custom integration alphaess which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2024-01-11 17:17:54.747 WARNING (SyncWorker_4) [homeassistant.loader] We found a custom integration homematicip_local which has not been tested by Home Assistant. This component might cause stability problems, be sure to disable it if you experience issues with Home Assistant
2024-01-11 17:18:22.578 WARNING (MainThread) [slixmpp.stringprep] Using slower stringprep, consider compiling the faster cython/libidn one.
2024-01-11 17:18:26.193 ERROR (MainThread) [reolink_aio.api] Host <IP_ADDRESS>:443, could not verify a working RTSP url
2024-01-11 17:18:26.422 ERROR (MainThread) [reolink_aio.api] Host <IP_ADDRESS>:443, could not verify a working RTSP url
2024-01-11 17:18:27.168 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:18:27.645 ERROR (MainThread) [homeassistant.components.sensor] Error adding entities for domain sensor with platform mobile_app
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 639, in state
numerical_value = int(value)
^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'Charging'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 642, in state
numerical_value = float(value)
^^^^^^^^^^^^
ValueError: could not convert string to float: 'Charging'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 507, in async_add_entities
await asyncio.gather(*tasks)
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 752, in _async_add_entity
await entity.add_to_platform_finish()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1278, in add_to_platform_finish
self.async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 941, in async_write_ha_state
self._async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1062, in _async_write_ha_state
state, attr, capabilities, shadowed_attr = self.__async_calculate_state()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 999, in __async_calculate_state
state = self._stringify_state(available)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 947, in _stringify_state
if (state := self.state) is None:
^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 646, in state
raise ValueError(
ValueError: Sensor sensor.carolas_iphone_battery_state has device class 'battery', state class 'None' unit 'None' and suggested precision 'None' thus indicating it has a numeric value; however, it has the non-numeric value: 'Charging' (<class 'str'>)
2024-01-11 17:18:27.673 ERROR (MainThread) [homeassistant.components.sensor] Error while setting up mobile_app platform for sensor
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 639, in state
numerical_value = int(value)
^^^^^^^^^^
ValueError: invalid literal for int() with base 10: 'Charging'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 642, in state
numerical_value = float(value)
^^^^^^^^^^^^
ValueError: could not convert string to float: 'Charging'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 368, in _async_setup_platform
await asyncio.gather(*pending)
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 507, in async_add_entities
await asyncio.gather(*tasks)
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 752, in _async_add_entity
await entity.add_to_platform_finish()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1278, in add_to_platform_finish
self.async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 941, in async_write_ha_state
self._async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1062, in _async_write_ha_state
state, attr, capabilities, shadowed_attr = self.__async_calculate_state()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 999, in __async_calculate_state
state = self._stringify_state(available)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 947, in _stringify_state
if (state := self.state) is None:
^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/components/sensor/init.py", line 646, in state
raise ValueError(
ValueError: Sensor sensor.carolas_iphone_battery_state has device class 'battery', state class 'None' unit 'None' and suggested precision 'None' thus indicating it has a numeric value; however, it has the non-numeric value: 'Charging' (<class 'str'>)
2024-01-11 17:18:28.687 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:18:28.694 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:18:28.728 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:18:29.243 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:18:31.038 WARNING (MainThread) [homeassistant.const] ENERGY_KILO_WATT_HOUR was used from alphaess, this is a deprecated constant which will be removed in HA Core 2025.1. Use UnitOfEnergy.KILO_WATT_HOUR instead, please create a bug report at https://github.com/CharlesGillanders/homeassistant-alphaESS/issues
2024-01-11 17:18:31.048 WARNING (MainThread) [homeassistant.const] POWER_WATT was used from alphaess, this is a deprecated constant which will be removed in HA Core 2025.1. Use UnitOfPower.WATT instead, please create a bug report at https://github.com/CharlesGillanders/homeassistant-alphaESS/issues
2024-01-11 17:18:44.245 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:18:44.281 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:18:44.795 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:18:59.797 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:18:59.831 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:19:00.329 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:19:10.486 WARNING (MainThread) [homeassistant.bootstrap] Waiting on integrations to complete setup: synology_dsm
2024-01-11 17:19:14.307 ERROR (MainThread) [homeassistant.components.google_assistant.http] No configuration for request_sync available
2024-01-11 17:19:15.361 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:19:15.594 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:19:26.617 WARNING (MainThread) [homeassistant.components.sonos] Subscription to <IP_ADDRESS> failed, attempting to poll directly
2024-01-11 17:19:28.602 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:19:43.604 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:19:43.634 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:19:44.195 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:19:59.196 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:19:59.228 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:19:59.841 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:20:14.843 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:20:14.877 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:20:15.398 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:20:30.400 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server RaspberryMatic
2024-01-11 17:20:30.436 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
2024-01-11 17:20:30.949 WARNING (MainThread) [hahomematic.central] CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
2024-01-11 17:20:45.950 WARNING (MainThread) [hahomematic.central] CHECK_CONNECTION failed: No clients exist. Trying to create clients for server Ra

Interface RaspberryMatic-HmIP-RF nicht erreichbar.
Keine Verbindung zu Schnittstelle RaspberryMatic-HmIP-RF.
Diese Integration versucht eine automatische Wiederverbindung.
Weitere Informationen finden Sie in den Protokolldateien von Home Assistant.
Warnung - 11.1.2024

Logger: hahomematic.central
Source: custom_components/homematicip_local/control_unit.py:123
Integration: Homematic(IP) Local (documentation, issues)
First occurred: 17:18:27 (2 occurrences)
Last logged: 17:18:28
CREATE_CLIENTS failed: No connection to interface RaspberryMatic-HmIP-RF [()]
CREATE_CLIENTS failed: No connection to interface RaspberryMatic-BidCos-RF [()]
Core
2024.1.2
Supervisor
2023.12.0
Operating System
11.4
Frontend
20240104.0

Was soll ich sagen. Die Integration kann keine Verbindung zu RaspberryMatic herstellen.
Da sind sehr viele Fehler im Log so das man den Wald vor lauter Bäumen nicht sehen kann. Bitte das nächste mal das Log als Datei anhängen.
Was hast du den bisher unternommen, um das Problem zu beseitigen. Neustarts sind immer hilfreich.

...and in the RaspberryMatic.

Die Formulierung klingt, als würde auch RaspberryMatic nicht funktionieren.

Ich habe den Home-Office Assistent mehrfach neu gestartet und auch sch komplett stromlos gemacht. Hat aber bis jetzt nichts geholfen.

Jetzt scheint es erstmal wieder zu funktionieren.  Ich hoffe das ich das nicht jedes Mal jetzt tun muss.


Cannot specify GSLB pool ratio in GSLB_Domain AS3 configuration

Environment

Application Services Version: v3.35.0
BIG-IP Version: BIG-IP <IP_ADDRESS> Build 0.0.10 Point Release 1 (VE)

Summary
When configuring GTM features via AS3, the WIP (Wide IP) configuration can be defined in GSLB_Domain object. This allows a WIP to be configured and assigned to 1 or more GSLB pools. GTM provides tiered global server load balancing where it distributes DNS name resolution requests, first to the best available pool in a wide IP, and then to the best available virtual server within that pool. This is described here: https://techdocs.f5.com/kb/en-us/products/big-ip_gtm/manuals/product/gtm-concepts-11-5-0/1.html
However, although you can specify the load balancing type in the GSLB_Domain object, you cannot actually assign any value to the pools as the object Pointer_GSLB_Pool does not accept any additional values apart from the reference to the pool object.
Compare this with object GSLB_Pool_Member_A which does allow specification of a ratio.
Steps To Reproduce
Steps to reproduce the behavior:

Build Wide IP with 2 pools for UK South and UK West:

			"example.com": {
				"class": "GSLB_Domain",
				"domainName": "wip.example.com",
				"resourceRecordType": "A",
				"poolLbMode": "ratio",
				"pools": [
					{
					"ratio": 50,
					"use": "pool-a"
					}]
				}

this uses poolLBMode option to specify ratio load balancing between pools
However, it errors as you cannot specify the ratio. Error returned is : 422 (Unprocessable Entity):

{
	"code": 422,
	"errors": [
		"/test/test/example.com/pools/0: should NOT have more than 1 properties"
	],
	"declarationFullId": "",
	"message": "declaration is invalid"
}

Checking API spec, I cannot see any way to specify the ratio in AS3:
GSLB_Domain API reference: GSLB_Domain

within this object the pools property references: array<Pointer_GSLB_Pool>
Pointer_GSLB_Pool

In this object there is no property to specify ratio, and there does not seem to be any other way of specifying it.

@antonywm specify you ratio in the members. Please see the following example https://github.com/F5Networks/f5-appsvcs-extension/issues/587

@mdditt2000  - Hi Mark there is no example in issue 587 but regardless, I don't want to specify ratio in the pool members, I want to specify ratio between the pools themselves. GTM/DNS offers this tiered load balancing feature via GUI but cannot see it within AS3.
Below is how it works in the GUI - in example you can see against my WIP I am load balancing 50/50 across 2 pools:

Adding support for a new property is a feature request, not a bug. Updating the labels.

Can I assume by this terse reply that F5 haven't implemented this key feature of GTM config in AS3? And if this is the case, why does the GSLB_Domain object have the poolLbMode property which allows you to specify the load balancing method (quote from API reference: "...Specifies the load balancing method used to select a pool in this domain") - but then rejects any value against it? Adding support for a new property is a feature request - but an existing property in the schema which isn't functioning properly....surely is a bug?

Thank you for your feedback. I have added AUTOTOOL-3141 to our internal product backlog to allow specifying a ratio value per pool member.


File ID not correct ?

It seems the file IDs provided by GOG do not work, e.g.:
gogdownloader://the_witcher/installer_win_en
would translate into:
lgogdownloader --download-file the_witcher/installer_win_en
but I get a 404 error : Found nothing in https://api.gog.com/downloader2/installer/the_witcher/installer_win_en/
Is it a bug ? an issue ? or am I just missing something ?
PS:  I use the latest 2.26 version on my ubuntu 15.04

The IDs in "installer_OS_language" format are group ids.
lgogdownloader doesn't support group ids.
You can get the individual file ids for installers with lgogdownloader --list-details ^the_witcher$
I have a general idea how the official windows downloader might be handling the group ids but I haven't actually disassembled/decompiled the downloader to see if I'm right.
I don't have any plans to add support for group ids at the moment.


Cleanup version tool and test

Pull Request Test Coverage Report for Build 409174421

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.03%) to 68.246%

Totals

Change from base Build 409102685:
-0.03%

Covered Lines:
821

Relevant Lines:
1203

💛  - Coveralls


Add tldr extension

Description

Browse tldr cheatsheets.
Type of change

New extension

Screencast
https://user-images.githubusercontent.com/17577332/141001974-34020b2d-aaf5-4524-afd3-3ebf8120aaa4.mp4
Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I checked that extension's icon has size of 512x512

Thanks, I was assuming that the supportPath existed. It should be fixed now.


  If it's an orphan inode, this trick can help.

This was half a year ago and I managed to wipe /var/lib/docker many times. Let's close.


Missing .so error on Unity sample for Android

Describe the bug
When attempting to deploy the Quickstart for Unity sample to Android, I get an "Unable to find libMicrosoft.CognitiveServices.Speech.core.so" error, despite the .so being contained in the built .apk
To Reproduce
Steps to reproduce the behavior:

Add Unity package to project (builds to Android).
Include a class using Microsoft.CognitiveServices.Speech
Build and deploy to device
Press button trigger for Cognitive Services
Error will appear in logs and services do not run.

Unity   : Unable to find libMicrosoft.CognitiveServices.Speech.core.so
Unity   : Unable to find Microsoft.CognitiveServices.Speech.core.so

Expected behavior
Cognitive services to initialize and then start a recognizer at a button press. This tutorial.
Version of the Cognitive Services Speech SDK
1.4.2
Platform, Operating System, and Programming Language

OS: Android, using SDK 26
Hardware - ARM (armeabi-v7a), Pixel 3XL
Programming language: C# in Unity

Additional context
I also receive this in the build logs:
Assembly 'Microsoft.CognitiveServices.Speech.csharp' has non matching file name: 'Microsoft.CognitiveServices.Speech.csharp.unix.dll'. This can cause build issues on some platforms.
Only the .dll/.so files under the Android folder and the .csharp.unix.dll are configured for Android

Thanks for feedback,
Could you check you have selected ARMv7 target architecture in your Unity Editor Player Settings ?
See https://docs.unity3d.com/Manual/class-PlayerSettingsAndroid.html
If that is correct, let me know what you have inside the /lib folder in .apk file you have built by extracting it locally. That should contain armeabi-v7a folder with .so files.

@jahardner - any update from your side on this?

Closing the issue, let us know if the provided information was not sufficient.

Hi,
I have the same issue. What is really strange is that my build was working at some point and now Unity says that the libMicrosoft.CognitiveServices.Speech.core.so is missing. I checked the APK and it is next to the others libraries in the lib folder.
Do you have any idea?

Hello all,
The error occured right after upgrading from Unity 2018.2.8 to Unity 2019.1.6.

Thanks for the feedback
Does the Android build work if you change scripting backend to Mono and .NET configuration to  .NET standard 2.0 ?

Hi @jhakulin ,
When we build with Mono, we get the library not found error at runtime (build is successful), when we build with IL2CPP, we get the issue I mentionned earlier.

Hi @jhakulin , @wolfma61 ,
Can we reopen this issue?

@jhakulin - can you take a look?

We have opened issue internally and identified issues when using 2019 version of Unity on Android.
With 2018 version of Unity, we do not see issue on Android.
I'll update the thread once we know more about solution with 2019 version.

Tested with 2019.1.8f1 Unity and when using Mono with Android, hello world sample below worked ok
https://github.com/Azure-Samples/cognitive-services-speech-sdk/tree/master/quickstart/csharp-unity
Could you check you have selected correct target architectures in your Unity Editor Player Settings ?
See https://docs.unity3d.com/Manual/class-PlayerSettingsAndroid.html
However with IL2CPP and 2019.1.8f1 Unity we still see the issues, we are looking on that.

Hi,
Thank you very much for looking into it. On our side, it also builds with Mono but it the library is missing at runtime.
We will test the samples today.

Hello @jhakulin,
I have tested the sample on my Android this morning, and the behaviour is strange.
My build settings : with Unity 2019.1.8

Android version : 9.0.0, Huawei P20 Pro.
Does work on the player, but when I export to Android, and inspect the logcat, the first time I click on the button, I see :

But it recognizes my speech, and print it to me.
Our problem was on the export to an Oculus App, by using Unity 2019.1.6.
I will do the same tests but with Unity 2019.1.6. Coming back with more infos.

Hi @Lasbleic
Logcat shows these error messages, but eventually Unity will find the .so, otherwise speech recognition would not work.
Related to IL2CPP build (and .NET 4.x), 2019 version of Unity do not like separate .csharp.unix.dll and build errors occur due to that. I was able to get IL2CPP .apk build done and working on Huawei P20 Pro by using following steps:

Do not reimport your project from 2018 (or 2017) version to 2019 version of Unity, but create project from scratch for 2019 version of Unity.

Reimported project was causing crashing issues on runtime in Unity side.

Remove Microsoft.CognitiveServices.Speech.core.dll and Microsoft.CognitiveServices.Speech.csharp.dll under Plugins\x86_64

NOTE: By doing this you can use the plugin only for Android

Rename Microsoft.CognitiveServices.Speech.csharp.unix.dll to Microsoft.CognitiveServices.Speech.csharp.dll
Build your app for Android with IL2CPP configuration

NOTE: Android build failed at first time to UnityEditor.BuildPlayerWindow+BuildMethodException, but second time and onwards build was successful
Also occasionally I saw "Copying assembly from xxxx failed" errors from Unity, which were resolved by doing Reimport again (Right click on Assets -> Reimport)

We will work on to update the Plugin in the coming releases.

Instead of removing SpeechSDK\Plugins\x86_64\Microsoft.CognitiveServices.Speech.csharp.dll and renaming SpeechSDK\Plugins\x86_64\Microsoft.CognitiveServices.Speech.csharp.unix.dll, (and thereby breaking the Standalone and WSA platforms) instead move SpeechSDK\Plugins\x86_64\Microsoft.CognitiveServices.Speech.csharp.unix.dll to SpeechSDK\Plugins\Android before renaming it to the last Microsoft.CognitiveServices.Speech.csharp.dll from it. That way, you can keep both versions of the DLL, it can have the same name so the Linker finds it, and the platform settings can be configured correctly.
The Unity Package for Azure Speech SDK needs to be updated to make sure that Microsoft.CognitiveServices.Speech.csharp.unix.dll file does not get output to SpeechSDK\Plugins\x86_64. It needs to go in any directory where it can have the name Microsoft.CognitiveServices.Speech.csharp.dll and not clash with the other DLLS.

Thanks, we are fixing this in the release coming out this month.

BTW, I can confirm that the SDK works on Oculus Go, from Unity 2019.2.4f1, with Managed Stripping Level set to "Low" (I haven't tested any higher) and ARM64 build enabled.

That's great to know, thanks for the information and helping to verify our SDK!

Oculus quest After the voice starts to recognize, if the local recording is turned on, the card owner will ask someone to know what the reason is. There is no problem in the unity editor mode.

Hi !
I have the same issue with Unity 2019.3.9f1 and Speech SDK 1.11.0.
The build works but when I launch the app I get the error : "Unable to find libMicrosoft.CognitiveServices.Speech.core"

@jhakulin did you  ever find a way to to use this effectively on the quest?

Can anyone help here? I am having the same issue.. @jhakulin ????

@Hisaack @Dalibur Yes, Speech SDK has been verified on Oculus Quest and that has been used by our customers. As this GitHub issue is already closed, could you please create a new issue which describes in detail, what is the environment you are using, Oculus Quest or Go and which Speech SDK version you are using and which shows the problem ?


Add get-started.md

Add get-started.md
Rename and re-title configure-device.md

This is legal.
https://guides.github.com/features/mastering-markdown/

I find this is not a problem as #### is just a synonym of HTML's h4 tag.

I thought too much on opening the docs on other web/IDE platforms. For GitHub and most platforms, they're not an issue.


[feature][nodejs] Remove upload to release from Node.js builder

Remove functionality to upload tarball and provenance to a GitHub release from the Node.js builder. We will only output the tarball and sigstore.bundle and users will be responsible for publishing separately on their own.

Completed in #2075


How to build a simple router using window event listeners in JavaScript

Article checklist
Pre-submission checks
Formatting and structure checks

[x] Have you used the correct folder and file structure? - see Contribution Guidelines

[x] Is your article properly formatted in Markdown? - see Github Markdown guide

[x] Have you used our preferred heading structure? - H3 (###) and up

[x] Does your article follow any of the suggested structure formats? - see example formats

[x] Is your article over 750 words? - Tool: Wordcounter.net

[x] Is the article you are submitting an in-depth and unique article? Does it go beyond what is in the official docs and what is covered in other blog sites. See these articles as examples.

[x] Does your article provide enough value and detail about your topic? - Articles should be clear, accurate, and fully explained.

[x] Can your article be understood by beginners? - Assume the audience is smart but has no prior exposure to the common terminology in your article.

[ ] Have you included a hero image that is 600x400 pixels and have the copyright to use it? - Tools: Pixlr Image Editor for resizing and Unsplash for Creative Commons images

Grammar & plagiarism checks

[ ] Have you spellchecked and grammar checked your article? - Tools: Write&Improve - ProWritingAid - Grammarly
[x] Please place your article through a 3rd party plagiarism checker. We suggest using Quetext, this tool is free and has a daily limit. We typically accept articles with 10% or less.
[x] Have you checked your article for readability? - Tool: Hemmingway
[ ] Have you added sources for quotes and images that aren't yours?

Technical checks

[x] Are your code snippets properly formatted for syntax highlighting - see Syntax guide
[x] Have you checked your code runs correctly and you've highlighted all necessary dependencies for installation?
[x] Are the software programs and packages you're highlighting in your article up to date, using current versions and not deprecated?

Topic suggestion this closes
This closes #3307

@nancy-maina Please add a hero image for your article.

@geoffrey45 I have added a hero image.

plagiarism check done ✅

@nancy-maina Your article is 610 words minus the code. Please update your article to reach the minimum requirements. ie 750 words.

@nancy-maina

I hav made the changes @geoffrey45

Hello @geoffrey45
I have made all the changes that you requested. Please check now.

Nice job guys. @nancy-maina @geoffrey45

Merged #3835 into master


Add WASM Support.

My understanding is that we need to strip out certain libraries that are unavailable with wasm bindings such as fs. Any idea what else we could remove for this? I want to be able to quickly encode/decode/process wav files in the browser. Does anyone else think wasm support would be a worthwhile contribution?

I’m not familiar with wasm compilation, but there is nothing in Hound that inherently needs access to std::fs, the functions work with generic io::{Read, Write}. As a convenience, there are WavReader::open and WavWriter::{create, append} and those use st::fs.
Does the entire std::fs module not exist when compiling for wasm? Or does it cause an error at link time if you try to use one of its functions? If it’s the latter, no changes should be needed. If it’s the former, I suppose you can just delete the imports of std::fs and everything that breaks because of it.

Seems like the crate type needs to be cdylib , looking at how to do this or a work around. It has to be a dynamic lib since it's compiling to another language but setting the crate type breaks tests.

I was able to get this library compiling and working for wasm as-is in a Rust project I'm currently working on (only tested encoding and then downloading the encoded audio). Instead of using WavWriter::create and trying to access the file system, I wrote the data into a buffer like so:
let mut bytes = Vec::new();
let mut bytes_cursor = Cursor::new(&mut bytes);
let mut wav_writer = WavWriter::new(&mut bytes_cursor, spec).unwrap();
// ... [omitted. Here I write sample data into the `bytes` buffer using the `wav_writer` just like the example]
wav_writer.finalize().unwrap();

and then downloaded the raw binary as a file in JavaScript by converting the Vec to a blob:
use wasm_bindgen::JsCast;
use web_sys::{Blob, HtmlAnchorElement, Url};

/// Downloads raw slice of bytes as a file from the browser
pub fn download_bytes(bytes: impl AsRef<[u8]>, file_name: &str) {
    let bytes = bytes.as_ref();
    // make all wasm memory allocations at the beginning of the function
    let window = web_sys::window().unwrap();
    let document = window.document().unwrap();
    let body = document.body().unwrap();
    let a: HtmlAnchorElement = document.create_element("a").unwrap().dyn_into().unwrap();
    a.style().set_css_text("display: none;");
    a.set_download(file_name);
    body.append_child(&a).unwrap();

    // data must be passed to blob constructor inside of a javascript array
    let blob_parts = js_sys::Array::new_with_length(1);

    // it is unsafe to get a raw view into WebAssembly memory, but because this memory gets imemdiately
    // used, downloaded, and then view is discarded, it is safe so long as no new allocations are
    // made in between acquiring the view and using it
    let u8_view = unsafe { js_sys::Uint8Array::view(bytes) };
    blob_parts.set(0, u8_view.dyn_into().unwrap());

    // create blob from raw view into wasm linear memory
    let blob =
        Blob::new_with_buffer_source_sequence(&blob_parts.as_ref()).unwrap();

    // make blob downloadable by creating a global document url for the blob resource
    let url = Url::create_object_url_with_blob(&blob).unwrap();

    a.set_href(&url);
    a.click();

    // release url from window memory when done to prevent memory leak
    // (this does not get released automatically, unlike most of web memory)
    Url::revoke_object_url(&url).unwrap();
}

If it would be helpful to others, I'd be happy to share more details on how to get this up and running.
Thanks for the nice library :)


Aria roles support?

Didn't realize react has it natively with the syntax aria-** https://reactjs.org/docs/accessibility.html


Simulator Keyboard Option for web

Teacher request - when students are testing/debugging programs that include a lot of user input ("Ask for String", "Ask for Number" blocks), it gets tiring to constantly use the game pad to enter data.  It would be great to be able to substitute a full keyboard input just for the online Simulator for testing purposes.

Agreed.  We have other ways to simulate input when using the computer that aren't true to the devices, so I don't see a problem with allowing things like using the full keyboard for entering letters (or even using a mouse to navigate and click instead of arrow/A) when using a simulator/phone.

I second this great idea!!!
-Would be a great enhancement both for teaching and debugging to able to:

Type input with keyboard directly into the game.askForString()-method, as suggested here
Type input with keyboard into the console with something like the Python input()-method, or an equivalent console prompt for JavaScript.
Same as point 2, but with the console shown in the simulator(ref. the Console Overlay extension

(Mouse support would also be great, but that is another issue...) ;-)
Apropos:
https://forum.makecode.com/t/keyboard-mouse-input-extension/5988
https://github.com/microsoft/pxt-microbit/issues/3857
Where there is will, there is a way. -You can do it!
Keep up all the great work!
Br,
Vegard

I think it would be cool if we could get keyboard and mouse and touchscreen events within Arcade. Maybe something like this: (similar to the web APIs)
simulatorOnly.onKeyUp((event: SimulatorOnly.KeyboardEvent) => {
  console.log(event);
});

{
  "key": "u",
  "keyCode": 85,
  "code": "KeyU",
  "altKey": false,
  "ctrlKey": false,
  "metaKey": false,
  "shiftKey": false,
  "repeat": false
}

Similar thing for mouse input. We should do the same for touch screens.
If we have these events implemented, then the game.askForString() function could just set up callbacks for these and it wouldn't complicate the implementation so much, plus then user games can access these as well.

Perhaps simulator.mouse.x and simulator.mouse.y attributes for accessing the mouse position in code?

And maybe a keyboard shorcut linked to a programmable property to switch between the default gamepad input and the keyboard/mouse modes?

That's a good idea too! Speaking of which, there's still no shortcut for the menu button 🤔

That's a good idea too! Speaking of which, there's still no shortcut for the menu button 🤔

I think ` works now!

Is/should be @riknoll assigned to this, since he might soon already be finished with it?:
https://forum.makecode.com/t/keyboard-mouse-input-extension/5988/11


Create TGD2022

If this is a debate format submission, please provide some information about the circuit, league or tournaments where this format is used:
This format is used for a debate of Vinschool High School from Vietnam. It's quite similar to World Schools rule but more suitable for beginners.
By submitting this pull request, I agree to license my contributions under the MIT License.

Hi, thanks for submitting, would you please move this file to the v1/formats directory (direct link to directory on your fork), and make sure it has a file name that's lower case and ends in ".xml"?

Superseded by

#19


Added arrow keys support

Hi!
Regarding https://github.com/ostrosco/device_query/issues/13 issue, I added the arrow keys support.
EDIT: I test it in linux and windows

Looks good to me. Thank you!


Merge prTesting_201905191121 branch to master branch

Docs Build status updates of commit 998c403:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details
Dependent Files

split/updateTestRef.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Inference Code

Hi @man805
Thanks for releasing the training code. However, there is no inference code available to generate the talking head videos as shown in the paper. Can you share the same as well? It will be very helpful.

Hi, @mdv3101.
Actually, I used CLIP-based editing's example command in github README.md for results in paper.
If you have any trouble in reproducing, please use this already cropped frames (link).
I didn't understand why, but even if the same command was used, the cropped images through the provided code and the cropped images used previously showed different results.
The link above is a link to the cropped image that was previously used.
These cropped images were made a long time ago, so I don't remember how they cropped.
You will be able to reproduce the paper results with below command.
python editing_CLIP.py --attribute "Beard" \
                       --src_txt "face" \
                       --trg_txt "face with beard" \
                       --lr 0.002 \
                       --scale 0.5 \
                       --clip_loss_w 5 \
                       --id_loss_w 1 \
                       --l1_loss_w 5 \
                       --video_path => (LOAD CROPPED IMAGES DIRECTLY IN CODE, NOT THIS WAY)


feat: omit 'undefined' when generating SSDK and @required trait is used

Issue #, if available:
Addresses issues raised in #503 for SSDK code
Description of changes:
Currently when the client SDK is generated, @required shapes have their
types rendered with ' | undefined'. This allows removing @required as
a non-breaking change for client SDK users.
However, the server SDK (SSDK) has no need for backwards compatibility,
it can be updated as the service evolves. When generating SSDK types
the project does not need to include ' | undefined' for required types.
This update changes the structure member writer when the SSDK is
generated to not include ' | undefined" when it is a required member.
Client SDK remains unaffected.
Server SDK does not appear to have any tests. Test frameworks do
not seem to support SSDK generation at this moment. only implementation
code is included.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

This causes type issues inside the deserialise functions. Its not feasible to make these changes without a lot of internal plumbing.


AssertionError: Assertion failed.

I am trying to implement background augmentator with multiple image and large sets of keypoints.
Here is error:
Process Process-5:
Traceback (most recent call last):
__File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self.kwargs)
File "/usr/local/lib/python2.7/dist-packages/imgaug/imgaug.py", line 1926, in augment_images_worker
batch.keypoints_aug = augseq_det.augment_keypoints(batch.keypoints)
File "/usr/local/lib/python2.7/dist-packages/imgaug/augmenters/meta.py", line 531, in augment_keypoints
ia.do_assert(all([isinstance(keypoints_on_image, ia.KeypointsOnImage) for keypoints_on_image in keypoints_on_images]))
File "/usr/local/lib/python2.7/dist-packages/imgaug/imgaug.py", line 677, in do_assert
raise AssertionError(str(message))
AssertionError: Assertion failed.
Here is the code i am trying
augseq = iaa.Sequential([
    iaa.Fliplr(0.5),
    iaa.CoarseDropout(p=0.1, size_percent=0.1)
])
fps = glob.glob('/notebooks/*.jpg')
kps = glob.glob('/notebooks/*.json')
# A generator that loads batches from the hard drive.
def load_batches():
    # Here, load 10 batches of size 4 each.
    # You can also load an infinite amount of batches, if you don't train
    # in epochs.
    batch_size = 2
    nb_batches = 2
    total_images = len(fps)
    count = 0
    for i in range(nb_batches):
        # A list containing all images of the batch.
        batch_images = []
        batch_keypoints = []
         batch_data = []
            # Add some images to the batch.
        for b in range(batch_size):
            print ("Image is:",fps[count])
            print ("json is:", kps[count])
            im  = cv2.imread(fps[count])
            keypoints = get_pandakeys(kps[count])

            batch_images.append(im)
            batch_keypoints.append(keypoints)

            count+=1
        batch = ia.Batch(
            images=np.array(batch_images, dtype=np.uint8),keypoints=batch_keypoints,
            data=batch_data
        )
        print("Finished_Batch",batch)
        yield batch
        batch_loader = ia.BatchLoader(load_batches)
        bg_augmenter = ia.BackgroundAugmenter(batch_loader, augseq)
       print("------------------")
print("augseq.augment_batches(batches, background=True)")
print("------------------")
batches = list(load_batches())
batches_aug = augseq.augment_batches(batches, background=True)
images_aug = []
keypoints_aug = []
for batch_aug in batches_aug:
    images_aug.append(batch_aug.images_aug)
    keypoints_aug.append(batch_aug.keypoints_aug)
plt.imshow(draw_grid(images_aug, keypoints_aug))

get_pandakeys() must return an instance of imgaug.KeypointsOnImage(), but doesn't seem to do that.


nfd and nvgpu artifacts

This pull request contains the following artifacts:

machine set for Azure-based Tesla-enabled VMs
nfd (node feature discovery) yaml files: for creating the nfd operator which is needed to successfully recognize GPUs on workers
NVidia (nv) gpu operator yaml files: for creating the NVidia gpu operator (requires nfd to be set up already)
install script to: set up nfd and nvop for vi

Install script needs install steps for Maximo VI; these are all the pre-reqs

#lgtm


ServerBuilder can't resolve lazy modules

Bug Report or Feature Request (mark with an x)
- [x] bug report -> please search issues before submitting
- [ ] feature request

Area
- [x] devkit
- [ ] schematics

Versions

node --version
v8.9.4

npm --version
5.6.0

npx ng --version

     _                      _                 ____ _     ___
    / \   _ __   __ _ _   _| | __ _ _ __     / ___| |   |_ _|
   / △ \ | '_ \ / _` | | | | |/ _` | '__|   | |   | |    | |
  / ___ \| | | | (_| | |_| | | (_| | |      | |___| |___ | |
 /_/   \_\_| |_|\__, |\__,_|_|\__,_|_|       \____|_____|___|
                |___/

Angular CLI: 6.0.0-rc.5
Node: 8.9.4
OS: linux x64
Angular: 6.0.0-rc.5
... animations, cli, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, platform-server, router

Package                           Version
-----------------------------------------------------------
@angular-devkit/architect         0.5.7
@angular-devkit/build-angular     0.5.7
@angular-devkit/build-optimizer   0.5.7
@angular-devkit/core              0.5.7
@angular-devkit/schematics        0.5.7
@ngtools/json-schema              1.1.0
@ngtools/webpack                  6.0.0-rc.5
@schematics/angular               0.5.7
@schematics/update                0.5.7
rxjs                              6.0.0-uncanny-rc.7
typescript                        2.7.2
webpack                           4.5.0

Repro steps

Install<EMAIL_ADDRESS>globally
npm install -g<EMAIL_ADDRESS>
Create new project
ng new example-app
cd example-app

Update Angular dependencies
npm install --save<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Update Angular dev dependencies
npm install --save-dev<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Universalify @angular/cli starter
cat >patch-universalify-starter.diff << EndOfPatch
diff --git a/angular.json b/angular.json
index 24f506b..4838eea 100644
--- a/angular.json
+++ b/angular.json
@@ -66,6 +66,15 @@
             }
           }
         },
+        "server": {
+          "builder": "@angular-devkit/build-angular:server",
+          "options": {
+            "outputPath": "dist/server",
+            "main": "src/main.server.ts",
+            "tsConfig": "src/tsconfig.server.json",
+            "verbose": true
+          }
+        },
         "extract-i18n": {
           "builder": "@angular-devkit/build-angular:extract-i18n",
           "options": {
diff --git a/src/app/app.module.ts b/src/app/app.module.ts
index f657163..36ef8df 100644
--- a/src/app/app.module.ts
+++ b/src/app/app.module.ts
@@ -1,14 +1,21 @@
 import { BrowserModule } from '@angular/platform-browser';
 import { NgModule } from '@angular/core';
+import { RouterModule } from '@angular/router';

 import { AppComponent } from './app.component';

+export const APP_ID = 'example-app';
+
 @NgModule({
   declarations: [
     AppComponent
   ],
   imports: [
-    BrowserModule
+    BrowserModule.withServerTransition({ appId: APP_ID }),
+    RouterModule.forRoot([
+      { path: '', component: AppComponent, pathMatch: 'full'},
+      { path: 'lazy', loadChildren: './lazy.module#LazyModule'}
+    ])
   ],
   providers: [],
   bootstrap: [AppComponent]
diff --git a/src/app/app.server.module.ts b/src/app/app.server.module.ts
new file mode 100644
index 0000000..119b840
--- /dev/null
+++ b/src/app/app.server.module.ts
@@ -0,0 +1,14 @@
+import { NgModule } from '@angular/core';
+import { ServerModule } from '@angular/platform-server';
+
+import { AppModule } from './app.module';
+import { AppComponent } from './app.component';
+
+@NgModule({
+  imports: [
+    AppModule,
+    ServerModule
+  ],
+  bootstrap: [AppComponent]
+})
+export class AppServerModule { }
diff --git a/src/app/lazy.module.ts b/src/app/lazy.module.ts
new file mode 100644
index 0000000..3b094c9
--- /dev/null
+++ b/src/app/lazy.module.ts
@@ -0,0 +1,18 @@
+import { NgModule, Component } from '@angular/core';
+import { RouterModule } from '@angular/router';
+
+@Component({
+  template: '
hello lazy module!
'
+})
+export class LazyComponent { }
+
+@NgModule({
+  declarations: [ LazyComponent ],
+  imports: [
+    RouterModule.forChild([
+      { path: '', component: LazyComponent, pathMatch: 'full' }
+    ])
+  ]
+})
+export class LazyModule { }
+
diff --git a/src/main.server.ts b/src/main.server.ts
new file mode 100644
index 0000000..914b062
--- /dev/null
+++ b/src/main.server.ts
@@ -0,0 +1 @@
+export { AppServerModule } from './app/app.server.module';
\ No newline at end of file
diff --git a/src/tsconfig.server.json b/src/tsconfig.server.json
new file mode 100644
index 0000000..4a5cad4
--- /dev/null
+++ b/src/tsconfig.server.json
@@ -0,0 +1,10 @@
+{
+  "extends": "./tsconfig.app.json",
+  "compilerOptions": {
+    "outDir": "../dist/out-tsc/app/server",
+    "module": "commonjs"
+  },
+  "angularCompilerOptions": {
+    "entryModule": "./app/app.server.module#AppServerModule"
+  }
+}
EndOfPatch

git apply patch-universalify-starter.diff

The log given by the failure

npx ng run example-app:server

7886ms building modules
2ms finish module graph
1ms sealing
0ms basic dependencies optimization
0ms dependencies optimization
1ms advanced dependencies optimization
2ms after dependencies optimization
0ms optimizing
0ms basic module optimization
1ms module optimization
0ms advanced module optimization
1ms after module optimization
1ms basic chunk optimization
1ms chunk optimization
6ms advanced chunk optimization
0ms after chunk optimization
0ms module and chunk tree optimization
1ms after module and chunk tree optimization
0ms basic chunk modules optimization
0ms chunk modules optimization
0ms advanced chunk modules optimization
0ms after chunk modules optimization
1ms module reviving
0ms module order optimization
0ms advanced module order optimization
0ms before module ids
1ms module ids
1ms module id optimization
0ms chunk reviving
1ms chunk order optimization
0ms before chunk ids
0ms chunk id optimization
1ms after chunk id optimization
2ms hashing
1ms after hashing
0ms module assets processing
8ms chunk assets processing
1ms additional chunk assets processing
1ms additional asset processing
0ms chunk asset optimization
0ms after chunk asset optimization
0ms asset optimization
1ms after asset optimization
1ms after seal
Hash: 565bb313bdaabe5347ae
Version: webpack 4.5.0
Time: 7943ms
Built at: 2018-4-18 19:19:44
  Asset      Size  Chunks  Chunk Names
main.js  22.6 KiB    main  main
Entrypoint main = main.js
chunk {main} main.js (main) 14.1 KiB [entry] [rendered]

ERROR in ./src/main.server.ts
Module not found: Error: Can't resolve 'app/lazy.module.ngfactory.js' in '/home/steven/code/ng-universal/src'
resolve 'app/lazy.module.ngfactory.js' in '/home/steven/code/ng-universal/src'
  Parsed request is a module
  using description file: /home/steven/code/ng-universal/package.json (relative path: ./src)
    resolve as module
      looking for modules in /home/steven/code/ng-universal/
        using description file: /home/steven/code/ng-universal/package.json (relative path: .)
          using description file: /home/steven/code/ng-universal/package.json (relative path: ./app/lazy.module.ngfactory.js)
            no extension
              /home/steven/code/ng-universal/app/lazy.module.ngfactory.js doesn't exist
            .ts
              /home/steven/code/ng-universal/app/lazy.module.ngfactory.js.ts doesn't exist
            .js
              /home/steven/code/ng-universal/app/lazy.module.ngfactory.js.js doesn't exist
            as directory
              /home/steven/code/ng-universal/app/lazy.module.ngfactory.js doesn't exist
      /home/steven/code/ng-universal/src/node_modules doesn't exist or is not a directory
      /home/steven/code/node_modules doesn't exist or is not a directory
      /home/steven/node_modules doesn't exist or is not a directory
      /home/node_modules doesn't exist or is not a directory
      /node_modules doesn't exist or is not a directory
      looking for modules in /home/steven/code/ng-universal/node_modules
        using description file: /home/steven/code/ng-universal/package.json (relative path: ./node_modules)
          using description file: /home/steven/code/ng-universal/package.json (relative path: ./node_modules/app/lazy.module.ngfactory.js)
            no extension
              /home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js doesn't exist
            .ts
              /home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js.ts doesn't exist
            .js
              /home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js.js doesn't exist
            as directory
              /home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js doesn't exist
[/home/steven/code/ng-universal/app/lazy.module.ngfactory.js]
[/home/steven/code/ng-universal/app/lazy.module.ngfactory.js.ts]
[/home/steven/code/ng-universal/app/lazy.module.ngfactory.js.js]
[/home/steven/code/ng-universal/src/node_modules]
[/home/steven/code/node_modules]
[/home/steven/node_modules]
[/home/node_modules]
[/node_modules]
[/home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js]
[/home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js.ts]
[/home/steven/code/ng-universal/node_modules/app/lazy.module.ngfactory.js.js]
 @ ./src/main.server.ts 5:17-56
 @ multi ./src/main.server.ts

Desired functionality

Create a server target with ServerBuilder to build an app module which has a lazy module.
Mention any other details that might be useful

I tried to apply the Server-side rendering technique for angular 6.
I deliberately didn't used @nguniversal/module-map-ngfactory-loader because it's not required to reproduce the bug.
The command npx ng run example-app:server corresponding to the command  ng build --prod --app 1 --output-hashing=false with @angular/cli@^1 (angular 5).
The exportLazyModuleMap and exportNgFactory transformers are correctly called and they handle LazyModuleNgFactory.
angular.json with example-app:server target only
{
  "$schema"<EMAIL_ADDRESS>  "version": 1,
  "newProjectRoot": "projects",
  "projects": {
    "example-app": {
      "root": "",
      "projectType": "application",
      "prefix": "app",
      "architect": {
        "server": {
          "builder": "@angular-devkit/build-angular:server",
          "options": {
            "outputPath": "dist/server",
            "main": "src/main.server.ts",
            "tsConfig": "src/tsconfig.server.json",
            "verbose": true
          }
        }
      }
    }
}

src/tsconfig.server.json
{
  "extends": "./tsconfig.app.json",
  "compilerOptions": {
    "outDir": "../dist/out-tsc/app/server",
    "module": "commonjs"
  },
  "angularCompilerOptions": {
    "entryModule": "./app/app.server.module#AppServerModule"
  }
}

src/main.server.ts
export { AppServerModule } from './app/app.server.module';

src/app/app.server.module.ts
import { NgModule } from '@angular/core';
import { ServerModule } from '@angular/platform-server';

import { AppModule } from './app.module';
import { AppComponent } from './app.component';

@NgModule({
  imports: [
    AppModule,
    ServerModule
  ],
  bootstrap: [AppComponent]
})
export class AppServerModule { }

src/app/app.module.ts
import { BrowserModule } from '@angular/platform-browser';
import { NgModule } from '@angular/core';
import { RouterModule } from '@angular/router';

import { AppComponent } from './app.component';

export const APP_ID = 'example-app';

@NgModule({
  declarations: [
    AppComponent
  ],
  imports: [
    BrowserModule.withServerTransition({ appId: APP_ID }),
    RouterModule.forRoot([
      { path: '', component: AppComponent, pathMatch: 'full'},
      { path: 'lazy', loadChildren: './lazy.module#LazyModule'}
    ])
  ],
  providers: [],
  bootstrap: [AppComponent]
})
export class AppModule { }

src/app/lazy.module.ts
import { NgModule, Component } from '@angular/core';
import { RouterModule } from '@angular/router';

@Component({
  template: '
hello lazy module!
'
})
export class LazyComponent { }

@NgModule({
  declarations: [ LazyComponent ],
  imports: [
    RouterModule.forChild([
      { path: '', component: LazyComponent, pathMatch: 'full' }
    ])
  ]
})
export class LazyModule { }

UPDATES

04/14/2018: update angular 6.0.0-rc.5
04/18/2018: update @angular/cli 6.0.0-rc.5, @ngtool/webpack 6.0.0-rc.5 and @angular-devkit 0.5.7

I spotted a difference with the \.ngfactory\.js|\.ngstyle\.js module rule in webpack config between<EMAIL_ADDRESS>and<EMAIL_ADDRESS>webpack config for target server with<EMAIL_ADDRESS>{ test: /(?:\.ngfactory\.js|\.ngstyle\.js|\.ts)$/,
  use: [ '@ngtools/webpack' ] }

webpack config for target server with<EMAIL_ADDRESS>{ test: /(?:\.ngfactory\.js|\.ngstyle\.js|\.ts)$/,
  use:
    [ { loader: '@angular-devkit/build-optimizer/webpack-loader',
        options: { sourceMap: false } },
      '@ngtools/webpack' ] }

Can this be the cause of the ServerBuilder's resolve failure?

@filipesilva I'm having the same exact issue.

Running in the same issue, but only when pre-building @angular/core with the webpack DllPlugin.

This issue still exists despite dependency updates (refer to the bottom of the first post): it's normal because nobody works on that issue yet (@filipesilva please correct me if I'm wrong).
@manekinekko
I spotted this issue with @angular-devkit 0.5.x.
Which version of the devkit did you used to reproduce the issue?
@iMarv
Can you sharing more information? I'm interesting to investigate your repository which works without DllPlugin. Is it possible to share a version with the minimum stuff to show the ServerBundle working with lazy module resolution (ngfactory file's resolution of a lazy module) ?

I made a diff on webpack plugins prepared by @angular/cli 1.7.3 and 6.0.0-rc.5 for a server build:

@angular/cli version
1.7.3
6.0.0-rc.5

webpack plugins
NoEmitOnErrorsPluginCopyPluginProgressPluginCircularDependencyPluginAngularCompilerPluginNamedLazyChunksWebpackPluginNamedModulesPlugin
ProgressPluginCircularDependencyPluginAngularCompilerPlugin

I think that it's okay to skip NoEmitOnErrorsPlugin and NamedModulesPlugin because webpack v4 changed that behavior (check the extract of webpack v4's changelog below) and mode is "development" and optimization.noEmitOnErrors is true ;
The CopyPlugin is out of subject (for information its used to copy assets, I left it in the table to visually align common plugins only) ;
But I don't know the purpose of the NamedLazyChunksWebpackPlugin.

@filipesilva
Do you know if the NamedLazyChunksWebpackPlugin plugin is needed for lazy module resolution? (yep, even the plugin's name, I'm asking the question :smile:).
Attachments
Extract of webpack v4's changelog

v4.0.0
@sokra sokra released this on Feb 25
Big changes

Configuration

You no longer need to use these plugins:

NoEmitOnErrorsPlugin -> optimization.noEmitOnErrors (on by default in production mode)
ModuleConcatenationPlugin -> optimization.concatenateModules (on by default in production mode)
NamedModulesPlugin -> optimization.namedModules (on by default in develoment mode)
CommonsChunkPlugin was removed -> optimization.splitChunks, optimization.runtimeChunk

@filipesilva
I think I found the cause of the issue in export_lazy_module_map.ts#L49 (@ngtools/webpack v6.0.0-rc.5):
// https://github.com/angular/devkit/blob/v6.0.0-rc.5/packages/ngtools/webpack/src/transformers/export_lazy_module_map.ts#L49
const relativePath = path.relative(dirName, modulePath).replace(/\\/g, '/');
// Create the new namespace import node.
const namespaceImport = ts.createNamespaceImport(ts.createIdentifier(`__lazy_${index}__`));
const importClause = ts.createImportClause(undefined, namespaceImport);
const newImport = ts.createImportDeclaration(undefined, undefined, importClause,
  ts.createLiteral(relativePath));

const firstNode = getFirstNode(sourceFile);
if (firstNode) {
  ops.push(new AddNodeOperation(sourceFile, firstNode, newImport));
}

We set relativePath with Node's path.relative(from, to) for each lazy route/module and used it to dynamically add an import in the entry point.
The Node's path.relative(from, to) function can returns two relative path formats:

relative path which starts with ../ (or ..\) when to path is outside the from path ;
when to path is inside from path: the relative path returned doesn't started with ./.

$ node
> process.version
'v8.9.4'
> path.relative('/foo/bar', '/foo')
'..'
> path.relative('/foo', '/foo/bar')
'bar'

For example...

...with an entry point in /example-app/src/main.server.ts
...and a lazy module in /example-app/src/app/lazy.module.ts
...the relativePath equals app/lazy.module.ngfactory.js (note: it's .ngfactory.js because we use AOT compilation)
...and the transformer dynamically add import * as __lazy_0__ from 'app/lazy.module.ngfactory.js'.

The example only work because the entry point is in /example-app/src first level: the path app/lazy.module.ngfactory.js can potentially be resolved if the /example-app/src exists in webpack config resolve.modules.
The var dirName is set with the entry point's dirname: if we move the /example-app/src/main.server.ts to /example-app/src/app/main.server.ts (inside a subfolder of /example-app/src), the var relativePath equals lazy.module.ngfactory.js (because the entry point and the lazy module is in the same folder /example-app/src/app), it can't be resolved and the issue is triggered.
Prefixing relativePath with ./ seems to fix this issue.
diff --git a/packages/ngtools/webpack/src/transformers/export_lazy_module_map.ts b/packages/ngtools/webpack/src/transformers/export_lazy_module_map.ts
index 9947b31..a8baa5f 100644
--- a/packages/ngtools/webpack/src/transformers/export_lazy_module_map.ts
+++ b/packages/ngtools/webpack/src/transformers/export_lazy_module_map.ts
@@ -46,7 +46,7 @@ export function exportLazyModuleMap(
         return;
       }

-      const relativePath = path.relative(dirName, modulePath).replace(/\\/g, '/');
+      const relativePath = './' + path.relative(dirName, modulePath).replace(/\\/g, '/');
       // Create the new namespace import node.
       const namespaceImport = ts.createNamespaceImport(ts.createIdentifier(`__lazy_${index}__`));
       const importClause = ts.createImportClause(undefined, namespaceImport);

@enten I am going to address this issue now, and would like to thank you for all the investigation that you have put into it. I think your assessment is quite right, that the format of relative imports is incorrect. Will fix and add a test to prevent this from breaking in the future 👍
@iMarv it's hard to talk about issues with DllPlugin since we don't really test or support it in @ngtools/webpack in general. We haven't been able to make DllPlugin work because of lazy routes, since they are loaded from @angular/core and DllPlugin tries to separate the compilations. So effectively @angular/core cannot be separated because of lazy routes.

@filipesilva Thanks alot for the fix! I hope it won't create unexpected side effects.


Manual Testing for Picture

Coverage remained the same at 88.976% when pulling db53e7a7e271eb5ec32a1c4ddc9f61c0c2ca37cb on denzelchung:dg-testing-pic into 0466c249e6b4a3f7c8487699abeb2d2a4d2443c8 on CS2103-AY1819S1-W13-1:master.


method _resize_masks() cause mask size large than image size

Describe the bug
When train HTC model with myself dataset, there have assert error in mmcv function impad() assert shape[i] >= img.shape[i]. In my dataset, each image has different width and height.  This assert error occured easily.
Assume one image shape is (800, 1333), scale is (1333, 800). one mask of this image has shape(133, 80).
After resize the mask, the mask shape will be (1330, 800), then 800 < 1330 which cause the assert error.
I checked code, I think there is a issue in the mmdet function _resize_masks() in the class Resize in the datasets\pipelines\transforms.py.
In the def _resize_masks(self, results)
if self.keep_ratio:
results[key] = results[key].rescale(results['scale'])
I think here should call the rescale() like:  rescale(results['scale_factor']). Because when you resize masks in one image, masks should keep same scale factor as resized image.
please check.
Thanks in advance!

https://github.com/open-mmlab/mmdetection/blob/38dfa875c048207fd46b8cd2b7ccafd5239b4a4e/mmdet/datasets/pipelines/loading.py#L275-L298
After loading mask annotation and before rescale,  the shape of the mask annotation and the image should be the same. So after rescale their shape should be still the same. I guess there is some other issues? Could you check it again


Altmarkets - Error fetching data from https://v2.altmarkets.io/api/v2/peatio/public/markets. HTTP status is 403

Describe the bug
There's an issue on the initial start of the Client
Altmarkets - Error fetching data from https://v2.altmarkets.io/api/v2/peatio/public/markets. HTTP status is 403
Note: Other connectors not affected
Steps to reproduce

Clone and install Client
Start the Client
Review logs pane

Release version
dev-1.19.0
Type of installation
Source
Attach required files
2023-08-30 10:14:11,982 - 3729817 - hummingbot.connector.exchange.altmarkets.altmarkets_api_order_book_data_source - NETWORK - Error fetching data from https://v2.altmarkets.io/api/v2/peatio/public/markets. HTTP status is 403. Retrying in 7s. Forbidden
2023-08-30 10:14:20,530 - 3729817 - hummingbot.connector.exchange.altmarkets.altmarkets_api_order_book_data_source - NETWORK - Error fetching data from https://v2.altmarkets.io/api/v2/peatio/public/markets. HTTP status is 403. Retrying in 31s. Forbidden
2023-08-30 10:14:52,251 - 3729817 - hummingbot.connector.exchange.altmarkets.altmarkets_api_order_book_data_source - NETWORK - Error fetching data from https://v2.altmarkets.io/api/v2/peatio/public/markets. HTTP status is 403. Retrying in 274s. Forbidden

AltMarkets.io looks like it's out of service, I recommend remove this connector


add user waiver upload

/cib rv add user waiver upload

Branch 89-rv-add-user-waiver-upload created!


 Minor Console Aspects fixes for 1.3.3

Console Aspects.zip
Programmer Console Aspects.zip
Made some minor bug fixes to work with Legacy4J 1.3.3 better:

Changed how water transparency works to be compatible with AND without Sodium (Swamp water is no longer accurate, but this exchange is worth it so the water transparency is normal in all other biomes)
Fixed kelp and seagrass black pixels during interpolation

Added in version 1.4, thanks again for your contribution!


fix: editing of apphooked CMS pages without apphook landing page

Summary
Fixes #7765
Links to related discussion
Proposed changes in this pull request
this implements a small patch and a test to make sure, that CMS pages that hold an apphook without a urlpattern at the ""-location still have the correct pagecontent object at the edit url
Documentation checklist

[ ] I have updated CHANGELOG.txt if appropriate
[ ] I have updated the release notes document if appropriate, with:

[ ] general notes
[ ] bug-fixes
[ ] improvements/new features
[ ] backwards-incompatible changes
[ ] required upgrade steps
[ ] names of contributors

[ ] I have updated other documentation
[ ] I have added my name to the AUTHORS file
[ ] This PR's documentation has been approved by Daniele Procida

@fsbraun I implemented the changes that we discussed in #7765. As this is my first PR to django-cms, I am not sure, where to edit the CHANGELOG.txt. seems like there is no section for 4.1.1 yet. shall I create one?

@Chilipp No need to change the Changelog. It will be automatically generated by the release process.

@fsbraun this PR should work now (at least the tests pass locally)

@Chilipp I sneaked in a little unrelated change in the docs to get this out. Hope that was ok.

Sure, it's your code :wink:


diagnose counting warmup draws

Summary:
make examples/bernoulli/bernoulli
examples/bernoulli/bernoulli sample save_warmup=1 data file=examples/bernoulli/bernoulli.data.R output file=output.csv

Edit output.csv and add a divergence to the post warmup samples. (here's one: output.csv.txt)
bin/diagnose output.csv

The output will include:
Checking sampler transitions for divergences.
1 of 2000 (0.05%) transitions ended with a divergence.

There is 1 divergence (we added it -- there should be a bunch during warmup), but there are only 1000 post warmup draws.
Current Version:
v2.25.0

the diagnose command depends on stan::mcmc::chains
went spelunking through the logic, and while only the sampling draws from the csv file are analyzed,
there's a bunch of logic that looks at the CSV header and if save_warmup is specified, it uses that somehow.
most def a bug - if not a bug, some programmer's random brain fart - not going to git blame to find out who farted.


Small QOL - Shorten the full name of items on GE

As you can see, I have to type the full name of the item for it to appear. Of course this would be expected however, OSbuddy allows for shortening of the name when looking it up.

Duplicate #1338


Unable to run julia from within vscode-fhs

Describe the bug
After making a shell with julia-bin in it, upon trying to run julia on the vscode terminal this error is generated:
fatal: error thrown and no exception handler available.
InitError(mod=:LibCURL_jll, error=ErrorException("could not load library "libcurl.so"
/usr/lib/libcurl.so: undefined symbol: nghttp2_option_set_no_rfc9113_leading_and_trailing_ws_validation"))
ijl_errorf at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/rtutils.c:77
ijl_load_dynamic_library at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/dlload.c:277
#dlopen#3 at ./libdl.jl:117
dlopen at ./libdl.jl:116 [inlined]
dlopen at ./libdl.jl:116 [inlined]
__init__ at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/usr/share/julia/stdlib/v1.8/LibCURL_jll/src/LibCURL_jll.jl:30
jfptr___init___66839.clone_1 at /nix/store/iajz3b58x6g0xjyv0barghic52mp1p5g-julia-bin-1.8.5/lib/julia/sys.so (unknown line)
_jl_invoke at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/gf.c:2377 [inlined]
ijl_apply_generic at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/gf.c:2559
jl_apply at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/julia.h:1843 [inlined]
jl_module_run_initializer at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/toplevel.c:75
_finish_julia_init at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/init.c:765
julia_init at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/init.c:698
jl_repl_entrypoint at /cache/build/default-amdci4-2/julialang/julia-release-1-dot-8/src/jlapi.c:713
main at julia (unknown line)
__libc_start_call_main at /usr/lib/libc.so.6 (unknown line)
__libc_start_main at /usr/lib/libc.so.6 (unknown line)
unknown function (ip: 0x401098)

Steps To Reproduce
Steps to reproduce the behavior:

install vscode-fhs
open vscode and in the terminal create a shell.nix with

{ pkgs ? import <nixpkgs> {} }:
with pkgs;

mkShell {
  buildInputs = [ julia-bin ];
}

nix-shell and attempt to run julia

Additional context
Possibly related to #181950, but this seems to be a different issue as I am not even able to enter the repl
Notify maintainers
@ninjin @raskin @NickCao
Metadata
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.12-zen1, NixOS, 23.05 (Stoat), 23.05pre456838.f5dad40450d`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.2`
 - channels(root): `"nixos"`
 - channels(mathiassven): `"home-manager"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

See https://github.com/NixOS/nixpkgs/issues/169464#issuecomment-1220236523

Is this being caused by the use of autoPatchelfHook? I am on unstable although both of my channels follow unstable. Does julia have some special casing that needs to be done unlike other binaries? I could try to manually look for build inputs that would satisfy the libraries needed if that would help

It's caused by LD_LIBRARY_PATH set in the FHS env, forcing any binary loading these specific set of libraries instead of the ones they were linked to at build time. When the FHS env and the binary come from the same nixpkgs commit, this is not an issue, but if they are not, all sorts of bad things happen. This is not specific to julia.

@MathiasSven did you find a way to work around this? I cannot use the Julia language server in VScode because of the same issue.


Remove content and link to the page with the official Docs

All content is moved here:
https://github.com/TheThingsNetwork/docs/blob/master/_content/applications/python/api-reference.md

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Hey man, it's me, necromancer!

I know this repo has been super dead for the past 4 years, but I really want to find myself a working autoclicker bc I don't know how to code. Libraries can't be installed now, versions stated are ether too old or non-existent, and it does nothing when run. Can I somehow revive in? All I need is to spam 1 keyboard button every 20 seconds in TF2 (specific window)

Hello, could you provide more details about the errors?

Environment that you are trying to run (python version, operating system, etc)
The error message

Currently I can't promise that I will make changes in the code, but I can see what I can do.

Windows 10 Pro, Version 10.0.19044 Build 19044. Python 3.10.9. Error:
C:\Users\aboba\Desktop\windows>python Main.py -n "cs2.exe"
Traceback (most recent call last):
File "C:\Users\aboba\Desktop\windows\Main.py", line 158, in
Main()
File "C:\Users\aboba\Desktop\windows\Main.py", line 150, in Main
afk_Clicker.run(afk_Clicker.get_hwnds_by_name(args.name))
File "C:\Users\aboba\Desktop\windows\Main.py", line 92, in run
raise Exception("Invalid handler, please check PID or process name")
Exception: Invalid handler, please check PID or process name
C:\Users\aboba\Desktop\windows>python version
python: can't open file 'C:\Users\aboba\Desktop\windows\version': [Errno 2] No such file or directory
C:\Users\aboba\Desktop\windows>python --version
Python 3.10.9
C:\Users\aboba\Desktop\windows>pip install -r requirements.txt
Collecting pywin32==306 (from -r requirements.txt (line 1))
Using cached pywin32-306-cp310-cp310-win_amd64.whl (9.2 MB)
Collecting win32gui==221.4 (from -r requirements.txt (line 2))
Using cached win32gui-221.4.tar.gz (605 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [19 lines of output]
Traceback (most recent call last):
File "C:\Users\aboba\AppData\Local\Programs\Python\Python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 353, in
main()
File "C:\Users\aboba\AppData\Local\Programs\Python\Python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "C:\Users\aboba\AppData\Local\Programs\Python\Python310\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
File "C:\Users\aboba\AppData\Local\Temp\pip-build-env-7ru0t6wg\overlay\Lib\site-packages\setuptools\build_meta.py", line 355, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=['wheel'])
File "C:\Users\aboba\AppData\Local\Temp\pip-build-env-7ru0t6wg\overlay\Lib\site-packages\setuptools\build_meta.py", line 325, in _get_build_requires
self.run_setup()
File "C:\Users\aboba\AppData\Local\Temp\pip-build-env-7ru0t6wg\overlay\Lib\site-packages\setuptools\build_meta.py", line 507, in run_setup
super(_BuildMetaLegacyBackend, self).run_setup(setup_script=setup_script)
File "C:\Users\aboba\AppData\Local\Temp\pip-build-env-7ru0t6wg\overlay\Lib\site-packages\setuptools\build_meta.py", line 341, in run_setup
exec(code, locals())
File "", line 26, in
File "C:\Users\aboba\AppData\Local\Temp\pip-install-e1ugdrnt\win32gui_0cd5f4b2f0174a1baa9b02bed3068197\win32\distutils\gui.py", line 6, in
from win32.distutils.command import win32_build_ext
ModuleNotFoundError: No module named 'win32.distutils.command'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.

My thought is that it probably actually works, but I can't install dependencies listed, since it's so hella old. And can't launch code without them. But what do I know

Hey, so I just checked on a Windows 10 VM using the newest python 3.12.0 and it still works :)
The trick was to bump the version of pywin32 and remove the dependency of win32gui. I updated the requirements.txt in the last commit.
Please, updated with the latest commit, give a try and let me know if it worked.

Ok, yeah. It definitely does something now for sure. But there are still some strange things going on. I repeated your tests, tested in Minecraft and notepad, as well as TF2 (where I hope it'll work) and CS2. So it does not work in any games at all, nothing. But in Notepad it does. Since it has to press letter 'r' every 20 seconds, I tested it with command python Main.py -k 0x52 -p %code%, and instead of typing 'r' it repeatedly typed 虀 (ex 虀虀虀虀虀虀虀虀虀) instead. So maybe windows can't recognize the symbol I'm trying to type? I had english keyboard on at the moment and my Windows is in english too

I changed that one number from 1 to 20, so It'll now type every 20 seconds I think. I also tried googling the problem, but found no issues like that, maybe that's on my PC or something

Bruh https://www.yellowbridge.com/chinese/dictionary.php?word=虀&cache=87827

LoL :laughing:
What you can try to check is in this line https://github.com/eHonnef/afk-clicker/blob/master/windows/Main.py#L83
That line is the one that posts the keystroke to the window handle. Maybe it should post another struct besides the win32con.WM_CHAR.
Maybe I will give a look in the weekend or next week, idk. This code is a little big mess that I ducked tape long ago.

Sorry, I just don't know how to code. And your "mess" almost works exactly as needed. Still idk if it'll work for valve's games as some autoclickers don't but to it's huuge still

Ay, have you looked into the code?

Man?...

Bruh https://www.yellowbridge.com/chinese/dictionary.php?word=虀&cache=87827

LoL 😆
What you can try to check is in this line https://github.com/eHonnef/afk-clicker/blob/master/windows/Main.py#L83
That line is the one that posts the keystroke to the window handle. Maybe it should post another struct besides the win32con.WM_CHAR.
Maybe I will give a look in the weekend or next week, idk. This code is a little big mess that I ducked tape long ago.

Man?...

Hello, sorry, I have no plans to work on this for now. Maybe you'll have some luck in one of the forks.


Does not work with Python 3

I notice that this does not work with Python 3. Is this a project that is going to be left as is, or looking for development and upkeep from the community?

@coljac I've tried updating this to py3. Seems to work fine. Can you verify the py3 branch in this fork: https://github.com/themiyan/pypegase.git ?


fix: Smol fixes on drop page

Thank you for your contribution to the KodaDot - One Stop Shop for Polkadot NFTs.
👇 __ Let's make a quick check before the contribution.
PR Type

[x] Bugfix
[ ] Feature
[ ] Refactoring

Context

[x] Closes #6355
[ ] Requires deployment <snek/rubick/worker>

Did your issue had any of the "$" label on it?

[x] My DOT address: Payout

Copilot Summary

🤖 Generated by Copilot at 658e37c
Refactored the DropCard and UnlockableCollectionInfo components to simplify their logic and props. Moved the UnlockableCollectionInfo component to a more appropriate folder.

🤖 Generated by Copilot at 658e37c

Oh, we're the coders of the sea, and we work with props and APIs
We fetch the data that we need, and we pass it down with ease
We move the components where they belong, and we simplify the logic when it's wrong
So heave away, me hearties, heave away, on the count of three, UnlockableCollectionInfo!

pay 30 usd

😍 Perfect, I’ve sent the payout
💵 $30 @ 4.99 USD/DOT ~ 6.012 $DOT
🧗 16SjUbGKSdjCdWTy3NNT3JxbRVGGqD4mwkHpc6BD9U2Rp29Z
🔗 0xfa98777972ac873e2ca0fd1079abbb070a8934b4cfdfd8c5c40aa05b1ee0d124
🪅 Let’s grab another issue and get rewarded!
🪄 github.com/kodadot/nft-gallery/issues


Fully support the full bugzilla.mozilla.org/rest/ endppoint

The real rest backend is not backwards compatible so we need to bump to v1x and pre 1.x can support the old bzapi (for backwards compat).

I've ported your work over to master branch, and we're using 'native' REST for the most part, except for /configuration
There are still differences between the two, and more differences have cropped up between Bugzilla Prod and the 5.x server on landfill, but I've tried to accommodate for the difference in responses. I think I should leave this issue open until Bugzilla 5.x gets deployed to Prod and there is less difference.


Extremely excessive logging due to 503 throttling "errors"

Which version of the AzCopy was used?
10.21.0
Which platform are you using? (ex: Windows, Mac, Linux)
Windows
What command did you run?
azcopy copy "https://<storage>.blob.core.windows.net/<removed>.vhd" "C:\Users\<removed>.vhd" --overwrite=prompt --check-md5 LogOnly --from-to=BlobLocal
What problem was encountered?
When downloading a moderately sized VHD from Azure blob storage (~128GB) on a fast connection you're likely to get lots of HTTP 503 throttling "errors". They're not truly errors as nothing is really wrong, the server is just indicating it's limiting the download speed.
After completing the download I subsequently found out that AzCopy had spammed the Application event log with ~9000 error events, all just benign throttling "errors". It was actually significantly more, but there were so many it caused the event log to wrap around. I did some quick calculations out of morbid curiosity and at around ~240 events per minute, that's around ~77,500 events throughout the total download time. Each event has around a KB of XML, excluding other metadata, so we're talking about 80MB of garbage.
This is completely insane behaviour, and if disabling the default "log to event log" behaviour is impractical (per other issues), at the very least 503 throttling events should not be logged at error level. At best they're informational, and I'd suggest they're "verbose".
How can we reproduce the problem in the simplest way?
Download a large file from Azure blob storage on a suitably fast connection.
Have you found a mitigation/solution?
Only mitigation I know of is to set AZCOPY_DISABLE_SYSLOG, but that's incredibly counter-intuitive. No reasonable person would expect what's fundamentally just a file transfer tool (ala. robocopy/rsync) to spam system logs, and even less so that the way that it's disabled is via an environment variable. I'm saying this because by the time you realise what's happened the damage is likely done.

Hi @ralish I do understand your concern here about excessive logging emitted by AzCopy. If these logs are not there, customer will come back saying my job took extremely long time to complete and we will have no proof that from backend we continuously received 5xx error or their account was being throttled. Error logs are important to debug any customer reported issues.
That being said, I do ack that logging is excessive here and we do have a backlog item to optimize our logging infra. For now, disabling it is the only way out. On a sunny day you shall not hit so many retries and the log rotations will not happen as well.

Closing this here as we do have a backlog item to relook and enhance our overall logging infra. This is on low priority as of now due to other important customer deliverables.


Ability to specify environment variables in Kudu.Web interface?

It took me a bit to find documentation on how to specify environment variables for my node app running on Kudu. I eventually found that I had to go to kudu/apps/codetunnel/site/wwwroot/web.config and add an appSettings node under the configuration node. Then I could add name value pairs that would turn into environment variables.
It would be a lot more awesome if I could just go to the Kudu.Web interface, click my application, click "configuration", and then add name value pairs to the custom properties section and get those as environment variables. Or else add another section just titled "environment variables".

+1

Hi
Kudu will continue to run in Azure App Service. However, this repo will no longer be maintained.
If the problem persists and is related to running on Azure App Service, please open a support incident in Azure:
https://learn.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request
This way we can better track and assist you on this case
Thanks,
Joaquin Vano
Azure App Service


Battery charger ADP5061 driver

Battery charger driver to be used with charge-control API.

@mkiiskila all suggestions addressed in forced update, thanks for the review


TagBot trigger issue

This issue is used to trigger TagBot; feel free to unsubscribe.
If you haven't already, you should update your TagBot.yml to include issue comment triggers.
Please see this post on Discourse for instructions and more details.
If you'd like for me to do this for you, comment TagBot fix on this issue.
I'll open a PR within a few hours, please be patient!

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/59469

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/72273

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/79105

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/82663

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/83501

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/85408

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/86553

Triggering TagBot for merged registry pull request: https://github.com/JuliaRegistries/General/pull/89852


Tokenizer

Added some code and tests for adding missing characters into machine.py.
Along the way, I ran into two issues related to existing code for adding language codes. The first issue was that if both lang_codes were new, it would assign the wrong index for the second one and then crash. I fixed this by upgrading to the latest version of transformers. However, the other issue is that for every tokenizer I've tried that isn't NllbTokenizerFast, added language codes don't save when the tokenizer is saved, and so when the tokenizer is reloaded it crashes when given the new language code. I haven't been able to resolve that yet, so I'm going to open a separate issue for it.
Also, in my tests I'm using the model hf-internal-testing/tiny-random-nllb. However, I think there's a mistake in the tokenizer_config.json) file, because it has "tokenizer_class": "MBartTokenizer" when it should be "tokenizer_class": "NllbTokenizer". Should I go ahead and submit a pull request on huggingface to change that, or is there a reason I'm not aware of why it should be MBartTokenizer?

This change is

machine/jobs/settings.yaml line 8 at r1 (raw file):

  tokenizer:
    update_src: false
    update_trg: false

Why are we defaulting this to false?  Wouldn't the default behavior be to update the tokenizer?  Is there some reason we would want to default to false?

machine/tokenization/custom_normalizer/tokenizer_config.json line 2 at r1 (raw file):

{
  "additional_special_tokens": null,

Can this be modified through the build_params?

machine/translation/huggingface/hugging_face_nmt_model_trainer.py line 175 at r1 (raw file):

                    data["model"]["vocab"][token] = vocab_len + i
                file.seek(0)
                json.dump(data, file, ensure_ascii=False, indent=4)

Why are you overwriting the tokenizer.json file?  Why not create a new file in the project (or potentially, a small json diff that would merged into tokenizer.json...)?

Codecov Report
Attention: 90 lines in your changes are missing coverage. Please review.

Files
Coverage Δ

...huggingface/test_hugging_face_nmt_model_trainer.py
3.50% <0.00%> (-96.50%)
:arrow_down:

... and 11 files with indirect coverage changes
:loudspeaker: Thoughts on this report? Let us know!.

machine/translation/huggingface/hugging_face_nmt_model_trainer.py line 175 at r1 (raw file):
Previously, mshannon-sil wrote…
Well there's no need to keep the older tokenizer file, so I think it would be a bit of a waste of memory space to have an old and new version of tokenizer.json in the same project directory. As for merging a small json diff, I didn't think there was a way to get around overwriting the whole file. All the recommendations I see online just dump the whole updated json object into the file, overwriting all its contents. Do you have a link to an example of merging json into a json file in place without overwriting everything?

That's fine - as long as it worked.  The biggest concern would be if there were two successive runs using machine.py - the tokenizer.json would continue to drift over time.  I am assuming that would not be desired, but neither would it be a huge issue either.  Also, we run these jobs on a fresh docker image each time.  It would have more concern for incremental tuning - if we need to add more and more tokens over time.

machine/jobs/settings.yaml line 6 at r4 (raw file):
Previously, ddaspit (Damien Daspit) wrote…
This should be moved under huggingface.

Should I also change these names to add_unk_src_tokens and add_unk_trg_tokens to match the changed argument names in HuggingfaceNmtModelTrainer?

machine/jobs/settings.yaml line 24 at r5 (raw file):

      batch_size: 16
    tokenizer:
      add_unk_src_tokens: false

Why false and true?  What if people are doing a Backtranslation?  Why would we not want both to be true?

tests/translation/huggingface/test_hugging_face_nmt_model_trainer.py line 203 at r5 (raw file):

            max_target_length=20,
            add_unk_src_tokens=False,
            add_unk_trg_tokens=False,

Sometimes initialized to true sometimes to false - why?


Program not respond in use an unknown partition

But this is a problem.
If the type of key or formatting is not recognized, you can not completely stop the program.
Originally posted by @gioreva in https://github.com/djuseeq/Ch376msc/issues/19#issuecomment-577609978

Hi, i have updated and uploaded again but i can't reproduce this error. If you have CH376 on module also then try with different architecture(e.g.8bit AVR, Uno board), the same problem occurs? Or if you have it just on your PCB then try to do not use other libraries, just in the very beginning put all devices on SPI bus in inactive state(CS pins). Do you have logic analyzer? I am very curious about the communication on the SPI bus when the error occurs. Regards

Or one more idea, try on UART

I would like to help by analyzing the code.
The problem is that they are late with all my projects.
I also decided that I mount optional CH376, on my card, because it is expensive.
You can add as many debug print?
So I am sending you a result to understand where and why crashes.
When I have time I will try to analyze the code.

However, if you have made entered the code for timeout insertion, only mistakes to not accept other commands after this.

Forcing higher the interrupt pin, the program crashes.

Hi, Int pin does not need pull-up resistor, put the pull-up resistors to the ChipSelect pins, and you can try this version. If that doesn't help, then if I have some free time i will write a debug version to see where it stuck.

Same using this download.
I have no resistor on INT pin, but when the chip is not welded is floating
I could put a resistor to ground, but now the card is in production.
The test program prints nothing, stops at init(), if INT is high.
flashDrive.init();
delay(100);
tft.println("Ch376 test");
if (flashDrive.pingDevice())     tft.println("Ch376 ok");
else   tft.println("Ch376 fail");

Opps, sorry, crash is forcing INT LOW


[BUG] Forms labeled as approved when moving to next step

Describe the bug:
When a form is approved by a lower level, it appears as approved in the next stage's inbox, rather than pending.
To Reproduce:
Steps to reproduce the behavior:

Go to any form as a kiosk, and fill it out.
Log in to the approval manager
Approve the form as a manager
Login to the form's second step for a workflow
See the request marked as approved.

Expected behavior:
The card should appear as pending, rather than accepted.
Actual Behavior:
A clear description of what actually happened.
Screenshots:

What's strange is, we can see the two pending requests, so some PR must've broken it.
Environment:

OS: Windows Venv
Production build

Additional context:
This was working when workflows was merged in, some PR afterwards must've broken it.

Extremely minor fix, a line was added elsewhere by mistake during the email process.