[BUG] ORC Reading should be in a positional way if all column names start with _col.

Describe the bug
Accorrding to the code here , Spark will select columns by index instead of column name if all column names start with _col.  But GPU still uses colum names, then it produces different output than CPU. For example

scala> import org.apache.spark.sql.types._
import org.apache.spark.sql.types._

scala> case class Testing(_col1: Int, _col2: String, _col3: Int)
defined class Testing

scala> val df = Seq(Testing(1, "hello", 2021)).toDF
df: org.apache.spark.sql.DataFrame = [_col1: int, _col2: string ... 1 more field]

scala> df.write.mode("overwrite").orc("/data/tmp/orc_pos/")

scala> val schema = StructType(Seq(
     |         StructField("name", StringType),
     |         StructField("id", LongType),
     |         StructField("year", IntegerType)))
schema: org.apache.spark.sql.types.StructType = StructType(StructField(name,StringType,true),StructField(id,LongType,true),StructField(year,IntegerType,true))

scala> spark.conf.set("spark.rapids.sql.enabled", "true")

scala> spark.read.schema(schema).orc("/data/tmp/orc_pos").show
22/07/11 05:19:52 WARN SchemaEvolution: Column names are missing from this file. This is caused by a writer earlier than HIVE-4243. The reader will reconcile schemas based on index. File type: struct<_col1:int,_col2:string,_col3:int>, reader type: struct<>
+----+----+-----+
|name|  id|year|
+----+----+-----+
|null|null| null|
+----+----+-----+

scala> spark.conf.set("spark.rapids.sql.enabled", "false")

scala> spark.read.schema(schema).orc("/data/tmp/orc_pos").show
22/07/11 05:20:00 WARN SchemaEvolution: Column names are missing from this file. This is caused by a writer earlier than HIVE-4243. The reader will reconcile schemas based on index. File type: struct<_col1:int,_col2:string,_col3:int>, reader type: struct<name:string,id:bigint,year:int>
+----+----+-----+
|name|  id|year|
+----+----+-----+
|   1|null| 2021|
+----+----+-----+

Expected behavior
The output should be the same with CPU's.
Additional context
The CPU output is expected, because schema evolution took effect.

name
type
value

_col1 -> name
int -> string
1 -> "1"

_col2 -> id
string -> long
"hello" -> null ("hello" is not a valid numeric string, so resulted in a null)

_col3 -> year
type is the same, no type conversion
2021 -> 2021

The GPU output are all nulls ,because no columns are found in the file schema.

The fix should depend on https://github.com/NVIDIA/spark-rapids/pull/5960.


Change Android views to Jetpack Compose

Supposedly, this can be done iteratively and doesn't need to be one big bang. Jetpack Compose gets rid of all the XML code and uses a declarative UI, similar to SwiftUI.
https://developer.android.com/codelabs/jetpack-compose-migration

I hope this makes the models and view models (why is there such a thing as a view model?? And why does ChatGPT say a VM can't observe changes on a model? Isn't that one of the only things it should do?)
I really don't understand the architecture of Android, neither the DI nor the MVVM stuff seems like any improvement over a monolith.


taskset: failed to set pid affinity

When running the client ./run.sh script having started the memcached server with mutated set up, I encounter the error message:
taskset: failed to set pid 3789's affinity: Invalid argument
For context, I am running the script with the following arguments:
./run.sh 4 10 4000000 200 2500 2 <IP_ADDRESS> 11211

You'll need to double check the arguments in taskset.


New LowCode platform

Hi
Please add the following to your awesome:
https://github.com/mirshahreza/AppEnd

@mirshahreza you can always change the Readme.md file and create a pull request from it.


Update miq-shortcuts

Description
https://github.com/ManageIQ/manageiq-ui-classic/pull/1204 will change the url of the containers list view.
This PR update the new url in the miq_shortcuts.yml file.
This PR depend on https://github.com/ManageIQ/manageiq-ui-classic/pull/1204

@miq-bot add_label compute/containers, bug
@simon3z @zeari @moolitayer @himdel please review

@miq-bot add_label providers/containers


Proposed recipe: fastest of cache vs network

Much like cache and network race, https://jakearchibald.com/2014/offline-cookbook/#cache-network-race, so that an app can dual fetch (from cache and network, and if network loses, it will then cache the latest response for next time).

That's already implemented as you describe in the quite useful toolbox.fastest request handler.
Please reopen if I'm misinterpreting your request and you're asking about something else.


Updated Linuxbrew instructions

The current ones are outdated and no longer work.

Merged, thanks!

Welcome! :-)


Fix typing for Table columns

Changes

This PR is to fix a portion of #886. The aim is to throw type errors when passing sub-columns. This is since we don't support grouped headers.
Testing

Docs

Couldn't get this working. Thought process explained in https://github.com/iTwin/iTwinUI/issues/886#issuecomment-1410585721


add BufferPacketType const values according to PION transport

I don't know whether BufferPacketType is useful in our cases.
I am waiting for more commits to see the usage of BufferPacketType before making decision whether merging this PR.
Thanks.

We have migrated this crate to the monorepo(webrtc-rs/webrtc) please re-open this pull request over there.


remove need to whitelist locales in @shopify/address

Description

This PR is to update @shopify/address to expand the number of supported locales. CountryService has expanded its list of SupportedLocales with all locales that are supported by ShopifyI18n and has also build in a default to fallback to en mechanism (https://github.com/Shopify/country-service/pull/409). Therefore we can remove the need to check against and maintain a list of supported locales on @shopify/address-consts.
The motivation behind this work is to allow for zh-CN and zh-TW in the address form in credit card billing form. Fixes https://github.com/Shopify/intl-china/issues/110
Below is the list of languages supported by shopify/web, and its state of translations for address forms before and after this PR.

country
before this PR
after this PR

Dansk
✅
✅

Deutsch
✅
✅

English
✅
✅

Español
✅
✅

Français
✅
✅

Italiano
✅
✅

Malay
❌
✅

Nederlands
✅
✅

Norsk
❌
✅

Polski
❌
✅

Português
✅
✅

Português (BR)
✅
✅

Suomi
❌
✅

Türkçe
❌
✅

Svenska
❌
✅

čeština
❌
✅

Hindi (हिन्दी)
❌
✅, but 1 field does not have translations in CountryDb

Thai
❌
✅

Japanese
✅
✅

Chinese (Simplified)
❌
✅

Chinese (Traditional)
❌
✅

Korean
❌
✅

Side note
Although the removal of some fields to ResponseError is unnecessary for this to work, however the interface for ResponseError is not aligned to GraphQl specification. So I have taken upon myself to fix this while adding the new fields to the interface. Let me know if this should be in another PR.
Type of change

[x] @shopify/address Minor: New feature (non-breaking change which adds functionality)
[x] @shopify/address-consts Major: Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] @shopify/address-mocks Minor: New feature (non-breaking change which adds functionality)

Checklist

[x] I have added a changelog entry, prefixed by the type of change noted above
[x] 🎩 with shopify/web

Give that this work requires changes from a few different PRs going it may be worth 🎩 ing all of them in web. We have a documented guide.
Though you might have to fight with lerna to get all the version correct since these PRs are all independent. For 🎩ing, I'd recommend

git cherry-picking all these changes into one branch
Revert all the manual version bumps
Run through the lerna release steps in the  guide for 🎩 ing
Consume in the project you're testing this on and test.

Initially I was under the impresssion that I have to split this PR, https://github.com/Shopify/quilt/pull/1302 and https://github.com/Shopify/quilt/pull/1303 into separate PRs and release the packages in order. However it turns out the release process is that all codes will be merged into master and everything should be released in one go. Therefore I am going to collapse the 2 other PRs into this PR.
By having all the changes required for this feature in 1 single PR, it will be easier to review and 🎩 the code changes.

@shopify/address (v2.8.0) requires @shopify/address-consts (v2.0.0) and @shopify/address-mocks (v1.3.0)
@shopify/address-mocks (v1.3.0) requires @shopify/address-consts (v2.0.0)

But doing yarn dev-release only bumps the version of each packages, without bumping the required dependencies (Which is understandable because I wouldn't expect Lerna to know which dependencies need to be bumped). However adding a commit to bump the dependencies will result in build error before the newly versioned packages are not released yet.

All in all, it seems like I shouldn't be putting bumping all 3 packages into the same PR. The sequence should be:

merge PR to improve and bump @shopify/address-consts
release @shopify/address-consts (requires admin)
merge PR to improve and bump @shopify/address-mocks so that it can use the new @shopify/address-consts version.
release @shopify/address-mocks (requires admin)
merge PR to improve and bump @shopify/address so that it can use the new @shopify/address-consts and @shopify/address-mocks version.
release @shopify/address (requires admin)

cc @ismail-syed

@ismail-syed I've tested with the dev release for 🎩 ing.
the released packages were

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Shipit built it directly into this PR, i'm not sure what is the next step now. Can you let me know whats after this? do i just merge?

The following steps require admin access to the Shopify/quilt GitHub repo.

@ismail-syed How do I get the above packages released? My guess is that I can follow the steps of the release-and-deploy.md#creating-releases and wait for an admin to merge the PR?

@TayKangSheng these packages are being release.

Thank you @michenly!! :grinning:


Fix crash for API lower than 23

PREVIEW_SDK_INT was introduced in API level 23 so we should check for Marshmallow not for Lollipop

Thanks! I merged this and released 2.2.2 from a tiny Bolivian airport ;-) - as mentioned in the release note:
Sorry for all affected! I'm traveling right now and it is difficult for me to quality control things well, while we don't have great CI support
PRs that add CirlceCI support for this repo, ideally using the react-native-community CircleCI orb (read as: most of the work should be done for you) would be most welcome!

Hey @mikehardy, hope we won't hear from you for the next 3 weeks.
Please enjoy your well deserved vacations away from OSS <3


DAB Melbourne 1 crashes

Hello,
AbracaDABra most of the time is experiencing crashes when selecting any service within the ensemble DAB Melbourne 1. This started to happen when services iHeartAustralia and iHeartDance were added to the ensenble, I am using AbracaDABra 2.2.1 on Windows.  I have attached unsigned 8 bit recordings where 20-32-13_202928000Hz.bin is working and 20-30-50_202928000Hz.bin is crashing.
sample.zip

Hello, thanks for reporting and sharing the recording. I can reproduce the issue on my side. Could you please share longer version of non working case (at least 30sec) ? I know how to fix the symptoms but I would like to understand what is really going on.

https://www.digitalbitrate.com/dtv.php?mux=9A&liste=1&live=628&lang=en
For those who are interested, there is a scanner in Melbourne, too.

Thanks for the quick response and release! It will no longer immediately crash. I noticed sometimes if I quickly switch between RSN Xtra 2 and other services, it is unable to change and produces these warnings:
21:31:04.359 [W] RadioControl: RadioControlEvent::SERVICE_SELECTION error 2
21:31:38.881 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F010C3, SCIdS 00: status 2

There are still some crashes occurring when I attempt to add favourite services. Curiously the ensemble country says Malaysia not Australia. Attached is a one minute recording. https://mega.nz/file/kdJWFT7D#C4ThaOi3IOUOJ-PTwPfOz5UHgoL6m_XzUKmXXfC3EaI

Thank you for sharing the recording, very appreciated!
I can meanwhile answer "Malaysia"issue - it is because ECC is 0xF0 and ensemble ID is 0xF003 thus country code (first 4 bits of ensemble ID) is 0xF. According to ETSI TS 101 756 V2.4.1 table 7 it is interpreted  as Malaysia. For Australia, ensemble ID should start with country ID 1-8. It seems that other ensembles in Melbourne are violating standard too.
I will try to reproduce other issues. I am very surprised about favourite crashes since this feature is widely used and nobody complained. Did you observe this problem since you started to use the app or has it started to happen recently?

Interesting. Looking at the digitalbitrate.com site, Perth is also using F.
After further testing, it seems the favourites crashing issue is not related to a particular service/ensemble but instead caused by using the services list (not the ensemble-tree). Choosing any services from this list then clicking the star will cause a crash. Using the ensemble-tree list instead does not cause a crash. 2.1.1 is not affected by 2.2.1 and 2.2.2 is.

I have just released 2.2.3 that should fix the issues. Please let me know if it works.

There were some issues with services removed from the ensemble tree but after a re-scan, it is all fixed. Other than that, it is ok.
15:12:51.653 [I] ServiceList: Removing service: [F0F003] RSN Xtra 2         F010C3 : 0
15:12:51.653 [I] ServiceList: Removing service: [F0F003] RSN Xtra 1         F010C1 : 0
15:12:51.653 [I] ServiceList: Removing service: [F0F003] TAB Lounge         F010C2 : 0

15:24:57.957 [I] RadioControl: Tuning 202.928 -> 206.352 MHz ...
15:24:57.971 [I] AudioOutput: Muting... [available 1920 samples]
15:24:59.077 [I] RadioControl: Current frequency 206.352 MHz
15:24:59.898 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS PopAsia        F03903 : 255
15:24:59.899 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS Arabic24       F03904 : 255
15:24:59.902 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS PopDesi        F03905 : 255
15:24:59.905 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC Classic        F03104 : 255
15:24:59.907 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC Country        F0310B : 255
15:24:59.911 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC Sport          F03100 : 255
15:24:59.913 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC Jazz           F03109 : 255
15:24:59.916 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC KIDS listen    F0310A : 255
15:24:59.919 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC NewsRadio      F0310C : 255
15:24:59.921 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABCRadioNational   F03103 : 255
15:24:59.924 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] ABC MELBOURNE      F03102 : 255
15:24:59.927 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] Double J           F03108 : 255
15:24:59.929 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] triple j           F03106 : 255
15:24:59.932 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] triplejUnearthed   F03107 : 255
15:24:59.934 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS Radio 1        F03900 : 255
15:24:59.937 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS Radio 2        F03901 : 255
15:24:59.939 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS Radio 3        F03906 : 255
15:24:59.942 [I] ServiceList:           [F03100 @ 206352 kHz |  9C] SBS Chill          F03902 : 255
15:24:59.944 [I] ServiceList: Removing service: [F03100] triplejUnearthed   F03107 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC Sport          F03100 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC NewsRadio      F0310C : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS PopAsia        F03903 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC MELBOURNE      F03102 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS Radio 3        F03906 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS Chill          F03902 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] Double J           F03108 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS PopDesi        F03905 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS Radio 1        F03900 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS Radio 2        F03901 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC Jazz           F03109 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC Classic        F03104 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] triple j           F03106 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC Country        F0310B : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABC KIDS listen    F0310A : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] ABCRadioNational   F03103 : 0
15:24:59.944 [I] ServiceList: Removing service: [F03100] SBS Arabic24       F03904 : 0
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03100, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F0310B, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03104, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03905, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03904, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03903, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03108, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03102, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03103, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F0310C, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F0310A, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03109, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03902, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03906, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03901, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03900, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03107, SCIdS FF: status 2
15:25:01.082 [W] RadioControl: DABSDR_NID_USER_APP_LIST SId F03106, SCIdS FF: status 2

It clearly does not work 🙁 I will try to fix it today, but I am not sure I will manage that. This is unexpected side effect from the change I did and it will probably affect all users 🙁

What is the technical background? Too many services?

The background is that this ensemble is not compliant with current DAB standard (SCIdS: The primary service component shall use the value 0) and the library is not implemented for supporting it and thus there is some unexpected behaviour. I am trying to find a way to support it without sacrifying performance on compliant ensembles.

I have released 2.2.4 with new version of DABSDR library. I hope it will fix the issues. Please try and let me know.

No problems so far 🙂

I am glad you do not see any problem so far, but I am afraid it still needs some fixes 🙁

Could you please try DABSDR 2.3.4 from attachment. Just replace DLL in AbracaDABra folder. You shoud see DABSDR version 2.3.4 in About application dialog.
Please let me know if you see any side effects.
libdabsdr.zip

After upgrading, the affected services become missing on the ensemble tree until a re-scan is performed

The services should update automatically once you tune the ensemble. Do I understand correctly that 3 services marked yellow appeared in the service list (left) but not in tree (right) until full band scan was performed? Or was it enough just to tune 9A channel to fix it?

This is correct. A band scan or clear services list then selecting 9A is needed to have services appear correctly in the tree. Subsequent close and re-open of the application does not have this issue.
Scan immediately after updating DLL
01:15:02.285 [I] RadioControl: Tuning 0.000 -> 202.928 MHz ...
01:15:02.737 [I] RadioControl: Current frequency 202.928 MHz
01:15:05.160 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM 2000s          F0113B : 0
01:15:05.162 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN Track          F01108 : 0
01:15:05.178 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth 91.5        F0111B : 0
01:15:05.179 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Racing&Sport   F010C0 : 0
01:15:05.196 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN 1116           F01106 : 0
01:15:05.211 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3MBS Fine Music    F0114E : 0
01:15:05.227 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM 80s            F01137 : 0
01:15:05.242 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] LightMIX           F0114D : 0
01:15:05.257 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Coles Radio        F0111C : 0
01:15:05.272 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Light89.9          F01151 : 0
01:15:05.287 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN SYDNEY         F0110A : 0
01:15:05.304 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM COUNTRY        F01139 : 0
01:15:05.319 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3RRR Digital       F0114C : 0
01:15:05.334 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Light Christmas    F01152 : 0
01:15:05.350 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Xtra 1         F010C1 : 1
01:15:05.366 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Radio Maria        F0111E : 0
01:15:05.388 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] NICHE RADIO        F0110B : 0
01:15:05.404 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Chill Pop Hits     F0113A : 0
01:15:05.426 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] TAB Lounge         F010C2 : 2
01:15:05.444 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Nova 100           F0111A : 0
01:15:05.461 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] iHeartAustralia    F01132 : 0
01:15:05.479 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN FAN            F01107 : 0
01:15:05.495 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Radio Maria Ital   F01008 : 0
01:15:05.510 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] VA IRIS Melb       F01150 : 0
01:15:05.527 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] DISRUPT            F0110C : 0
01:15:05.543 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Xtra 2         F010C3 : 4
01:15:05.577 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] NICHE RADIO 2      F0110D : 0
01:15:05.592 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] iHeartDance        F01133 : 0
01:15:05.611 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth Relax       F0111D : 0
01:15:05.628 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] easy music 3MP     F01109 : 0
01:15:05.644 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3ZZZ Ethnic        F0114F : 0
01:15:05.661 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM CLASSIC ROCK   F01138 : 0
01:15:05.678 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth Vintage     F0111F : 0
01:15:05.697 [I] ServiceList: Removing service: [F0F003] TAB Lounge         F010C2 : 0
01:15:05.697 [I] ServiceList: Removing service: [F0F003] RSN Xtra 1         F010C1 : 0
01:15:05.697 [I] ServiceList: Removing service: [F0F003] RSN Xtra 2         F010C3 : 0

Scan after clearing services list
01:17:24.888 [I] RadioControl: Tuning 202.928 -> 0.000 MHz ...
01:17:27.335 [I] RadioControl: Tuning 0.000 -> 202.928 MHz ...
01:17:27.805 [I] RadioControl: Current frequency 202.928 MHz
01:17:30.227 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN Track          F01108 : 0
01:17:30.230 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Xtra 2         F010C3 : 4
01:17:30.230 [I] ServiceList: Adding F010C3 : 4 as primary service [old DAB standard]
01:17:30.247 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] iHeartDance        F01133 : 0
01:17:30.250 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth 91.5        F0111B : 0
01:17:30.266 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Racing&Sport   F010C0 : 0
01:17:30.284 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN 1116           F01106 : 0
01:17:30.300 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3MBS Fine Music    F0114E : 0
01:17:30.316 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM 80s            F01137 : 0
01:17:30.332 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] LightMIX           F0114D : 0
01:17:30.349 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Light Christmas    F01152 : 0
01:17:30.364 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth Relax       F0111D : 0
01:17:30.382 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] easy music 3MP     F01109 : 0
01:17:30.398 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Light89.9          F01151 : 0
01:17:30.415 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN SYDNEY         F0110A : 0
01:17:30.431 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM COUNTRY        F01139 : 0
01:17:30.448 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] NICHE RADIO        F0110B : 0
01:17:30.465 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM CLASSIC ROCK   F01138 : 0
01:17:30.482 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3RRR Digital       F0114C : 0
01:17:30.498 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Chill Pop Hits     F0113A : 0
01:17:30.516 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] TAB Lounge         F010C2 : 2
01:17:30.516 [I] ServiceList: Adding F010C2 : 2 as primary service [old DAB standard]
01:17:30.532 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] iHeartAustralia    F01132 : 0
01:17:30.550 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Radio Maria        F0111E : 0
01:17:30.565 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Smooth Vintage     F0111F : 0
01:17:30.584 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Coles Radio        F0111C : 0
01:17:30.600 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Nova 100           F0111A : 0
01:17:30.622 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] SEN FAN            F01107 : 0
01:17:30.641 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] Radio Maria Ital   F01008 : 0
01:17:30.663 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] VA IRIS Melb       F01150 : 0
01:17:30.682 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] RSN Xtra 1         F010C1 : 1
01:17:30.682 [I] ServiceList: Adding F010C1 : 1 as primary service [old DAB standard]
01:17:30.701 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] DISRUPT            F0110C : 0
01:17:30.721 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] MMM 2000s          F0113B : 0
01:17:30.740 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] NICHE RADIO 2      F0110D : 0
01:17:30.761 [I] ServiceList:           [F0F003 @ 202928 kHz |  9A] 3ZZZ Ethnic        F0114F : 0

I found the rootcause but I have decided not to fix it because it is only affecting old DAB standard transmission and it should not happen anymore unless SCIdS will change in future. It was caused by changing SCIdS from 0 (stored service list with older DLL) to N (service list using new DLL) on affected services.
By the way restarting of the application fixes it too, no need to rescan the band.
Side note: old standard 1.4.1 is from 2006, latest standard 2.1.1 is from 2017 and there is already new version in preparation. No transmission should use SCIdS != 0 for primary service today.

Fair enough. I don't have anything to say. Good job!


(Enhancement) Add sound support for more click events

Now, the extension gives user some kind of clicking feedback and sure improves the experience.
However, the only click event supported is game selection.
it's not enough comparing to other game UI, such as Steam's big picture mode. (Though, Steam won't let you DIY the sound which is not cool as this extension)

i can only add events for events that are exposed by the plugin system and thats whats already happening


getting best bids/asks from orderBookSync

Hi,
Is there a way to fetch latest/best bids and asks from websocket. I see the orderBookSync which returns >30k entries list for bids and asks. How to get the sorted list and get the latest/best values for bids and asks. Is there a ready way available in the orderBookSync method?
Also how often does this list get updated from websocket?
Want to know from the community best ways of dealing with this method.

I'm also looking for a nice way to get just the top few items from the order book.  I half solved it with the code below, but it's doesn't work for bids because of the way the RBTree is sorted.  If you replace the asks with the bids you get the worst prices rather than the best.
const orderbookSync = new GDAX.OrderbookSync(['BTC-USD', 'ETH-USD']);

function printTop(symbol, count) {
    const book = orderbookSync.books[symbol];

    let it = book._asks.iterator();
    let item;
    let i = 0;

    while ((item = it.next()) !== null) {
        i++;

        let quantity = 0;
        item.orders.forEach((order) => quantity += order.size.toNumber());

        console.log(i, {price: item.price.toString(), quantity: new BigNumber(quantity).toString()});

        if (i >= count)
            break
    }

    console.log();
}

setInterval(() => {
    printTop('BTC-USD', 5);
}, 5000);


Link code on KITTI homepage

Dear author,
thank you for the tensorflow version of our paper Sparsity Invariant CNNs.
We would actually like to link your code on the KITTI homepage - would this be fine with you?
Thanks!
Nick

@nischnei
Hi nischnei, would you think this is the correct implementation of sparse convolution in tensorflow?
Because the code of the paper is not released yet.

Hey buldajs,
I'm on of the authors of the paper and I got the code working yesterday. There are minor improvements to be made, which I will address in a seperate post.
Furthermore, we should maybe add an example, especially if you want it to use for the depth completion task we just released:
http://www.cvlibs.net/datasets/kitti/eval_depth.php?benchmark=depth_completion
We will also release the caffe version of our code on the webpage, but have to extract it first as it is part of a huge deep learning framework which we are not allowed to release by our company.

Hello,
Yes of course you can link it to your homepage!
I´m also open to adress any changes you like.

@nischnei
Hei nischnei, thanks for your answer!
I am doing research on depth completion, I implement the sparse convolution operator like the author did in tensorflow.
I also do some experiments on depth completion task, I observed the sparse convolution can handle the scale of input data. but the result in your paper is so impressive...(multi scale train multi scale test the same 0.99 mae). It's amazing although we can observe the sparisty invariant feature...(but maybe slight change by scale)
So I am confused maybe I missed some small details......

I got tensorflow running since yesterday and haven't worked with it so far. I will need a bit more time to understand all the concepts but hopefully I can give you a better feedback by the end of the week. Currently I see, that kernel regularization seems to be turned off and the bias is initialized with 0.01 instead of zero (if you have mean free images). Fixing both seems to lead to reasonable convergence on the mentioned dataset.

Thanks for your reply about the details.
I will check it. Although in my experiments, it's already converged very fast.
One more question, in your paper, you say the network is 5 layers, 11 7 5 5 3，16channels, the last layer output h,w,16 images, did you use 1×1 conv to do prediction?

Hi @PeterTor
I am working on a 'Single Image Depth Estimation' project, and I would like to use dense depth maps for KITTI training as a starting point. I'm relatively new to the tensorflow world.  It would be of help to me if I get the complete code rather than just the core function. Do you have a version now, which you can share?
Thank you very much.
Regards,
Balaji

Hi @nischnei
Your work is very detailed and excellent, especially the generation of data sets.
Although there are references to the method of making data sets in the paper, it is unfortunate that no relevant code is seen on the Internet.
So could you share the code for generating data sets? I am a student and want to reproduce the results of this article and explore the impact of dynamic objects on data sets.
Thank you very much!

Hi @PeterTor @nischnei
Thanks for this excellent job!
I cannot find the code to make depth ground truth data yet. Can you share the code for generating the data set? I want to use this to conduct more in-depth research.
Thank you very much!


Run mode needs to show URL to join

Once I have programmed a game, I want to share a link that allows people to start their own games, without going through the editor view. That is, basically, the run view. But currently, it does not show the link (because it tries to call a function outside).
Maybe it would be nicer to integrate the showing of the „Share this URL“ into the canvas (or at least the frame, overlying the canvas). Maybe with a button that copies the URL to the clipboard.
Also, the waiting for other players could be visualized. E.g. circles that are filled until all circles are filled.
(This is somewhat rambly phrased. Do you know what I mean?)

Copying to the clipboard without a user action is tricky, because of browser security policies.  Looks like there's an open-source library called clipboard.js that abstracts over the many ways of doing it, so maybe that makes it feasible now.

It could still be an HTML-based dialogue with an entry field. It just needs to be contained by the run.html window, not the env.html window.

I'm switching now to sharing by four-letter codes.  This means typing game codes in the canvas itself, rather than using a dialog.  That will fix this problem.
The new workflow will be:

Share the URL for your project.  You can choose whether to include the source code or not.
All players run the game on their own.
One player chooses to start a new game, and communicates the 4-letter code to the others.
Other players type in the code.

 That sounds nice!

Closing this as a duplicate.


feat(storage): Storage now supports s3 and local filesystems.

Before Storage constructor took a dataset and a layer name,
and would assume that the full path to the layer was
gs://neuroglancer/dataset_name/layer_name.
We now made the the storage class directly take the full path
to the layer make it way more flexible:

Other bucket names can now be used.
gs://neuroglancer-tmp/dataset_name/layer_name
Non-rooted datasets can be used.
gs://neuroglancer/some/other/path/dataset_name/layer_name
Other protocols can be specified to refer to s3 or the local
filesystem.
s3://neuroglancer/dataset_name/layer_name
file://neuroglancer/dataset_name/layer_name

When developing locally, we usually use the python server which holds
our datasets on RAM, this causes problems when they are large. Storing
a dataset on disk, and serving it with a SimpleHTTPServer could a
workaround.

I've tested Ingest, Downsample,  Meshing and MeshManfiest tasks.
I've not tested BigArrayTask, and HyperSquare tasks it is pretty likely that this will break part of them,
but given that those were ad-hoc tasks, which will probably get removed in the future it doesn't seems worth fixing them now.


Improve design

In this PR I improved the design and made it a little responsive.

thanks very much @Kelvin-Ben I appreciate your work, I think there is a close button in the popup though..

Yes, I noticed it, however try repositioning the close button in the upper right corner to make it more noticeable. Take the previous proposal as a challenge, and figure out how to make the popup disappear when the user clicks outside of it.


Exception setting "Version" error during provisioning for Ubuntu 22.04

Description
I am trying to build the runner image for Ubuntu 22.04 and everything proceeds well for around 2 hours until I get to the provisioning step where SoftwareReport.Generator.ps1 is executed. At this point, the packer build fails with the following error:
==> azure-arm.build_vhd: Provisioning with shell script: D:/Sayak/Work/Misc/runner-images/images/linux/scripts/base/apt-mock-remove.sh
==> azure-arm.build_vhd: Provisioning with shell script: C:\Users\mukho\AppData\Local\Temp\packer-shell3143520940
==> azure-arm.build_vhd:  ›   Warning: Our terms of service have changed:
==> azure-arm.build_vhd:  ›   https://dashboard.heroku.com/terms-of-service
==> azure-arm.build_vhd: /imagegeneration/SoftwareReport/SoftwareReport.Generator.ps1 : Exception setting "Version": "The argument is null or empty. Provide an argument that is not null or empty, and then try the command again."
==> azure-arm.build_vhd: + CategoryInfo          : NotSpecified: (:) [SoftwareReport.Generator.ps1], SetValueInvocationException
==> azure-arm.build_vhd: + FullyQualifiedErrorId : ExceptionWhenSetting,SoftwareReport.Generator.ps1
==> azure-arm.build_vhd: Script exited with non-zero exit status: 1. Allowed exit codes are: [0]
==> azure-arm.build_vhd: Step "StepProvision" failed
==> azure-arm.build_vhd: [c] Clean up and exit, [a] abort without cleanup, or [r] retry step (build may fail even if retry succeeds)?

I am not sure as to exactly what is causing the issue as it takes a couple of hours to come to this issue.
Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 18.04
[ ] Ubuntu 20.04
[X] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
I am building locally on my workstation.
Is it regression?
Don't know as this is the first time I am trying this
Expected behavior
I expected the packer build to complete successfully.
Actual behavior
The packer build is throwing an error and then cleaning up and exiting with exit code 1.
Repro steps
I am executing the packer build by running GenerateResourcesAndImage -SubscriptionId 12345678-1234-1234-1234-12345678901 -ResourceGroupName my-rg -ImageType Ubuntu2204 -AzureLocation "Central India" according to https://github.com/actions/runner-images/blob/main/docs/create-image-and-azure-resources.md#prepare-environment-and-image-deployment
I tried running 2 times and the error happened both the times. Since its almost at the end of the build flow, it takes a couple of hours before the error shows and hence I am not able to try and get to the root cause of this. Still, if there is a quicker way I can get this error to trigger, I can update the repro steps in here.

I get same issue for Ubuntu 22.04.
I'd successfully been running the build daily for several days and then it started failing on 12th January 2023 without any changes in my process.
Like above, it fails after a number of hours of build time.
I've rerun several times across several days but still failing - last run 15th January 2023.
Running the call with powershell scripting against a VM Scale Set Agent managed by Azure DevOps.
Call to run the generate:
GenerateResourcesAndImage -SubscriptionId "$SubscriptionId" -ResourceGroupName "$ResourceGroupName" -ImageGenerationRepositoryRoot "$pwd" -ImageType "$ImageType" -AzureLocation "$AzureLocation" -AzureClientId "$AADApplicationID" -AzureClientSecret "$AADApplicationSecret" -AzureTenantId "$AADTenantID" -Force
Sanitised log uploaded.
ImageBuildFailLog.txt

+1
Running the process via Azure DevOps pipeline on a VMSS (Linux) agent as well.
Additionally, I have tried creating a vhd for Ubuntu 20.04 with the same error message.
Will try to aggregate some more logs/information in the meantime.
PS: Is PR #6919 related to this? Running the pipeline again right now to test.
FYI @mikhailkoliada

@davidhoferzeni yes, issue is related to that PR you mentioned. Should be fixed already.

@SayakMukhopadhyay please try again with the latest changes and update your status.

I should be able to test in 6 hours or so, so just hold on.

I'm rerunning now....report back in few hours...

@erik-bershel absolutely awesome, thanks for the fast reply!
Since I had already triggered a run two hours ago, I can confirm that from my side the pipeline is now finishing correctly and generating the image successfully.

Yes, Ubuntu-2204 working for me now as well. Thanks.

So I close that issue.
@SayakMukhopadhyay please feel free to ping me here if you have something to add. Or you may open new one if you have another troubles or concerns.

yep, the build worked. Thanks for making the quick fix!


Support checksum and sha256

Summary

With recent dependency management changes (#390), new versions of .NET Core SDK in the buildpack.toml will have a checksum.
This PR transitions build code to use a checksum for the dependency cache, but will still support dependencies that use a SHA256.
Use Cases

Checklist

[X] I have viewed, signed, and submitted the Contributor License Agreement.
[ ] I have linked issue(s) that this PR should close using keywords or the Github UI (See docs)
[ ] I have added an integration test, if necessary.
[X] I have reviewed the styleguide for guidance on my code quality.
[X] I'm happy with the commit history on this PR (I have rebased/squashed as needed).

@paketo-buildpacks/dotnet-core-maintainers bump on this, lets get this into the next release with the dependency workflow changes


Forwarding serde attributes

In messages, serde attributes should be forwarded for its fields.
Let's consider a function:
fn foo(&self, _: (DepsMut, Env, MessageInfo), #[serde(default)] field: bool) -> Result<Response, ContractError> {
  todo!()
}

Obviously, I want my field to have the #[serde(default)] attribute so it is optional and false by default. Basically, all serde attributes should be moved to a new place.

Moved to 0.4 Milestone due to timing issues - not a critical.


Running warning

Warning when running:
<PKHUD.FrameView 0x7fe412755080> is being asked to animate its opacity. This will cause the effect to appear broken until opacity returns to 1.

See issue #6 - This is nothing to worry about. Might get fixed via workaround though.


Update PowerShellGet to install the modules and scripts to proper locations in PowerShell Core on Windows

Update PowerShellGet to install the modules and scripts to proper locations in PowerShell Core on Windows #2021.
Added few CI tests for PowerShellGet

Hi @bmanikm, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;

Please ignore the changes in fcf747d and 97eb76c commits. Those changes were already merged with master in my last PR.

Please rebase and consider squashing to clean your commit log.
There are two test failures that must be resolved.

Submitted another PR due to rebasing issues with my fork's master.


Oops; flutter has exited unexpectedly.

Flutter crash report; please file at https://github.com/flutter/flutter/issues.
command
flutter packages get
exception
ProcessException: ProcessException: No such file or directory
Command: /usr/bin/xcodebuild -project /Users/brzhang/flutter/flutter/examples/flutter_gallery/ios/Runner.xcodeproj -target Runner -showBuildSettings
#0      _ProcessImpl._runAndWait (dart:io/runtime/binprocess_patch.dart:488:7)
#1      _runNonInteractiveProcessSync (dart:io/runtime/binprocess_patch.dart:634:18)
#2      Process.runSync (dart:io/runtime/binprocess_patch.dart:66:12)
#3      LocalProcessManager.runSync (package:process/src/interface/local_process_manager.dart:83:20)
#4      _runWithLoggingSync (package:flutter_tools/src/base/process.dart:322:48)
#5      runCheckedSync (package:flutter_tools/src/base/process.dart:280:10)
#6      XcodeProjectInterpreter.getBuildSettings (package:flutter_tools/src/ios/xcodeproj.dart:160:24)
#7      CocoaPods.setupPodfile (package:flutter_tools/src/ios/cocoapods.dart:164:52)
#8      injectPlugins (package:flutter_tools/src/plugins.dart:292:17)
<asynchronous suspension>
#9      FlutterProject.ensureReadyForPlatformSpecificTooling (package:flutter_tools/src/project.dart:114:11)
<asynchronous suspension>
#10     PackagesGetCommand.runCommand (package:flutter_tools/src/commands/packages.dart:84:23)
<asynchronous suspension>
#11     FlutterCommand.verifyThenRunCommand (package:flutter_tools/src/runner/flutter_command.dart:348:18)
#12     _asyncThenWrapperHelper.<anonymous closure> (dart:async/runtime/libasync_patch.dart:77:64)
#13     _rootRunUnary (dart:async/zone.dart:1132:38)
#14     _CustomZone.runUnary (dart:async/zone.dart:1029:19)
#15     _FutureListener.handleValue (dart:async/future_impl.dart:129:18)
#16     Future._propagateToListeners.handleValueCallback (dart:async/future_impl.dart:642:45)
#17     Future._propagateToListeners (dart:async/future_impl.dart:671:32)
#18     Future._complete (dart:async/future_impl.dart:476:7)
#19     _SyncCompleter.complete (dart:async/future_impl.dart:51:12)
#20     _AsyncAwaitCompleter.complete.<anonymous closure> (dart:async/runtime/libasync_patch.dart:33:20)
#21     _rootRun (dart:async/zone.dart:1124:13)
#22     _CustomZone.run (dart:async/zone.dart:1021:19)
#23     _CustomZone.bindCallback.<anonymous closure> (dart:async/zone.dart:947:23)
#24     _microtaskLoop (dart:async/schedule_microtask.dart:41:21)
#25     _startMicrotaskLoop (dart:async/schedule_microtask.dart:50:5)
#26     _runPendingImmediateCallback (dart:isolate/runtime/libisolate_patch.dart:114:13)
#27     _RawReceivePortImpl._handleMessage (dart:isolate/runtime/libisolate_patch.dart:170:5)

flutter doctor
[✓] Flutter (Channel master, v0.5.8-pre.288, on Mac OS X 10.13.5 17F77, locale zh-Hans-CN)
    • Flutter version 0.5.8-pre.288 at /Users/brzhang/flutter/flutter
    • Framework revision 21f22ed3ba (63 minutes ago), 2018-08-09 18:23:36 -0700
    • Engine revision e54bc4ea18
    • Dart version 2.0.0-dev.69.5.flutter-eab492385c

[!] Android toolchain - develop for Android devices (Android SDK 28.0.0)
    • Android SDK at /Users/brzhang/Library/Android/sdk
    • Android NDK at /Users/brzhang/Library/Android/sdk/ndk-bundle
    • Platform android-28, build-tools 28.0.0
    • ANDROID_HOME = /Users/brzhang/Library/Android/sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1024-b01)
    ✗ Android license status unknown.

[✓] iOS toolchain - develop for iOS devices (Xcode 9.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 9.4.1, Build version 9F2000
    • ios-deploy 1.9.2
    • CocoaPods version 1.5.3

[✓] Android Studio (version 3.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 26.0.1
    • Dart plugin version 173.4700
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1024-b01)

[!] IntelliJ IDEA Ultimate Edition (version 2017.3.4)
    • IntelliJ at /Applications/IntelliJ IDEA.app
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • For information about installing plugins, see
      https://flutter.io/intellij-setup/#installing-the-plugins

[!] VS Code (version 1.23.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension not installed; install from
      https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter

[✓] Connected devices (2 available)
    • brzhang的 iPhone • c50a3c88e239175b7a126ab35c4ada3a86395abb • ios • iOS 11.4.1
    • iPhone X   • 5480AE66-7B9E-4E72-9174-636D46D1CE46     • ios • iOS 11.4 (simulator)

! Doctor found issues in 3 categories.

Closing as dup of #19852


Sonoff RF with Kerui KR-D026 (states on and off) door sensors

I have this config:
sonoff:
  username<EMAIL_ADDRESS>  password: xxxxxxxxx
  default_class: light
  sensors: [temperature, humidity, pir, door]
  mode: local
  reload: always
  debug: True
  rfbridge:
    Entrance_door:
     turn_on:
     name: Door Sensor with two states
     device_class: door
     timeout: 0
     payload_off: turn_off Entrance_door

the problem is: when i restard home assistant, the entity show that door is closed, when i open the door, it shows door open, but this is it. It just remain open. Even if i close the door, it dosen't show in the entity.

I updated readme. Check new example.
Check this issue https://github.com/AlexxIT/SonoffLAN/issues/185
And this https://github.com/AlexxIT/SonoffLAN/issues/192


RFC: Fix builds with MBEDTLS_HAVE_TIME disabled and test

Description
This attempts to bring together #3444 and (an earlier version of) #3449: it adds tests to catch bad uses of time.h when MBEDTLS_HAVE_TIME is not defined.
The idea is to add an additional, overriding include directory that #errors out if time.h is included.
I wanted to get some feedback before I do the changelog and backports.
Status
IN DEVELOPMENT
Requires Backporting
Yes
Which branch? - I'm not sure and would appreciate guidance.
Migrations
NO
Additional comments
Ping @naynajain and @raoulstrackx.
Todos

[x] Tests
[x] Documentation
[ ] Changelog updated
[ ] Backported

Steps to test or reproduce
Run the tests, specifically build_baremetal and build_crypto_baremetal.

@daxtens I am sorry we somehow lost track of this PR. We would be happy to review it now if you still would like to contribute. Would you like to resolve the conflicts?

Sure, I will add this to my to do list and hopefully get to it within a few
days.

This now applies on the development branch and the build_baremetal and build_crypto_baremetal test suites pass on my Linux x86_64 laptop.

Unfortunately on the CI ./tests/scripts/all.sh build_baremetal and ./tests/scripts/all.sh build_crypto_baremetal are failing:

/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
#error "time.h included in a configuration without MBEDTLS_HAVE_TIME"

Additionally ./tests/scripts/all.sh build_baremetal test_malloc_0_null is failing as well:

In file included from ../../include/mbedtls/build_info.h:59:0,
from ../../include/mbedtls/platform_time.h:25,
from common.h:8,
from common.c:1:
/var/lib/build/tests/configs/config-wrapper-malloc-0-null.h:24:21: error: redefinition of 'custom_calloc'
static inline void *custom_calloc( size_t nmemb, size_t size )

Have you tried running the test suites with ./tests/scripts/all-in-docker.sh? (It supposed to replicate the exact environment on the CI.)

Fascinating. I'll try all-in-docker and report back.

Weird, ./tests/scripts/all-in-docker.sh build_crypto_baremetal and build_baremetal pass for me.
Can you copy out a little more of the context for the first failure please? (the one with the #error from time.h)
I can replicate the failure for test_malloc_0_null. I'll fix that up.

It is weird. Some more context on the error:
  CC    psa_crypto_aead.c
  CC    psa_crypto_driver_wrappers.c
  CC    psa_crypto_mac.c
  CC    oid.c
  CC    psa_crypto_se.c
In file included from /usr/include/x86_64-linux-gnu/sys/types.h:132:0,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/platform.h:64,
                 from aes.c:33:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^
In file included from /usr/include/x86_64-linux-gnu/sys/select.h:43:0,
                 from /usr/include/x86_64-linux-gnu/sys/types.h:219,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/platform.h:64,
                 from aes.c:33:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^
In file included from /usr/include/x86_64-linux-gnu/sys/types.h:132:0,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/platform.h:64,
                 from aria.c:36:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^
In file included from /usr/include/x86_64-linux-gnu/sys/types.h:132:0,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/threading.h:28,
                 from ecp.c:76:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^
In file included from /usr/include/x86_64-linux-gnu/sys/types.h:132:0,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/platform.h:64,
                 from ssl_cache.c:29:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^

And it goes on like that with many more source files.

@daxtens I just learned that ./tests/scripts/all-in-docker.sh doesn't work as expected: it compiles the library on the host and runs the tests in the docker. Can you try manually building and running the test inside the docker image?

oh that's good to know. I will give that a go.

Huh, actually those errors are very revealing:
In file included from /usr/include/x86_64-linux-gnu/sys/select.h:43:0,
                 from /usr/include/x86_64-linux-gnu/sys/types.h:219,
                 from /usr/include/stdlib.h:314,
                 from ../include/mbedtls/platform.h:64,
                 from aes.c:33:
/var/lib/build/tests/include/baremetal-override/time.h:18:2: error: #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
 #error "time.h included in a configuration without MBEDTLS_HAVE_TIME"
  ^

I infer that on your system (and perhaps in Docker, I haven't checked), time.h is included by select.h. This doesn't happen for me (Ubuntu 21.04). It does make some sense, the man page for <sys/select.h> suggests that a time_t type is required so it stands to reason that time.h might be included.
(On Ubuntu, the type is defined out of time.h - sys/select.h includes bits/types/time_t.h for a definition instead.)
So, where to from here?
I see 2 options:

Potentially any number of headers in the standard library might reference a time_t type and pull in time.h to provide it. So we could play whack-a-mole with the header replacement - make sure nothing references select() without MBEDTLS_HAVE_TIME, provide an alternative select.h which is a no-op and doesn't include time.h, and then progressively squash anything else that uses time.h. This may take a while.
Testing against a non-standard libc is fundamentally very difficult without identifying a concrete alternative libc and setting up a full 'cross'-build. That might be a worthwhile exercise for other reasons, but I'm not aware of an easy-to-target libc that doesn't also include time.h (klibc and dietlibc both contain a time.h, for example.) So for now at least, just don't test this - only pick patches 1 and 3.

If you can let me know which direction you'd like to go in I'm happy to keep chipping away at this.

I suggest we go for option 2 with a slight tweak: we leave commit 2 and 4 in, but comment them out and add a comment that these can be enabled once the Ubuntu in the CI is updated to a later version. (In particular to a version that sys/select.h includes bits/types/time_t.h instead of time.h.)

What matters is the libc version, not the distribution. In Glibc 2.23 on Linux, as seen on our CI which mostly runs on Ubuntu 16.04, including (for example) stdlib.h includes sys/types.h which contains
#if defined __USE_XOPEN || defined __USE_XOPEN2K8
# define __need_clock_t
#endif
#define __need_time_t
#define __need_timer_t
#define __need_clockid_t
#include <time.h>
…

In Glibc 2.31 on Linux, as in Ubuntu 18.04, these lines are gone.
Given that Ubuntu 18.04 is already available on our CI images, this gives us another solution: run the new components with the time.h inclusion verification on Ubuntu 18.04. To do that, create functions in all.sh that indicate that the component is not supported on Ubuntu 16.04. This will cause it to run on 18.04 instead.
support_build_baremetal () {
    # Older Glibc versions include time.h from other headers such as stdlib.h,
    # which makes the no-time.h-in-baremetal check fail. Ubuntu 16.04 has this
    # problem, Ubuntu 18.04 is ok.
    ! grep -q -F time.h /usr/include/x86_64-linux-gnu/sys/types.h
}
support_build_crypto_baremetal () {
    support_build_baremetal "$@"
}

I've got the glibc errors sorted, just working on the malloc ones. Thanks for your patience.

This, hopefully, fixes up the build errors. Thanks again for your patience.

Thank you for your patience! We're aware that it can be frustrating to have a pull request left unreviewed and accumulate merge conflicts. We've scheduled some time in the upcoming quarter to finish ongoing work, meaning primarily reviewing/reworking existing pull requests, both from the dev team and the community.

@daxtens do you mind if I push further changes to this PR - I think I can fix the remaining issues.

Absolutely be my guest. My employer has rejigged some priorities and as a
result I have been swamped; if you have cycles please do not let me be the
blocker here!

I believe the CI failures are unrelated to this patch. One is related to #5012, and the other seems to be an infrastructure issue.

Backport passing CI and ready for review: https://github.com/ARMmbed/mbedtls/pull/5563

@d3zd3z, @tom-cosgrove-arm - only the changelog was added since your last review.

I'm very happy for that change to be made, I personally am not going to
have a chance to do it any time soon because I am flat out with other stuff

apologies.

Message ID: @.***>

Do we not also need
diff --git a/library/net_sockets.c b/library/net_sockets.c
index 17a9e4a57..d1700f3bb 100644
--- a/library/net_sockets.c
+++ b/library/net_sockets.c
@@ -107,7 +107,9 @@ static int wsa_init_done = 0;

 #include <stdio.h>

+#if defined(MBEDTLS_HAVE_TIME)
 #include <time.h>
+#endif

 #include <stdint.h>

Something to let library/timing.c compile without MBEDTLS_HAVE_TIME:
diff --git a/library/timing.c b/library/timing.c
index 8a02c00de..0c47a8cdc 100644
--- a/library/timing.c
+++ b/library/timing.c
@@ -45,9 +45,12 @@ struct _hr_time

 #include <unistd.h>
 #include <sys/types.h>
+#if defined(MBEDTLS_HAVE_TIME)
 #include <sys/time.h>
-#include <signal.h>
 #include <time.h>
+#endif
+#include <signal.h>
+#define gettimeofday(x, y)

 struct _hr_time
 {
@@ -77,6 +80,7 @@ struct _hr_time
  */
 #if defined(_WIN32) && !defined(EFIX64) && !defined(EFI32)

+#if defined(MBEDTLS_HAVE_TIME)
 unsigned long mbedtls_timing_get_timer( struct mbedtls_timing_hr_time *val, int reset )
 {
     struct _hr_time *t = (struct _hr_time *) val;
@@ -97,6 +101,15 @@ unsigned long mbedtls_timing_get_timer( struct mbedtls_timing_hr_time *val, int
         return( delta );
     }
 }
+#else
+unsigned long mbedtls_timing_get_timer( struct mbedtls_timing_hr_time *val, int reset )
+{
+    (void) val;
+    (void) reset;
+
+    return( 0 );
+}
+#endif /* MBEDTLS_HAVE_TIME */

 #else /* _WIN32 && !EFIX64 && !EFI32 */

Finally, it's possible to compile the library without MBEDTLS_HAVE_TIME but with MBEDTLS_TIMING_C - this may or may not be an oversight.
However, this PR (together with my comments above) does then work, except for programs/test/benchmark.c.
Here, I suggest the following:
diff --git a/programs/test/benchmark.c b/programs/test/benchmark.c
index d3faad91e..83adf4373 100644
--- a/programs/test/benchmark.c
+++ b/programs/test/benchmark.c
@@ -17,6 +17,9 @@
  *  limitations under the License.
  */

+#if !defined(MBEDTLS_TIMING_C)
+#endif
+
 #define MBEDTLS_ALLOW_PRIVATE_ACCESS

 #include "mbedtls/build_info.h"
@@ -30,10 +33,10 @@
 #define mbedtls_free       free
 #endif

-#if !defined(MBEDTLS_TIMING_C)
+#if !defined(MBEDTLS_TIMING_C) || !defined(MBEDTLS_HAVE_TIME)
 int main( void )
 {
-    mbedtls_printf("MBEDTLS_TIMING_C not defined.\n");
+    mbedtls_printf("MBEDTLS_TIMING_C or MBEDTLS_HAVE_TIME not defined.\n");
     mbedtls_exit( 0 );
 }
 #else

It looks like this is a straightforward backport of 3624, so once that is done, this should be quite quick

Finally, it's possible to compile the library without MBEDTLS_HAVE_TIME but with MBEDTLS_TIMING_C - this may or may not be an oversight.
However, this PR (together with my comments above) does then work, except for programs/test/benchmark.c.
Here, I suggest the following:
diff --git a/programs/test/benchmark.c b/programs/test/benchmark.c
index d3faad91e..60f293795 100644
--- a/programs/test/benchmark.c
+++ b/programs/test/benchmark.c
@@ -30,10 +30,10 @@
 #define mbedtls_free       free
 #endif

-#if !defined(MBEDTLS_TIMING_C)
+#if !defined(MBEDTLS_TIMING_C) || !defined(MBEDTLS_HAVE_TIME)
 int main( void )
 {
-    mbedtls_printf("MBEDTLS_TIMING_C not defined.\n");
+    mbedtls_printf("MBEDTLS_TIMING_C or MBEDTLS_HAVE_TIME not defined.\n");
     mbedtls_exit( 0 );
 }
 #else

I think that this problem might go a step deepr. Compiling without HAVE_TIME but with MBEDTLS_TIMING_C is intended if you're sure that you can satisfy the requirements - `The provided implementation only works on POSIX/Unix (including Linux,

BSD and OS X) and Windows.. If you want, you can provide your own implementation by adding MBEDTLS_TIMING_ALTinto the mix. The current state of the PR(*) works (or rather, compiles) with this set of restrictions - and it can be tested by runningtests/scripts/all.sh "build_module_alt"`

well, net_sockets.c and the common.c misuse of MBEDTLS_HAVE_TIME still need to be fixed.
As for the optimizations with unused variables - I also agree that these should be added.

Would you agree on such resolution, @tom-cosgrove-arm?

LGTM

Thanks a lot for your assistance!

@tom-cosgrove-arm - all of your remarks should now be addressed.

@AndrzejKurek You'll need to rebase to get https://github.com/ARMmbed/mbedtls/pull/5588 (which is merged) in order to fix the two failing CI checks

Rebased to have a passing CI.

Backport (#5563) is approved, so this PR and 5563 are ready to be merged

CI failures (ci.trustedfirmware.org): 4 x Scripts not permitted to use new java.util.NoSuchElementException java.lang.String + 1 x No such property: pullRequest for class: groovy.lang.Binding


How to test multi-thread ART?

I am reading your paper and want to know how to implement multi-thread ART.
But I find your ART is libart and it is a single thread implementation. And in your benchmark_art_full.cpp, thread_num is 1.

ok, I find it in your another GitHub account. And I have another question, why do you create two GitHub accounts? hhhhh


How to open custom images in cityscapes Label Tool

I am executing cityscapesLabelTool.py file, and I have updated the path to the dataset, I am not getting error but images are not loading in tool,can you please help me to solve this issue.

This is a very late response, but i had the same question and figured out how to do it. So, for future reference:

create an empty folder in gtFine/train/ (this is where the annotation results will be placed)

create a folder with the same name in leftImg8bit/train

your images need to be named with the suffix "_leftImg8bit.png" (note that this can be changed by modification of the code in cityscapesLabelTool.py line 286)
  # Image extension
  self.imageExt = "_leftImg8bit.png"

the folder will then appear as a dataset in the "open dataset" choice dialog

You can rename the images using Windows or Linux Explorer or Nautilius GUI by selecting all the images and rename with the suffix.


Can i display image on push notification?

For ios:
- how can i display push when app in FG?

Hey.. did you figure out how to display image when the app is in foreground?
I am facing the same problem.

@sujitgawas19  No, I can't show image in FG.
I am looking for solution!

@BunHouth Great.
Why don't you create a PR for this?

I think that feature is optional.

Could you create PR for this feature ?  I think more people need to see this

@BunHouth Great.
Why don't you create a PR for this?

I think that feature is optional.

Could you create PR for this feature ? I think more people need to see this

That feature is optional, because we just using it for local notification only.
You can using my fork repo or using patch package instead.

Okie. I got it

I created PR for this issue, please check it out https://github.com/react-native-push-notification-ios/push-notification-ios/pull/272

@BunHouth  Amazingly, I was able to show the picture while in FG. thank you very much!!!!!!!!

@BunHouth How can I show image with remote notification, thanks

@BunHouth How can I show image with remote notification, thanks

for remote notification, please check this https://rnfirebase.io/messaging/ios-notification-images#step-1---add-a-notification-service-extension

@BunHouth Amazingly, I was able to show the picture while in FG. thank you very much!!!!!!!!

Hi Thuy, can i have your code ? i tried but not work :(

@trungtin2222 what version react native do you use???

@trungtin2222 what version react native do you use???

I use<EMAIL_ADDRESS>

@trungtin2222 what version react native do you use???

I use<EMAIL_ADDRESS>
@trungtin2222 you can check this thread first
https://github.com/react-native-push-notification-ios/push-notification-ios/issues/255#issuecomment-793955531
react-native-push-notification-ios is not support local image notification.

@trungtin2222 what version react native do you use???

I use<EMAIL_ADDRESS>
@trungtin2222 you can check this thread first
#255 (comment)
react-native-push-notification-ios is not support local image notification.

hi @BunHouth, i checked your comment, i was used your code but it's not work for me, i try to check AppDelegate.m but i don't have more information

@trungtin2222 what version react native do you use???

I use<EMAIL_ADDRESS>
@trungtin2222 you can check this thread first
#255 (comment)
react-native-push-notification-ios is not support local image notification.

hi @BunHouth, i checked your comment, i was used your code but it's not work for me, i try to check AppDelegate.m but i don't have more information

if you want local notification work, you need to change your package.json
"@react-native-community/push-notification-ios": "^1.8.0" to
 "@react-native-community/push-notification-ios": "aasatech/push-notification-ios",

@trungtin2222 what version react native do you use???

I use<EMAIL_ADDRESS>
@trungtin2222 you can check this thread first
#255 (comment)
react-native-push-notification-ios is not support local image notification.

hi @BunHouth, i checked your comment, i was used your code but it's not work for me, i try to check AppDelegate.m but i don't have more information

if you want local notification work, you need to change your package.json
"@react-native-community/push-notification-ios": "^1.8.0" to
 "@react-native-community/push-notification-ios": "aasatech/push-notification-ios",

I think you should create PR for this feature, my app still not work with image, i think this issue happening on M1 devices :(

it's work in intel devices, many thanks @BunHouth

rich notification support with images has been added in v1.9.0 :tada:

image not showing in background


Partial French translation update

A smaller subset as requested. Views and models only. Controllers (for validation/error messages) yet to come.

Sorry - this repo is not maintained anymore.


[CRYPTO CLEANUP] Add a family of AES-CBC related tests

Description
As we are using the CBC mode of AES with 256 key-length, we might as well put together a few tests to lock-in its expected behavior. This should serve as a light 'Epic'/master issue, against which we should submit related tests/PRs.
Clarification: while we don't need to test the strength of AES, we should test a few edge cases, expected behavior (e.g. of the padding/unpadding scheme used).
I'll quickly put together a few of the standard tests, but happy for others to weigh in/join and assist!
Describe How to Reproduce

For starters, we should raise a flag early on (break the build/tests) if/when the local AES primitive(s) (i.e. CBCEncrypt/CBCDecrypt) is acting suspiciously/not as expected.

:+1:


Error in math rendering

When the abstract includes the commands \dag or \ddag, the math engine inside Obsidian does not render properly the equation.
How it can be avoided?

This is a problem due to the authors. The LaTeX engine inside Obsidian Markdown does not include the /dag command. I can not solve all the possible errors caused by the authors.


VelocityJS: Missing pattern: padding

Your system information

VelocityJS version<EMAIL_ADDRESS>Browser: brave
Operating System: Ubuntu Mate

Checklist

Is this an issue with code?: [Yes/No]
Is this an issue with documentation?: [Yes/No]
Have you reproduced this in other browsers?: [Yes/No]
Have you checked for updates?: [Yes/No] I found the cdn link from your git
Have you checked for similar open issues?: [Yes/No]

$ev[j].velocity/*animate*/({
   'height': $ev[j].attr('h')+'px',
    'opacity': 1,
    'padding': '23px 8px '+(first_ev==1000?'0.08':'0')+'px',
    'margin-bottom': '4px'
},450,function(){...

Not a bug - that's you using it as a shortcut, and padding needs 4 values. You're passing 3 which the browser will auto-expand to four - so when it's finding the value it'll not match the three you have supplied. The solution (for now) is to either use force-feeding and supply the from value as 3 values too, or supply 4 values so the browser handles it all.
Saying that, going to leave this open, as I feel that this is a good one to have a handler for those shortcut values, and to auto-convert 1/2/3 into 4 values so it's all transparent (same for margin, border etc) :-)

yeah, good idea!


✨ Add new bottlerocket settings for Kubernetes settings support

What this PR does / why we need it:
Adds support for configuring the following Kubernetes settings on Bottlerocket. All settings that Bottlerocket offers here for Kubelet Configuration are added in this PR (except for serverTLSBootstrap).
   bottlerocket:
      kubernetes:
        clusterDomain: "cluster.local"
        containerLogMaxFiles: 10000
.
.
.
.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #

/lgtm
/approve


Type assertions aren't merge right

Bug Report
🔎 Search Terms
type assertions order
🕗 Version & Regression Information
Started at least from 3.3
⏯ Playground Link
Playground link with relevant code
💻 Code
const receiver = (x: {}) => x;

const f = (x: unknown) => {
  if (typeof x !== 'object' || x == null) {
    return undefined
  }
  return receiver(x)
}

const f1 = (x: unknown) => {
  if (x == null || typeof x !== 'object') {
    return undefined
  }
  return receiver(x)
}

🙁 Actual behavior
Has error: Argument of type 'object | null' is not assignable to parameter of type '{}'. Type 'null' is not assignable to type '{}'.
🙂 Expected behavior
Shouldn't have any error. Checks are equivalent.

Duplicate of #28131. Used search terms: null typeof object


Fix karabiner uninstall

karabiner uninstall step was broken. Using uninstall script from author instead.
Changes to a cask
Editing an existing cask

[x] Commit message includes cask’s name (and new version, if applicable).
[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.

Could you elaborate on how uninstall was broken and how this fixes it?

I kept getting:
An error of type -10810 has occurred. (-10810)
and it never got past the quit stanza. I have changed the formula to use the native uninstall script, which both quits Karabiner and uninstalls everything relevant cleanly.

I have updated pull request with your requests and recommendations.


move type to dev dependencies

Which problem is this PR solving?

The KOA router type dependency is clashing with the dependencies on the API

Short description of the changes

Moving type dependencies to devDependencies

The koa types are used in the public API of the instrumenation. Therefore moving it into dev dependency requires consumers to install it.
See https://github.com/open-telemetry/opentelemetry-js-contrib/blob/main/GUIDELINES.md for more details.

The koa types are used in the public API of the instrumenation. Therefore moving it into dev dependency requires consumers to install it otherwise typescript build would be broken.
See https://github.com/open-telemetry/opentelemetry-js-contrib/blob/main/GUIDELINES.md for more details.

Thanks for you comment and reviewing this PR.
Given the koa-router in devdependencies are in 12.0.0, I believe it is safe to upgrade the @types/koa__router to the same version too. I've updated this PR to upgrade it.
Could you let me know if this would cause issues?

Thanks for your comment @blumamir .
I've tried to move export type KoaMiddleware to internal-type.ts. To do that, I had to move other types as well, to avoid cycle references.
Let me know if the changes that I did looks correct to you.

To do that, I had to move other types as well, to avoid cycle references.

Can you elaborate on what cycle references you encountered?
The rule is that types CANNOT import internal-types but internal-types CAN import types.

To do that, I had to move other types as well, to avoid cycle references.

Can you elaborate on what cycle references you encountered? The rule is that types CANNOT import internal-types but internal-types CAN import types.

The issue is:

KoaContext is used in the types.ts for KoaRequestInfo.
KoaPatchedMiddleware declared in the internal-types.ts is equal to KoaMiddleware (declared in types.ts).

So, if we move KoaContext to internal-types, we would need to import it into types for KoaRequestInfo, that would create a cyrcle reference.
However, reading the guidelines and after knowing the rule you shared, I don't think we can move KoaContext to internal-types, as this would break the rule.
Hope it all make sense for you.

Given the comments above, I just reverted all my last changes.

given the comments above, I've moved only KoaMiddleware to internal-types. As it seems it is the only type that doesn't need to be part of the public API.

LGTM
Thanks again
Seems CI is broken by other package, so I will rebase and merge once CI is fixed.

Yeah, I notice CI was broken by other changes.
Thanks again for reviewer the PR and help with directions.


Decimated vs undecimated recordings

Joulescope model
JS220
UI version
other
Your question
UI Version 1.1.10.
I want to do some calculations about the signals I recorded. I want to calculate the average power consumption of a signal whenever GPI[0] is High, and do the same for whenever GPI[0] is low. This could be done by using Python and CSV. However, If i have a ~251 second recording with a sample rate of 1Mhz, this export to CSV using the example python script takes a very long time.
So I tried to do it by reading the JLS files directly into python using the pyjls library. Here I can read the average power values without any problems. I can open a file and look at the number of samples in the recording for the power signal and the GPI[0] signal.
path = 'data\\data.jls'
with Reader(path) as r:
    power = r.signal_lookup('power')
    rfenable = r.signal_lookup('gpi[0]')
    p_length = power.length
    rf_length = rfenable.length
    print(power)
    print(rfenable)
    print(f'length of Power samples is {p_length} samples')
    print(f'length of RF Enable samples is {rf_length} samples')

The output i get is what i expect:
SignalDef(signal_id=3, source_id=1, signal_type=0, data_type=8196, sample_rate=1000000, samples_per_data=8192, sample_decimate_factor=128, entries_per_summary=640, summary_decimate_factor=20, annotation_decimate_factor=100, utc_decimate_factor=100, sample_id_offset=0, name='power', units='W', length=251595035)
SignalDef(signal_id=5, source_id=1, signal_type=0, data_type=259, sample_rate=2000000, samples_per_data=65536, sample_decimate_factor=1024, entries_per_summary=1280, summary_decimate_factor=20, annotation_decimate_factor=100, utc_decimate_factor=100, sample_id_offset=0, name='gpi[0]', units='', length=503189504)
length of Power samples is 251595035 samples
length of RF Enable samples is 503189504 samples

To check if I am doing things correct, I can calculate the overall power of the complete recording to compare with the joulescope UI, and this returns almost the same value as the UI tells me. (I think the UI does some rounding before the calculations are being made vs when i do it with the raw values in python?)
avg_pow = r.fsr(power.signal_id, 0, p_length)
print(f'The average power calculated with numpy is {round(np.mean(avg_pow) * 1000, 5)} mW')

I know that it is calculated over the complete dataset because with the IDE I am using, the length of the array is correct.
But now there is something I don't understand. When I do this for the GPI[0] signal, the output does not correspond to the number of samples I expect. For example, when I take the first 2000 samples, the output array is just 1/8th the length of what I expect.
rfenable_arr = r.fsr(rfenable.signal_id, 0, 2000)
print(len(rfenable_arr))

With output:
250

I can confirm this using the IDE:

I think this has something to do with the sample_decimate_factor of 128 for the power signal, and 1024 for the GPI[0] signal. However, the signalDef that gets returned states a sample frequency of 2Mhz which would correspond with the duration of the recording (~251 seconds) and the given length of 503189504.
When I open the file in the Joulescope UI software, I can zoom in and see that there are twice as many datapoints for the GPI[0] signal when compared to the power signal, so the data is there inside of the file.
Is there a difference between the decimated saved data and the non-decimated saved data?
what am I missing here.
What OS are you using?
Windows 11

Hi @StrandmonYellow - I think that the primary issue is that the digital signal bits are returned packed in a byte.  So, you get 8 digital samples per byte.  You can unpack them using numpy, like this:
y = np.unpackbits(y, bitorder='little')

If you want, you can also use the JLS library to compute average power for you much faster than from python and without having to load all the data.  Replace that r.fsr call with:
avg_power = r.fsr_statistics(power.signal_id, 0, p_length, 1)[0, jls.SummaryFSR.MEAN]

The UI uses this fsr_statistics call to compute power.  It also truncates the signal to only what is stored for all included signals.
You will need to time align the GPI signal to the power signal.  You can use the timestamp_to_sample_id and sample_id_to_timestamp methods for this.  See the extract.py entry point for an example.
Does this help?

This helps! Thanks. Why is time alignment necessary? I assume that the signals are sampled simultaneously? Only that the GPI signals are sampled with a twice as high frequency compared to the power signal.

The signals are sampled simultaneously, but the JLS file and recording makes no guarantee that the first samples are aligned.  For a single Joulescope, you can use the signal's sample_id_offset property to align them.  However, this does not work for multiple Joulescopes.  In general, it's better just to time align, which is not difficult.

I think that this issue is resolved, but please reopen and comment if not!


Small logging changes in access control

Problem
Want to know about certain cases.
Change overview
May not keep this for release but need it for the next few weeks.
Testing

CI

Actually, nevermind I folded these small logging changes into PR #14921.


Add Code of Conduct to the Repository

Explanation: We want to improve the inclusiveness and community standards of our business by including a code of conduct. This manual will help create a comfortable and welcoming environment for both providers and users.
Suggested Resources:
• A brief introduction to the purpose of the Code of Conduct
• A Guide to Respectful Communication
• expectations of behavior in the community
• Misconduct reporting procedures
Steps in reproduction:
• Create a new file named CODE_OF_CONDUCT.md in the root directory of the repository.
• Include the items listed above, as well as any additional items you deem necessary.
Expected Results:
A comprehensive code of conduct that aligns with the values of our profession and is easily referenced by the entire community.
Labels: good first issue, documentation

I think https://www.contributor-covenant.org/ is a good starting point here. Maybe even directly the latest version 2.1: https://www.contributor-covenant.org/version/2/1/code_of_conduct/

👋 Thank you for raising an issue! We appreciate your effort in helping us improve. Our team will review it shortly. Stay tuned!


Add dxw VPN to 'allow list' for dev environments

Allow the VPN of supplier dxw (https://www.dxw.com) access
to the dev environments.

need to include the values in values.yaml too

thanks Peter, I was meaning to ask in the PR whether the override clobbers all the value of the key! I'll fix that up...

Closing this PR as developers should be using MoJ issues laptops so that can use the MoJ VPN.
If you speak to your Deliver Manager, they should be able to source you one.

OK thanks Simon, I will look into getting that hardware.


Bring Codebase Back to Sanity!

Working on all of this with @ouziel-slama (!)

~Migrate to Python 3.11~
~Use the latest version for all dependencies~
~Replace setup.py with pyproject.toml~
~Add and document Hatch support~
~Fix test suite~
Get comprehensive test suite running in CI
Update documentation

Split into separate issues. See https://github.com/CounterpartyXCP/counterparty-core/issues/1473


org-mode cannot swap lists

Under emacs org mode, when trying to swap lists (option+shift+uparrow, or just option+uparrow), receiving a user-error: No further hunks found.

I suspect this is something local to your configuration, because I can't reproduce this locally. It sounds like the bindings are triggering commands in diff-hl-mode, but for me those two bindings just cause the normal org-mode actions.

Hummm, I tried the following:

removed init-local, the same error occurs;
removed .emacs.d completely, it worked;
with a clean install, no additional touches, the same error occurs.

GNU Emacs 29.2, used in terminal, on Sonoma 14.4.

I can't get those 2 key combinations to work at all in Terminal with Emacs 29.3, Sonoma 14.4. Emacs sees them as <up> which is mapped to previous-line.
(In GUI mode, for me, option-shift-uparrow is S-up  that calls (org-shiftup) as I expected: it will swap list rows or kill table rows.
option-uparrow is M-<up> that maps to (org-metaup) that will swap two items (lists, subtrees, tables , paragraphs). I expect that is what is broken for you.)
If you still need help,

What are the outputs of C-h k (describe-key) for your key combinations?
What are your key actions in Terminal profile? [I don't have any set for those keys.]
Does everything work as expected in GUI mode?
(By the way, do you have "Use Option as Meta Key" set? [I don't] do you start emacs from zsh? and what are your relevant customizations, if any, in $HOME/.zshrc)

Thanks @dcorking! Sorry for my late in reply -- I was working towards several deadlines and then forgot about it.

What are the outputs of C-h k (describe-key) for your key combinations?
Please find the output below:
"runs the command diff-hl-previous-hunk (found in
diff-hl-mode-map), which is an interactive byte-compiled Lisp function
in ‘diff-hl.el’.
It is bound to M-ESC and C-x v [.
(diff-hl-previous-hunk)
Go to the beginning of the previous hunk in the current buffer.
[back]
"

Does everything work as expected in GUI mode?
I don't have GUI installed, but the terminal version works before me updating to the current version of emacs.
(By the way, do you have "Use Option as Meta Key" set?
Yes, I have this set already.

Your paste missed out the beginning of the output of  C-h k. However the parts you show make it pretty clear that your Emacs is not being sent the keystrokes you typed. I think you must have something in your terminal, shell or keyboard driver that is mapping option+shift+uparrow, or just option+uparrow to either option-esc or C-x v [ . (The first part will tell you which key strokes Emacs actually received.)
To diagnose your keyboard driver, I think the virtual keyboard might help you.
I'm not a zsh user, but I suggest you also check for relevant bindkey entries in your plugins and customizations.
Alternatively, and probably simpler than all that,  add a new global-set-key  to 'org-metaup in your init-local.el .
Just for info mine looks like this in Linux and macOS (whether in no-window-system mode or GUI, for example if I start it with emacs -nw -q so bypassing all customizations.):
M-<up> runs the command org-metaup (found in org-mode-map), which is
an interactive byte-compiled Lisp function in ‘org.el’.

org.el is built in to Emacs: purcell/emacs.d doesn't do anything special with this keybinding.

Hi @dcorking
Thanks for your suggestions. I at the end disabled the keybindings in diff-hl to resolve the issue, with the following code added in my init-local.el
(with-eval-after-load 'diff-hl
;; Unbind M-ESC and C-x v [
(define-key diff-hl-mode-map (kbd "M-ESC") nil)
(define-key diff-hl-mode-map (kbd "C-x v [") nil))


Could you fix the sample file link?

This link appears broken. Could you please fix, or point to a new location?
http://hpgeoc.sdsc.edu/downloads/awp-odc-os-v1.0-example.tar.gz

Updated


Add ChatPDF to LokiHub

an application similar to ChatPDF; however, implement it in a different way based on LokiHub