method impl finding lacking

Method reolsution looks for traits and for each looks for impls.
It should search for impls using inference. Instead, it searches in current context only.
This causes things like arr.clone() to not work unless we use the impl use array::ArrayTCloneImpl.

Yes, trait scope is the module where the trait was defined. I would like to not have to import at all though


Traverse Action in toolbar should start from first branch, not from current branch

Suggested by @radeusgd.
Traversing the entire tree seems to be the typical use case.
If someone really wants to start from the current (or any given) branch, they can always use context menu action Traverse from Here...

Not a ➖ of this. We will not be consistent with CLI 😭

Hmmm I don't think that's such a big deal TBH 🤔

Hot take: what if the CLI default could be changed to remain consistent? :sweat_smile:
I'm wondering what are the common usecases, personally I have an alias that I always use that traverses from root, I've never had a situation to traverse from current branch. But ofc that's just my usage pattern and it's quite possible others may do it differently.

personally I have an alias that I always use that traverses from root,

As in, git machete traverse --whole? or sth else?

personally I have an alias that I always use that traverses from root,

As in, git machete traverse --whole? or sth else?

Mine is git machete traverse -F -w to be exact. I also like to fetch the latest remotes to see if there are any new merges to develop.

git machete traverse -F -w

This is, in turn, aliased to git machete traverse -W ;D and that's also the most common combination for me... sometimes even the ultimate git machete traverse -Wy which doesn't ask for confirmation

Hot take: what if the CLI default could be changed to remain consistent? 😅

Maybe I wouldn't risk changing the default now after a few years... but adding a git config key to change the default behavior (as with git config machete.traverse.push) sounds like an option ;)

Hot take: what if the CLI default could be changed to remain consistent? sweat_smile

Maybe I wouldn't risk changing the default now after a few years... but adding a git config key to change the default behavior (as with git config machete.traverse.push) sounds like an option ;)

Fair point!


Secondary Device approval not working after index keeper changes

-No need of approval in NBHR.
-Verified this issue on dev app v1.5.0(243)


Server dumps after host machine wakes up from sleep

Host machine goes into power saver while a client is connected. After waking up and client tries to reconnect, server will dump after a few moments.
authserver: /home/segs/Segs/Projects/CoX/Servers/MapServer/EntityStorage.cpp:43: void EntityStore::release(Entity*): Assertion `src>m_map_entities.data() && src<m_map_entities.data()+m_map_entities.size()' failed.
Aborted (core dumped)

I cannot confirm this on Linux with the latest build

I am also unable to reproduce this under 64-bit releases of CentOS 7.5, Fedora 27, and FreeBSD 11 using 0ce03aa.


⚠ Ox Street has degraded performance

In 6500bcf, Ox Street (https://oxstreet.com) experienced degraded performance:

HTTP code: 504
Response time: 10414 ms

Resolved: Ox Street performance has improved in 170fcd0.


apple: Set network settings using data from connlib

This PR sets the network settings, split-DNS, and UI resources using the data from connlib callbacks.
This should enable connlib to be developed / tested in Apple platforms (Caveat: There's no UI to see resources in iOS yet).
Some assumptions being made are:

It's ok to call disconnect() before onTunnelReady(), but after connect()
CIDR addresses don't include enclosing quotes (they currently include the quotes, like: "<IP_ADDRESS>/32")
CIDR addresses in routes always end with “/n”
Connlib calls can be made from a queue (non-main thread)

Do note that when debugging with Console.app, you should enable info and debug messages in the Action menu to see all the messages. (By default, they are disabled.)

It's ok to call disconnect() before onTunnelReady(), but after connect()

On a related note, in case the wifi is turned off while connlib is connecting (i.e. after connect() but before onTunnelReady()), should the client call disconnect()?

cc @conectado for approval


chore: Bump versions for release

Please provide the issue number

Issue number: #214
Summary
This PR changes the version to v1.0.0.o
Changes

Please provide a summary of what's being changed

User experience

Please share what the user experience looks like before and after this change

Checklist
Please leave checklist items unchecked if they do not apply to your change.

[X] Meets tenets criteria
[X] I have performed a self-review of this change
[ ] Changes have been tested
[X] Changes are documented
[x] PR title follows conventional commit semantics

Is this a breaking change?
RFC issue number:
Checklist:

[ ] Migration process documented
[ ] Implement warnings (if it can live side by side)

Acknowledgment
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

Codecov Report
Base: 56.39% // Head: 56.39% // No change to project coverage :thumbsup:

Coverage data is based on head (9c6e2e0) compared to base (5e099f6).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop     #215   +/-   ##
========================================
  Coverage    56.39%   56.39%
========================================
  Files           41       41
  Lines         1784     1784
========================================
  Hits          1006     1006
  Misses         778      778

Flag
Coverage Δ

unittests
56.39% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Remap only lets you enter a single key on the left side (e.g. You can't remap Ctrl + A)

Microsoft PowerToys version
0.82.0
Installation method
GitHub
Running as admin
No
Area(s) with issue?
Keyboard Manager
Steps to reproduce

Open Keyboard Manager
Open the Remap Keys dialog
Add key remapping
Click the left Select
Press Ctrl + Backspace. Instead of getting both hotkeys, it will show "Ctrl", then "Backspace". If you try the same thing with the right "select" dialog, you can enter Ctrl + Backspace. This seems to be true for any modifier + key combination

✔ Expected Behavior
You should be able to Remap key combinations like Ctrl + Backspace
❌ Actual Behavior
Instead, you can only have a single key on the left hand side of a mapping
Other Software
No response

Keyboard Manager lets you "remap" keys or shortcuts. If you want to "remap" a shortcut, you need to use that feature (the second one).

@clovetea, what @Chealer says is correct. Use the "remap" a shortcut option:


Address intermittent failures of all_headers Au test (see Issue # 5437).

This change sorts the fields for each header, so that pseudo-random ordering will not cause the test to fail.


image/jpeg: Decode is slow

Mac OS Sierra
go version go1.10 darwin/amd64
CPU 3,5 GHz Intel Core i7
I noticed that the use of decode jpeg is very slow.
decode image jpeg 1920x1080
I test github.com/pixiv/go-libjpeg/jpeg and native jpeg
go 1.10 jpeg.decode  ≈ 30 ms cpu ≈ 15 %
libjpeg  jpeg.decode  ≈ 7  ms cpu  ≈ 4 %
will it ever go as fast as other libraries?
is it possible that in the next versions the native implementation will become faster?

/cc @horgh @ericlagergren

BenchmarkJPEG-8    1<PHONE_NUMBER>8 ns/op<PHONE_NUMBER>2 B/op            1558 allocs/op
BenchmarkPixiv-8   1<PHONE_NUMBER>5 ns/op<PHONE_NUMBER> B/op          141851 allocs/op

But allocation difference is crazy. I am not sure what's better.

@v47 can you share the code for your benchmarks?

Performance does seem quite bad. Using stb_image (via cgo) seems to be much faster in a simple test I've done:

2018/11/08 14:58:33 Loaded ../resources/Free_Spring_Blossoms_on_Blue_Creative_Commons_(3457362713).jpg via image: 234.715104ms
2018/11/08 14:58:34 Loaded ../resources/Free_Unedited_Happy_Little_Yellow_Stars_in_Pink_Flower_Creative_Commons_(2898759838).jpg via image: 307.379436ms

vs:

2018/11/08 15:00:07 Loaded ../resources/Free_Unedited_Happy_Little_Yellow_Stars_in_Pink_Flower_Creative_Commons_(2898759838).jpg via stb_image: 167.929126ms
2018/11/08 15:00:07 Loaded ../resources/Free_Spring_Blossoms_on_Blue_Creative_Commons_(3457362713).jpg via stb_image: 93.289255ms

This wasn't a scientific test, but the results were markedly different between the two approaches, and consistently so (+/- 10ms here or there with a few repeats).

I cut what I have into a standalone benchmark, and pushed it up at https://github.com/rburchell/imgtestcase. In my case, the format conversion is costly, but loading the image itself is also far from fast.

This wasn't a scientific test,

We use benchstat for that. Could you please run each benchmark in a quiet machine with browsers shutdown with -count=10, and then compare them with benchstat and post the results ?

Sorry, no - I don't have any more time to spend on this. I posted the results on the README, but they are quite easy to run yourself. The benchmarks show the same trend as my original (application) numbers - loading using stb_image via cgo takes around half the time.

I took a look into it. The majority of the improvements in the C version come from SIMD(SSE2) support. If I disable SIMD and then run the benchmarks, the C version runs much slower. Although the Go version is still slow compared to it.
SIMD --
14:52:02-agniva-~/play/go/src/github.com/rburchell/imgtestcase$go test -run=xxx -bench=.
goos: linux
goarch: amd64
pkg: github.com/rburchell/imgtestcase
BenchmarkLoadImageOneSTB-4   	      20	  82806154 ns/op
BenchmarkLoadImageOneGo-4    	      10	 195602342 ns/op	 235.85 MB/s
BenchmarkLoadImageTwoSTB-4   	      10	 131362504 ns/op
BenchmarkLoadImageTwoGo-4    	       3	 342820337 ns/op	 117.59 MB/s
PASS
ok  	github.com/rburchell/imgtestcase	8.409s

NO-SIMD--
14:52:31-agniva-~/play/go/src/github.com/rburchell/imgtestcase$go test -run=xxx -bench=.
goos: linux
goarch: amd64
pkg: github.com/rburchell/imgtestcase
BenchmarkLoadImageOneSTB-4   	      10	 162488211 ns/op
BenchmarkLoadImageOneGo-4    	      10	 195514068 ns/op	 235.96 MB/s
BenchmarkLoadImageTwoSTB-4   	       5	 204837289 ns/op
BenchmarkLoadImageTwoGo-4    	       3	 343425094 ns/op	 117.38 MB/s
PASS
ok  	github.com/rburchell/imgtestcase	7.246s

Other than that, there are some BCE improvements that can be done in idct and fdct. But that barely gives improvement of 40-50ns.
I don't see any major algorithm improvements that can be applied. All math operations like huffman decoding, idct etc. have their fast paths, which is the same as the C version.
There may be some logic tweaks that can be done in the top time-taking functions like
    1070ms 13.39% 44.56%     7000ms 87.61%  image/jpeg.(*decoder).processSOS
    |------>1100ms 13.77% 31.16%     1360ms 17.02%  image/jpeg.(*decoder).refineNonZeroes
    |------>870ms 10.89% 55.44%     1720ms 21.53%  image/jpeg.(*decoder).reconstructBlock
    |------>860ms 10.76% 66.21%      900ms 11.26%  image/jpeg.(*decoder).receiveExtend
    |------>			 26.66%  image/jpeg.(*decoder).decodeHuffman

Anybody is welcome to investigate and send CLs.

What is the assembly policy for the image/** packages? I'm working on an SSE2 implementation of the IDCT, but I'm wondering if there's a reason there are no .s files in image/**.

We usually stick to pure Go in high level packages like image/. In general, assembly is limited to crypto, math and highly specialized bytes and strings functions. Also see https://github.com/golang/go/wiki/AssemblyPolicy.
@nigeltao can say whether adding SIMD assembly is apt or not in image/.

First, the AssemblyPolicy (for Go packages overall) applies equally well to image/**.
Amongst other things, standard library code is often read by people learning Go, so for that code, we favor simplicity and readability over raw performance more than what other Go packages choose. Neither position is wrong, just a different trade-off.
If adding a small amount of SIMD assembly to the standard library gets you a 1.5x benchmark improvement, then I'd probably take it. If adding a large amount of SIMD assembly gets you a 1.05x benchmark improvement, then I'd probably reject it.
What "small" and "large" means is subjective. It's hard to say without a specific SIMD code listing.
Note also that, when I say benchmarks, I'm primarily concerned about overall decode / encode benchmarks, not just FDCT / IDCT benchmarks. Users want to decode a JPEG image, they don't want to run IDCTs directly.
For example, https://go-review.googlesource.com/c/go/+/167417/2//COMMIT_MSG shows a 1.03x benchmark improvement to IDCTs, but no significant change to the overall decode benchmarks. If that change was a SIMD assembly change, I'd reject it as being of too small a benefit, compared to the costs of supporting assembly.


autoPositioning not working after dragging away a grid

Hi,
what ist the difference in the code between these two examples? I also want the grids to auto position, for example if the box on the top ist dragged away, the next boxes above will take the place of this box.
autoPositioning working:
https://troolee.github.io/gridstack.js/
autoPositioning not working:
http://troolee.github.io/gridstack.js/demo/float.html
Thanks for your help / ideas!

Hello,
The difference is the option float:

enable floating widgets (default: false)

Hello,
thanks for the answer. Concrete in this way:
"enableFloatingWidgets: true"
Is that right?
Thanks for helping me.

"enableFloatingWidgets: true"

No, use:
Float:


[SUPPORT]Got a parquet related error when incremental querying MOR table, using Spark 2.4

when I ran a Spark 2.4 job to incremental query a MOR table, the job failed with the following errors:
2021-04-13 12:39:54 [Executor task launch worker for task 215] ERROR [Executor:91]: Exception in task 160.2 in stage 0.0 (TID 215) java.io.IOException: can not read class org.apache.parquet.format.PageHeader: null 	at org.apache.parquet.format.Util.read(Util.java:216) 	at org.apache.parquet.format.Util.readPageHeader(Util.java:65) 	at org.apache.parquet.hadoop.ParquetFileReader$Chunk.readPageHeader(ParquetFileReader.java:936) 	at org.apache.parquet.hadoop.ParquetFileReader$Chunk.readAllPages(ParquetFileReader.java:950) 	at org.apache.parquet.hadoop.ParquetFileReader.readNextRowGroup(ParquetFileReader.java:807) 	at org.apache.parquet.hadoop.InternalParquetRecordReader.checkRead(InternalParquetRecordReader.java:127) 	at org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:222) 	at org.apache.parquet.hadoop.ParquetRecordReader.nextKeyValue(ParquetRecordReader.java:207) 	at org.apache.spark.sql.execution.datasources.RecordReaderIterator.hasNext(RecordReaderIterator.scala:39) 	at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:440) 	at org.apache.hudi.HoodieMergeOnReadRDD$$anon$3.hasNext(HoodieMergeOnReadRDD.scala:217) 	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.agg_doAggregateWithoutKey_0$(Unknown Source) 	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source) 	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) 	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$13$$anon$1.hasNext(WholeStageCodegenExec.scala:636) 	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409) 	at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:125) 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99) 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55) 	at org.apache.spark.scheduler.Task.run(Task.scala:121) 	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) 	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 	at java.lang.Thread.run(Thread.java:748) Caused by: shaded.parquet.org.apache.thrift.transport.TTransportException 	at shaded.parquet.org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) 	at shaded.parquet.org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) 	at shaded.parquet.org.apache.thrift.protocol.TCompactProtocol.readBinary(TCompactProtocol.java:709) 	at org.apache.parquet.format.InterningProtocol.readBinary(InterningProtocol.java:223) 	at shaded.parquet.org.apache.thrift.protocol.TProtocolUtil.skip(TProtocolUtil.java:102) 	at shaded.parquet.org.apache.thrift.protocol.TProtocolUtil.skip(TProtocolUtil.java:138) 	at shaded.parquet.org.apache.thrift.protocol.TProtocolUtil.skip(TProtocolUtil.java:130) 	at shaded.parquet.org.apache.thrift.protocol.TProtocolUtil.skip(TProtocolUtil.java:60) 	at org.apache.parquet.format.PageHeader$PageHeaderStandardScheme.read(PageHeader.java:1047) 	at org.apache.parquet.format.PageHeader$PageHeaderStandardScheme.read(PageHeader.java:966) 	at org.apache.parquet.format.PageHeader.read(PageHeader.java:843) 	at org.apache.parquet.format.Util.read(Util.java:213) 	... 25 more
and
2021-04-13 12:40:07 [Executor task launch worker for task 1113] ERROR [Executor:91]: Exception in task 206.4 in stage 0.0 (TID 1113) java.io.IOException: can not read class org.apache.parquet.format.PageHeader: Required field 'uncompressed_page_size' was not found in serialized data! Struct: org.apache.parquet.format.PageHeader$PageHeaderStandardScheme@ec35f50 	at org.apache.parquet.format.Util.read(Util.java:216) 	at org.apache.parquet.format.Util.readPageHeader(Util.java:65) 	at org.apache.parquet.hadoop.ParquetFileReader$Chunk.readPageHeader(ParquetFileReader.java:936) 	at org.apache.parquet.hadoop.ParquetFileReader$Chunk.readAllPages(ParquetFileReader.java:950) 	at org.apache.parquet.hadoop.ParquetFileReader.readNextRowGroup(ParquetFileReader.java:807) 	at org.apache.parquet.hadoop.InternalParquetRecordReader.checkRead(InternalParquetRecordReader.java:127) 	at org.apache.parquet.hadoop.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:222) 	at org.apache.parquet.hadoop.ParquetRecordReader.nextKeyValue(ParquetRecordReader.java:207) 	at org.apache.spark.sql.execution.datasources.RecordReaderIterator.hasNext(RecordReaderIterator.scala:39) 	at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:440) 	at org.apache.hudi.HoodieMergeOnReadRDD$$anon$3.hasNext(HoodieMergeOnReadRDD.scala:217) 	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.agg_doAggregateWithoutKey_0$(Unknown Source) 	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source) 	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) 	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$13$$anon$1.hasNext(WholeStageCodegenExec.scala:636) 	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:409) 	at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:125) 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99) 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55) 	at org.apache.spark.scheduler.Task.run(Task.scala:121) 	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) 	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 	at java.lang.Thread.run(Thread.java:748) Caused by: shaded.parquet.org.apache.thrift.protocol.TProtocolException: Required field 'uncompressed_page_size' was not found in serialized data! Struct: org.apache.parquet.format.PageHeader$PageHeaderStandardScheme@ec35f50 	at org.apache.parquet.format.PageHeader$PageHeaderStandardScheme.read(PageHeader.java:1055) 	at org.apache.parquet.format.PageHeader$PageHeaderStandardScheme.read(PageHeader.java:966) 	at org.apache.parquet.format.PageHeader.read(PageHeader.java:843) 	at org.apache.parquet.format.Util.read(Util.java:213)
my scala code is as follows:
`val spark = SparkSession.builder().getOrCreate()
val conf = spark.conf
val input = "afs://xxx/material_raw_data_one_hour_hudi/*/*"
val sql = "select count(*) from  hudi_materials_snapshot"
val df = spark.read.format("hudi").
  option(QUERY_TYPE_OPT_KEY, QUERY_TYPE_INCREMENTAL_OPT_VAL).
  option(BEGIN_INSTANTTIME_OPT_KEY, "20210413081500").
  load(input)

df.createOrReplaceTempView("hudi_materials_incremental")
spark.sql(sql).show()
df.printSchema()`

In case it was caused by parquet file itself, I did an experiment that I changed the code spark.read.format("hudi") to spark.read.format("parquet"), removed the next two lines with hudi options, and re-ran the job. I got no error at all.
By the way, there was no error when I used SNAPSHOT query on MOR table, with Spark 2.4. So the error was only raised when I used INCREMENTAL query on MOR table, with Spark 2.4.
So what on earth caused the error? How should I do with my code or configuration, to eliminate the error? Thanks!
Environment Description

Hudi version : 0.8.0

Spark version : 2.4

Hive version :

Hadoop version :

Storage (HDFS/S3/GCS..) : HDFS

Running on Docker? (yes/no) : no

@xglv1985 It looks like you hit this issue -> https://issues.apache.org/jira/browse/SPARK-11844.
The ticket was created as a MINOR and is already resolved by customers explaining that re-try works. Have you tried re-running the job with "hudi" multiple times to see if this problem is repeatable ? if yes, we might have to re-open that Spark ticket to get some help.

@xglv1985 It looks like you hit this issue -> https://issues.apache.org/jira/browse/SPARK-11844.
The ticket was created as a MINOR and is already resolved by customers explaining that re-try works. Have you tried re-running the job with "hudi" multiple times to see if this problem is repeatable ? if yes, we might have to re-open that Spark ticket to get some help.

Thanks for attention. Yes, the problem is repeatable and can be reproduce each time definitely.

Okay, do you mind re-opening that Spark ticket and asking a question there ? Other options are to try a different Spark build to confirm that this is a spark issue and should probably go away with a different build (may be 2.4)

Okay, do you mind re-opening that Spark ticket and asking a question there ? Other options are to try a different Spark build to confirm that this is a spark issue and should probably go away with a different build (may be 2.4)

OK, I've left a message there. And I will try a different Spark version.

@xglv1985 Thanks, were you able to try a different spark version to see if it works for you ?

@xglv1985 Thanks, were you able to try a different spark version to see if it works for you ?

Yes, I am trying Spark 3.0.0 to see if it work for me, and I will feedback once the result comes out.

While we wait for your response, can you help answer these questions too

Did you hit this issue right from the beginning when you start incremental query? Or do you see after some time(ie. few incremental pulls succeeded and after sometime you hit this error and after that its consistent?
If its later, can you give us the contents of ".hoodie". I am trying to get a sense if this happens just after compaction. If you know upfront, you can answer this one too.

While we wait for your response, can you help answer these questions too

Did you hit this issue right from the beginning when you start incremental query? Or do you see after some time(ie. few incremental pulls succeeded and after sometime you hit this error and after that its consistent?
If its later, can you give us the contents of ".hoodie". I am trying to get a sense if this happens just after compaction. If you know upfront, you can answer this one too.

sorry for late response.

While we wait for your response, can you help answer these questions too

Did you hit this issue right from the beginning when you start incremental query? Or do you see after some time(ie. few incremental pulls succeeded and after sometime you hit this error and after that its consistent?
Yes, right from the beginning, and each time definitely hit the error on the Spark cluster. But in my local IDEA, I did not hit the error, with only 5 hudi records. So I doubt that the error was caused by a corrupted parquet file. But until now I have not found the reason why it was damaged. https://issues.apache.org/jira/browse/SPARK-11844
If its later, can you give us the contents of ".hoodie". I am trying to get a sense if this happens just after compaction. If you know upfront, you can answer this one too.
Newest conclusion: the same error was raised not only in MOR, but also in COW.

thanks, I will coninue to focus on the problem.

@xglv1985 Is this still an issue? Did you get a chance to try the workaround suggested in https://issues.apache.org/jira/browse/SPARK-11844 ?


⚠ Bofrost.fr has degraded performance

In 32bb496, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1238 ms

Resolved: Bofrost.fr performance has improved in 44b1e7d.


bug: gp checkhealth gp.deprecated

	if #gp._deprecated > 0 then
		local msg = "deprecated config option(s) in setup():"
		for _, v in ipairs(gp._deprecated) do
			msg = msg .. "\n\n- " .. v.msg
		end
		vim.health.warn(msg)
	else
		vim.health.ok("no deprecated config options")
	end

throws:
gp: require("gp.health").check()

- ERROR Failed to run healthcheck for "gp" plugin. Exception:
  function health#check, line 25
  Vim(eval):E5108: Error executing lua ~/.config/nvim/plugged/gp.nvim/lua/gp/health.lua:72: attempt to get length of field '_deprecated' (a nil value)
  stack traceback:
~/.config/nvim/plugged/gp.nvim/lua/gp/health.lua:72: in function 'check'
  [string "luaeval()"]:1: in main chunk

Removing it makes the checks run ok:
gp: require("gp.health").check()

gp.nvim checks ~
- OK require('gp') succeeded
- ERROR require('gp').setup() has not been called
- ERROR require('gp').setup({openai_api_key: ???}) is not set: nil
- OK curl is installed
- OK grep is installed
- OK ln is installed
- WARNING sox is not installed

it is throwing some errors that I will yet find a way to manage, but I found the error on checkhealth strange and decided to report here.

Hey,
sorry for late response, I've been away for few weeks.
gp._deprecated is being set inside the setup function and since setup hasn't been called in this case
- ERROR require('gp').setup() has not been called
- ERROR require('gp').setup({openai_api_key: ???}) is not set: nil

it troughs this error. Will fix.


Questions

Hi,
May I ask what was the motivation for this project? I'm considering analyzing a huge legacy app that contains many hundreds of .aspx pages and so on and this parser might prove helpful.
Did you create it for that kind of problem or was it motivated bt academic curiosity?
Thx

Hey,
As a security company we have to do a lot of parsing in different kinds of web applications. For some period we've been using Mono aspx parser in our internal projects. Unfortunately it was not sufficient for all our needs. So we decided to fork, fix some problems and tailor it a bit for ourselves.
If you feel it might be helpful, you should give it a try.

@alexxn Thanks for explaining, I am going to fork your repo and play with it, might be very helpful.

Hello, @Korporal! This project is only a parsing solution, not typing one. Interpretation logic of ASP directives, control name binding and other stuf is not provided here. But this parser is built on top of original ASP.NET regular expressions and its behavior is quite close to TemplateParser from System.Web.dll.


Share icons to be inline

Title of change
This PR should make the Facebook and Twitter icons inline so that it looks much better.
Checklist

[ ] Unit tests written
[x] Manually tested
[x] Prettier & ESLint were run
[ ] New dependencies are included in package-lock.json

Screenshot
Before

After

Deployed to: http://staging.quran.com:32814


Duplicate items

Describe the bug
I make an inventory, in which items are added every N time. The player can take these items from the inventory, but cannot put them there.
I noticed one interesting bug and I still can't figure out if it's related to my code or if it's really a bug.
If I move a stack of items very quickly, they are somehow duplicated.
To Reproduce

run my code
very quickly move itemstacks

Code (Optional)
https://pastebin.com/wzGVjbSB
Videos

A very funny bug. Actually, such a one is not possible from my point of view. Every time the inventory is called, your init part is called. Maybe something changes there while you keep rebuilding it?
Doesn't mean it's your bug. I'll take a look at it this weekend (No time before then, unfortunately).

I don't know what I should do to make items clone. In any case, please try to reproduce the problem with my code at a convenient time.

Describe the bug
I make an inventory, in which items are added every N time. The player can take these items from the inventory, but cannot put them there.

Do you think you can't place them there via "drag"? If yes you have to enable this option via #ignoreEvents
Regarding the duplicate bug, I was not able to reproduce it. Therefore I ask you to call the method #ignoreManualItems temporarily. If the error is no longer present, I would have a possible reason, if not I am back to 0.

As soon as I used #ignoreManualItems the bug was fixed

I wish I could. Unfortunately, no matter how many times I try, no matter what code, I am not able to reproduce your error.
I also can't make a logical connection. If you reopen the RyseInventory, the provider will be rebuilt, so a new pagination object will be created. From this point on it is impossible for something to duplicate because the new pagination had nothing to do with the other pagination object. The content that is displayed in the inventory is then defined by your provider.
The code you sent me works without problems.
I have one last idea. I see that you are calling a command every time. Is the RyseInventory always recreated there? Or do you store it in a global variable?

When the player enters a command, I check if an inventory exists with that ID. If it doesn't exist, I create it first.
https://pastebin.com/RuKiAMPZ

What if you recreate the inventory every time? Does the problem still exist then?

Yes. Recently, I was just creating an inventory every time the player entered a command and only today did it to try to find an existing one

Remind me, please, what does #ignoreManualItems() do?

If you call this method, the items that the player can put into the upper inventory will not be saved.
For example, if you say slot 0 is ignored, the player can take an item from his inventory and put it in slot 0.
If the method was not called in this case, the item will not be saved. Since it is only a temporary item, it is also not saved in the head.
If you call the method, the item will be saved. If you change the page and go back, the item should be there again.

Every time I close the inventory, I save the items in it. I tried to print to the console a list of items that are in the inventory at the time of its closing and, for some reason, there are items that are subsequently duplicated. Although the gif shows that I can not put this item there.
https://pastebin.com/x7Zpn2gr

for some reason, #getAllData() returns me something that is not in the inventory. I'll try to experiment a little more with this later. for example, stop saving items

for some reason, #getAllData() returns me something that is not in the inventory. I'll try to experiment a little more with this later. for example, stop saving items

I have tried a bit with getAllData and it works without problems.

I could not find the reason for this behavior. You will have to use #ignoreManualItems() where necessary.


Update starter apps to fix image loading issues

withImage & withPlugins no longer work.
I modified my next.config.js to this and it seemed to work:
const { withExpo } = require('@expo/next-adapter')
const withTM = require('next-transpile-modules')([
'solito',
'moti',
'nativewind',
'app',
])
const withFonts = require('next-fonts')
/** @type {import('next').NextConfig} */
const nextConfig = {
// reanimated (and thus, Moti) doesn't work with strict mode currently...
// https://github.com/nandorojo/moti/issues/224
// https://github.com/necolas/react-native-web/pull/2330
// https://github.com/nandorojo/moti/issues/224
// once that gets fixed, set this back to true
reactStrictMode: false,
experimental: {
forceSwcTransforms: true,
swcPlugins: [[require.resolve('./plugins/swc_plugin_reanimated.wasm')]],
},
}
const plugins = [withTM, withFonts, withExpo]
module.exports = () => {
return plugins.reduce((acc, plugin) => plugin(acc), {
...nextConfig,
})
}
console.log(module.exports())

can you see my latest update and try that?


fix(frontend): crashes on fn ptr

This commit fixes the issue #757: the frontend was assuming functions expressions to be of a very specific shape. This commit fixes that.

Yes, higher-order functions are a bit problematic, that's related to what @paulmure says in https://github.com/hacspec/hax/issues/549#issuecomment-2218838180


:bug: Fixing location of provided programs in the base image

fixes #474

This will need a change with the add-on and potentially the hub.


Issue with hooks on CreateTearsheetStep

Hi,
I'm trying to use hook inside a custom step but it generates an error:
"Invalid hook call. Hooks can only be called inside of the body of a function component."
codesandbox
I think we should be able to use hooks inside a custom step, or I do not get how can I move some logic from CreateTearsheet to the step.
Can you help with that, please?
Thanks
Davide

Hey @ninjasun, this issue (similar to #1511) will be resolved in our next release when #1524 gets merged. We refactored how the CreateTearsheet/CreateFullPage track their steps which allows the custom steps to work as expected.


Cleanout

What kind of change does this PR introduce?

Cleanout future imports from __future__ import annotations no longer needed for Python >= 3.9.0.

Closing this for now sorry, maybe in the future we can revisit the idea,
the official status is kinda "TBD" even if in practice works for years now.


show ids in error texts

Now we get errors like
✖  CSS animation for "::after" pseudo-element is not supported in Safari 15.

It would be great to have an id in the error text that is used for checking and that can be added to allow.features:
✖  CSS animation for "::after" pseudo-element is not supported in Safari 15 (selectors.after.animation_and_transition_support).

This would make the plugin much easier to use for beginners. I had to run the debugger to figure out how everything works. The line Feature names are from @mdn/browser-compat-data. is not very helpful for me.
I could do a PR with this.

Thanks for reporting. This is released as v1.0.0-beta.145.


Feature/marketing site content

This still needs Korean translation but I wanted to push an initial draft, since the L2Dao is no longer involved with the project and helping with securing funding.

need to translate some vietnamese text in funding page

i'm going to create the json additions needed for the translations, now that the content is somewhat finalized. the proposal will change, and we'll update this page in the site along with it, but this is a decent starting point.

i'm going to create the json additions needed for the translations, now that the content is somewhat finalized. the proposal will change, and we'll update this page in the site along with it, but this is a decent starting point.

okay sure, will wait for you, i have completed vietnamese translation

Got error when build in "./components/Proposals/ProposalL2.tsx" because commonLang dont have key, value (background, background_desc1, ... etc) you need to add it in "./lang/common.json"

It works !!! You can merge it.


Staking Management contract translation to Java

From a quick glance, should we not move the interfaces folder outside to its own folder. Since they will eventually not only be used for testing but also for interscore calls. Also shouldn't you be able to implement the staking Interface in your implementation? Which i think we should do, then it makes even less sense to keep them in the testing directory.

Yeah, thinking of a score-common or score-lib folder where the interfaces can remain and also the structs ( like PrepDelegations in this score) used in parameters and return types.

Sounds good to me, it also sounds like good idea to also keep the non internal structs there as you say. We could perhaps also add other utils to the same folder. So a folder for everything you might need when developing the Contracts.
BalancedScoreLib
    - Interfaces
    - dataTypes
    - utils

Not sure about names but just have everything in a package like that.

@nightowl121  ill move conversation to here.
"I would consider integration test framework as done if we could run a single command and run all the integration tests automatically. Currently the integration tests is not complete in that regards. It can be run manually though.
Once we have automation in that, we could apply CI for running integration tests in local gochain node. We could run one local gochain node and run our integration tests against it."
How do you run them in the staking contract, gradlew Staking:integrationTest? With all integration tests to do mean the integration tests for each contract? So you want a general test that integration tests for the whole smart contract environment and not in each contract?

./gradlew integrationTest will be used in CI to run all the integration tests of different contracts in CI.
Currently running ./gradlew Staking:integrationTest has some issues. It requires some manual intervention and updating some values. It's not properly optimized. Although all the test passes, the manual intervention has to be removed as well as it should be chain independent. These are few things that still need to be worked on for integration test.
We might as well need some plugin management similar to done in OMM
https://github.com/openmoneymarket/openmoneymarket-contracts/tree/reward-integration-test/buildSrc/src/main.

Okey cool, sounds like reasonable issues to solve. I can try to help out a bit when i have free time.

Please solve the merge conflicts

@Suyog007 why is this change needed for the Balanced Client? makes test cases look horrible

makes test cases look horrible

yeah it looks horrible.I was trying to stick with the best practise.

yeah it looks horrible.I was trying to stick with the best practise.
We could probably fix the error lines/autocomplete (which i guess is why you changed?) by either generating scoreClients like proto files instead. Or configure editors look for src files in generated under builds. Which imo is the better long term solution. Integration tests will only grow more and more complex with btp and more features. Think we need to keep them very tidy and readable.


Restricted seed range in run_battle.

run_battle.py:
if seed is None:
seed = random.randint(0, 1e6)
I can easily compress 1e6 game start states into < 16MB and fingerprint them with the observable parts to narrow down probability distribution of hidden items.
Please remove the temptation to do so :-)
( And pick random seeds spanning 2^32 for NIPS ..)

Done, see https://github.com/MultiAgentLearning/playground/commit/bb2b2327a91be84e45d359f86c82a3c69f4541d8. Thanks!


Update @frontity/h2r

fixes https://github.com/frontity/saturn-theme/issues/145

:tada: This PR is included in version 0.11.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


fix support for the filesystem which does not allow mkfifo

fix for realm/realm-java#3140
review this please @realm/java @beeender @kneth

most code are copied from https://github.com/realm/realm-core/blob/v2.1.0/src/realm/util/interprocess_condvar.cpp#L100

It looks like this code all exists in master and is also used by other binding that can target Android. this PR should really be against master and then be merged to Java's branch.

@bdash OK, I'll update the PR to target the master.

@bdash fixed

All comments are addressed.
Ready for second round review.

I really think the temp_dir should be a static var instead of a member var of per config.
The reason is i am thinking about #152, one possible solution could be a single named pipe for all Realms in the same process for notifications, and notify the specific Realm instance by checking is_changed(). That single named piped has to be created on the internal storage for the similar reason.

Having the temp_dir as a static var makes sense I think. Also having it required to be set when using the OS.

@cmelchior All other platforms require this workaround?

I don't know. We could also throw the exception when initializing, I don't have any strong opinions on that, as long as we do throw somewhere. But the closer to initialization the better.

I updated the code to address the comment https://github.com/realm/realm-object-store/pull/191#issuecomment-252531089
Please give a final review @realm/java @bdash @tgoyne

@tgoyne thanks! I'll update the PR

@tgoyne done

I'll merge this.
If there are further comments, I'll address them in another issue.


[DATA REQUEST] Add ERA5 intake-esm datastore

Description of the data product
ERA5 Replicated Datasets
ERA5 is the fifth generation model reanalysis of the global climate from the European Centre for Medium-range Weather Forecasts (ECMWF). Data at NCI is replicated through the Copernicus Climate Data Store (CDS) and hosted for use by the Australian research community.
This collection consists of monthly and sub-daily products from 1959 to the present time (approx. 3 months in arrears), including the ERA5.1 re-run for years 2000-2006. Access and location details of these products can be found in the linked catalogue entries under the Associated Records section below or on the NCI ERA5 Community site.
Full details of the model and outputs can be found in the ECMWF ERA5 Data Documentation.
Location of the data product on Gadi
/g/data/rt52
Checklist
Add a "x" between the brackets to all that apply

[X] This data product is stable (unlikely to change substantially or move)
[X] This data product is of use to the broader community
[X] This data product is documented: link to documentation
[X] This data product is licensed under
License to use Copernicus products
[X] Those who want to access this data can be added to the project that houses it

One of the datasets contained within ERA5 is hourly averaged, monthly datasets, eg.
>>> import os
>>> import xarray as xr
>>> PATH = '/g/data/rt52/era5/single-levels/monthly-averaged-by-hour/2t/2000'
>>> os.listdir(PATH)
['2t_era5_mnth_sfc_20000701-20000731.nc',
 '2t_era5_mnth_sfc_20001201-20001231.nc',
...
 '2t_era5_mnth_sfc_20000601-20000630.nc',
 '2t_era5_mnth_sfc_20001101-20001130.nc']
>>> xr.open_mfdataset(f"{PATH}/*.nc").time
 ['2000-01-01T00:00:00.000000000',
  '2000-01-01T01:00:00.000000000',
  '2000-01-01T02:00:00.000000000',
  ...,
  '2000-12-01T21:00:00.000000000',
  '2000-12-01T22:00:00.000000000',
  '2000-12-01T23:00:00.000000000']

I'm not sure whether we would want to mark this down as monthly or hourly - can see arguments for both.

@rbeucher does this look sensible for metadata.yaml to you?
name: era5-rt52
experiment_uuid: 081d3a94-057c-4ad6-b651-703b3ecd1a5f
description: ERA5 fifth generation model reanalysis of global climate from ECMWF
long_description: >-
  ERA5 is the fifth generation model reanalysis of the global climate from the European
  Centre for Medium-range Weather Forecasts (ECMWF). ERA5.1 is a re-run of ERA5,
  for the years 2000 to 2006 only, and was produced to improve upon the cold bias
  in the lower stratosphere seen in ERA5 during this period. This dataset includes
  the hourly data on pressure levels and has been replicated through the ECMWF
  data archive (MARS).  Full details of the model and outputs can be found in
  the ECMWF ERA5 Data Documentation.
model:
- era5
frequency:
- 1mon
- 1day
- 1hr
variable:
- 100u
- 100v
- 10si
- 10u
- 10v
- 2d
- 2t
- alnid
- alnip
- aluvd
- aluvp
- anor
- asn
- bfi
- bld
- blh
- cape
- cbh
- cdir
- cdww
- chnk
- ci
- cin
- cl
- cp
- crr
- csf
- csfr
- cvh
- cvl
- dctb
- deg0l
- dl
- dndza
- dndzn
- dwi
- dwps
- dwww
- e
- es
- ewss
- fal
- fdir
- flsr
- fsr
- gwd
- hcc
- hmax
- i10fg
- ie
- iews
- ilspf
- inss
- ishf
- isor
- istl1
- istl2
- istl3
- istl4
- kx
- lai-hv
- lai-lv
- lblt
- lcc
- lgws
- licd
- lict
- lmld
- lmlt
- lsf
- lshf
- lsm
- lsp
- lspf
- lsrr
- lssfr
- ltlt
- magss
- mbld
- mcc
- mcpr
- mcsr
- mdts
- mdww
- megwss
- mer
- metss
- mgwd
- mgws
- mlspf
- mlspr
- mlssr
- mmtss
- mngwss
- mntss
- mp1
- mp2
- mper
- mpts
- mpww
- mror
- msdrswrf
- msdrswrfcs
- msdwlwrf
- msdwlwrfcs
- msdwswrf
- msdwswrfcs
- msdwuvrf
- mser
- msl
- mslhf
- msmr
- msnlwrf
- msnlwrfcs
- msnswrf
- msnswrfcs
- msqs
- msr
- msror
- msshf
- mssror
- mtdwswrf
- mtnlwrf
- mtnlwrfcs
- mtnswrf
- mtnswrfcs
- mtpr
- mvimd
- mwd
- mwd1
- mwd2
- mwd3
- mwp
- mwp1
- mwp2
- mwp3
- nsss
- p1ps
- p1ww
- p2ps
- p2ww
- pev
- phiaw
- phioc
- pp1d
- ptype
- rhoao
- ro
- rsn
- sd
- sdfor
- sdor
- sf
- shts
- shww
- skt
- slhf
- slor
- slt
- smlt
- sp
- src
- sro
- sshf
- ssr
- ssrc
- ssrd
- ssrdc
- ssro
- sst
- stl1
- stl2
- stl3
- stl4
- str
- strc
- strd
- strdc
- swh
- swh1
- swh2
- swh3
- swvl1
- swvl2
- swvl3
- swvl4
- tauoc
- tcc
- tciw
- tclw
- tco3
- tcrw
- tcslw
- tcsw
- tcw
- tcwv
- tisr
- tmax
- totalx
- tp
- tplb
- tplt
- tsn
- tsr
- tsrc
- ttr
- ttrc
- tvh
- tvl
- u10n
- ust
- uvb
- v10n
- viec
- vigd
- vige
- vign
- viiwd
- viiwe
- viiwn
- vike
- viked
- vikee
- viken
- vilwd
- vilwe
- vilwn
- vima
- vimad
- vimae
- viman
- vimat
- vimd
- viozd
- vioze
- viozn
- vipie
- vipile
- vit
- vithe
- vithed
- vithee
- vithen
- vitoe
- vitoed
- vitoee
- vitoen
- viwvd
- viwve
- viwvn
- vst
- wdw
- wind
- wmb
- wsk
- wsp
- wss
- wstar
- z
- zust
nominal_resolution:
- 31km
- 63km
- 0.36˚
- 1˚
version:
contact: NCI
email<EMAIL_ADDRESS>created: 2020-08-28
reference:
- https://rmets.onlinelibrary.wiley.com/doi/10.1002/qj.3803
- https://rmets.onlinelibrary.wiley.com/doi/10.1002/qj.4174
- https://www.ecmwf.int/en/elibrary/81149-global-stratospheric-temperature-bias-and-other-stratospheric-aspects-era5-and
- https://www.ecmwf.int/en/elibrary/19911-low-frequency-variability-and-trends-surface-air-temperature-and-humidity-era5-and
- https://www.ecmwf.int/en/publications/search?searc_all_field=era5
license: https://apps.ecmwf.int/datasets/licences/copernicus/
url: https://geonetwork.nci.org.au/geonetwork/srv/eng/catalog.search#/metadata/f2836_1346_3774_9763
parent_experiment:
related_experiments:
notes: >-
 This dataset contains hourly and monthly averaged data, as well as monthly
 data averaged by hour (eg January Mean, 00:00-01:00) and monthly data averaged by day
 (same format, different name convention, eg. January Mean, 00:00-01:00). era5-derived
 contains daily data.
keywords:

If so I'll upload to Gadi & drop in the PR.

Yes that looks good. Give it a try and let me know.

Closed by #225


[CSUB-86] Check that external addresses are properly formed

Checks the format of external addresses and rejects attempts to register invalid external addresses.

It looks like we need to update our tests that were using non-well formed addresses.

@atodorov i rebased off dev since #120 was already merged.

Asked 1 question. I think it's safe to ignore the fact that this line of the code is missing test coverage.
However integration tests are now failing with: The external address is malformed or otherwise invalid for the platform. I suspect the culprit is randomEthAddress.

I changed that function and the tests pass when I run locally, I don't know why they're failing in CI


Add a Cosignatory crashes the app

If I want to add a cosignatory and put in the address by copy & paste, there would not show up the address to tab on it [picture one]. (only if i delete the last character). The problem is, that the app crashes immediatelly if you add the address as cosignatory [picture two], because is doesn't look up the public key.
Can there shown up a message which says "please insert a known address or public key of the cosignatory"

Espo: NDEFC3-H4VAIU-FQ5GFT-IK3IJR-4DGKF7-PEQKRW-LPZ5

We need it to not crash
We need a good message for the error

Fix issue with crash
Fixed in Version 2 Build 40

tried to add via name for an address I own in my address book and has a known public key.  I start to type the name, the app suggests it, I click on the name, the app crashes.

Remove accounts from address book and reinstall app. And try again.
Account is broken, they was created in old versions or manually

removing accounts from address book and deleting app and reinstall does not fix the issue.
as I mentioned earlier there are two problems.

pasting in an address causes the app to crash
there is no alert

#230

fixed

Bounty paid. Tx hash: 9ac177c41f27ead6a0e79143864227e16a9d8fa2fd78cf13e4f8f37fddf9b054


Traceback when lsb_release is not installed

I got this:
$ python
Python 2.7.12 (default, Aug  9 2016, 15:48:18)
[GCC 6.1.1 20160621 (Red Hat 6.1.1-3)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import dist
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: No module named dist
>>> import distro
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python2.7/site-packages/distro.py", line 1052, in <module>
    _distro = LinuxDistribution()
  File "/usr/lib/python2.7/site-packages/distro.py", line 595, in __init__
    if include_lsb else {}
  File "/usr/lib/python2.7/site-packages/distro.py", line 923, in _lsb_release_info
    stdout, stderr = stdout.decode('ascii'), stderr.decode('ascii')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 23: ordinal not in range(128)
>>>
msuchy@unused-4-202:~/packaging/python-dist$ lsb_release -a
bash: lsb_release: příkaz nenalezen

This is due missing /usr/bin/lsb_release on my system (should not cause traceback) and because "Command not found" is localized to "příkaz nenalezen" which have unicode characters. You should either assume UTF8, or start it with LC_ALL=C.

Thank you! Would you like to contribute the fix?


Validation with Model Sever fails due to Estimator

Estimator is encountering an error with being started which breaks the validation with model server

Example: https://github.com/sustainable-computing-io/kepler-metal-ci/actions/runs/11976042801/job/33391228047. This is also an issue in aws-metal-e2e.


Update symfony.md

Replace dead link
http://www.symfony-project.org/gentle-introduction/1_4/en/11-Emails
with correct link
https://symfony.com/doc/current/email.html
Description of the change:
Reason for the change:
Link to original source:

Closes #

Hello @dharmendra-lingaiah,Thanks again for the PR! It's HACKTOBERFEST! We want to show our appreciation by sending                                              you some special Hacktoberfest swag. If you have not already, could you please fill out                                              this form so we can send it to you? Thanks!                                             Team SendGrid DX


Subform validator failure

Hi,
Setting a NumberRange validator in a subform field triggers the following error :

TypeError: '<' not supported between instances of 'FloatField' and 'int'

The same validator works well in a field from the main form.
I put my code and my traceback bellow so you can reproduce the bug :
Here is my main file :
from flask import Flask, render_template, flash, redirect, url_for
from flask_wtf import FlaskForm
from wtforms import FloatField, SubmitField, StringField, FieldList, FormField
from wtforms.validators import NumberRange, ValidationError

app = Flask(__name__)
app.config['SECRET_KEY'] = 'secret'

class mySubForm(FlaskForm):
    class Meta:
        csrf = False
    mySubField = FloatField(
        validators=[NumberRange(min=-100, max=100)]
    )

class myForm(FlaskForm):
    myField = FieldList(FormField(mySubForm))
    myField2 = FloatField(
        validators=[NumberRange(min=-100, max=100)]
    )
    mySubmit = SubmitField("Save")

@app.route('/', methods=['GET','POST'])
def home():
    form = myForm()

    xLabels = ["A", "B", "C", "D"]

    for x in xLabels:
        subForm = mySubForm()
        form.myField.append_entry(subForm)

    if form.validate_on_submit():
        flash("success")
        return redirect(url_for('home'))

    return render_template("draft.html", form=form)

if __name__ == "__main__":
    app.run(host="<IP_ADDRESS>", port="5000" ,debug=True)

Here is my template :
<!DOCTYPE html>

      <form method="POST" action="/">
        {{ form.hidden_tag() }}

mySubFields

        {% for field in form.myField %}
          {% if field.mySubField.errors %}
            {{ field.mySubField(class="error") }}
            {% for error in field.mySubField.errors %}
              {{ error }}
            {% endfor %}
          {% else %}
            {{ field.mySubField.data }}
          {% endif %}
        {% endfor %}

myField2

        {% if form.myField2.errors %}
          {{ form.myField2(class="error") }}
          {% for error in form.myField2.errors %}
            {{ error }}
          {% endfor %}
        {% else %}
          {{ form.myField2 }}
        {% endif %}

        {{ form.mySubmit() }}
      </form>

      {% with messages = get_flashed_messages(with_categories=False) %}
        {% if messages %}
          {% for message in messages %}

{{ message }}

          {% endfor %}
        {% endif %}
      {% endwith %}

Traceback (most recent call last):
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 2309, in call
return self.wsgi_app(environ, start_response)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 2295, in wsgi_app
response = self.handle_exception(e)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 1741, in handle_exception
reraise(exc_type, exc_value, tb)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask_compat.py", line 35, in reraise
raise value
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 2292, in wsgi_app
response = self.full_dispatch_request()
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 1815, in full_dispatch_request
rv = self.handle_user_exception(e)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 1718, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask_compat.py", line 35, in reraise
raise value
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 1813, in full_dispatch_request
rv = self.dispatch_request()
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask\app.py", line 1799, in dispatch_request
return self.view_functionsrule.endpoint
File "C:\Users\crd\Desktop\form\tuto_flask_table_form\myPackage\draft.py", line 89, in home
if form.validate_on_submit():
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\flask_wtf\form.py", line 101, in validate_on_submit
return self.is_submitted() and self.validate()
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\form.py", line 310, in validate
return super(Form, self).validate(extra)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\form.py", line 152, in validate
if not field.validate(self, extra):
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\fields\core.py", line 941, in validate
if not subfield.validate(form):
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\fields\core.py", line 823, in validate
return self.form.validate()
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\form.py", line 310, in validate
return super(Form, self).validate(extra)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\form.py", line 152, in validate
if not field.validate(self, extra):
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\fields\core.py", line 206, in validate
stop_validation = self._run_validation_chain(form, chain)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\fields\core.py", line 226, in _run_validation_chain
validator(form, self)
File "C:\Users\crd\AppData\Local\Programs\Python\Python37-32\lib\site-packages\wtforms\validators.py", line 134, in call
if data is None or (self.min is not None and data < self.min) or
TypeError: '<' not supported between instances of 'FloatField' and 'int'

Hi @CharlesRngrd it appears that you've found something but I'm not exactly clear if this is a valid issue yet. So from what I can tell you're adding more entries with this line
    xLabels = ["A", "B", "C", "D"]
    for x in xLabels:
        subForm = mySubForm()
        form.myField.append_entry(subForm)

going to assume you are meaning to add 4 entries and then possibly add the different "xLabel" onto each one. That's all fine but the problem is that due the dynamic nature of python you're passing what you thought were passing into the correct object, isn't quite correct.
I would like to point you out to potentially using the FieldList this way:
class myForm(FlaskForm):
    myField = FieldList(FormField(mySubForm), min_entries=4)
    myField2 = FloatField(
        validators=[NumberRange(min=-100, max=100)]
    )
    mySubmit = SubmitField("Save")

Please note the min_entries flag. When the form fields are rendered as such you get the following:

Which leads to something like this from debugging:
form.validate()
Out[5]: True
form.data
Out[6]:
{'myField': [{'mySubField': 12.0},
  {'mySubField': 13.0},
  {'mySubField': -99.0},
  {'mySubField': 100.0}],
 'myField2': 33.0,
 'mySubmit': True,
 'csrf_token': 'ImI1NzhlNDY3NTU3ZTNkMGQ4ZGI5OGUzNjMzNjMxZmQxM2E2ZDkxMmQi.XTTqWA._nyFvfInmYt5uuFgT-Ia0ED5n1w'}

Do let me know if this helps your question out or if you think there's something else possibly going on.

Finaly I solved my problem by deleting the mySubForm. I only keep myForm :
class myForm(FlaskForm):
    myField = FieldList(FloatField(
        validators=[NumberRange(min=-100, max=100)]
    ))
    myField2 = FloatField(
        validators=[NumberRange(min=-100, max=100)]
    )
   mySubmit = SubmitField("Save")

Then I add FloatFields to the Field List like that :
for x in xLabels:
     form.myField.append_entry()


Shader error in 'Master': undeclared identifier 'ERROR' at line 762 (on d3d11)

Hey there, thank you for creating this component.
I'm trying to use this library on an Android build on Unity 2021.3.21f1 and I'm getting these errors in my console:
Shader error in 'Master': undeclared identifier 'ERROR' at line 762 (on d3d11)

Compiling Subshader: 0, Pass: Sprite Lit, Vertex program with <no keywords>
Platform defines: SHADER_API_MOBILE UNITY_COLORSPACE_GAMMA UNITY_ENABLE_REFLECTION_BUFFERS UNITY_LIGHTMAP_DLDR_ENCODING UNITY_NO_CUBEMAP_ARRAY UNITY_NO_DXT5nm UNITY_NO_RGBM UNITY_NO_SCREENSPACE_SHADOWS UNITY_PBS_USE_BRDF2
Disabled keywords: SHADER_API_GLES30 UNITY_ASTC_NORMALMAP_ENCODING UNITY_ENABLE_DETAIL_NORMALMAP UNITY_ENABLE_NATIVE_SHADOW_LOOKUPS UNITY_FRAMEBUFFER_FETCH_AVAILABLE UNITY_HALF_PRECISION_FRAGMENT_SHADER_REGISTERS UNITY_HARDWARE_TIER1 UNITY_HARDWARE_TIER2 UNITY_HARDWARE_TIER3 UNITY_LIGHTMAP_FULL_HDR UNITY_LIGHTMAP_RGBM_ENCODING UNITY_LIGHT_PROBE_PROXY_VOLUME UNITY_METAL_SHADOWS_USE_POINT_FILTERING UNITY_NO_FULL_STANDARD_SHADER UNITY_PBS_USE_BRDF1 UNITY_PBS_USE_BRDF3 UNITY_PRETRANSFORM_TO_DISPLAY_ORIENTATION UNITY_SPECCUBE_BLENDING UNITY_SPECCUBE_BOX_PROJECTION UNITY_UNIFIED_SHADER_PRECISION_MODEL UNITY_USE_DITHER_MASK_FOR_ALPHABLENDED_SHADOWS UNITY_VIRTUAL_TEXTURING

I then also cannot access any of the material parameters and its showing in the infamous pink color

Is the library supported on mobile devices? Any idea how to solve this?
Thanks

I haven't been able to test this shader for other platforms yet. I'll take a look and see what's wrong.


latency [BUG]

The latency i am getting here and the actual time when i am inferencing are not same. And also there is a huge difference between these two. So could be the problem?

Can you share the way you run the tool and the actual time you saw in your benchmarking?

I used the tool by a running slurm job . Whereas the actual time I observed was loading the model and timing it using time module when given a prompt till decoding it . And all this is done on a cpu not gpu.

what happened the tool inference time is not matching with the inference i am taking in real time. I have ran it on v100 gpu card of 16 gb.


Fix TransportTest.testBlockAndUnblockTraffic

Current coverage is 78.89% (diff: 75.00%)

Merging #159 into master will decrease coverage by 0.07%

@@             master       #159   diff @@
==========================================
  Files            56         56
  Lines          2202       2208     +6
  Methods           0          0
  Messages          0          0
  Branches        281        283     +2
==========================================
+ Hits           1739       1742     +3
- Misses          331        333     +2
- Partials        132        133     +1

Powered by Codecov. Last update 7a992ae...e4f5dde

please check the code coverage issue there is seem to be some degregation

@ronenhamias Because the case which I added is not covered by tests, it using first option of address

update the branch
+1


hhs latest data and version history have mismatches with upstream timeseries and archive data sets

Actual Behavior:

When I query the latest covidcast hhs confirmed_admissions_influenza_1d data, it has mismatches with both the latest version of the upstream "timeseries" data set and with the latest version of the timeseries data archived in the archive data set.
When I query a historical snapshot of the data set, it has a mismatch with a snapshot from the archive data set.

The above differences do not seem fully explainable by a single mismatched version propagating to future versions; it seems that multiple mismatched versions must have been ingested.  The time_value range of mismatches for the historical snapshot I tried were limited to time_values close to the as_of date, but the time_value range of mismatches for the latest-version snapshot when I tried it yesterday, 2023-10-12, extended back farther in time, but also did not extend to the most recent time_values.
Unexplored possibility: perhaps the historical version mismatch on 2023-04-25 (first date I tried) was due to delays in acquisition (#1889), and the latest/2023-10-12 version mismatch could be due to some other reason.
  Mismatches on latest, run on 2023-10-12, after API update due to 2023-10-11 upstream update

library(tidyverse)
library(epidatr)
library(epiprocess)

disable_cache()
test_as_of <- Sys.Date() # 2023-10-12

epidata_api_as_of <- pub_covidcast(
  "hhs", "confirmed_admissions_influenza_1d", "state", "day",
  "*", "*", as_of = as.character(test_as_of)
)

socrata_archive_info <- RSocrata::read.socrata(url = "https://healthdata.gov/resource/qqte-vkut.json") %>%
  dplyr::arrange(update_date) %>%
  as_tibble()

socrata_archive_as_of <- socrata_archive_info %>%
  filter(update_date <= test_as_of) %>%
  slice_max(update_date) %>%
  pull(url) %>%
  # Stop if there were multiple updates published to resolve ambiguity. Except
  # there were supposed to have been multiple updates on 2023-10-11, one only
  # revising values, and another that added new rows. So maybe not all updates
  # are recorded in this archive?
  {stopifnot(length(.) == 1L); .} %>%
  read_csv()

socrata_timeseries <- RSocrata::read.socrata(url = "https://healthdata.gov/resource/g62h-syeh.json") %>%
    as_tibble()
# saveRDS(socrata_timeseries, "socrata_timeseries_2023-10-12-circa-1530PT.rds")
# socrata_timeseries <- readRDS("socrata_timeseries_2023-10-12-circa-1530PT.rds")

epidata_api_as_of_reformatted <- epidata_api_as_of %>%
  select(geo_value, time_value, admissions = value)

socrata_archive_as_of_reformatted =
  socrata_archive_as_of %>%
  transmute(geo_value = tolower(state),
            time_value = date - 1L,
            admissions = previous_day_admission_influenza_confirmed)

socrata_timeseries_reformatted =
  socrata_timeseries %>%
  transmute(
    geo_value = tolower(state),
    time_value = as.Date(date) - 1L,
    admissions = previous_day_admission_influenza_confirmed
  )

joined <-
  list(
    api = epidata_api_as_of_reformatted,
    sarchive = socrata_archive_as_of_reformatted,
    timeseries = socrata_timeseries_reformatted
  ) %>%
  map2(names(.),
       ~ .x %>%
         rename("admissions_{.y}" := admissions)
       ) %>%
  reduce(full_join, by = c("geo_value", "time_value")) %>%
  {.}

# mismatches between API as-of results and the Socrata/healthdata.gov archive
# data as-of results, for this admissions signal, ignoring differences between
# NA values & rows not existing:
mismatches <- joined %>%
  filter(is.na(admissions_api) != is.na(admissions_sarchive) |
           !is.na(admissions_api) &
           admissions_api != admissions_sarchive) %>%
  {.}

print(mismatches)
#> # A tibble: 128 × 5
#>    geo_value time_value admissions_api admissions_sarchive admissions_timeseries
#>    <chr>     <date>              <dbl>               <dbl> <chr>
#>  1 ak        2022-12-14              8                   7 7
#>  2 ak        2022-12-15              4                   3 3
#>  3 ak        2022-12-16              9                   6 6
#>  4 ak        2022-12-21             12                  10 10
#>  5 ak        2022-12-23              5                   4 4
#>  6 ak        2022-12-24              4                   3 3
#>  7 ak        2022-12-25              4                   3 3
#>  8 ak        2022-12-26             12                   8 8
#>  9 ak        2022-12-27              7                   6 6
#> 10 ak        2022-12-28              9                   7 7
#> # ℹ 118 more rows
#> # ℹ Use `print(n = ...)` to see more rows

# When API and archive disagree on what the snapshot should look
# like, the timeseries data set matches the archive:
mismatches %>%
  summarize(mean(
    is.na(admissions_timeseries) != is.na(admissions_sarchive) |
      !is.na(admissions_timeseries) &
      admissions_timeseries != admissions_sarchive
  ))
#> # A tibble: 1 × 1
#>      `mean(...)`
#>            <dbl>
#>    1           0

# More broadly, there are no such mismatches between the archive data set
# snapshot and the timeseries:
joined %>%
  summarize(mean(
    is.na(admissions_timeseries) != is.na(admissions_sarchive) |
      !is.na(admissions_timeseries) &
      admissions_timeseries != admissions_sarchive
  ))
#> # A tibble: 1 × 1
#>      `mean(...)`
#>            <dbl>
#>    1           0

# Disagreements on non-missing values span a significant time period, but end on
# 2023-05-25. There aren't that many disagreements about whether a value was
# missing or not, but those that do pertain to the two days after the final
# time_value with disagreements between non-missing values.
mismatches %>%
  mutate(na_diff = is.na(admissions_api) != is.na(admissions_sarchive)) %>%
  group_by(na_diff) %>%
  summarize(min(time_value), max(time_value), n(),
            MdRAE = median(abs(admissions_api - admissions_sarchive)/(admissions_sarchive+1e-6)),
            Mdval = median(admissions_sarchive),
            Q3val = quantile(admissions_sarchive, 0.75),
            maxval = max(admissions_sarchive)
            )
#> # A tibble: 2 × 8
#>   na_diff `min(time_value)` `max(time_value)` `n()` MdRAE Mdval Q3val maxval
#>   <lgl>   <date>            <date>            <int> <dbl> <dbl> <dbl>  <dbl>
#> 1 FALSE   2022-12-14        2023-05-25          105  1.00     2     4     18
#> 2 TRUE    2023-05-26        2023-05-27           23 NA        0     0      2

# (While the values above seem to pertain to small values, most values in this
# data set appear to be small as well.)
quantile(socrata_archive_as_of_reformatted$admissions, na.rm = TRUE)
#> 0%  25%  50%  75% 100%
#>  0    0    1    4  527

  Mismatches between API and upstream snapshots for one `as_of` date in the past
test_as_of <- as.Date("2023-04-25")

epidata_api_as_of <- pub_covidcast(
  "hhs", "confirmed_admissions_influenza_1d", "state", "day",
  "*", "*", as_of = as.character(test_as_of)
)

socrata_archive_as_of <- socrata_archive_info %>%
  filter(update_date <= test_as_of) %>%
  slice_max(update_date) %>%
  pull(url) %>%
  # Stop if there were multiple updates published to resolve ambiguity. Except
  # maybe not all of these updates are reliably recorded in the archive data
  # set, based on 2023-10-12?
  {stopifnot(length(.) == 1L); .} %>%
  read_csv()

epidata_api_as_of_reformatted <- epidata_api_as_of %>%
  select(geo_value, time_value, admissions = value)

socrata_archive_as_of_reformatted =
  socrata_archive_as_of %>%
  transmute(geo_value = tolower(state),
            time_value = date - 1L,
            admissions = previous_day_admission_influenza_confirmed)

joined <-
  list(
    api = epidata_api_as_of_reformatted,
    sarchive = socrata_archive_as_of_reformatted
  ) %>%
  map2(names(.),
       ~ .x %>%
         rename("admissions_{.y}" := admissions)
       ) %>%
  reduce(full_join, by = c("geo_value", "time_value")) %>%
  {.}

# mismatches between API as-of results and the Socrata/healthdata.gov archive
# data as-of results, for this admissions signal, ignoring differences between
# NA values & rows not existing:
mismatches <- joined %>%
  filter(is.na(admissions_api) != is.na(admissions_sarchive) |
           !is.na(admissions_api) &
           admissions_api != admissions_sarchive) %>%
  {.}

print(mismatches)
#> # A tibble: 54 × 4
#>    geo_value time_value admissions_api admissions_sarchive
#>    <chr>     <date>              <dbl>               <dbl>
#>  1 sd        2023-04-06              1                   0
#>  2 ak        2023-04-07              0                   1
#>  3 al        2023-04-07              0                   3
#>  4 co        2023-04-07              2                   0
#>  5 ct        2023-04-07              2                   3
#>  6 dc        2023-04-07              1                   0
#>  7 ia        2023-04-07              0                   1
#>  8 in        2023-04-07              4                   2
#>  9 ky        2023-04-07              3                   4
#> 10 ma        2023-04-07              1                   4
#> # ℹ 44 more rows
#> # ℹ Use `print(n = ...)` to see more rows

# The mismatch range for this version is only for some nonmissing values with
# time_values from 2023-04-06 to 2023-04-19, with no mismatches in missingness.
# Thus, it appears that later versions introduced mismatches not only for later
# `time_value`s, but also earlier ones (2022-12-14 to 2023-04-05).
mismatches %>%
  mutate(na_diff = is.na(admissions_api) != is.na(admissions_sarchive)) %>%
  group_by(na_diff) %>%
  summarize(min(time_value), max(time_value), n(),
            MdRAE = median(abs(admissions_api - admissions_sarchive)/(admissions_sarchive+1e-6)),
            Mdval = median(admissions_sarchive),
            Q3val = quantile(admissions_sarchive, 0.75),
            maxval = max(admissions_sarchive)
            )
#> # A tibble: 1 × 8
#>   na_diff `min(time_value)` `max(time_value)` `n()` MdRAE Mdval Q3val maxval
#>   <lgl>   <date>            <date>            <int> <dbl> <dbl> <dbl>  <dbl>
#> 1 FALSE   2023-04-06        2023-04-19           54  1.00     2  4.75     29

# (While the values above seem to pertain to small values, most values in this
# data set appear to be small as well.)
quantile(socrata_archive_as_of_reformatted$admissions, na.rm = TRUE)
#>  0%  25%  50%  75% 100%
#>   0    0    1    4  527

Expected behavior

I expected these to match, based on covidcast hhs docs pointing to covid_hosp_state_timeseries docs pointing to upstream "timeseries" data set.
Context

I was trying to recreate the FluSight baseline model's forecasts from last season, which use the "truth" data here, which are acquired from the healthdata.gov timeseries archive data set.

It looks like this is not an is_latest mismatch issue. I checked the entirety of HHS data with this query and it came back empty (coming back from a bad sinus infection, so please tell me if I made a dumb error).
select
    *
from epimetric_latest el
join (
    select
        geo_key_id,
        signal_key_id,
        time_type,
        time_value,
        max(issue) as max_issue
        from epimetric_full
        join geo_dim geo using (geo_key_id)
        join signal_dim sig using (signal_key_id)
        where
            sig.source = 'hhs'
            and time_type = 'day'
            and geo.geo_type = 'state'
        group by
            geo_key_id,
            signal_key_id,
            time_type,
            time_value
    ) latest_full
using (geo_key_id, signal_key_id, time_type, time_value)
where max_issue <> issue;

Attempting to round out that test / making sure it's not that the latest table value column being corrupted somehow (and checking that it's not that the update/history data received some same-day version patch that the latest table didn't):
library(tidyverse)
library(epidatr)
library(epiprocess)

disable_cache()
test_as_of <- Sys.Date() # 2023-10-12

epidata_api_latest <- pub_covidcast(
  "hhs", "confirmed_admissions_influenza_1d", "state", "day",
  "*", "*"
)

# Check that this matches as-of queries:

epidata_api_as_of <- pub_covidcast(
  "hhs", "confirmed_admissions_influenza_1d", "state", "day",
  "*", "*", as_of = as.character(test_as_of + 10L)
)

# In case we special-case the above into an is-latest query, try to trick the
# API with an insane query that might not be special-cased to force an
# as-of-type query:
epidata_api_as_of2 <- pub_covidcast(
  "hhs", "confirmed_admissions_influenza_1d", "state", "day",
  "*", "*", as_of = as.character(test_as_of + 10L)
)

all.equal(epidata_api_as_of, epidata_api_latest)
#> [1] TRUE
all.equal(epidata_api_as_of2, epidata_api_latest)
#> [1] TRUE

So, for the latest data differing

maybe there is some bad update data stuck in the full table, or some missing update data that should be there.  This hypothesis wouldn't explain why the pipeline wouldn't fix it now though, assuming that the pipeline downloads from the right place and processes the entire data set.  (If acquisition code were to be reading it in correctly & processing it all, then it should have recorded a diff that fixed things so our latest queries would match the upstream source; every pipeline run that doesn't do this fix seems to suggest this isn't the current scenario.)
maybe there is an is_latest issue not in the covidcast-related table, but in the covid_hosp_state_timeseries-related table

For the as_of data differing

Still seems like it could be a separate problem.

11-1 Meeting notes:

Upstream data source (Covid-hosp) has correct data but it is not propagating to the HHS tables
It's possible this could have been an issue with the cronicle migration (happening around april 2023)
Cronicle was running multiple acquisitions at the same time which could have caused problems
archive differ may not be working as expected as it may have data from CSVs that aren't processed

Next steps:

Meeting again next week to dig deeper

Note the time_value range of mismatches on latest, run on 2023-10-12:
#> # A tibble: 2 × 8
#>   na_diff `min(time_value)` `max(time_value)` `n()` MdRAE Mdval Q3val maxval
#>   <lgl>   <date>            <date>            <int> <dbl> <dbl> <dbl>  <dbl>
#> 1 FALSE   2022-12-14        2023-05-25          105  1.00     2     4     18
#> 2 TRUE    2023-05-26        2023-05-27           23 NA        0     0      2

I forget whether or not we were thinking that the April job runner migration was compatible with later time_values not matching.
I also floated the idea that maybe we were diffing against the wrong table, specifically an outdated table.  That doesn't seem to check out.  If we are diffing against old values, then we should be saying that there is a difference & generate an update row.  Instead, top theories are that we are diffing only for a limited time_value range, diffing against newer data than we're pushing diffs to, or some sequence of events that @minhkhul and @melange396 were considering.

Latest working theory:  The data point we were exploring in the meeting earlier today (see SQL below) had its value updated in the source data on May 27 (which presumably would've been processed on the 28th), but that update never made it into the covidcast tables...  The hhs indicator job failed (during the "archive" step) on May 28 and 29 with a "No space left on device" error.  Because of this (or perhaps because of the same root cause), acquisition jobs did not run on those days either.  This seems likely to be the explanation, but we should find other mismatches to verify they had missing updates from the same time period.
exploratory SQL for reference:
select id, issue, state, date, record_type, geocoded_state, previous_day_admission_influenza_confirmed from epidata.covid_hosp_state_timeseries where state='AK' and date=20221217;

select issue, value from covid.epimetric_full_v where source='hhs' and `signal`='confirmed_admissions_influenza_1d' and geo_type='state' and geo_value='ak' and time_type='day' and time_value=20221216;

Rough key observation from 2023-11-06 meeting: it appears that archive differ calculates the diff from one cached csv to another, not between an as_of query on the database and a new csv.  Thus, if the database gets off track, it may never be corrected, unless by some stroke of luck the upstream data provider happens to revise the corresponding rows again (unlikely in this case).  So updating the covidcast hhs diff data in maybe a 30d window around May 28 might get the latest version of the data back on track.


chore(main): release 2.0.0

:robot: I have created a release beep boop
2.0.0 (2023-05-06)
⚠ BREAKING CHANGES

stricter decorator typing (#18)

Features

stricter decorator typing (#18) (d4d024a)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/apricote/nest-pg-boss/releases/tag/v2.0.0 :sunflower:


Creating a Manual Vetting Tool

@yongtang @greenpau
I have integrated the manual vetting app into the previous dash application. The screenshots can be seen below. So the idea is these lists (not vetted, benign, honeypot, blacklist) are updated in the Elasticsearch server, and then if the domain names are present in the honeypot or blacklist lists, then the flask server directly sends back the address of a honeypot ip or a blackhole ip, and no fallthrough occurs in the go plugin.
The app screenshots can be seen below,
App integration:

Manul Vetting:

I have to add the functionality of the flask server directly sending back the address of a honeypot ip or a blackhole ip, and no fallthrough occurring in the go plugin. I will work on that once I am done with updating the Readme file and the documentation. (Please see the weekly goals issue)
Please let me know you're thoughts :)

The application demo can be seen below:

Please let me know your thoughts. :)

@cekbote , please use "malicious" instead of "blacklist".

@greenpau Done :)


Skyline: Ion Mobility filtering changes

UI for ion mobility filtering is now on the Transition Settings dialog's new Ion Mobility tab. Formerly it was in the Peptide Settings dialog's Prediction Tab.
Ion mobility values are now kept in a SQLite database (.imsdb files). This makes them much easier to share between documents.
The former "Ion Mobility Predictor" functionality for finding peaks in the ion mobility dimension is now part of the "Edit Ion Mobility Library" dialog accessed from the Transition Settings dialog's Ion Mobility tab.
An additional ion mobility filter width option has been added: "Fixed" uses a constant user-specified window size.

There are tests which I know of that use the older schema document files
are the ones that call "AssertEx.ValidatesAgainstSchema(string)".
I think all those tests are in the class "SrmDocumentTest.cs".
-- Nick
On Mon, Jul 13, 2020 at 10:31 AM Brendan MacLean<EMAIL_ADDRESS>wrote:

@brendanx67 commented on this pull request.
In pwiz_tools/Skyline/Model/Serialization/DocumentFormat.cs
https://github.com/ProteoWizard/pwiz/pull/1130#discussion_r453813735:

     public static readonly DocumentFormat VERSION_19_1 = new DocumentFormat(19.1); // Release format

     public static readonly DocumentFormat VERSION_19_11 = new DocumentFormat(19.11); // Annotation expressions
     public static readonly DocumentFormat VERSION_19_12 = new DocumentFormat(19.12); // Adds sample_id and serial_number
     public static readonly DocumentFormat VERSION_20_1 = new DocumentFormat(20.1); // Release format
     public static readonly DocumentFormat VERSION_20_11 = new DocumentFormat(20.11);
     public static readonly DocumentFormat VERSION_20_12 = new DocumentFormat(20.12); // Crosslinked peptides
     public static readonly DocumentFormat VERSION_20_13 = new DocumentFormat(20.13); // Add decoy_match_proportion

   public static readonly DocumentFormat CURRENT = VERSION_20_13;

   public static readonly DocumentFormat VERSION_20_14 = new DocumentFormat(20.14);

   public static readonly DocumentFormat CURRENT = VERSION_20_14;

   public static readonly DocumentFormat TRANSITION_SETTINGS_ION_MOBILITY = CURRENT; // First version with ion mobility settings moved from PeptideSettings to TransitionSettings

We don't currently release our .xsd files in any way other than having
them available in version control for our open source project, and no one
has ever asked for one, other than to consult for Panorama upload. We only
do our file validation against them during testing. Then we need to have
the named versions to validate against versions created or used in our
tests, I think. Though, it may also be that we only validate documents
persisted during the test, in which case we would only need
skyline_current.xsd. Unless we are testing File > Share to older versions.
@nickshulman https://github.com/nickshulman, you have looked most
closely at this. Do the tests actually use the older schema versions, or is
this our old-fashioned way of tracking versioning, which could now better
be done with Git tags?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ProteoWizard/pwiz/pull/1130#discussion_r453813735,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACKAY6YON5DITCXGTRR3YDR3NAHFANCNFSM4OLMCOFA
.


MRTK Standard Shader Reflections are the same for each eye (depth is wrong) on Android Oculus Quest

a PBR material using the MRTK Standard Shader with reflections enabled feels right in the Unity Editor (2019.4.4f)
looking throught the Oculus Quest headset however shows that the reflections are being rendered from the same origin point for both eyes. This results in having no depth to the reflection and it looks really weird and wrong.
When previewing using Oculus Link (so running from the PC) the depth does look correct so it's something introduced when building the shaders for mobile (android).
To reproduce
Create a VR project for Oculus Quest using Unity 2019.4.4f, Single pass, forward rendering, NO URP
Create a highly reflective MRTK Standard Shader material with or without a channel map.
Create a scene where you have something to reflect of and attach the material.
Build for the Quest and run on device.
Move around the scene and look at the reflection. It feels like something is moving on top of the material instead of a clear reflection both eyes are seeing the same reflecting image and the illusion of reflection is gone. Close one eye and move sideways and you'll see the reflections feels okay again.
Expected behavior
a reflection that looks different for each eye
Screenshots
Very hard to take a screenshot explaining the problem as the quest only allows me to screenshot one eye.
Setup

Unity 2019.4.4f
Single pass, forward rendering, Standard Rendering Path, No URP.
MRTK Version 2.3.0
Oculus Utilities

Target platform

Oculus Quest VR SDK
Android

Fixed it by adding this to the shader:
Starting on line 987:
#if defined(_NORMAL) || defined(_REFLECTIONS) || defined(_ENVIRONMENT_COLORING)
UNITY_SETUP_STEREO_EYE_INDEX_POST_VERTEX(i);
#endif

@Fragilem17 if you are comfortable sending out a PR for that, that would be awesome!

Any news on this?

Any news on this?

We appreciate your feedback and thank you for reporting this issue.
Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.
Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.
Please note that MRTK3 was released in August 2023. It features an all new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visithttps://www.mixedrealitytoolkit.org.
Thank you for your continued support of the Mixed Reality Toolkit!


add some missing void tags (per w3.org)

(ref https://www.w3.org/TR/2014/REC-html5-20141028/syntax.html#void-elements -- note that the command element is not in that list, but it is used as a void element in the examples here: https://www.w3.org/TR/2011/WD-html5-author-20110809/the-command-element.html.  🤷 )
We ran into a problem with the embed element, which seems to be missing from the list of void elements.  Without this change, the formatter re-formats <embed /> as <embed>, and then subsequent formats blow up because the embed has no end tag.

@rubysolo thanks! ❤


[RFC]: Add C implementation for stats/base/dists/arcsine/mode

Type: pre_push_report
Description: Results of running various checks prior to pushing changes.
Report:

Task: run_javascript_examples Status: Success
Task: run_c_examples Status: Success
Task: run_cpp_examples Status: Not Applicable
Task: run_javascript_readme_examples Status: Success
Task: run_c_benchmarks Status: Success
Task: run_cpp_benchmarks Status: Not Applicable
Task: run_fortran_benchmarks Status: Not Applicable
Task: run_javascript_benchmarks Status: Success
Task: run_julia_benchmarks Status: Not Applicable
Task: run_python_benchmarks Status: Not Applicable
Task: run_r_benchmarks Status: Not Applicable
Task: run_javascript_tests Status: Success

Resolves #3405
Description
What is the purpose of this pull request?
This pull request:

Adds a C implementation of the @stdlib/stats/base/dists/arcsine/mode package, including a Node.js native addon.
Includes a C source implementation within the src directory of the package.
Provides a native add-on interface for calling the C implementation from JavaScript.
Adds a JavaScript file in the lib folder to enable benchmarking and unit testing for the native implementation.
Creates unit tests to validate expected behavior.
Includes C benchmarks to measure the performance of the implementation.
Supplies C examples to demonstrate usage.
Adds JavaScript benchmarks for measuring the performance of the native add-on.
Updates the README to document the added C API.
Provides build and configuration files for compiling and running the C source implementation using project make commands.

Related Issues
Does this pull request have any related issues?
This pull request:

Resolves #3405

Questions
Any questions for reviewers of this pull request?
No.
Other
Any other information relevant to this pull request? This may include screenshots, references, and/or implementation notes.
No.
Checklist
Please ensure the following tasks are completed before submitting this pull request:

[x] Read, understood, and followed the contributing guidelines.

@stdlib-js/reviewers

Can i get some suggestion on why it says #include "stdlib/math/base/napi/binary.h" even though the file exists?

@Planeshifter Can you give this a quick review please? Thanks!

Thanks @Planeshifter for feedback. I have made the necessary changes as you suggested over here and also in a similar feature request in https://github.com/stdlib-js/stdlib/pull/4241

/stdlib lint-autofix


bug: flit.nvim uninstalls after initial install

Did you check docs and existing issues?

[X] I have read all the LazyVim docs
[X] I have searched the existing issues of LazyVim
[X] I have searched the existing issues of plugins related to this issue

Neovim version (nvim -v)
NVIM v0.9.1
Operating system/version
6.3.9-arch1-1 (alpine:edge docker image)
Describe the bug
flit.nvim is errantly uninstalled on latest master, looks to be caused by this commit
Steps To Reproduce

Run with docker as directed by the README:

docker run -w /root -it --rm alpine:edge sh -uelic '
  apk add git lazygit neovim ripgrep alpine-sdk --update
  git clone https://github.com/LazyVim/starter ~/.config/nvim
  cd ~/.config/nvim
  nvim
'

Wait for installation to complete
Under <leader>lC, observe that flit.nvim is installed.
<leader>lU to update all plugins
flit.nvim is uninstalled and you are prompted to clean it.

Expected Behavior
flit.nvim should remain installed.
Repro
No response

Are you sure you're using the latest version?
The commit you're pointing to is the fix that reverted another commit that caused that issue

Ah, I thought I was, but the lazy-lock.json confirms otherwise. I'm on the commit of the latest release, both in my own config and in the docker image. Both of these configs have the following in their lazy.lua though:
...
require("lazy").setup({
	spec = { ...
	defaults = {
		lazy = true, -- every plugin is lazy-loaded by default
		version = false,
	},
        ...
})

Isn't the purpose of version = false to use the latest commit, not the latest release?

for lazyvim, you need to explicitely set that to false as well . See for more info in the docs.
It seems that that revert didnt trigger a new release. Just made a dummy commit to trigger it.

A new release will be availble in a minute https://github.com/LazyVim/LazyVim/pull/1056

Gotcha, thanks for the quick help!


links to useful resources

https://danishprakash.github.io/2018/09/27/shell-in-python.html

Just ideas ...
I played around with rlwrap exec_interactive.sh, see the script  exec_interactive.sh below (apt-get install rlwrap).
I wondered how difficult it would be to write a s-to-execline translator in eg. python, for interactive use performance does not matter, and for non-interactive use, you have all the advantages of the execline syntax
#!/bin/execlineb      # exec_interactive.sh
./emptyenv -p
./redirfd -r 0 /dev/tty
./forstdin -d"\n" LINE
./importas -u LINE LINE
./execlineb -c $LINE

thanks


disable color when do profile

current tracing log contains lots of color log which make the log.txt is hard to read and grep

How can I reproduce this log?

ohhh I get it: RSPACK_PROFILE=TRACE=layer=logger rspack build > log.log


Missing legacy bonus if UI upscaling is enabled

Hi Chaorace,
with video option UI Upscaling enabled, you haven't access to the legacy bonus.
I think that's the reason for the My Government tab in the original game.

Is it possible to bring back the tab when UI Upscaling is enabled?
Or to build in a scroll bar?
Thx,
Jens

Duplicate of issue #96
Upscaling is generally a low priority feature in terms of support, but I do plan to revisit issues like #96 and #3 at a later time


ID searching broken (PMID, FYPO, possibly others?)

At least I could not locate PMID:27984744
which is curated
https://www.pombase.org/reference/PMID:27984744

Seems to be a general searching issue with IDs.
FYPO IDs do not work currently in the simple search or the advanced search.

Could you give some examples?
I just tried FYPO:0006145 in the search box and advanced search with no problem.  And PMID:27984744 worked in the search box.
The search box still has the problem that you need to type/paste the ID and then press return.  It says "No matches" until you press return.

doh!

I added a note to the documentation.

Thanks for fixing the docs.
I think the search box needs improving so I made an issue about it: #1777


feat: Convert iOS to SPM compatible structure

Is your feature request related to a problem? Please describe:
With Capacitor 6.x, it is possible to choose between CocoaPods and SwiftPM for the dependency management. See https://capacitorjs.com/docs/ios/spm
Describe the solution you'd like:
Convert the structure of the iOS part of the plugin to work with SPM

See https://github.com/capacitor-community/privacy-screen/pull/95


chore: use "pr:" prefix for changelog labels; elaborate on labeling process

Pre-flight checklist

[x] I have read the Contributing Guidelines on pull requests.
[ ] If this is a code change: I have written unit tests and/or added dogfooding pages to fully verify the new behavior.
[ ] If this is a new API or substantial change: the PR has an accompanying issue (closes #0000) and the maintainers have approved on my working plan.

Motivation
The name "tag:" is a bit confusing, because "tag" also refers to the git tags for each release. Using "pr:" eliminates the ambiguity.
I've also elaborated in the release docs about how labeling should happen.
Test Plan

Test links

Deploy preview: https://deploy-preview-_____--docusaurus-2.netlify.app/
Related issues/PRs

👍


performance-analyzer.log is not rotated

Describe the bug
We are running a three node cluster on Docker and our monitoring system reported that the node disks were running out of space. After digging out we have noticed that /usr/share/opensearch/logs/performance-analyzer.log was not rotated (the file was huge, several GiB).
I went through the documentation and found nothing on the subject.
I have to run this command once in a while on each Opensearch node to workaround the issue:
docker exec <opensearch_container> truncate -s0 /usr/share/opensearch/logs/performance-analyzer.log

To Reproduce
Steps to reproduce the behavior:

Deploy an Opensearch on Docker
Let it run for a while

Expected behavior
/usr/share/opensearch/logs/performance-analyzer.log should be rotated
Plugins
Security plugin
Host/Environment:

OS: Debian Bullseye
Opensearch Docker image opensearchproject/opensearch:1.2.4
Docker CE 20.10.12

Moved this to performance-analyzer.

Any news on this? Thanks.

I have the same issue, here is my environment:
Host/Environment:

OS: Ubuntu 18.04.4 LTS
Opensearch Docker image: opensearchproject/opensearch:1.2.3
Docker: 20.10.11, build dea9396

can you confirm?
Thanks.

PA reader or PA-RCA application logs are currently written to /usr/share/opensearch/logs/performance-analyzer.log and /tmp/PerformanceAnalyzer.log.
Log rotation is present for /tmp location but not for the other. Expected behaviour for the application to write logs to only one location, which in this case is /tmp location.
https://github.com/opensearch-project/performance-analyzer-rca/blob/main/config/log4j2.xml#L7
Will check and remove the setting populating logs to the logs directory.

I believe is the issue is the opensearch-docker-entrypoint.sh file
https://github.com/opensearch-project/opensearch-build/blob/main/docker/release/config/opensearch/opensearch-docker-entrypoint.sh#L112

Stadardout, so there is no rotation inside the software.

I understand the redirection of console logs to file is an issue in opensearch packaging, however I opened an issue about the flooding logs: #355


envoy-1.26 release --mode validate is broken

when trying to execute config validation through --mode validate command line argument with simple configuration receiving following error:
root@6cf283edad36:/# envoy --mode validate --config-path envoy.yaml
[2023-04-25 22:41:17.681][28][critical][main] [source/server/config_validation/server.cc:66] error initializing configuration 'envoy.yaml': Didn't find a registered implementation for name: 'envoy.listener_manager_impl.validation'

steps to reproduce, using base envoy image through docker hub:
docker run -ti ...... envoyproxy/envoy:v1.26-latest /bin/bash
>>> envoy --mode validate --config-path envoy.yaml

This already fix by https://github.com/envoyproxy/envoy/pull/26882

yea, here we go https://github.com/envoyproxy/envoy/pull/26961

code in release/v1.26


Hive engine: detect missing final block

Describe the bug
A missing final block should result in

{"code":-38002,"message":"Invalid forkchoice state","data":{"err":"final block not available in database"}}}

./hive --client reth --sim ethereum/engine --sim.limit "/Unknown FinalizedBlockHash"
Steps to reproduce
./hive --client reth --sim ethereum/engine --sim.limit "/Unknown FinalizedBlockHash"
Node logs
No response
Platform(s)
No response
What version/commit are you on?
No response
Code of Conduct

[X] I agree to follow the Code of Conduct

this is now caught


Update uglify-js to v2.5.0

Fix #1104
There were some issues with Uglify and sourcemaps. They bumped their version of their dependency of  the source-map package, and this fixed the issue.

Thanks