[   INFO] Map Download failed

2016-07-28 20:43:04,980 [   auth_ptc] [   INFO] PTC Login successful
2016-07-28 20:43:05,651 [     search] [   INFO] Login successful
2016-07-28 20:43:07,301 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:07,301 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:07,301 [     search] [   INFO] Loading map failed, waiting 0.49182 seconds
2016-07-28 20:43:07,311 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:07,331 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:07,940 [     search] [   INFO]     8 reqs in 00m02s  [  3.5 reqs/s   3.9KB/s (up)   2.8KB/s (down)] 1.37s av. per request
2016-07-28 20:43:08,930 [     search] [   INFO]    22 reqs in 00m03s  [  6.7 reqs/s   7.1KB/s (up)   5.8KB/s (down)] 0.81s av. per request
2016-07-28 20:43:10,151 [     search] [   INFO]    38 reqs in 00m05s  [  8.4 reqs/s   8.8KB/s (up)   7.4KB/s (down)] 0.71s av. per request
2016-07-28 20:43:11,611 [     search] [   INFO]    55 reqs in 00m06s  [  9.2 reqs/s   9.8KB/s (up)   8.2KB/s (down)] 0.65s av. per request
2016-07-28 20:43:12,782 [     search] [   INFO]    72 reqs in 00m07s  [ 10.1 reqs/s  10.6KB/s (up)   8.9KB/s (down)] 0.61s av. per request
2016-07-28 20:43:14,242 [     search] [   INFO]    93 reqs in 00m09s  [ 10.8 reqs/s  11.0KB/s (up)   9.5KB/s (down)] 0.58s av. per request
2016-07-28 20:43:15,332 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:15,332 [     search] [   INFO] Loading map failed, waiting 0.22140 seconds
2016-07-28 20:43:15,351 [     search] [   INFO] Map Download failed. Trying again.
2016-07-28 20:43:15,641 [     search] [   INFO]   109 reqs in 00m10s  [ 10.9 reqs/s  11.2KB/s (up)   9.6KB/s (down)] 0.58s av. per request
2016-07-28 20:43:16,792 [     search] [   INFO]   129 reqs in 00m11s  [ 11.6 reqs/s  11.7KB/s (up)  10.3KB/s (down)] 0.56s av. per request
2016-07-28 20:43:17,954 [     search] [   INFO]   148 reqs in 00m12s  [ 12.0 reqs/s  12.0KB/s (up)  10.4KB/s (down)] 0.55s av. per request
2016-07-28 20:43:19,375 [     search] [   INFO]   169 reqs in 00m14s  [ 12.3 reqs/s  12.1KB/s (up)  10.8KB/s (down)] 0.53s av. per request
2016-07-28 20:43:20,542 [     search] [   INFO]   188 reqs in 00m15s  [ 12.6 reqs/s  12.4KB/s (up)  11.0KB/s (down)] 0.54s av. per request
2016-07-28 20:43:21,589 [     search] [   INFO]   205 reqs in 00m16s  [ 12.9 reqs/s  12.7KB/s (up)  11.2KB/s (down)] 0.53s av. per request
2016-07-28 20:43:22,842 [     search] [   INFO]   224 reqs in 00m17s  [ 13.0 reqs/s  12.7KB/s (up)  11.4KB/s (down)] 0.52s av. per request

Was also seeing errors exactly like this, this morning when using PTC with -c enabled.

That's just the Niantic servers being overloaded and responding with garbage, that happens occasionally.
You're fine as long as the majority of request goes through.

But try the same account, works on pokemon go map

But it's just random requests that are dropping. We send requests much faster so you're more likely to see errors in the same timespan.
I had the same error in my Logs today for half an hour. That was just the niantic servers being down, the downloaded throttled to one req every two minutes and recovered half an hour later.


Fix select2#5378 ie11 specific focus issue.

This pull request includes a

[ ] Bug fix
[ ] New feature
[ ] Translation

The following changes were made

If this is related to an existing ticket, include a link to it as well.

conflicts resolved


feat(charts/prow): add additional env supports

hook component
external plugins

Signed-off-by: wuhuizuo<EMAIL_ADDRESS>

/approve

/approve


Demo pre-triained file and demo site are not same

Hi, I downloaded your pre-trained model : Demo-Europarl-EN.pcl.
It works but not same as demo web site.
here is my text : scam mail data
http://london.campusanuncios.com/detcommunity972996941X-ZZMonths-old-London.html 11Months old Brenda is seeking for a new<EMAIL_ADDRESS>Brenda and Junior are a survivor, 1year old.growing and thriving against all odds! They are waiting for a forever family.They are intelligent, resourceful, outgoing, and logical.growing strong and healthy under the loving care of me and nannies. They needs an adoptive family who will explain their past to them and help them understand what has happened.As you can see in their pictures, Brenda and Junior are very healthy and well cared for baby. They arrived in a state of advanced malnutrition but is recovering beautifully. They are well attached to their caretakers. Now all they needs is a forever family of their own.Contact us directly my E-mail<EMAIL_ADDRESS>for more information e-mail: 11Months old Brenda is seeking for a new<EMAIL_ADDRESS>LondonClick to expand... Received: from [<IP_ADDRESS>] CAMEROON From: Jesica Brown<EMAIL_ADDRESS>DEAR SIR/MADAM,      Its with great pleasure  and happiness that i write to you this day,I am very sorry for the late reply because i have been very busy.I am  willing to give this baby girl to any loving family...she is   one year old  and will be getting her first birth day next week ending.       I want to believe  that you are able to offer all this to this baby... she is so cute and very playful,please I will also like to know where you are presently located.               As soon as you see the pictures and you think you like the baby girl please just get back to me ,i would have loved her to spend her first birthday with her new supposed  family.                note that this baby shall be coming from Victoria Cameroon , i will like you to know that only the good Lord we serve with his infinite mercy will bless you for taking care of this children.they are a gift from God Almighty.                                        FINANCIALLY. i will like you to know that there is no adoption fee as this baby is free to you ok.you shall only take care of the  charges for the procedure which shall be carried out here in Victoria Cameroon . i will guide you through every step on the way through the maze of paperwork until the day you are officially declared the parent and the child is issued a new Birth Certificate bearing your surname.Children are a gift from God Children are innocent, regardless of the circumstance they are born. They have every right to have loving parents and a stable home. Adoption provides them hope for a happy beginning and a brighter future. Every child, with proper upbringing has the potential to become a better person. Moses was adopted. He became a great leader. You too can change the world by changing someone's life. You can make a difference, one child at a time. You can live and leave a lasting legacy. Now?  THANKS Tel:+(237)94428364Click to expand...
this is Demo-Europarl-EN.pcl with play_with_model.py.
http://london.campusanuncios.com/detcommunity972996941X-ZZMonths-old-London.html 11Months old Brenda is seeking for a new<EMAIL_ADDRESS>Brenda and Junior are a survivor, ,COMMA 1year ,COMMA old.growing and thriving against all odds! They are waiting for a forever .PERIOD family.They are intelligent, resourceful, ,COMMA outgoing, and logical.growing strong and healthy .PERIOD under the loving care of me and nannies. .PERIOD They needs an adoptive family who will explain their past to them and help them understand .PERIOD what has happened.As you can see in their pictures, .PERIOD Brenda and Junior are very healthy and well cared for .PERIOD baby. They arrived in a state of advanced malnutrition ,COMMA but is recovering .PERIOD beautifully. They are well attached to their caretakers. Now .PERIOD all they needs is a forever family of their own.Contact us directly .PERIOD my E-mail<EMAIL_ADDRESS>for more information ,COMMA e-mail: 11Months old Brenda ,COMMA is seeking for a new<EMAIL_ADDRESS>LondonClick to expand... Received: from [<IP_ADDRESS>] CAMEROON From: Jesica Brown ,COMMA<EMAIL_ADDRESS>,COMMA DEAR ,COMMA SIR/MADAM, Its ,COMMA with great pleasure and happiness that i write to you .PERIOD this day,I am very sorry for the late reply ,COMMA because i have been very busy.I ,COMMA am willing to give this baby girl to any loving family...she is one year old and will be getting her first birth day next week .PERIOD ending. Attached to this mail are some pictures of the baby .PERIOD girl.this is such and unfortunate situation for me.,i want you to know that children are a gift from God and they deserve to be happy, .PERIOD This baby is free and shall be going to any family .PERIOD free.there is nothing like adoption .PERIOD fee.all I need is a family to spoil her with much love,care tenderness and lots of affection. .PERIOD most importantly ,COMMA to give her a sound education. .PERIOD I want to believe that you are able to offer all this to this baby... .PERIOD she is so cute and very playful,please .PERIOD I will also like to know where you are presently located. As soon .PERIOD as you see the pictures -DASH and you think you like the baby girl -DASH please just get back to me -DASH ,i -DASH would have loved her to spend her first birthday with her new supposed family. note that this baby shall be coming from Victoria Cameroon , .PERIOD i will like you to know that only the good Lord we serve with his infinite mercy will bless you for taking care of this children.they are a gift from God Almighty. FINANCIALLY. .PERIOD i will like you to know that there is no adoption fee ,COMMA as this baby is free to you .PERIOD ok.you shall only take care of the charges for the procedure which shall be carried out here in Victoria Cameroon . .PERIOD They have every right to have loving parents and a stable ,COMMA home. Adoption provides them hope for a happy beginning and a brighter future. Every child, with proper upbringing ,COMMA has the potential to become a better person. .PERIOD Moses was adopted. ,COMMA He became a great leader. .PERIOD You too ,COMMA can change the world by changing someone's life. You can make a difference, one child at a time. .PERIOD You can live and leave a lasting legacy. Now? Adopt BRENDA now NOTE THAT BRENDA SHALL BE COMING FROM Victoria Cameroon AS I AM PRESENTLY ,COMMA THERE ,COMMA WITH ,COMMA BRENDA.GET ,COMMA BACK ,COMMA TO ,COMMA US ,COMMA WITH ,COMMA YOUR ,COMMA CREDENTIALS ,COMMA OK. ,COMMA THANKS Tel:+(237)94428364Click to expand...
This is Demo-website
Http //london.campusanuncios.com/detcommunity972996941X-ZZMonths-old-London.html 11Months old Brenda is seeking for a new Family, ( jesicabrown82 @ yahoo.com, ), Brenda and Junior are a survivor, 1year, old.growing and thriving against all odds. They are waiting for a forever family.They are intelligent, resourceful outgoing and logical.growing strong and healthy. Under the loving care of me and nannies., They needs an adoptive family who will explain their past to them and help them understand what has happened.As you can see in their pictures. Brenda and Junior are very healthy and well cared for baby.. They arrived in a state of advanced malnutrition, but is recovering beautifully.. They are well attached to their caretakers.. Now all they needs is a forever family of their own.Contact us directly. My E-mail, (, jesicabrown82 @ yahoo.com, ) for more information, e-mail, 11Months, old Brenda is seeking for a new Family, ( jesicabrown82 @ yahoo.com ) LondonClick to expand ... Received from [ <IP_ADDRESS> ], CAMEROON From Jesica Brown, <, jesicabrown82 @ yahoo.com, > DEAR SIR/MADAM, Its with great pleasure And happiness that i write to you this day, I am very sorry for the late reply, because i have been very busy.I - am willing to give this baby girl to any loving family .... She is one year old and will be getting her first birth day next week. Ending. Attached to this mail are some pictures of the baby. Girl.This is such and unfortunate situation for me..  This baby is free and shall be going to any family. Free.There is nothing like adoption. Fee.All, I need is a family to spoil her with much love care, tenderness and lots of affection.. Most importantly, to give her a sound education., I want to believe that you are able to offer all this to this baby .... She is so cute and very playful. Please I will also like to know where you are presently located. As soon as you see the pictures, and you think you like the baby girl, please just get back to me. I would have loved her to spend her first birthday with her new supposed family. note that this baby shall be coming from Victoria Cameroon. I will like you to know that only the good Lord we serve with his infinite mercy will bless you for taking care of this children.they are a gift from God, Almighty. FINANCIALLY.. I will like you to know that there is no adoption fee, as this baby is free to you. Ok.You shall only take care of the charges for the procedure which shall be carried out here in Victoria Cameroon. I will guide you through every step on the way, through the maze of paperwork. Until the day you are officially declared the parent and the child is issued. A new Birth Certificate bearing your surname.Children are a gift from God. Children are innocent, regardless of the circumstance they are born.. They have every right to have loving parents and a stable home. Adoption provides them hope for a happy beginning and a brighter future.. Every child with proper upbringing has the potential to become a better person.. Moses was adopted., He became a great leader.. You too can change the world by changing someone's life.. You can make a difference. One child at a time.. You can live and leave a lasting legacy.  Ok. THANKS Tel +, ( 237 ) 94428364Click to expand ...
Demo site works better than local one.
Can you tell me why??
for example for upper data, there is nothing like adoption fee. part is different.

I would also love to be able to use the current demo's model. I've noticed that the prebuilt model (and play script) don't seem to add final punctuation to the block of text. Is that something special with the current demo?

@jtokoph The demo doesn't always add the final punctuation either.
@zerobugplz The Demo-Europarl-EN.pcl is the same model that's used in the demo (http://bark.phon.ioc.ee/punctuator). The difference is in the preprocessing between the play_with_model.py script and server script. play_with_model.py is a general purpose script and assumes that the input is already pre-processed similarly to the training data.
I added a new demo_play_with_model.py script that uses the same preprocessing as the server and should give identical results with nltk version 2.0.4 (I got different results with nltk 3.2.1).


[CARE-3532] Allow specyfying whether a native name or english name of the language is displayed

This is a change required by a custom theme, but should also be useful for future projects. This change allows us to display either a native language name (current default) or use English naming

Hey @e1himself, I see the tests are failing, also on other open PRs. Could this be related to any SDK updated you did recently?

@oleg-semyonov let me see

https://github.com/prezly/theme-kit-js/pull/489


Inspect HTTP events

Can this be accomplished with Pode?
https://requestbin.com/

Hey @dfinke,
Do you mean can you do something like RequestBin with Pode, where you can send any HTTP request regardless of method/path and inspect the Request?
If so, this should do it:
Add-PodeRoute -Method * -Path '/*' -ScriptBlock {
    param($e)
}

The $e parameter will contain the normal $e.Data, $e.Query, and others depending on what's sent.

could probably also create a middleware for more in depth inspection ?


updated README.md

Solves #1
Added website links in README.md

Solves #1
Added crypto link in README.md


Official release is delayed for so long, how can community help development team?

If it's not confidential, can you give some issues that take time of development team in releasing new official version?
Superset is a good product and many people want to maintain it :)

0.33.0rc1 seems to be the last proposed release candidate.
<EMAIL_ADDRESS>

I'll throw my name into the hat here... I'm on the PMC for Apache Drill, and would be willing to help organize the release process.

0.34.0 is out! It's just not on Pypi yet though


Upgrade to v14, fixed some golangci-lint issues

Marketing-API did not get any changes that affect us in the last two versions, so the upgrade was fairly straight forward.

This looks good


is_dir() and is_file() are not working properly for gs

Hey,
I tried to use the is_dir and is_file functions from both s3 and gs, but discovered that:
from cloudpathlib import AnyPath

p1 = AnyPath("gs://my-bucket/test/test_dir")
p2 = AnyPath("gs://my-bucket/test/test_dir/")

print(p1.is_dir())  # True
print(p2.is_dir())  # False

p1 = AnyPath("s3://my-bucket/test/test_dir")
p2 = AnyPath("s3://my-bucket/test/test_dir/")

print(p1.is_dir())  # True
print(p2.is_dir())  # True

looks like in gs everything is classified as a file unless I strip the last "/".
Any Idea why is this happening?
using cloudpathlib==0.20.0
Thanks in advance

This doesn't repro generically, so it has something to do with the configuration of your bucket/storage and the objects that actually exist in your storage. For example, I see:
In [1]: from cloudpathlib import CloudPath

In [2]: CloudPath('gs://cloudpathlib-test-bucket/performance_tests/').is_dir()
Out[2]: True

In [2]: CloudPath('gs://cloudpathlib-test-bucket/performance_tests').is_dir()
Out[2]: True

Do you have more information about your use case?
A few helpful questions:

Are there actual blob objects that exist and end with a /? If so, do you know how these got created?
Is your bucket configured with a different folder type than the standard Simulated Folders?
Could you provide all of the object metadata for the folders that we say are files?

Thanks for the response! I'm still getting this for some reason, I just created a folder  using the gs ui:

>>> from cloudpathlib import AnyPath
>>> p1 = AnyPath("gs://airis-packages-tests/folder1")
>>> p1.exists()
True
>>> p1.is_dir()
True
>>> p2 = AnyPath("gs://airis-packages-tests/folder1/")
>>> p2.is_dir()
False

For some reason the blob metadata function run only on "folder1/" and on "folder" I got None:
Blob: folder1/
Bucket: airis-packages-tests
Storage class: STANDARD
ID: airis-packages-tests/folder1//1735484279960870
Size: 0 bytes
Updated: 2024-12-29 14:58:00.020000+00:00
Generation:<PHONE_NUMBER>960870
Metageneration: 1
Etag: CKbqlOCezYoDEAE=
Owner: None
Component count: None
Crc32c: AAAAAA==
md5_hash: 1B2M2Y8AsgTpgAmY7PhCfg==
Cache-control: None
Content-type: text/plain
Content-disposition: None
Content-encoding: None
Content-language: None
Metadata: None
Medialink: https://storage.googleapis.com/download/storage/v1/b/airis-packages-tests/o/folder1%2F?generation=1735484279960870&alt=media
Custom Time: None
Temporary hold:  disabled
Event based hold:  disabled
Retention mode: None
Retention retain until time: None

From this looks like the blob object has "/' which I don't know why. Maybe that's the issue?
The bucket itself was created with gcp's default configuration

Quick update: I tried creating a path with gsutil: gsutil cp file1.txt gs://airis-packages-tests/folder8/123.txt and is_dir worked perfectly fine on folder8. Seems like the issue is with creating folders with gs UI, maybe it creates an empty blob or something like that. Is it possible to support that as well? Thanks in advance!


Advanced Alchemy - Rule elements

According to the description, the number of alchemical items that can be produced is 4 + your Intelligence modifier.
Meanwhile, in the rules it is:
<EMAIL_ADDRESS>+ @actor.abilities.int.mod"}
It should be:
{"key":"ActiveEffectLike","mode":"upgrade","path":"system.resources.crafting.infusedReagents.max","predicate":["class:alchemist"],"value":"4 + @actor.abilities.int.mod"}

Duplicate of https://github.com/foundryvtt/pf2e/issues/15647


Change variables, functions and class methods from camelCase to snake_case

Codecov Report

Merging #376 (8fef1ee) into master (d552502) will increase coverage by 0.44%.
The diff coverage is 85.63%.

@@            Coverage Diff             @@
##           master     #376      +/-   ##
==========================================
+ Coverage   78.08%   78.52%   +0.44%
==========================================
  Files          67       68       +1
  Lines        6597     6692      +95
==========================================
+ Hits         5151     5255     +104
+ Misses       1446     1437       -9

Impacted Files
Coverage Δ

simtools/util/validate_data.py
72.59% <0.00%> (ø)

simtools/simtel/simtel_runner_ray_tracing.py
14.28% <10.86%> (ø)

simtools/job_submission/job_manager.py
57.14% <50.00%> (ø)

simtools/ray_tracing.py
32.22% <53.12%> (ø)

simtools/camera_efficiency.py
45.10% <55.00%> (ø)

simtools/simtel/simtel_runner.py
63.82% <55.00%> (ø)

simtools/model/camera.py
39.85% <55.31%> (ø)

simtools/configuration.py
70.73% <56.09%> (-6.13%)
:arrow_down:

simtools/util/validate_schema.py
77.38% <56.25%> (-1.89%)
:arrow_down:

simtools/psf_analysis.py
56.09% <68.75%> (ø)

... and 53 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

This PR is ready for review. I know there are many changes, but they are all trivial so it should be easy to review. Even though it will be tedious and long to review, please try to make sure I did not change anything that was not supposed to be changed (that's more important than if I missed something).
The issues Codacy are reporting are not important, we decided already in the past that we will not fix them. The coverage issue we had when I first pushed the code is now gone.

Hi Orel. Thanks for this huge effort. I am starting reviewing it. I will let you know once I am finished with the first round

Thanks for going through it all!


Support Moveit for real  arm

Enable use moveit to control a real arm
Features

add an interface to publish joint_states and receive the joint command.
implement action server for joint trajectory following
enable moveit to control a real arm

Notes

currently only support Mycobot280. for 320,350,600, we have to update the related launch and yaml files

https://user-images.githubusercontent.com/3666095/146381158-b96b264f-fc43-4e8f-bc57-6bad7333aab0.mp4
Usage
## Terminal1:
$ roslaunch mycobot_communication mycobot_interface.launch
## Terminal2:
$ roslaunch mycobot_280_moveit demo.launch

You can also try from moveit_commander instead of the inveractive_marker in RViz:
## Terminal3:
$ rosrun mycobot_280_moveit moveit_commander_sample.py

Enable moveit for MyCobot Pro 320.
New Usage:
MyCobot 280:
$ roslaunch mycobot_280 startup.launch
$ roslaunch mycobot_280_moveit demo.launch

MyCobot Pro 320:
$ roslaunch mycobot_320 startup.launch
$ roslaunch mycobot_320_moveit demo.launch

This was closed by GitHub automatically, but should probably be merged.

@wangWking @weijian sould someone reveiw this PR?


Fix PR number (legacy-decorators)

legacy-decorators has been moved into the transform-decorators in https://github.com/babel/babel/pull/5290:
the source code has been moved, tests structure has been modified (like in other packages), chai -> assert
/cc @hzoo

I forgot again about skip ci =(

/cc @existentialism

thanks @alxpy!


Do you plan to release a pre-trained model?

Hi @hackiey
Do you plan to release a pre-trained model,
or training/validation loss, or average precision?
Thanks.

Hi, @CltKitakami I'm very sorry for some confusion caused by this repository, actually I use this paper's method to do another project, so I didn't test the performance on the paper's dataset. I just analyze an image with visualization.


Matrix Badges - "guests not allowed"

Are you experiencing an issue with...
shields.io
🐞 Description
The badges for Matrix rooms all show the same error, "guests not allowed".
It started coming up a few weeks ago I would say.
I've noticed it on my repo: https://github.com/cyb3rko/flashdim
But here are some more examples:

https://github.com/matrix-org/matrix-appservice-irc
https://github.com/gotify/server
https://github.com/hedgedoc/hedgedoc

🔗 Link to the badge
https://img.shields.io/matrix/flashdim%3Amatrix.org?logo=matrix&label=Matrix Chat&color=black
💡 Possible Solution
No response

Looking at the examples you've posted, these are all for rooms hosted on matrix.org
It looks like matrix.org has disabled guest access, which was the method we were using to get stats.
This isn't the case for all matrix servers though. For example, these badges (using different matrix servers) work just fine

 https://img.shields.io/matrix/ndcube:openastronomy.org.svg?server_fqdn=openastronomy.modular.im
 https://img.shields.io/matrix/voicenotify:p51.me?server_fqdn=matrix.p51.me
etc

although I am aware that matrix.org is by far the most common choice of server so this upstream change breaks the majority matrix badges.
In general, the method the matrix badges use to get stats is not very good for performance reasons outlined in https://github.com/badges/shields/issues/10138 even where guest access is available. Moving to the solution outlined in that issue would solve this problem and also provide performance benefits. One of the reasons nobody worked on that is because it is a bit fiddly to deal with different matrix servers out there running different versions of the software. I wonder if enough time has passed that we could simplify the implementation by just dropping the old guest access method and say you now must have the summary endpoint to use the badge. That would simplify things a bit.

Thanks Chris,
that makes sense. I wondered if we could use the same method https://matrix.to/#/#flashdim:matrix.org uses to preview the room user number.
Turns out, they use the mentioned summary endpoint as well:
https://matrix-client.matrix.org/_matrix/client/unstable/im.nheko.summary/rooms/%23flashdim%3Amatrix.org/summary?via=matrix.org&_cacheBuster=4447781817273286
https://matrix-client.matrix.org/_matrix/client/unstable/im.nheko.summary/rooms/%23ndcube:openastronomy.org/summary?via=openastronomy.modular.im/&_cacheBuster=4447781817273286
https://matrix-client.matrix.org/_matrix/client/unstable/im.nheko.summary/rooms/%23voicenotify:p51.me/summary?via=matrix.p51.me/&_cacheBuster=4447781817273286

I would say it makes sense to adopt this new method now and drop the guest access for older rooms / homeservers.
What do you think?

But then again I wonder how https://app.element.io/#/room/#flashdim:matrix.org fetches the user number without the summary call

OK. So just having done a bit more reading on it, it looks like:

https://github.com/matrix-org/matrix-spec-proposals/pull/3266 is still not accepted
This feature is off by default in Synapse (which I think seems to be the most common server implementation?). You have to explicitly opt-in to an experimental feature to enable this endpoint.
This proposal is not implemented in some server implementations
I've not done a full census, but having checked a few other servers I could find based on searching for badges in public READMEs, I have not been able to find another server other than matrix.org with the summary endpoint enabled.

Given that, I think it is too soon to drop the existing method and require the summary endpoint. Doing that would probably fix badges for matrix.org users but break it for a lot of other users. Annoyingly, I think we would ideally need to able to use both methods at this stage.

Someone on Matrix mentioned that apparently shields.io got blocked on matrix.org:
https://matrix.to/#/!QQpfJfZvqxbCfeDgCj:matrix.org/$NzO5dGBTC0TjhDMlZgL36KTt4NWIQU2VT8rbbcaZmcg?via=matrix.org&via=envs.net&via=element.io

Furthermore, guest access doesn't seem to be disabled for matrix.org

That's exciting.
Matrix badges are cached downstream for 30 seconds
https://github.com/badges/shields/blob/bf91e268d62d4a07550ecc0e6a1aa80dffe3ae07/services/matrix/matrix.service.js#L84
but we could, of course, increase that.

It should be increased a lot I feel like.
The only thing fetched in the end is the number of users, right?
If so, we could easily say a cache of 1 day would still be enough. I mean the number of users is not a sensitive stat that has to be up-to-date permanently.

Yeah looking back at it, I think the person who originally contributed this probably copied this from the discord badge, which shows the number of users online right now. The matrix badge just shows the number of channel members. There's less need for this to be fresh. We tend not to cache things for as long as a day, but I've submitted a PR bumping it to 4 hours at https://github.com/badges/shields/pull/10778 . That's 480 times longer than we were caching it previously.
Whether or not that gets us unbanned is another issue but caching for longer is something we can do quickly and easily.
Either way, the ability to optionally use the summary endpoint would be an improvement for other reasons.

Sounds good.
Do you think the logic should be adjusted for now to fetch the summary for matrix.org and for every other server the current logic?


Colors

Hi,

when color is changed in Color editor and pressed save, new palete is not save to image. I don't understand if colors are saved as pixel data or is changed only color palette in png file.

AndyGFX

In order to save the colors back to the colors.png you will need to use the export button.

This is a little bit confusing and something I need to address when I clean up the tools next month. The Save button only saves the settings. Hope that clears things up?

Thanks.
I will try it.
AndyGFX.
On Mon, Jul 10, 2017 at 9:50 AM PixelVision8<EMAIL_ADDRESS>wrote:

Closed #44 https://github.com/PixelVision8/GameCreator/issues/44.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/PixelVision8/GameCreator/issues/44#event-1156294821,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAe_MkxKTNsg9pnIKhM_jf4K43vi1Flfks5sMdffgaJpZM4OSMyA
.


(feat): "Remove Github Thread" context menu

As it is sometimes annoying
So now u can delete it

Why should you use regex on the starter message, instead of checking the channel name? It should be unique to any other threads, right?

Why should you use regex on the starter message, instead of checking the channel name? It should be unique to any other threads, right?

yh idk

What happens if the user edits the message?

I suppose a thread arching emits an event, why not delete the thread when it archives?

What happens if the user edits the message?

Matching content won't work...

Not liking how chunky context menus become with all these additions. Maybe consider unifying it into a cleanup or similar idea and base what it does on where it is used?

Not liking how chunky context menus become with all these additions. Maybe consider unifying it into a cleanup or similar idea and base what it does on where it is used?

Maybe connect it with #8 ?

I think this could move to an automated delete/cleanup

Connected with #8


build: update to typescript 3.2

Updates to TypeScript 3.2 and fixes some compilation errors.

@crisbeto could you rebase?

Rebased.

This was merge-safe all along (we don't sync schematics)


HttpRemoteTaskRunner leak memory

In my test environment, there was a total of 3500supervisor(index_kafka,task count:1, replicas:1)，task is pending
The runPendingTasksExec thread pool in HttpRemoteTaskRunner contains 50 million tasks.

Affected Version
0.21.1
Description
Please include as much detailed information about the problem as possible.

Cluster size
master2
query3
historical*21
middlemanager * 16
indexers * 5

Could you provide a bit more context.
How did the cluster arrive at this state?
3500 seems like a lot, what are you expecting to see and why?

I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.

I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.

Could you provide a bit more context.
How did the cluster arrive at this state?
3500 seems like a lot, what are you expecting to see and why?
I'm testing how many datasources and supervisors a druid cluster can run at the same time. Supervisor tasks are KIS, so there are many streams.


License

Can you please add a LICENSE file or otherwise clarify the licensing of this project (even if it's just all rights reserved).
I'm interested in extending/contributing if this project is available under a permissive license.

MIT license added, thanks.

Thanks, perfect


Decoupling, continued

Create the renderer library
Split Assets into Assets and IO

Neither of these libraries have the correct boundaries/APIs. Instead, this is split in the way that was the absolute smallest code change. I'll do another pull request with refactoring to get the boundaries/APIs/responsibilities right later on.

Updated to use Directory.Build.props


dart analysis and compiler dosen't check type when using ?? operator

Dart 2.2.1 (build 2.2.1-dev.1.0 674fd0e060) (flutter 1.3.10)
Linux - ubuntu 18.04 or nexus 5 device android 8.1.0
final anythingNull = null;
String someString = anythingNull ?? 10;

Dart analysis and Compiler don't show any errors.

It turns out that the inferred type of anythingNull is dynamic:
final anythingNull = null;
String someString = anythingNull ?? 10;

void printType<X>(X x) => print(X);

main() {
  printType(anythingNull);
}

So in this situation you get an expression whose type is the least upper bound of dynamic and int, and that's dynamic, and that is assignable to String.
You can use --no-implicit-casts on the command line to require that all casts are shown explicitly (or put it into your 'analysis_options.yaml'). You could also give the type Null explicitly in the declaration of anythingNull (if that matches the actual situation where you encountered this).

List<int> listOfInts = [10,20];
List<int> nullListOfInts = null;
List<String> listOfStrings1 = listOfInts; //Compiler & analysis error
List<String> listOfString2 = listOfInts ?? 10; //No compiler & analysis error
List<String> listOfString3 = nullListOfInts ?? 10; //No compiler & analysis error

It is the actual situation I encounter such a behaviour. It a little bit different because there is List

Should this issue be transferred to the language repo?

We have two issues here:

Should type inference on final v = null; equip v with the type annotation dynamic?
Errors reported here.

I've created dart-lang/language#300 in order to resolve the former.
If such variables will actually have the type dynamic then the other symptoms reported here are just unavoidable consequences, i.e., the whole issue can be closed with "working as intended".
Otherwise (where such variables get some other type than dynamic), the reported symptoms will disappear when the required changes have been made in all tools. That would make this issue blocked on dart-lang/language#300, but I'd suggest that we just close this one anyway, because the implementation of dart-lang/language#300 will surely be associated with new tests where such things are tested anyway.
For bullet two, the reported symptoms are a consequence of an extreme upcast followed by a downcast (LeastUpperBound(List<int>, int) == Object, then implicitly downcast to List<String>). This issue will go away when implicit downcasts are eliminated as part of the non-null-by-default transition (check label nnbd on the language repository).
For earlier reports on the same kind of situation, check out, e.g., https://github.com/dart-lang/sdk/issues/34058#issuecomment-409904758.
With that, I'll close this issue.


Add some more options for Run

Add options to Run() for passing in additional environment variables, overriding the default command, user, and working directory, and a flag for controlling whether or not we attach to the host's network.

 [Buildah] Add "dockah build-dockerfile"

:+1:
@rh-atomic-bot r+ ce200eb


refactor(routes/healthcheck): do not treat route as plugin

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

12 of 12 (100.0%)  changed or added relevant lines in 9 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 99.147%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
429

Relevant Lines:
432

💛  - Coveralls


how to make np array translate to kitti dataset?

hello~
i want to use 3D np array data to mmdetection3d
but i don't know how to make 3D np array to kitti dataset
is there any article can teach me how to do that?
thanks every one

Hi @zoearthmoon ,
Can you state your question clearer and perhaps provide an example?

thank for your reply
for example
i want to use a np array like  3d_array = np.zeros((200, 200, 200))
and label is in the array center
how to make the train data and label data ?
thanks for help~

You should modify the get-data and get-annotation functions here and here.
Note that in the get-data function we only get the path to the point cloud file, so you may also have to modify the point cloud loading pipeline here.
But I suggest you first separate the data and annotation instead of putting them in one numpy array.

hello ~ thank for your reply
actually i whant to use data is medical DICOM images
like human full body 3d data CT scan
and i label a tumor by a 3d box label
but i dont know how to change the 3D data and  3d box label to kitti dataset type.
and how to define the model input shape like (512 ,512, 64) ?
thanks for help again~

I would recommend you to carefully examine the kitti dataset format and convert you data to the format before using them with our codebase, then you need not modify the data loading and preparation functions.
See https://github.com/open-mmlab/mmdetection3d/blob/master/docs/data_preparation.md
It samples ground truth annotations from all annotations based on class name, difficulty, point number in 3d box, etc.

hello ~ @THU17cyz  thank for your reply
i just cant understand the kitti data format
i have use coco dataset before
and coco dataset have complete teaching
like this vid
https://www.youtube.com/watch?v=h6s61a_pqfM
but...
i cant find the  complete teaching for kitti data format...
can you give me some suggest?
thank you~

Unfortunately I don't know such tutorial. Maybe take a look at readme from https://s3.eu-central-1.amazonaws.com/avg-kitti/devkit_object.zip?


Remove deletion suggestion from invalid_iaas_credentials.json

Rewords invalid_iaas_credentials message

LGTM, but need mgmt approval too.

/lgtm
/approve


Update table search index mapping

Summary of Changes
https://github.com/lyft/amundsen/issues/433
Tests
What tests did you add or modify and why? If no tests were added or modified, explain why. Remove this line
Documentation
What documentation did you add or modify and why? Add any relevant links then remove this line
CheckList
Make sure you have checked all steps below to ensure a timely review.

[ ] PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"

In case you are adding a dependency, check if the license complies with the ASF 3rd Party License Policy.

[ ] PR includes a summary of changes.
[ ] PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
[ ] In case of new functionality, my PR adds documentation that describes how to use it.

All the public functions and the classes in the PR contain docstrings that explain what it does

[ ] PR passes make test

cc @jdavidheiser

Codecov Report

Merging #262 into master will decrease coverage by 0.28%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #262      +/-   ##
==========================================
- Coverage   74.45%   74.16%   -0.29%
==========================================
  Files         100      100
  Lines        4188     4188
  Branches      387      368      -19
==========================================
- Hits         3118     3106      -12
- Misses        971      975       +4
- Partials       99      107       +8

Impacted Files
Coverage Δ

databuilder/publisher/elasticsearch_constants.py
100.00% <ø> (ø)

databuilder/loader/file_system_neo4j_csv_loader.py
83.33% <0.00%> (-5.96%)
:arrow_down:

...ilder/transformer/regex_str_replace_transformer.py
91.66% <0.00%> (-4.17%)
:arrow_down:

...abuilder/extractor/snowflake_metadata_extractor.py
93.44% <0.00%> (-1.64%)
:arrow_down:

...tabuilder/extractor/postgres_metadata_extractor.py
93.54% <0.00%> (-1.62%)
:arrow_down:

databuilder/extractor/mssql_metadata_extractor.py
94.02% <0.00%> (-1.50%)
:arrow_down:

databuilder/publisher/neo4j_csv_publisher.py
84.23% <0.00%> (-0.99%)
:arrow_down:

databuilder/task/neo4j_staleness_removal_task.py
83.62% <0.00%> (-0.87%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update edbb208...550bad0. Read the comment docs.

actually I wonder whether autocomplete as search_analyzer is better. @jdavidheiser have you experimented as well?

I have not experimented with using autocomplete analyzers - I was mostly trying to find ways to get fairly simple and easy to predict search behavior.


WIP OSD-11019 update boilerplate to v2.2.0

update boilerplate to version v2.2.0

Codecov Report

Merging #107 (889ddd6) into master (21ecb26) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #107   +/-   ##
=======================================
  Coverage   33.00%   33.00%
=======================================
  Files          14       14
  Lines         512      512
=======================================
  Hits          169      169
  Misses        341      341
  Partials        2        2

@rendhalver - Could you please also add a description to the PR? Details like purpose of this PR and tracking tickets will help to understand context of the change.

@rendhalver - Could you please also add a description to the PR? Details like purpose of this PR and tracking tickets will help to understand context of the change.

Should I have used the make boilerplate-commit command instead of creating this commit manually?

I have tested this in a staging cluster and it looks to be behaving as expected.
I created a new SubjectPermission resource and it created the resources as expected.

/approve

@rendhalver - Could you please also add a description to the PR? Details like purpose of this PR and tracking tickets will help to understand context of the change.

Should I have used the make boilerplate-commit command instead of creating this commit manually?

The commit itself is fine but mentioning the associated Jira ticket in the PR description will cause an automatic link to be added to the Jira ticket to reference this PR which is quite helpful for tracking.
We should add a PR template to this repo which will help prompt those inputs. Would you mind having a look at that @rendhalver ?  Our MUO one is here as an example.

/approve

/wip

/approve

@rendhalver - Could you please also add a description to the PR? Details like purpose of this PR and tracking tickets will help to understand context of the change.

Should I have used the make boilerplate-commit command instead of creating this commit manually?

The commit itself is fine but mentioning the associated Jira ticket in the PR description will cause an automatic link to be added to the Jira ticket to reference this PR which is quite helpful for tracking.
We should add a PR template to this repo which will help prompt those inputs. Would you mind having a look at that @rendhalver ? Our MUO one is here as an example.

/approve

@rendhalver - Could you please also add a description to the PR? Details like purpose of this PR and tracking tickets will help to understand context of the change.

Should I have used the make boilerplate-commit command instead of creating this commit manually?

The commit itself is fine but mentioning the associated Jira ticket in the PR description will cause an automatic link to be added to the Jira ticket to reference this PR which is quite helpful for tracking.

Ahha I had missed that. I updated the description to include that.

We should add a PR template to this repo which will help prompt those inputs. Would you mind having a look at that @rendhalver ? Our MUO one is here as an example.
Sounds good I will open a PR to get that added.

/lgtm


Dmz issue patch

This PR patches the issues we had with the DMZ server serving pages relating to magic links.
Changes:

Only show a web page if it has a tsml file, else return a 404 (I think this makes sense because we do not want to show unverified token links nor should we say ones without tsml as 'unavailable' as this gives a false impression).
Remove currency link support, this was buggy and a feature which is not very useful to begin with (MakerDAO team bailed on it). It also requires paymaster support to prevent front running.

I keep this as WIP until we can agree these changes are correct or suggest a different path. For the first point, it may simply be more elegant to show a page that says the token is available but has no corresponding tsml file (that would be a separate PR however).

[1. ]Only show a web page if it has a tsml file, else return a 404 (I think this makes sense because we do not want to show unverified token links nor should we say ones without tsml as 'unavailable' as this gives a false impression).

For the first point, it may simply be more elegant to show a page that says the token is available but has no corresponding tsml file (that would be a separate PR however).

Unless there are constraints, I think we should support showing the token as available (or not available) even if there is no TSML file (as a separate PR). It's at least useful during development when the TSML file hasn't been deployed on the repo server yet.
How does the rendering for the token card view work on the web page currently? Does it support function-origin based attributes?

[1. ]Only show a web page if it has a tsml file, else return a 404 (I think this makes sense because we do not want to show unverified token links nor should we say ones without tsml as 'unavailable' as this gives a false impression).

For the first point, it may simply be more elegant to show a page that says the token is available but has no corresponding tsml file (that would be a separate PR however).

Unless there are constraints, I think we should support showing the token as available (or not available) even if there is no TSML file (as a separate PR). It's at least useful during development when the TSML file hasn't been deployed on the repo server yet.

@hboon that's what the local environment is for? When you test you simply do so locally with the tsml file and then later deploy to the server.

Unless there are constraints, I think we should support showing the token as available (or not available) even if there is no TSML file (as a separate PR). It's at least useful during development when the TSML file hasn't been deployed on the repo server yet.

@hboon that's what the local environment is for? When you test you simply do so locally with the tsml file and then later deploy to the server.

I was thinking of something like this during development, or a hackathon:

Deploy a contract
Generate MagicLink
Maybe write TokenScript. But haven't deployed to repo server yet. This takes time or is unnecessary. We can send the file directly to A via email/iOS AirDrop.
Send MagicLink to A
5a When A taps the link without the app installed (or on a desktop), the webpage shows an error.
5b AlphaWallet app is installed, A taps the link and imports it properly

It isn't critical, but sounds like an arbitrary omission to not support 5a when 5b is supported. Is there a reason to not support it?

@hboon fair.

The recent patch enables support of ERC875 tokens without a definition. Useful for people doing experiments with tokens.


Added BraveSoftware.BraveBrowser version 1.26.63

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?

[x] Does your manifest conform to the 1.0 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Oops, hold on. I may have messed up the review with the other Brave manifest.

Oops, hold on. I may have messed up the review with the other Brave manifest.

@ItzLevvie No worries, I noticed. I'll sort it out with the correct version.


[Question] How to use horizontal tracking and vertical tracking parameters?

Is there a way to user horizontal tracking and vertical tracking parameters (these values set to true or false) with the SingleAxisTracker ?

I'm sorry, I don't understand your question. Could you elaborate on the system you wish to model?
This appears to be a question about how to use pvlib rather than a request for a feature or reporting a bug. Could you post the question to the pvlib google group?
Cheers,
Cliff


chore(orchestrator): decommission the ProcessInstance.lastUpdate field

The lastUpdate field in the GraphQL schema for ProcessInstance is supposed to be a non-null value. However, for some reason, this value is being returned null and the query fails. Although we are asking for the lastUpdate field in our GraphQL queries, we are not using this value anywhere in the front-end
Addresses:

https://issues.redhat.com/browse/FLPATH-1017

/lgtm cancel

/approve
/lgtm


Fix NullBufferBuilder::new_from_buffer wrong size assertion

Which issue does this PR close?

Closes #5445.
Rationale for this change

Avoid panic with the following code
        let mut builder = Int32Builder::new();
        for i in 0..64 {
            if i % 2 == 0 {
                builder.append_null();
            } else {
                builder.append_value(i as i32);
            }
        }
        let array = builder.finish();
        let _ = array.into_builder().expect("into_builder");

What changes are included in this PR?

Are there any user-facing changes?
no

Could we get a test please, e.g. the PR description

Could we get a test please, e.g. the PR description

Of course, I have already added the test.


Allow to skip authorization checks for some endpoints

Overview
jay_doubleu_ree follows the Secure By Default philosophy, but there should be a way to customize the project to not use authorization if not needed.
One way is to only use the middleware in the routes for the API part of the system.
But there could be a need to disable the check for single route or action. Therefore it would be a nice to have a way of skipping the authorization only in that single place.
Potential solution.
Add a reader effect, disabling the auth verification.

Resolved by: https://github.com/hanamimastery/jay_doubleu_tee/commit/f6f490f6468493cdda501a6ebba0c3ee91738774


Extracting the JSON tag name

Package version eg. v8, v9:
v9
Issue, Question or Enhancement:
Hi there, how can i extract the "json" name of the struct field (provided in the tag) instead of the real struct field name?
When i do the following:
for _, err := range errValidate.(validator.ValidationErrors) {
    fmt.Println("Struct Field: ", err.StructField())
}

i get the real struct field name, not the one i provide in the json:"something" tag
Sorry to bother you with this, i'm stuck with this and don't know how to handle it. I will appreciate any kind of help here.
Code sample, to showcase or reproduce:

Sorry, i found the answer in the closed issue here:
https://github.com/go-playground/validator/issues/258
Thank you!


Remove experimental folder from lerna

This isn't needed right now, and just slows down lerna bootstrap.

Might be good to also add lerna.json to the workflow dependency cache keys so we regenerate node_modules when it changes

Do you think that is necessary, given lerna.json should not change often?


Feature Request: Mindmap

Problem
When I'm writing down my ideas in excalidraw as mindmap, each thought takes me quite a while to write: Write text, add circle around, make an arrow. This breaks my flow and I end up doing it on paper because I constantly loose my track of thoughts.
Solution request
Have a "MindMap" mode, where from every node I can add a next node that is connected via arrow and has a text and a circle.
It would be awesome to have the circle grow (or the text shrink) as I'm writing, so I don't have to interrupt the flow to adjust the size.
This would be a very valuable feature in my flow as I come constantly accross situations where I want to write down a bunch of thoughts in something like a MindMap.
The same functionality would also allow to do create flow-diagrams much easier. This would maybe require to change forms (e.g. a circle to a rectangle)

We are supporting attached icons now, but the rest of the features seems a bit out of the scope for Excalidraw..

Maybe this could be realized through the coming plugin API.
The behaviour of coggle could serve as an inspiration, especially its keyboard shortcuts.


Request: Support aliases in argcompletion

Hi,

For my-awesome-script, we currently don't do any work to make this work with aliases. If you need this, I'd suggest opening a new issue to request the feature.

There it is! :-)
I currently have a script at /path/to/file which takes two positional arguments arg1 + arg2.
The script is usually called via alias a=python3 /path/to/file arg1 and arg2 should be completable. It works fine when I type it out, but it would be really nice if I could use argcomplete with my alias.
Thanks!

From my limited reading it seems this is a general problem with completion and not something we should deal with inside argcomplete. Here a few of the pages I've looked at:

https://stackoverflow.com/questions/342969/how-do-i-get-bash-completion-to-work-with-aliases
https://unix.stackexchange.com/questions/4219/how-do-i-get-bash-completion-for-command-aliases
https://ubuntuforums.org/showthread.php?t=733397

The suggestions for arg2 are computed inside of /path/to/file though and I don't know how to do that in bash (getting suggestions from a single file).
It would be a lot easier if this could be done in argcomplete. Is there any chance this could be implemented? I'm sure lots of users would benefit from this feature if it existed.

Looking at this a bit more closely, we would at least have to replace the alias in COMP_LINE for any generic solution to work, including in global completion where the above links don't apply. I don't have any time to work on this, but I'd be happy to help where I can if you want to work on a solution (provided @kislyuk is interested in merging this feature in some form).

I'm afraid I don't know how to approach this.
I managed to circumvent this issue by defining

a function in .bashrc which calls /path/to/file and
a wrapper in /etc/bash_completion.d/ inspired by "A Basic Example" from https://debian-administration.org/article/317/An_introduction_to_bash_completion_part_2

However, this does not work with aliases. The function defined in .bashrc acts speeds things up though.

I'm not sure if we want to accommodate aliases. In case we do, here is how the git bashcomp shellcode does it:
__git_complete ()
{
    local wrapper="__git_wrap${2}";
    eval "$wrapper () { __git_func_wrap $2 ; }";
    complete -o bashdefault -o default -o nospace -F $wrapper $1 2> /dev/null || complete -o default -o nospace -F $wrapper $1
}
__git_func_wrap ()
{
    local cur words cword prev;
    _get_comp_words_by_ref -n =: cur words cword prev;
    $1
}


libcoap_430: Update code for use with libcoap 4.3.0 (IDFGH-5355)

Add in multicast support for coap_server/coap_client.
Update libcoap logging to use esp-idf logging

Thanks for your contribution.

Hi @mrdeep1, Thank you for the PR, I have tested it and works fine. I have raised an internal MR for this and in the process of review and merge.
I just had one doubt.
When we run the coap_client example with coap_server on other esp32. It gives error E (8682) CoAP_client: select timeout after receiving the Hello World Message from the server.
Previously, it did not print the Error message.
Is this the expected behaviour ?, can we do something to avoid the error message, as having error message, in example would be confusing for the user !

@AdityaHPatwardhan Sure - will look into why we are now getting this message and make it 'a bit less painful'.  I see that
coaps://californium.eclipse.org has been replaced by coaps://californium.eclipseprojects.io recently and will update that as well.

@AdityaHPatwardhan I found the issue E (8682) CoAP_client: select timeout and fixed it, and re-organized some code in the example to make it more readable.  I have also updated the example code to refer to coaps://californium.eclipseprojects.io.

@mrdeep1 , Thank you for fixing it, I will let you know once it is merged internally, Then it may take a couple of days to be available publicly.

@AdityaHPatwardhan I have just updated the certificates so that the client can do PKI against coaps://californium.eclipseprojects.io

Just bumped libcoap library to be released 4.3.0 rather than 4.3.0rc3 - minor docs change and unused compiler disable option fix.

@mrdeep1 sorry for the late reply, actually these new changes increase the heap usage by around 10KB so this PR was stuck in the review stage. I will investigate it this week that the increased heap was due to libcoap itself or because of removing certain menuconfig options from port/coap_mbedtls.c  when this PR moves it to src/port_mbedtls.c If it is such case then I am afraid we might have to fall back to some similar structure to port/coap_mbedtls.c for decreasing heap usage.
I understand this PR also fixes the issue https://github.com/espressif/esp-idf/issues/7219 so If that's okay with you, I was going take only that part of the commit in your name and open a different MR to fix that issue first and then move to this MR .
Sorry for the delay

@AdityaHPatwardhan Sure, replacing coaps://californium.eclipse.org with coaps://californium.eclipseprojects.io in coap_client example in various places is a good fix for #7219.  If you are going to update the PKI keys (which work for coaps://californium.eclipseprojects.io) , then you will need to update coap_server's certs as well.
There has been some minor enhancements to coap_mbedtls.c, but I tried to keep the conditional compliations in step, but are now using the Mbed TLS conditional names to make it more generic for other libcoap users - e.g., CONFIG_MBEDTLS_SSL_PROTO_DTLS -> MBEDTLS_SSL_PROTO_DTLS which esp-idf does under the hood anyway.  It is possible that something may have been missed here, but unlikely (there has been overall a ~900 increase).
What is more likely is the change in libcoap for supporting block-wise transfers (RFC7959) has been moved from being handled by the application down into libcoap so making transparent large data handling a lot easier.  There have been a couple of other updates which will cause code increases such as more rigorous packet checking, proxy support, cache keys and async support.
Some testing shows (building coap_server with no configuration changes)
Previous libcoap

            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        236  12315       0      0        0      41848    13521   67920

Without Mbed TLS
            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        228   9007       0      0        0      35823    11925   56983

coap_log() disabled
            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        232   9871       0      0        0      35451     5784   51338

New libcoap

            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        244  12590       0      0        0      63766    17443   94043

Without TCP Enabled
            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        244  12590       0      0        0      58739    15869   87442

Without Mbed TLS
            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        244  10978       0      0        0      55952    15011   82185

coap_log() disabled
            Archive File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total
               libcoap.a        244  10146       0      0        0      55161     7021   72572

So the Mbed TLS support has grown from 10937 to 11858.  No-oping coap_log() unsurprisingly gets rid of a lot the usage. differences.

Further libcoap file usage research shows (need to think about space reduction possibilities)
             Object File DRAM .data & .bss & other   IRAM   D/IRAM Flash code & rodata   Total

             address.c.o          0      0       0      0        0        259       62     321 Old
             address.c.o          0      0       0      0        0        288       87     375 New

               async.c.o          0      0       0      0        0        593      216     809 New

               block.c.o          0      0       0      0        0       1253      301    1554 Old
               block.c.o          0      8       0      0        0       9380     1594   10982 New

          coap_cache.c.o          0      0       0      0        0        577      131     708 New

          coap_debug.c.o         16   5243       0      0        0       2921     2164   10344 Old
          coap_debug.c.o          8   5254       0      0        0       3251     2370   10883 New

        coap_hashkey.c.o          0      0       0      0        0         76        0      76 Old
        coap_hashkey.c.o          0      0       0      0        0          0        0       0 New

             coap_io.c.o          4    280       0      0        0       5745     1933    7962 Old
             coap_io.c.o          0    280       0      0        0       4793      767    5840 New

        coap_mbedtls.c.o          8   3308       0      0        0       5766     1604   10686 Old
        coap_mbedtls.c.o          0   1612       0      0        0       7267     2351   11230 New

           coap_prng.c.o          4      0       0      0        0         82        0      86 New

        coap_session.c.o          0    384       0      0        0       4264     1381    6029 Old
        coap_session.c.o          0    260       0      0        0       7936     1652    9848 New

            coap_tcp.c.o          0      0       0      0        0       1432     1114    2546 New

           coap_time.c.o          0      8       0      0        0        212        0     220 Old
           coap_time.c.o          0      8       0      0        0        277        0     285 New

              encode.c.o          0      0       0      0        0        177       74     251 Old
              encode.c.o          0      0       0      0        0        337       96     433 New

                 mem.c.o          0      0       0      0        0        139      136     275 Old
                 mem.c.o          0      0       0      0        0        139      136     275 New

                 net.c.o          8   3092       0      0        0       9144     2398   14642 Old
                 net.c.o          0   3092       0      0        0      10752     2799   16643 New

              option.c.o          0      0       0      0        0       1975      571    2546 Old
              option.c.o          0      0       0      0        0       2018      571    2589 New

                 pdu.c.o        192      0       0      0        0       2945     1997    5134 Old
                 pdu.c.o        224   2056       0      0        0       6329     2479   11088 New

            resource.c.o          8      0       0      0        0       5279      910    6197 Old
            resource.c.o          8      0       0      0        0       5619     1002    6629 New

                 str.c.o          0      0       0      0        0        124       25     149 Old
                 str.c.o          0     20       0      0        0        295      101     416 New

           subscribe.c.o          0      0       0      0        0         48       67     115 Old
           subscribe.c.o          0      0       0      0        0         48       67     115 New

                 uri.c.o          0      0       0      0        0       1638       34    1672 Old
                 uri.c.o          0      0       0      0        0       2448       46    2494 New

Merged with https://github.com/espressif/esp-idf/commit/ed3d44042878b15779ce586fbb78ffe560fa2399. Thanks for your contribution @mrdeep1


separates poll results for checkboxes

Fixes #360

Polls multiselect fields like checkboxes results will be calculated based on each individual choice
Added missing check for poll submission so results are only calculated after poll submission

👍🏼


A pair of 2+ closed.

Source name
A Pair Of 2
Source language
English
Source link
po2scans.com
Other details
Their website has been dead for a while and they mentioned recently in their discord (pinned) it's officially closed and they're moving  their stuff to mangadex.
Acknowledgements

[X] I have updated all installed extensions.
[X] I have opened WebView and checked that the source website is down.
[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a meaningful title with the source name.
[X] I will fill out all of the requested information in this form.

Proof👆


Release 0.14.12

Major changes:

endpoints crate

Support ControlNet

Extend ImageCreateRequest with the control_image field
Extend ImageCreateRequestBuilder with the with_control_image method
Extend ImageEditRequest with the control_image field
Extend ImageEditRequestBuilder with the with_control_image method

Extend TranscriptionRequest with new fields: detect_language, offset_time, duration, max_context, max_len and split_on_word
Extend TranslationRequest with new fields: detect_language, offset_time, duration, max_context, max_len and split_on_word
Extend ImageCreateRequest with new fields: strength, scheduler, apply_canny_preprocessor, and style_ratio
Extend ImageEditRequest with new fields: scheduler, apply_canny_preprocessor, and style_ratio
(NEW) Introduce  the sd_webui module to support stable-diffusion-webui with reference-only control

llama-core crate

(BREAKING) Rename init_core_context API to init_ggml_context
(BREAKING) Rename init_rag_core_context API to init_ggml_rag_context
(BREAKING) Rename SDContextType type to StableDiffusionTask
(BREAKING) Improve init_sd_context_with_full_model and init_sd_context_with_standalone_model APIs with new arguments
(BREAKING) Improve WhisperMetadata and WhisperMetadataBuilder

Rename offset_t field to offset_time
Introduce detect_language field
Update types of the fields: processors, offset_time, duration, and max_len

(BREAKING) Improve WhisperMetadataBuilder

Rename with_offset_t to with_offset_time
Introduce the detect_language method
Update the methods: with_processors, with_offset_time, with_duration, and with_max_len

Support ControlNet in image_generation API
Update audio_transcriptions and audio_translations APIs to support new request params

Hello, I am a code review agent on flows.network.
It could take a few minutes for me to analyze this PR. Relax, grab a cup of coffee and check back later. Thanks!


Add scan logging at the end of e2e runs

Let's print out the actual scans that are about to be orphaned at the
end of the e2e run.
This should help use find out if there is a specific set of tests not
cleaning up resources, or if it's random.

This should be accompanied with some form of cleanup to actually fix the issue.
Proposing this early to see what information we can get from CI to aid in debugging.

This should be accompanied with some form of cleanup to actually fix the issue.
Proposing this early to see what information we can get from CI to aid in debugging.

/retest e2e-aws

/test e2e-aws

First CI run didn't cleanup some resources:
time="2023-03-06T20:33:07Z" level=warning msg="12 scans not cleaned up"
time="2023-03-06T20:33:07Z" level=warning msg="scan hide-rules-test still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan kubelet-default-test-suite still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan manual-rules-test-node-master still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan manual-rules-test-node-worker still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan ocp4-cis still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan rhcos4-e8-master still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan rhcos4-e8-worker still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan test-scan-produces-remediations still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan test-scan-produces-remediations-master still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan test-scan-produces-remediations-worker still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan test-scan-setting-binding-watches-tailored-profile still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="scan test-scheduled-suite-priority-class-workers-scan still exists in namespace osdk-e2e-e81b3154-1efe-4ad2-8ea2-503447a32f2c"
time="2023-03-06T20:33:07Z" level=warning msg="timed out waiting for scans to cleanup: timed out waiting for the condition"

Rerunning the e2e tests to see if the second run provides different results.

Results from the second run:
time="2023-03-06T22:46:08Z" level=warning msg="4 scans not cleaned up"
time="2023-03-06T22:46:08Z" level=warning msg="scan ocp4-cis still exists in namespace osdk-e2e-dd78cb93-14dc-4408-ae3a-9a5d7078c9f5"
time="2023-03-06T22:46:08Z" level=warning msg="scan test-scan-produces-remediations still exists in namespace osdk-e2e-dd78cb93-14dc-4408-ae3a-9a5d7078c9f5"
time="2023-03-06T22:46:08Z" level=warning msg="scan test-scan-produces-remediations-master still exists in namespace osdk-e2e-dd78cb93-14dc-4408-ae3a-9a5d7078c9f5"
time="2023-03-06T22:46:08Z" level=warning msg="scan test-scan-produces-remediations-worker still exists in namespace osdk-e2e-dd78cb93-14dc-4408-ae3a-9a5d7078c9f5"
time="2023-03-06T22:46:08Z" level=warning msg="timed out waiting for scans to cleanup: timed out waiting for the condition"

/test e2e-aws

/test e2e-aws

Results from 3rd run:
time="2023-03-07T21:43:44Z" level=warning msg="3 scans not cleaned up"
time="2023-03-07T21:43:44Z" level=warning msg="scan test-scheduled-suite-invalid-priority-class-workers-scan still exists in namespace osdk-e2e-10ae2b87-66a9-4af3-9b5e-ca465fe05a73"
time="2023-03-07T21:43:44Z" level=warning msg="scan test-scheduled-suite-timeout-fail-workers-scan still exists in namespace osdk-e2e-10ae2b87-66a9-4af3-9b5e-ca465fe05a73"
time="2023-03-07T21:43:44Z" level=warning msg="scan test-scheduled-suite-update-workers-scan still exists in namespace osdk-e2e-10ae2b87-66a9-4af3-9b5e-ca465fe05a73"

/retest
Doing a retest to see the results of parallel and serial tests now that they're separated into different suites.

Added some additional cleanup to take care of the left over scans. Ideally, we should find a way to clean this up in the tests.
Based on what I've been able to debug so far, my hypothesis is that the scans are in the process of getting cleaned up when the CRDs are deleted.
I'd like to test that by rechecking the tests on this patch a few times and seeing if cleaning them up before the cleanup functions run will address the issue.

/test e2e-aws-serial
Failed due to connection issues. Retesting to see if it's reproducible:
2023/03/17 02:41:27 failed to delete &{map[apiVersion:rbac.authorization.k8s.io/v1 kind:ClusterRole metadata:map[name:scansettingbinding-editor-role namespace:osdk-e2e-3cd1ccdf-06d3-4324-99fc-5423fad6ba4d] rules:[map[apiGroups:[compliance.openshift.io] resources:[scansettingbindings] verbs:[create delete get list patch update watch]] map[apiGroups:[compliance.openshift.io] resources:[scansettingbindings/status] verbs:[get]]]]}: Delete "https://api.ci-op-6n4ttw2q-f837a.origin-ci-int-aws.dev.rhcloud.com:6443/apis/rbac.authorization.k8s.io/v1/clusterroles/scansettingbinding-editor-role": read tcp <IP_ADDRESS>:35876-><IP_ADDRESS>:6443: read: connection reset by peer
FAIL	github.com/ComplianceAsCode/compliance-operator/tests/e2e	2281.178s

The serial failure could be transient since the parallel suite cleaned up that role:
2023/03/17 02:24:19 deleting ClusterRole remediation-aggregator
2023/03/17 02:24:19 deleting ClusterRole scansettingbinding-editor-role
2023/03/17 02:24:19 deleting ClusterRole scansettingbinding-viewer-role
2023/03/17 02:24:19 deleting ClusterRole tailoredprofile-editor-role
2023/03/17 02:24:19 deleting ClusterRole tailoredprofile-viewer-role

@jhrozek @Vincent056 should be ready for some reviews.

All the e2e passed!

/lgtm, Thanks for fixing up the e2e

Yep - thanks for the help unwinding it.
I'll have some more patches that make test setup consistent with tearDown (done in the same layer).

adding no-FF labels


MOL-790: ApplePay Domain file download with custom Filesystem Adapter

attention, still not quite sure if this is the way to go, this is a POC PR


Training Steps Erroneous

I'm trying to train resnet50 model with FGVC8 dataset which has 18632 images totally. While performing training using this lightning module, The max steps for an epoch becomes 292 and the batch size is 64 which when multiplied gives 18688. I didn't set any max_steps explicitly. I used StratifiedKFold to split the dataset into training and validation set. The number of splits is 5.
While splitting the dataset becomes 14905 for training and 3727 for validation. I'm passing this pytorch dataset into dataloader with batch size 64 and num_workers 4
After splitting, The steps for training must be 14905/64 which is around 232. But the network trains for 292 steps. Why is this happening. Is the network being trained on the whole dataset. I even didn't perform any augmentations.
Link to my Source code: Resnet50 Training FGVC8
Dataset:
def train_augs():
    return Compose([
        Resize(256,256),
        Normalize(),
        ToTensorV2()
    ])
def val_augs():
    return Compose([
        Resize(256,256),
        Normalize(),
        ToTensorV2()
    ])

class FGVC(Dataset):
    def __init__(self,df,root_dir,transforms=None):
        self.root_dir = root_dir
        self.transforms = transforms
        self.dataf = df
    def __len__(self):
        return len(self.dataf)
    def __getitem__(self,idx):
        img_name = self.dataf.loc[idx,'image']
        img = cv2.imread(os.path.join(self.root_dir,img_name))
        #print(img_name)
        label = self.dataf.loc[idx,'lbc']
        if self.transforms is not None:
            img = self.transforms(image=img)['image']
        return img,torch.tensor(label)

Training Loop:
for fold,(train_ind,val_ind) in enumerate(StratifiedKFold(n_splits=5).split(train_data.image.values,train_data.labels.values)):

    print(f"***** Training Fold {fold}/5 *****")

    train_data1 = train_data.loc[train_ind].reset_index(drop=True)
    val_data1 = train_data.loc[val_ind].reset_index(drop=True)

    train_dataset = FGVC(df=train_data1,transforms=train_augs(),root_dir="train_images")
    val_dataset = FGVC(df=val_data1,transforms=val_augs(),root_dir="train_images")

    train_loader = DataLoader(train_dataset,batch_size=64,num_workers=4,shuffle=True)
    val_loader = DataLoader(val_dataset,batch_size=64,num_workers=4)

    print(len(train_loader.dataset),len(val_loader.dataset))

    trainer.fit(model,train_dataloader=train_loader,val_dataloaders=val_loader)

My Lightning Module:
class FGVCNet (pl.LightningModule):
    def __init__(self):
        super(FGVCNet,self).__init__()
        self.model = resnet50(pretrained=True)
        num_ftrs = self.model.fc.in_features
        self.model.fc = nn.Linear(num_ftrs,train_data.labels.nunique())

    def forward(self,x):
        return self.model(x)

    def configure_optimizers(self):
        opt = torch.optim.Adam(self.parameters(),lr=0.01)
        scheduler = {
            'scheduler':optim.lr_scheduler.ReduceLROnPlateau(
                optimizer=opt,
                mode='min',
                factor=0.5,
                patience=2,
                verbose=True
            ),
            'monitor':'val_loss',
            'interval':'epoch',
            'frequency':1,
            'strict':True
        }

        self.opt = opt
        self.scheduler = scheduler

        return [opt],[scheduler]

    def training_step(self,batch,batch_idx):
        X,y = batch
        y_hat = self.model(X)
        loss_tr = F.cross_entropy(y_hat,y,weight=weights)
        f1_tr = pl.metrics.functional.f1(y_hat,y,12)
        self.log("TrainLoss",loss_tr,prog_bar=True,on_step=True,on_epoch=True)
        self.log("TrainF1",f1_tr,prog_bar=True,on_epoch=True,on_step=True)
        return loss_tr

    def validation_step(self,batch,batch_idx):
        X,y = batch
        y_hat = self.model(X)
        loss_val = F.cross_entropy(y_hat,y,weight=weights)
        f1_val = pl.metrics.functional.f1(y_hat,y,12)
        self.log("val_loss",loss_val,prog_bar=True,on_step=True)
        self.log("val_f1",f1_val,prog_bar=True,on_epoch=True)
        return loss_val

Where did you get these numbers from, the progress bar?
What is the size of your validation set? is it 60?
train + val = 232 + 60 == 292, which is what the progress bar would show

Where did you get these numbers from, the progress bar?
What is the size of your validation set? is it 60?
train + val = 232 + 60 == 292, which is what the progress bar would show

These were the numbers that I got as training steps in my progress bar. The size of validation set is 3727 and size of training set is 14905. As always, if the batch size is 64 and total training samples are 14905, The steps must be 232 right?

Yes, that explains it:
ceil(14905 / 64) = 233  (not 232 as you stated, it is not evenly divisible)
ceil(3727 / 64) = 59
59 + 233 = 292
So for one epoch of training + validation we get 292 batches for 100% completion of the progress bar. Correct?
If you want to turn off validation and only get the 233 training batches per epoch, set limit_val_batches=False.


Update fxsConfigHelper.ts

Fixed conditional that checks if the interface to bind for the FXServer is the same as for txAdmin, which is only mandatory in the case of Zap Hosting because environment requirements. In other scenarios it may make sense that txAdmin binds to a different interface than FXServer does.

This config is not exclusive for zap hosting.


Intro documentation

Intro documentation for APIs:

Device Location
Device Status

Changed also the architecture picture.

🚀  Check and resolve conversations to be able to merge (select Squash & merge) and let me know so adjust a couple of things then 👏🏼


Build out Python API to CalibrationSet

As it stands, the Python bindings don't support most of the CalibrationSet API. It should expose bindings to them.

Closed by #156


229 add txn with status

What this PR do

Allow creation of done txn via addTxn status/Done
refactor Transaction class with status parameter directly

closes #229

As discussed, I have added future consideration issue #294


"Process markdown files" hangs[BUG]

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

doctor publish --outputFolder .
login to Microsoft Device Login using code provided
"Process markdown files" hangs for 30 min
There is no output in the output folder

Expected behavior

Process markdown files work.
There are output in output folder

Screenshots

Desktop (please complete the following information):

OS: Windows
Version: 10

Additional context
Add any other context about the problem here.

@estruyf Could you please look into the bug? Thanks.

can confirm i'm having the same issue.
Reproduced from a docker container - node:lts

@yuxin1234 @DennisRutherford could you try to run doctor publish --debug to see if it gives more information on why it hangs?

I just released version 1.12.0, which now supports Node.js version 18 and higher. If you could update to the latest version and test it again, that would be great.

Can confirm that latest version is now working to publish

Thanks @DennisRutherford for verifying

@estruyf  Happy to help.
I've got another issue where this is happening again.
If I try and use certificate based authentication it gets stuck; but if I use device code it works fine. Any ideas?

@estruyf Thanks for fixing it. Still hanging for me after I upgraded to 1.12.0.

@yuxin1234  What do you get when you add the --debug flag?
Can you give more information about your environment? Node version, ...

@estruyf Below is the screenshot for running "doctor publish --debug":

Node: 18.0.0
Platform: Windows 10
Thanks.

Ah, I see you are not using SharePoint Online, but your own server. That might be the issue. As I have no access to an on-prem server, I won't be able to test out that use-case.

@estruyf Thanks.


Question about the position of the object center with respect to the global frame

          Thanks for your question. The point cloud obtained from the sensor should be transformed to the global frame (where Z+ is the normal vector of the horizontal plane, e.g., the tabletop or the ground) since the output from our pre-trained network is constrained to a predefined view space in the global frame.

Originally posted by @psc0628 in https://github.com/psc0628/SCVP-Simulation/issues/2#issuecomment-2178432102
Taking into account that the pointcloud should be transformed to the global frame. Does it matter where the object center (which is the same as the hemisphere center) is with respect to global frame?

The object needs to be centered in the input grid.  A real-world experiment can be handled in this way: first, filter out the point cloud of the object in the global coordinate system, then calculate the center and the bounding box. Input the grid into the network consisting of each occupancy value of the points within the bounding box in XYZ order (as the network takes 323232*1 occupancy values as input).


Iterative search can not search more than 2 iterations

Expected Behavior
Search should be able to search N iterations
Current Behavior
Search can currently just search 2 iterations

Fixed the issue and changed the regression test from 2 iterations to 3 (https://bitbucket.org/martin_steinegger/mmseqs-benchmark/commits/7d99a2e8a4f6f7ba7d61a17a176535b01b0df490)


Failed to start after installation finished

Current Behavior
node:internal/modules/cjs/loader:1147
throw err;
^
Error: Cannot find module './config'
Require stack:

<EMAIL_ADDRESS><EMAIL_ADDRESS>at Module._resolveFilename (node:internal/modules/cjs/loader:1144:15)
at Module._load (node:internal/modules/cjs/loader:985:27)
at Module.require (node:internal/modules/cjs/loader:1235:19)
at require (node:internal/modules/helpers:176:18)
at Object. (D:\flowforge.bak\app\node_modules@flowfuse\flowfuse\forge\forge.js:11:16)
at Module._compile (node:internal/modules/cjs/loader:1376:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1435:10)
at Module.load (node:internal/modules/cjs/loader:1207:32)
at Module._load (node:internal/modules/cjs/loader:1023:12)
at Module.require (node:internal/modules/cjs/loader:1235:19) {
code: 'MODULE_NOT_FOUND',
requireStack: [
<EMAIL_ADDRESS><EMAIL_ADDRESS>]
}

Node.js v20.11.0
Expected Behavior
No response
Steps To Reproduce
OS: Windows 10
extract flowforge installer to d:
then rename to d:\flowforge
change to directory d:\flowforge
type bin\flowfuse to start
Environment

FlowFuse version: 2.6
Node.js version: 20.11.0
npm version: 10.8.1
Platform/OS: Windows 10
Browser: N/A

Linked Customers

Customer name and/or link to HubSpot contact

Steps To Reproduce
OS: Windows 10 extract flowforge installer to d: then rename to d:\flowforge change to directory d:\flowforge type bin\flowfuse to start

Hi @barrypoon, just checking, in the docs  it says to run install.bat but your "Steps to Reproduce" does not mention this.
Can you confirm that please?

I know what the problem is, need to do a 2.6.1 release

@barrypoon this was a broken package, if you change to app directory and run the following:
npm install<EMAIL_ADDRESS>
It should fix the problem

@barrypoon this was a broken package, if you change to app directory and run the following:
npm install<EMAIL_ADDRESS>
It should fix the problem

Got it. Thank you very much!


Altering column type should include explicit cast

The column type-altering method should supply USING colname::newtype  so that some common scenarios with narrowing the type can possibly work.  E.g. going from a text to an int8 column, with the desire to interpret the text as integers (assuming all values are appropriate integer serializations).

a fix for this is pushed to master

a fix for this is pushed to master


[Research] ig memory usage investigation

Simple measurement using htop
ig seems to have RAM usage of around 100-120 MB. To measure this correctly in our experiments lets add the following loop to our program in a separate go routine.
go func() {
  for {
    runtime.GC()
    debug.FreeOSMemory()
    time.Sleep(1 * time.Second)
  }
}()

This manually runs the garbage collector and asks it to release its free memory back to the system.
Let's now run a gadget and look at the memory consumption:
$ ig run trace_dns

In htop I get a RES size of 111M and a SHR of 52M
Using pprof
To dig deeper we can use pprof which is a golang profiler.
While building it is also advisable to use CGO_ENABLED=0
import (
  _ "net/http/pprof"
  ...
)

func main() {
  go func() {
    http.ListenAndServe("localhost:6060", nil)
  }
  ...
}

Now if we run ig run trace_dns we can connect to the pprof server in another terminal:
$ go tool pprof -http=:8081 http://localhost:6060/debug/pprof/heap

A browser will start up and shows us the heap usage at that timestamp. So wait some seconds until the ig process fully started. We want to capture the memory usage while the gadget is running.
When switching to View->Flamegraph we can see which parts of our code allocated the most memory:

So pprof shows a total golang memory usage of 50M. Of that 50M our FanotifyEbpf notifier uses 46M. Almost all of that is in the BTF Spec.
But from our statistics from htop, /proc/<PID>/smaps and are reporting a usage of more than 100M. So where is the rest of the usage that is not reported by pprof
The missing memory not discovered by pprof
I am using the smem tool which gives easy access to USS and RSS.
USS is the unique memory size that a process has. So if no other program is using the shared part it will equal to the RSS.
Running only a single instance of ig run trace_dns gives me the following output:
$ sudo smem -r -k -P "./ig"
    PID User     Command                         Swap      USS      PSS      RSS
1989621 root     ./ig run trace_dns                 0   111.7M   111.7M   111.7M

So with a single process nothing is shared. This means the memory we are able to share is not common enough that it might be shared with other processes that I have running on my dev machine.
Let's test with a second parallel instance of ig run trace_dns. After starting the second instance I get the following output:
$ sudo smem -r -k -P "./ig"
    PID User     Command                         Swap      USS      PSS      RSS
1989621 root     ./ig run trace_dns                 0    63.4M    87.6M   111.9M
2041115 root     ./ig run trace_dns                 0    60.1M    84.3M   108.6M

This is promising. The unique memory pages are now down to around 60MB. That is not far off of our 50MB that we see in pprof. So at least it is shareable with other ig instances. And we should keep in mind that RSS here doesn't show us the real memory consumption. The PSS (USS + some percentage of SHR) is a better approximation.
Shared memory
Is it that bad? The RSS value can confuse a lot of people (me too) that the actual memory usage is around 110MB for EACH of the ig processes. In reality its around 50-60MB per process and once 60MB for all shared memory.
But where does it come from? I don't know. So I ran further experiments to see if I get the cause by luck.
My first test was just to see how much shared memory ig needs to just start up and enter main.
I added the following code to main():
for {
  time.Sleep(10 * time.Second)
  a := fmt.Sprintf("Hello")
  if a == "asd" {
    break
  }
}

The condition will never be true, but I think the optimizer doesn't know that. Wanted to make sure that the rest of the codebase is compiled the same way.
Now lets look at the SHR memory usage (I used htop again): 39MB. Almost 40MB and we just entered our main() function. So is this all loaded into memory in some init() function of our dependencies?
init() functions are called in order and by dependency. So after resolving and "ordering" all dependencies the first init() function will be called from top to bottom. We could also interrupt this chain by writing our own init() function and create an endless loop in there. So in theory we can pinpoint which dependency allocates that much memory (At least I think this is the way it could have worked out).
The first init() I wrote directly in cmd/ig/main.go right before the main():
func init() {
  for {
    time.Sleep(10 * time.Second)
    a := fmt.Sprintf("Hello")
    if a == "asd" {
      break
    }
  }
}

func main() {
  ...
}

This kept the SHR usage at 39MB. Good - we expected that the usage should be the same right before main() and right after main().
Now I moved that init() into a newly created package pkg/zzz/a.go and imported that as the last package in main.go. In theory that should also give us the same memory usage. But after running we get SHR usage of 13MB.
I thought it might be an issue that the package is in the same repository as the main.go - Shouldn't make a difference but I tried anyway to create an independet repo: github.com/burak-ok/init_for
But here I still get "only" 13MB - This way needs more investigation.
This is currently all I know. I also tried to go bottom up with creating a new go project and importing some packages we used in Inspektor Gadget. Didn't get far yet

From the pprof, btf.LoadKernelSpec() takes the most memory. This is part of the cilium/ebpf library, it is loading and parsing the BTF data from the kernel (/sys/kernel/btf/vmlinux) and caching the data for next queries. It can be removed from the cache with FlushKernelSpec. We currently don't call FlushKernelSpec but we could; it might take more cpu to load BTF the next time but less memory.
This is not exclusively for the FanotifyEbpf notifier: other gadgets use this too (via the btfgen operator for image-based gadgets or directly like the builtin trace-tcpdrop gadget).
/sys/kernel/btf/vmlinux is 5.6M on my Linux distro, so less than the ~40MB listed in pprof. I think that once it is parsed by cilium/ebpf, it takes more space in memory.
There are a few related issues:
https://github.com/cilium/ebpf/issues/1311
https://github.com/cilium/ebpf/issues/1262
https://github.com/cilium/ebpf/issues/1068
https://github.com/cilium/ebpf/issues/542

I thought it might be an issue that the package is in the same repository as the main.go - Shouldn't make a difference but I tried anyway to create an independet repo: github.com/burak-ok/init_for
But here I still get "only" 13MB - This way needs more investigation.

Your package github.com/burak-ok/init_for still has the prefix "github.com" so it is not at the end of the alphabetic order. In IG's go.mod, we have packages starting with "go.opentelemetry.io", "sigs.k8s.io" etc.
You could add a package called "zzz.io/init_for" but with a replace line:
replace zzz.io/init_for => github.com/burak-ok/init_for

And check if the memory usage is different there.
Alternatively, we need a gadget reporting the memory syscalls (brk, sbrk, mmap) and reporting the user stack trace whenever they are called.

I tried to name memory regions allocated by cilium/ebpf using Linux 5.17's prctl-PR_SET_VMA_ANON_NAME feature:
https://github.com/torvalds/linux/commit/9a10064f5625d5572c3626c1516e0bebc6c9fe9b
vendor/github.com/cilium/ebpf/internal/unix/types_linux.go:
func Mmap(fd int, offset int64, length int, prot int, flags int) (data []byte, err error) {
	data, err = linux.Mmap(fd, offset, length, prot, flags)
	if err != nil {
		return
	}

	mmapName := []byte("cilium-ebpf-mmap\000")
	linux.Prctl(linux.PR_SET_VMA, linux.PR_SET_VMA_ANON_NAME, uintptr(unsafe.Pointer(&data[0])), uintptr(length), uintptr(unsafe.Pointer(&mmapName[0])))

	return
}

Unfortunately, my kernel is compiled without CONFIG_ANON_VMA_NAME so I can't see the names in /proc/pid/maps.

Using https://github.com/Zxilly/go-size-analyzer (see also wasm website), I can see what contributes to the size of the binary:

PERCENT
NAME
SIZE
TYPE

16.61%
github.com/inspektor-gadget/inspektor-gadget
18 MB
vendor

14.51%
k8s.io/api
16 MB
vendor

11.24%
.rodata
12 MB
section

8.43%
.strtab
9.4 MB
section

7.32%
.debug_info
8.2 MB
section

6.43%
github.com/gopacket/gopacket
7.2 MB
vendor

5.37%
.debug_loc
6.0 MB
section

3.97%
.debug_line
4.4 MB
section

2.47%
.symtab
2.7 MB
section

2.06%
k8s.io/client-go
2.3 MB
vendor

1.69%
k8s.io/apimachinery
1.9 MB
vendor

1.59%
github.com/tetratelabs/wazero
1.8 MB
vendor

1.57%
google.golang.org/protobuf
1.7 MB
vendor

1.54%
.debug_ranges
1.7 MB
section

1.49%
k8s.io/cri-api
1.7 MB
vendor

1.42%
github.com/containerd/containerd
1.6 MB
vendor

1.40%
github.com/google/gnostic-models
1.6 MB
vendor

1.39%
net
1.6 MB
std

1.23%
crypto
1.4 MB
std

1.15%
runtime
1.3 MB
std

1.02%

1.1 MB
generated

0.99%
.debug_frame
1.1 MB
section

0.92%
google.golang.org/grpc
1.0 MB
vendor

0.90%
go.opentelemetry.io/otel
1.0 MB
vendor

0.81%
github.com/cilium/ebpf
903 kB
vendor

For more details, I used some code to get the 15 packages (including sub-package) using most space:

Package
Size in bytes

github.com/gopacket/gopacket
6283796

github.com/inspektor-gadget/inspektor-gadget/pkg/gadgets
3905927

github.com/inspektor-gadget/inspektor-gadget/pkg/columns
3018229

github.com/inspektor-gadget/inspektor-gadget/pkg/socketenricher
2822452

k8s.io/api/core/v1
1924338

runtime
1168502

github.com/tetratelabs/wazero
896770

k8s.io/cri-api/pkg/apis/runtime/v1
849102

crypto
815069

net
777945

github.com/containerd/containerd
713807

k8s.io/api/apps/v1
661025

github.com/inspektor-gadget/inspektor-gadget/pkg/parser
617325

k8s.io/api/flowcontrol/v1
570828

k8s.io/api/admissionregistration/v1
530556

Is there a way to add this sort of measurement to the CI?


Should the repo search be toggleable?

I think this is unnecessary since if somebody doesn't want the output in their book, they can just not include the code block.  I don't think we need to complicate things by adding in the option to turn it off in PRs?  Thoughts @avahoffman?

agreed!


Enhance or add to code documentation: classes, functions, etc.

This issue has been split in several issues.
Related PRs:

https://github.com/massalabs/massa-as-sdk/pull/198
https://github.com/massalabs/massa-as-sdk/pull/197
https://github.com/massalabs/massa-as-sdk/pull/189
https://github.com/massalabs/massa-as-sdk/pull/199


Typo in definition file 'options'

https://github.com/capacitor-community/bluetooth-le/blob/d1c1c99e8edd8e35dc867af7ec316248836974c5/src/definitions.ts#L166

Thanks for opening this issue. It will be fixed with the next release.

Thanks for opening this issue. It will be fixed with the next release.


test compatibility with java8

compiling locally with jdk8 causes test failures (see #13 ). Slightly annoying when building locally.
Test failures:
https://drive.google.com/file/d/0B_ixtCXTNKxSdlhQQ0Q5TzZiUFU/view?usp=sharing

Looks like Java 8 just causes the code to be generated in a different order (but still created functionally identical classes). That's gonna be annoying to fix! Thanks for the upload, helped a lot.

Test failures (probably same as @andaag 's): https://gist.github.com/talklittle/11104573b03b4a8e8cb9

Yep, looks the same. Not really sure how to address this, as compile-testing's built-in code generation tests basically just do a string comparison of generated vs. expected. If things are in a different order, that's gonna fail, no matter how identically they perform.
Instead of writing crazy code code that reorders other code to match what's expected, does anyone know if there's a way to force the tests to be run in Java 7 from the build.gradle?

You can check out https://github.com/google/compile-testing for comparing the actual ast instead of strings.

This should be fixed now in commit 6fb772b249c21d1cf9498167c96f9b9b4e6dc66f. I'll close this issue for now. If there are any other JDK issues, please feel free to re-open.

Confirmed, seems to work fine with JDK 8. Thank you @EricKuck !


Change audit and log archive account ids

Describe the outcome you'd like
We'd like to change the audit and log-archive account ids set here, but are unsure of the consequences:
module "aft" {
  source = "github.com/aws-ia/terraform-aws-control_tower_account_factory.git?ref=1.12.0"

  # Account ids
  log_archive_account_id   = var.log_archive_account_id
  audit_account_id         = var.audit_account_id

  # ...
}

Could someone please confirm if this is already supported and if doing so could break anything?
Is your feature request related to a problem you are currently experiencing? If so, please describe.
N/A
Additional context
N/A

Hi @caspar-ds , the accounts that are to be set to these variables need to be the Log and Audit accounts created as part of your Control Tower landing zone setup. Please refer to this documentation page: Shared Accounts.
Could you clarify if you performed a landing zone decommission and re-setup to create new log and audit accounts? If not, then this is not supported.

Hi @wiltangg. There was a misconfiguration and these accounts are the wrong way around. We'd like to correct this, but aren't sure of the consequences. Thanks


fix: Remove duplicate Suresh Thumma card

This is a regression of resolving a merge conflict for #32.

📝 Changed routes:

/speakers

(view full size)

Commit 520d9e094d363b898aeec9b40ebe7d675ac9834d (https://hackportal-hackutd-2fl2h5izd-acmutd.vercel.app).