Cohere models are failing

  File "/nlp/u/maiyifan/miniconda3/envs/helm-v0.2.1-rc1/lib/python3.8/site-packages/helm/benchmark/adaptation/adapters/language_modeling_adapter.py", line 122, in generate_requests
    prompt_text, num_conditioning_tokens = self.construct_language_modeling_prompt(
  File "/nlp/u/maiyifan/miniconda3/envs/helm-v0.2.1-rc1/lib/python3.8/site-packages/helm/benchmark/adaptation/adapters/language_modeling_adapter.py", line 173, in construct_language_modeling_prompt
    raw_prompt, pred_tokens = self.fits_tokens_within_context_window(
  File "/nlp/u/maiyifan/miniconda3/envs/helm-v0.2.1-rc1/lib/python3.8/site-packages/helm/benchmark/adaptation/adapters/language_modeling_adapter.py", line 245, in fits_tokens_within_context_window
    raise ValueError(
ValueError: Truncating pred_tokens to fit them in the context window, got len(pred_tokens) == 0, which will lead to an infinite loop.

Seems to break on the_pile:subset=ArXiv, the_pile:subset=Github and the_pile:subset=PubMed Central

Now I'm getting:
helm.benchmark.executor.ExecutorError: Failed to make request to cohere after retrying 8 times. Error: CohereClient error: Request failed with error too many tokens: total number of tokens (prompt and prediction) cannot exceed 2048 - received 2049. Try using a shorter prompt, a smaller max_tokens value, or enabling prompt truncating. See https://docs.cohere.ai/reference/generate for more details. Request: Request(model='cohere/command-medium-nightly', embedding=False, prompt='Title: Stephen Colbert\n\nBackground: Colbert was born in Washington, D.C., the youngest of 11 children in a Catholic family. He spent his early years in Bethesda, Maryland. He grew up on James Island, South Carolina. Colbert and his siblings, in descending order by age, are James III, Edward, Mary, William, Margo, Thomas, Jay, Elizabeth, Paul, Peter, and Stephen.\n\nSection: The Colbert Report\nPassage: While at Northwestern, Colbert studied with the intent of becoming a dramatic actor; mostly he performed in experimental plays and was uninterested in comedy. He began performing improvisation while in college, both in the campus improv team No Fun Mud Piranhas and at the Annoyance Theatre in Chicago as a part of Del Close\'s ImprovOlympic at a time when the project was focused on competitive, long-form improvisation, rather than improvisational comedy. "I wasn\'t gonna do Second City", Colbert later recalled, "because those Annoyance people looked down on Second City because they thought it wasn\'t pure improv - there was a slightly snobby, mystical quality to the Annoyance people". After Colbert graduated in 1986, however, he was in need of a job. A friend who was employed at Second City\'s box office offered him work answering phones and selling souvenirs. Colbert accepted and discovered that Second City employees were entitled to take classes at their training center for free. Despite his earlier aversion to the comedy group, he signed up for improvisation classes and enjoyed the experience greatly. Shortly thereafter, he was hired to perform with Second City\'s touring company, initially as an understudy for Steve Carell. It was there he met Amy Sedaris and Paul Dinello, with whom he often collaborated later in his career. By their retelling, the three comedians did not get along at first - Dinello thought Colbert was uptight, pretentious and cold, while Colbert thought of Dinello as "an illiterate thug" - but the trio became close friends while touring together, discovering that they shared a similar comic sensibility. When Sedaris and Dinello were offered the opportunity to create a television series for HBO Downtown Productions, Colbert left The Second City and relocated to New York to work with them on the sketch comedy show Exit 57. The series debuted on Comedy Central in 1995 and aired through 1996. Although it lasted for only 12 episodes, the show received favorable reviews and was nominated for five CableACE Awards in 1995, in categories including best writing, performance, and comedy series. Following the cancelation of Exit 57, Colbert worked for six months as a cast member and writer on The Dana Carvey Show, alongside former Second City castmate Steve Carell, and also Robert Smigel, Charlie Kaufman, Louis C.K., and Dino Stamatopoulos, among others. The series, described by one reviewer as "kamikaze satire" in "borderline-questionable taste", had sponsors pull out after its first episode aired and was cancelled after seven episodes. Colbert then worked briefly as a freelance writer for Saturday Night Live with Robert Smigel. Smigel brought his animated sketch, The Ambiguously Gay Duo, to SNL from The Dana Carvey Show; Colbert provided the voice of Ace on both series, opposite Steve Carell as Gary. Needing money, he also worked as a script consultant for VH1 and MTV, before taking a job filming humorous correspondent segments for Good Morning America. Only two of the segments he proposed were ever produced and only one aired, but the job led his agent to refer him to The Daily Show\'s then-producer, Madeline Smithberg, who hired Colbert on a trial basis in 1997. During the same period, Colbert worked again with Sedaris and Dinello to develop a new comedy series for Comedy Central, Strangers with Candy. Comedy Central picked up the series in 1998 after Colbert had already begun working on The Daily Show. As a result, he accepted a reduced role, filming only around 20 Daily Show segments a year while he worked on the new series. Strangers with Candy was conceived of as a parody of after school specials, following the life of Jerri Blank, a 46-year-old dropout who returns to finish high school after 32 years of life on the street. Most noted by critics for its use of offensive humor, it concluded each episode by delivering to the audience a skewed, politically incorrect moral lesson. Colbert served as a main writer alongside Sedaris and Dinello, and portrayed Jerri\'s strict but uninformed history teacher, Chuck Noblet, seen throughout the series dispensing inaccurate information to his classes. Colbert has likened this to the character he played on The Daily Show and later The Colbert Report, claiming that he has a very specific niche in portraying "poorly informed, high-status idiot" characters. Another running joke throughout the series was that Noblet, a closeted homosexual, was having a "secret" affair with fellow teacher Geoffrey Jellineck, despite the fact that their relationship was apparent to everyone around them. This obliviousness also appears in Colbert\'s Daily Show and Colbert Report character. Thirty episodes of Strangers with Candy were made, which aired on Comedy Central in 1999 and 2000. Though its ratings were not remarkable during its initial run, it has been characterized as a cult show with a small but dedicated audience. Colbert reprised his role for a film adaptation, which premiered at the Sundance Film Festival in 2005 and had a limited release in 2006. The film received mixed reviews. Colbert also co-wrote the screenplay with Sedaris and Dinello. Colbert hosted his own television show, The Colbert Report, from October 17, 2005, through December 18, 2014. The Colbert Report was a Daily Show spin-off that parodied the conventions of television news broadcasting, particularly cable-personality political talk shows like The O\'Reilly Factor, Hannity, and Glenn Beck. Colbert hosted the show in-character as a blustery right-wing pundit, generally considered to be an extension of his character on The Daily Show. Conceived by co-creators Stewart, Colbert, and Ben Karlin in part as an opportunity to explore "the character-driven news", the series focused less on the day-to-day news style of the Daily Show, instead frequently concentrating on the foibles of the host-character himself. The concept for The Report was first seen in a series of Daily Show segments which advertised the then-fictional series as a joke. It was later developed by Stewart\'s Busboy Productions and pitched to Comedy Central, which green-lighted the program; Comedy Central had already been searching for a way to extend the successful Daily Show franchise beyond a half-hour. The series opened to strong ratings, averaging 1.2 million viewers nightly during its first week on the air. Comedy Central signed a long-term contract for The Colbert Report within its first month on the air, when it immediately established itself among the network\'s highest-rated shows. Much of Colbert\'s personal life was reflected in his character on The Colbert Report. With the extended exposure of the character on the show, he often referenced his interest in and knowledge of Catholicism, science fiction, and The Lord of the Rings, as well as using real facts to create his character\'s history. His alternate persona was also raised in South Carolina, is the youngest of 11 siblings and is married. The actual Colbert\'s career history in acting and comedy, however, was often downplayed or even denied outright, and he frequently referred to having attended Dartmouth College (which was at the forefront of the conservative campus movement in the 1980s) rather than his actual alma mater, Northwestern. In July 2012, Colbert added two years to his contract with Comedy Central, extending the run of The Colbert Report until the end of 2014. The final episode on December 18, 2014, featured a rendition of "We\'ll Meet Again" and appearances from former guests of the show, including Jon Stewart, Randy Newman, Bryan Cranston, Willie Nelson, Yo-Yo Ma, Mandy Patinkin, Neil deGrasse Tyson, Tom Brokaw, David Gregory, J. J. Abrams, Big Bird, Gloria Steinem, Ken Burns, James Franco, Barry Manilow, Bob Costas, Jeff Daniels, Sam Waterston, Bill de Blasio, Katie Couric, Patrick Stewart, George Lucas, Henry Kissinger, Cookie Monster, Alan Alda, Eliot Spitzer, Vince Gilligan, Paul Krugman, and a text from Bill Clinton, and appearances by Alex Trebek, U.S. and coalition Afghanistan forces, and further characters (a space station astronaut, Santa, Abraham Lincoln, etc.).\n\nQuestion: what was the colbert report about?\nAnswer: Colbert has likened this to the character he played on The Daily Show and later The Colbert Report,\n\nQuestion: what did the colbert report contain?\nAnswer: Another running joke throughout the series was that Noblet, a closeted homosexual,\n\nQuestion: what influence did his report have?\nAnswer: The series opened to strong ratings, averaging 1.2 million viewers nightly during its first week on the air.\n\nQuestion: what is the interesting aspect of this report?\nAnswer: Following the cancelation of Exit 57, Colbert worked for six months as a cast member and writer on The Dana Carvey Show,', temperature=0.0, num_completions=1, top_k_per_token=1, max_tokens=100, stop_sequences=['\n'], echo_prompt=False, top_p=1, presence_penalty=0, frequency_penalty=0, random=None)

The total number of tokens error turned out to be a different issue (using stale tokenizer results after the tokenizer version changed).

Hi, may I know whether there is any update on this issue? I encountered the same problem when running the_pile:subset=ArXiv using vicuna model, but not on the_pile:subset=Github.

@enor2017 Unfortunately the_pile is deprecated because there is no longer a reliable host for that dataset.

Closing as wontfix because we no longer perform language modeling evaluations on Cohere models.


Closes #1187: Extend the configuration UI to be able to hide files

closes #1187

This change is

a discussion (no related file):
Previously, aaronweissler wrote…
When I create a new file or folder while hidden files are not shown, they all appear again. I assume it is because in the writeFile action the fetchFiles action is dispatched as well.
Maybe the hiding could be incorporated into the fetchFiles action directly?
I also wonder if the default should be that the hidden files are not shown, so they are only shown when explicitly asked for?

Good point, thank you for the comment!
I have refactored toggleShowHiddenFiles and incorporated it in fetchFiles.
Let's discuss the default state in the next meeting.

a discussion (no related file):
Previously, heiko-holz (Heiko Holz) wrote…
Good point, thank you for the comment!
I have refactored toggleShowHiddenFiles and incorporated it in fetchFiles.
Let's discuss the default state in the next meeting.

The default state was now changed to false, i.e., hidden files are not shown per default


Custom Material Shader

Terrain3D version
v0.9.1
System information
Godot v4.2 / linux / 6.9.3-arch1-1
Is the issue reproducable in the demo?
Yes
Issue description
When trying to create my own shader for my material I always run into the issue that some code is being appended after my code. I tried creating a new empty shader or a visual shader. For example
--Main Shader--
    1 | shader_type spatial;
    2 | render_mode blend_mix, depth_draw_opaque, cull_back, diffuse_lambert, specular_schlick_ggx;
    3 |
    4 |
    5 |
    6 |
    7 | void fragment() {
    8 |
    9 |  vec4 n_out2p0 = vec4(1.000000, 0.000000, 0.000000, 1.000000);
   10 |
   11 |
   12 |
   13 |  ALBEDO = vec3(n_out2p0.xyz);
   14 |
   15 |
   16 |
E  17->  ALBEDO = color_map.rgb;
   18 |  ROUGHNESS = 0.7;
   19 |  SPECULAR = 0.;
   20 |  NORMAL_MAP = vec3(0.5, 0.5, 1.0);
   21 |
   22 |
   23 |  if(bool(texelFetch(_control_maps, get_region_uv(floor(uv)), 0).r >>1u & 0x1u)) {
   24 |  ALBEDO *= vec3(.5, .0, .85);
   25 |  }
   26 |
   27 |
   28 |
   29 | }
   30 |

this code was generated by a simple VisualShader which just applies the color red to albedo. Everything from Line 17 on is autogenerated code that references e.g. a colormap, which in my case I didn't provide (I have textures and masks for every pixel). But even it I'd provide the colormap I'd run into an issue in the next lines.
I also tried to use the autogenerated code (~400 lines) and made some changes there, but it seems, changing the ALBEDO like in the example there has no effect (but at least no code is being appended)
Am I doing this wrong? How do I prevent the auto appending of code?
Logs
see above

The terrain is driven by the shader. If you insert an empty shader, you'll break the terrain. Look in extras for a minimal shader that is everything you need to allow the terrain to function without texturing.

this code was generated by a simple VisualShader

VisualShaders aren't supported yet. But not for any reason other the fact that the minimal shader isn't in visual form yet. You could implement it. See #226.

Everything from Line 17 on is autogenerated code that references

This code is added when you enable the colormap debug view in the material. All debug views add shader code. The color map debug view is automatically enabled under certain conditions, probably if you have no textures in the asset dock.

I also tried to use the autogenerated code (~400 lines) and made some changes there, but it seems, changing the ALBEDO like in the example there has no effect (but at least no code is being appended)

Either use the minimal shader and make your own texturing, or work on the default generated shader. If you didn't see changes when modifying ALBEDO, perhaps you did something else wrong. Now that you know this is the correct path, try again and see. Also 0.9.2 is out and better, but this all still applies.

thanks for the detailed response! now that I know how its supposed to work I'll upgrade and have a look again


Yale YRD446 not displaying whose PIN was entered on the keypad (+fix)

Hi there,
Congratulations on an awesome app. I'm using a YRD446 and noticed that when I tested users entering their PIN codes it was showing code 99 for all of them.
The event from the lock when a user enters a code is payload: 00 71 05 13 01 00 FF 06 06 04 63 03 01 01 00
When I looked at def zwaveEvent(physicalgraph.zwave.commands.alarmv2.AlarmReport cmd) in conjunction with the documentation here http://www.cd-jackson.com/zwave_device_uploads/624/Yale-Real-Living-ZWave-Plus-System-Integrators-Guide-YRL-deadbolts-Rev-4.pdf, I noticed the function matches two aspects of the Yale implementation:

cmd.zwaveAlarmType = 0x06 and cmd.zwaveAlarmEvent = 0x06
cmd.alarmType = 0x13, with cmd.zwaveAlarmType = 0x06 and cmd.zwaveAlarmEvent = 0x06

For my lock, it chooses path 1), which goes on to use cmd.eventParameter[0] for the slot number. This does not allow the SmartApp Lock codeUsed() to find the user.
I changed the device handler at line 200 to have the following in my local implementation:

  	case 6:
        	/* Added by Alan Moore for handling YRD446 */
            if(cmd.alarmType == 19) {
  	    	if (cmd.alarmLevel) {
  				map.descriptionText = "$device.displayName was unlocked with code $cmd.alarmLevel"
  				map.data = [ usedCode: cmd.alarmLevel ]
  			}
            } /* Original code */
  		else if (cmd.eventParameter) {
  			map.descriptionText = "$device.displayName was unlocked with code ${cmd.eventParameter.first()}"
  			map.data = [ usedCode: cmd.eventParameter[0] ]
  		}
  		break

The lock handler now correctly reports the end user name. Please let me know if you need further information.
Regards,
Alan

Thanks for this fix!!  I believe that SmartThings have addressed this issue in their most recent DeviceHandler.
LockManager 2.0 is going to start using the updated DTH from SmartThings.  Actually, the custom DTH is no longer needed.
I THINK the new default DTH includes this fix.
https://github.com/ethayer/lock-manager/tree/beta-2
If you get a change to use the beta, let me know if this is still a problem.  If it is, I'll include this logic in the new optional DTH for Yale.
I'm planning on releasing this beta branch as the master version soon, I just have to get around to making an install guide for it.


Example role configuration for reverse proxy

Trying to setup ArcGis server behind a reverse proxy other than the Web Adapter if possible. Right now it sort of works. I can get to the /manager GUI, but the /admin GUI and map previews doesn't work due to path and redirect issues.
Does anyone have any example role configurations for what needs to be set as node properties for a fully functioning server instance behind a reverse proxy?

Hi @wilhelmi,
I recommend including the WebContextURL property in the attribute role json file.
node['arcgis']['server']['web_context_url']
https://github.com/Esri/arcgis-cookbook/tree/master/cookbooks/arcgis-enterprise#server
Will also want to configure the reverse proxy headers:
https://enterprise.arcgis.com/en/server/latest/deploy/linux/using-a-reverse-proxy-server-with-arcgis-server.htm#ESRI_SECTION1_7C21416FDBFA440191ADF803B70C7DA5
Happy Automating,
Cameron K.

Any pointers setting the web context URL?
Configuring the machine via chef-solo, the role json I am running is:
{
  "name": "server-role",
  "description": "",
  "json_class": "Chef::Role",
  "default_attributes": {
    "arcgis": {
      "run_as_user": "****",
      "run_as_password": "****",
      "version": "10.7",
      "configure_windows_firewall": "true",
      "cache_authorization_files": "true",
      "server": {
        "admin_username": "****",
        "admin_password": "****",
        "directories_root": "C:\\customer-site",
        "install_system_requirements": "true",
        "authorization_file": "****.prvc",
        "wa_name": "cust",
        "wa_url": "https://sample.com/cust/",
        "web_context_url": "https://sample.com/cust/"
      }
    }
  },
  "chef_type": "role",
  "run_list": [
    "recipe[arcgis-enterprise::system]",
    "recipe[arcgis-enterprise::server]"
  ]
}

This will create the site, however if I go to the admin gui the web_context_url property is not set. What am I missing?
Thanks!

@wilhelmi
I've confirmed that currently the node['arcgis']['server']['web_context_url'] is only used in the federation block.
Current design does not populate the webcontexturl within the AGS admin properties. One workaround would be to use /arcgis in the Reverse Proxy URL:

If you're using a reverse proxy server and the URL to your site does not end with the default string /arcgis (all lowercase), you should also set the ArcGIS Server WebContextURL property. This helps ArcGIS Server construct the correct URLs on all resources it sends to the end user.

Otherwise if using something other than /arcgis in the Reverse Proxy url, for now it will have to be manually added by going to :6443/arcgis/admin/system/properties/update and add:
{
   "WebContextURL": "https://sample.com/cust"
}

Any suggested approaches to plagiarizing some existing code to set this is a wrapper cookbook?

Trying to update this by hand and still no luck. The goal is to use the first part of the URL path to route to the correct instance. ex:
https://sample.com/path1 -> routed to instance #1
https://sample.com/path2 -> routed to instance #2
If I set the web_context_url to https://sample.com/path1/ and set up a rewrite/forwarding rule in the reverse proxy to replace /path1/ with /arcgis/. In a browser, https://sample.com/path1/manager works. Looking at network traffic on the Arc Server VM the http request comes into /arcgis/manager. X-Forwarded-Host is also set to the correct dns name of the reverse proxy, sample.com for this example.
However map previews and https://sample.com/path1/admin do not work, they redirect back to http://sample.com/arcgis/admin which 404 at the reverse proxy.
From what I can read in the docs, seems like this should be possible? Reference to myGis path.
Any ideas what needs to get set to make this work?
Note I tried various combinations of path1/arcgis/manager settings and urls and just get 404's for the arc server.
Thanks for any ideas!

Hi @wilhelmi,
I'm not quite sure I understand the need for the rewrite/forwarding rule to replace /path1/ to /arcgis/ if the webcontexturl is being set to {"WebContextURL": "https://sample.com/path1"}.
Here is an example, if using Apache, (with Web Adaptor)
ProxyPass /path1 https://webadaptor.domain.com/path1
ProxyPassReverse /path1 https://webadaptor.domain.com/path1
{"WebContextURL": "https://sample.com/path1"}
without Web Adaptor:
ProxyPass /arcgis https://gisserver.domain.com:6443/arcgis
ProxyPassReverse /arcgis https://gisserver.domain.com:6443/arcgis
{"WebContextURL": "https://sample.com/arcgis"}

I am trying to do selective routing, and maybe that isn't possible here?
In this case, I have 2 arc server instances, AS1 & AS2 for simplicity.
https://sample.com/path1/arcgis -> routed to AS1
https://sample.com/path2/arcgis -> routed to AS2
Trying to figure out the configuration that would let me browse to:
https://sample.com/path1/ and get to the services on the AS1 instance. Such as /admin* /manager* etc
I was hoping to skip installing the WA to keep things simple, but maybe I have to do that for each instance?
The most success I have had is:
AS1: WebContextUrl = "https://sample.com/path1/"
Front end reverse proxy is configured to match /path1 and replace it with /arcgis. This routes it to the right backend.
In a browser https://sample.com/path1/manager interface works, the /admin doesn't some of the map previews don't either.
Reading the docs it would imply the WA is simply a LB / RP and could be replaced with 3rd party tools?

@wilhelmi
The RP/NLB context name can only go one level deep:
If you do not use ArcGIS Web Adaptor in your deployment, be sure that the reverse proxy server's context name only goes one URL level deep. For example, you can have a reverse proxy URL such as https://proxy.domain.com/enterprise, but you cannot have a reverse proxy URL such as https://proxy.domain.com/myorg/enterprise.
Though this is in the Portal doc it also applies to AGS as well. So configuring https://sample.com/path2/arcgis won't work unfortunately.
That is correct though, the Web Adaptor is Esri's implementation of a reverse proxy/load balancer (in multi-note sites). It is completely optional, unless using Integrated Windows Authentication then it is required.

Made some progress:
WebContextUrl = "https://sample.com/path1/"
Rewrite Rule -> match on /path1 and replace with /arcgis
(so keeping with your note on 1 level deep)
From tracing WA traffic added the following headers from the RP:
X-Forwarded-Url-Base:/path1
X-Forwarded-Request-Context: https://sample.com/path1
This gets pretty close with only a couple of redirect hiccups:
https://sample.com/path1/manager/ -> Works as expected.
https://sample.com/path1/rest  -> Redirects to -> http://sample.com/arcgis/rest/ (fails)
https://sample.com/path1/rest/services -> Works as expected.
https://sample.com/path1/admin/ -> Loads login page as expected
Submit Login -> Redirects to -> http://sample.com/arcgis/admin/ (fails)
Manually reload https://sample.com/path1/admin/ -> Logged in and works as expected

@wilhelmi
Interesting, so its redirecting to http url's. I would check to ensure AGS, WA and RP all have the same HTTP/HTTPS settings. Meaning if AGS has HTTP (6080) and HTTPS (6443) enabled, then the WA (IIS or web server where it resides) has HTTP (80) and HTTPS (443) enabled, as well as the RP HTTP (80) and HTTPS (443) enabled.
Alternatively, if AGS only has HTTPS (6443) enabled then we will want the WA to also only have HTTPS (443) as well as RP HTTPS (443).

I set the AGS to be https only, and RP is as well, that gets it down to just a path redirect problem.

https://sample.com/path1/admin/login (200 loads fine)

Enter username and password -> POST to: https://sample.com/path1/admin/login?redirect=

Post returns a 302 with a location of https://sample.com/path1/admin

Browser does a GET to: https://sample.com/path1/admin which returns a 302 with a location of: https://sample.com/arcgis/admin/

Browser does a GET to https://sample.com/arcgis/admin/ which fails with a 404

Now if a manually put the url from step 3 in the browser again is succeeds with a 200 from there.

So I am confused why step 4 only happens on first login to the admin page. Any ideas?

@wilhelmi Since we are no longer troubleshooting Chef, but rather manually configuring a RP with AGS I am going to recommend reaching out to Esri's Technical Support for further assistance.

To use a Reverse Proxy with AGS set the following two parameters within the json file:
node['arcgis']['server']['system_properties'] = ArcGIS Server system properties. Default value is {}.
and
node['arcgis']['server']['web_context_url'] = ArcGIS server web context URL. By default, this is 'https://<Domain name>/<WA name>.
Example json:
"arcgis": {
	"version":"10.8",
    "server": {
         "web_context_url":"https://myreverseproxy.domain.com/server",
	  "system_properties":{
		"WebContextURL": "https://myreverseproxy.domain.com/server"
	  }
    }

The node['arcgis']['server']['web_context_url'] will be used for the Federation Services URL, and the node['arcgis']['server']['system_properties'] will set the actual web_context_url property within Server Admin API.


Periodically run other RL variants, e.g. forceserialize and forceundodefer.

We often find bugs in ES6 because we didn't remember to run forceserialize, forceundodefer, etc. They aren't common enough to bloat unit test time, but we should periodically run them to surface bugs.

@tcare Are you suggesting we have a separate test configuration to run these daily / weekly / something else? Or are you suggesting that we add additional test coverage and run them as a part of an existing config?

@tcare we run other test configs in nightlies. Is that enough to close this?

We do -forceserialize but not forcedeferparse / forceundodefer. They aren't really worth running all the time.  At the very least we shouldn't get asserts/crashes though.


commit_default option in job metadata prevents writing in database

Environment

Nautobot version (Docker tag too if applicable): 1.5.21
Python version: 3.8.17
Database platform, version: postgres 13
Middleware(s):

If I try to use the commit_default = False option the metadata of my job inside my SSoT plugin, I get a weird behaviour. At first it seems, that it doesn't have an effect, I have to uncheck the "dry run" box despite the setting.
With this this option set to false, no changes at all are stored in the database, they are rolled back every time.
Link to NautobotDocs
Steps to Reproduce

add commit_default = Falseto you job class metadata
Navigate to the "run job" window and see, that the box is still checked
uncheck the box and run the job

Expected Behavior
I run the job and all necessary changes are stored in the database and not reverted.

Observed Behavior
With "dry run" box checked

With "dry run" box unchecked

As you can see, in both cases the database changes are reverted.
Bonus:
I already created an overview with docs, code and the box, for that and just provide it here:

This may be related to the fact that nautobot-ssot hides the commit checkbox in the UI and implements its own dry run checkbox instead.

IIRC the reason for the SSOT behavior is because it always wants to run in ‘commit’ mode (so that it can at least save the diff to the DB); ‘dry run’ controls whether it then actually runs the sync. Changing commit_default to False would make it so that the automatic rollback at the end of the job would prevent even the diff from being saved to the database.
I think to achieve your desired goal for an SSOT job specifically, you'll want to override the definition of the dry_run flag and change its default, rather than using the commit_default flag.
This’ll become a lot less confusing in 2.0 where the dry_run flag on a Job just means whatever the job wants it to mean, rather than causing the entire job to always roll back all its DB changes.

Thanks for the explanation. I will try your proposal :-)

@glennmatthews With the changes coming in for 2.0, would it be worth moving this to nautobot-plugin-ssot for consideration with jobs changes there for the future?

Yeah, it's probably worth putting on the radar for the 2.0 updates to SSOT. I've tagged an existing issue there that also touches on this behavior.


Antlr Menu Options Appear Twice

Using JetBrains GoLand and right-clicking in a Grammar file displays a popup menu where some menu options are duplicated.
Interestingly, the duplicate "Configure ANTLR..." menu options do not share the same settings instance!
I.e. If I set the output directory in the popup form for the first "Configure ANTLR..." menu option, I can set a different output directory in the popup form for the second "Configure ANTLR..." menu option.

Hi, do you have any other antlr plugins installed


Add language change button to your website

Description
By adding language change button more user gets connected with your website. it will enhance your website.
Screenshots

Checklist

[X] I have checked the existing issues
[X] I have read the Contributing Guidelines
[X] I'm a GSSoC'24-Extd contributor
[X] I'm a Hacktoberfest'24 contributor
[X] I am willing to work on this issue (optional)

Hey @Antima2004, The website requires multilingual support for global usage, where it's understood that everyone knows English, with just minor adjustments.
If we need this feature in the future, we will definitely let you know.
Please don't be discouraged. I need to close your issue. You can raise another issue, and I will be happy to assign it to you, but make sure that the issue you raise is valid and truly needs to be addressed on our website; otherwise, invalid issues will be closed.

Join our official Discord server where we can easily talk about how to enhance our project even better.

Thank you!
Thank you!


pds store hashed passwords using scrypt

Fixes: #59

Hey @bnewbold. Could you please take a look? I don't know if this change impact any deployment. Please let me know if the migration is needed

Hi @erka, I took a quick scan and this looks pretty good. I don't foresee any direct conflicts with work in flight (eg, I don't know of anybody else working on PDS password hashing). I do want to review this more carefully before merging.
I'm probably not going to merge this, or other PRs, for a couple week though. We are trying to stay very focused on wrapping up protocol features. The golang PDS is only used for integration tests, and has no timeline for being used or promoted for self-hosting or anything like that. I'm tempted to rip out the cmd/laputa/ directory for now to prevent any confusion about this. We have been merging occasional contributions and bug fixes, but what we say in the repo README still stands:

We are developing in the open, but not ready to accept or review significant contributions. Keep checking back!

Sorry if there are any mixed messages, like the "contributions welcome" tag on the scrypt issue. We do really appreciate interest and contributions, and look forward to more collaboration soon.

Hey! Im going to close this PR since we arent currently building the Go code for being a production PDS service. The PDS code here (for now) is just for integration tests to ensure the BGS is working as intended.
I'm happy to revisit once we decide to push this PDS into being a maintained production-ready thing


Update manage-stale-devices.md

Updated to note that it is in public preview (if there are other ways - please propose/update as needed)

@spunukol : Thanks for your contribution! The author, @MarkusVi, has been notified to review your proposed change.

#sign-off


Add support for DRBD

DRBD is used when the need arises for a Linux network data replication solution, as it is integrated in the Linux kernel. It would be great for Datadog to support is, by monitoring its counters (http://docs.linbit.com/docs/users-guide-8.4/p-work/#s-performance-indicators), or reporting DRBD events in the Events stream.
P.-S.: I hope this is not the wrong place to ask it.
P.-P.-S.: usage statistics available here, but many people disable their sending.

Hi @PenegalECI,
Thanks for the feature request. We've discussed it, and while we agree the feature has merit, unfortunately we're not able to dedicate engineering resources to it at this time (Istill have created a ticket in our backlog to keep track of the idea).
That said, we like the idea and if you submit a PR to our integrations-extras repo we're happy to review and merge it. If you have any questions or need assistance with the process, we have community office hours twice a month.


fixes: NameError: uninitialized constant YAML

Hi @mohitsethi, thanks for the fix. For clarity, this is occurring when you vagarnt up? Surprisingly I never had the problem.

@JeanFred thats correct.

Thanks for confirming @mohitsethi ! Now merged.


Docker error output is not being captured

The error message is saying Jib failed to run "docker load" which loads the built image into your local docker daemon. The IOException is supposed to include the error output of "docker load", but I see it's empty. That said, I wonder why. What is clear is that, running the "docker load" command from Jib failed.

Originally posted by @chanseokoh in https://github.com/GoogleContainerTools/jib/issues/991#issuecomment-422077844

Reopening. There is still a case an error is not being captured when using Maven 0.9.13:
https://github.com/GoogleContainerTools/jib/issues/330#issuecomment-434603230

Oh, seems like Maven 0.9.13 doesn't have the fix #1064 in it.

Yeah, 0.9.12 and 0.9.13 were branched straight from the 0.9.11 tag with specific patches. So this is already fixed for 0.10.0.


fix: show venue info in mobile

Description
Show all info in mobile hero view same as in desktop
Issues
Closes
DEV-XXX:
Related
Testing
Automated tests
Manual testing
Screenshots
Additional notes

Sports-Helsinki branch is deployed to platta: https://liikunta-pr255.dev.hel.ninja :rocket::rocket::rocket:

TestCafe result is success for https://liikunta-pr255.dev.hel.ninja :laughing::tada::tada::tada:


Navbar can be improvised

The navbar looks odd from the page.

I will improve it by today. After assigning me this issue.
[X]  I agree to follow this project's Code of Conduct
[X]  I'm a GSSOC'24 contributor
[X]  I want to work on this issue

@codervivek5 Please assign this issue to me. I have already contributed to this project


[spaceship] Fixed crash when raising an exception

Fixes https://github.com/fastlane/fastlane/issues/4633

👍

👍


Enable auto-complete and Error in the editor

Is your feature request related to a problem? Please describe.
QCodeEditor has many problems, see the issues.
Describe the solution you'd like
Use QScintilla as the editor.
Describe alternatives you've considered
Improve QCodeEditor.
Additional context
It's been discussed on Telegram, open here just for tracking.

Error highlighting is done!
newly added API to handle error highting are:
    /**
     * @brief squiggle Puts a underline squiggle under text ranges in Editor
     * @param level defines the color of the underline depending upon the severity
     * @param tooltipMessage The tooltip hover message to show when over selection.
     * @note QPair<int, int>: first -> Line number in 1-based indexing
     *                        second -> Character number in 0-based indexing
     */
    void squiggle(QCodeEditor::SeverityLevel level, QPair<int, int> startLocation, QPair<int, int> stopLocation, QString tooltipMessage);

    /**
     * @brief clearSquiggle, Clears complete squiggle from editor
     */
    void clearSquiggle();

If you use Language Server with these API, make sure to increment the line number received by LSP before passing for highlighting because of LSP sends the responses with 0-based indexing.


added CODEOWNERS file to support GitHub merging workflow

Pull Request Test Coverage Report for Build 15

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 92.811%

Totals

Change from base Build 14:
0.0%

Covered Lines:
1433

Relevant Lines:
1544

💛  - Coveralls


NameObfuscation access bug

Bug Report
Expected Behaviour
The Name Obfuscation would leave the methods' access of excluded classes untouched
Actual Behaviour
It changes everything to public
How to reproduce the behaviour

Try to obfuscate a jar with some excluded classes which contains private methods

Possible fix
Make a check if the class is not remapped

Example:

Causes crash
[20:45:39] [main/FATAL] [mixin]: Mixin apply failed mixins.backdoored.json:MixinLayerArmorBase -> net.minecraft.client.renderer.entity.layers.LayerArmorBase: org.spongepowered.asm.mixin.transformer.throwables.InvalidMixinException Mixin mixins.backdoored.json:MixinLayerArmorBase contains non-private static method renderEnchantedGlint(FFFF)V

Fixed in e41b971ae782d62eabe273f4b4af37309e9f755b


Add automation on project boards

Fixes #438
This action used by Maxslide is working in theory. Therefore, this should run after fixing syntax problems.

Developer Certificate of Origin
Version 1.1
Copyright (C) 2004, 2006 The Linux Foundation and its contributors.
1 Letterman Drive
Suite D4700
San Francisco, CA, 94129
Everyone is permitted to copy and distribute verbatim copies of this
license document, but changing it is not allowed.
Developer's Certificate of Origin 1.1
By making a contribution to this project, I certify that:
(a) The contribution was created in whole or in part by me and I
have the right to submit it under the open source license
indicated in the file; or
(b) The contribution is based upon previous work that, to the best
of my knowledge, is covered under an appropriate open source
license and I have the right under that license to submit that
work with modifications, whether created in whole or in part
by me, under the same open source license (unless I am
permitted to submit under a different license), as indicated
in the file; or
(c) The contribution was provided directly to me by some other
person who certified (a), (b) or (c) and I have not modified
it.
(d) I understand and agree that this project and the contribution
are public and that a record of the contribution (including all
personal information I submit with it, including my sign-off) is
maintained indefinitely and may be redistributed consistent with
this project or the open source license(s) involved.

Please let us know when this issue is ready for review.

@kgodey It's ready for review, and a futher test shows the same as I thought, issue works, pull requests doesn't. Secrets set by administrators don't come with PR.

We're more concerned about issues anyway - thanks for this!


Good Examples of Multi Accessory Platform Plugins To Follow

Describe Your Problem:

I am starting to work on my very first plug-in off this template and have the template all up and running; first with the dummy accessories and now have started testing the waters of changing those accessories to type Switch with a Temperature Sensor service added that is actually reading from my device.
Eventually I will need to create a Thermostat accessory, a Fan accessory and many more. I know that it is said that we are to create a separate platformAccessory.ts for each accessory but am not finding good examples of plug-ins that do multiple accessories in this manner. The Homebridge example plug-ins do not follow the method of this plug-in template and a lot of older plug-ins put all logic in one index.js file.
What I am after is an example of a plug-in that uses platform.ts for device setup and discovery and has multiple versions of the platformAccessory.ts file for accessory logic; preferably an example that Homebridge would endorse and like new devs to follow.
Logs:
N/A

Plugin Config:
N/A

Screenshots:

Environment:

Plugin Version: N/A
Homebridge Version:  N/A
Node.js Version:  N/A
NPM Version:  N/A
Operating System:  N/A

@donavanbecker sorry to tag you directly, but you were one of the most recently active devs on here that I have seen.

@mitch7391 for an example, take a look at my homebridge-tasmota plugin, it creates various device types based on the tasmota device discovered.

Closing this now, please feel free to re-open if needed!


feat: Possible support for Workload Identity Federation in GCP

Is your feature request related to a problem? Please describe.
The Lambda function that's run on AWS requires JSON credentials for a GCP service account, which includes a non-rotatable secret key, and through which has broad access to all gSuite user data.
Describe the solution you'd like
GCP has a feature Workload Identity Federation (AWS instructions), which allows AWS to use OAuth to obtain short-lived credentials for impersonating a service account. Rather than having a JSON file with a secret key, instead you only need a JSON file with non-secret information, and everything else is configured in GCP via an identity pool.
Describe alternatives you've considered
The alternative here is just to use service account credentials, which just requires being a bit more careful.
Additional context
According to the AWS instructions, the primary requirement  seems to be that golang.org/x/oauth2 must be version v0.0.0-20210218202405-ba52d332ba99 or later. Beyond that, there just needs to be a way to assign an AWS IAM Role to the executing function so that it has a role it can assert during the credential exchange.

@Parent5446 this looks like a good feature, let's me see how we can implement it.

I will focus in this feature to see of this is possible for next release v0.0.15


Use ImDrawCmd::IdxOffset for advancing offset of index buffer

This pull request fixes incorrect background color of popup modal by taking ImDrawCmd::IdxOffset into consideration in Slate widget for rendering ImGui output.
Please refer to the following pages for the problem and fix that are almost identical to this PR.  Thanks.

https://github.com/ocornut/imgui/issues/4845
https://github.com/ocornut/imgui/commit/c80e8b964cbb75c4202949ad86f4b0bb3ea6aa44

Thanks!


Bump the versions of different packages to fix the security issues

Summary
Fixed security issue
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/1
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/29
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/42
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/38
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/55
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/41
https://github.com/mattermost/mattermost-plugin-jira/security/dependabot/48

@ayusht2810 Let's defer QA testing to the next release.


Add Tilt CI GA workflow

Hopefully it works after merging https://github.com/artefactual-sdps/enduro/pull/33.


Fix #467 and #206; quit app on window close

This PR fixes the crash on close on OS X (#467) that was introduced by #450 but still fixes #206.
@rauchg @albinekb @c0b41 It seems the problem was that the window-all-closed event was never being triggered. (I looked through the electron issues and didn't see anything about that so I'm not sure if it's just the current behavior or something wrong on our end.)
I've tested this on OS X 10.11.6 and on Ubuntu 16.04. The only events triggered on window close are close and closed. Calling app.quit() on closed seems to work fine.

@freebroccolo idk but this fix all window closes? maybe close event okey?

If someone wants to verify that window-all-closed is not being triggered, you can add this to app/index.js:
// for app
const _appEmit = app.emit.bind(app);
app.emit = (event, ...args) => {
  console.log(event);
  _appEmit(event, ...args);
};

// for win
const _winEmit = win.emit.bind(win);
win.emit = (event, ...args) => {
  console.log(event);
  _winEmit(event, ...args);
};

This looks really good to me. Needs rebase.

@rauchg done.


[W6.4d][W14-B2]Koo chin chye

[LO-Polymorphism]
Added a function to check if a command Mutates

@koo1993
Some comments added. Please ack & close the PR after reading comments.


[Bug] Image prints with black image

I use FlutterBluetoothPrinter.printImage and get black image

i too

i too

hi @minhtritc97 sorry for delay, could you try the latest version?

yes, I have tried the new version.
it's not working

yes, I have tried the new version. it's not working

is it still black?

it worked on version 2.13.0
thank for supporting


Automatically create release on tag creation, closes #1166

The Problem/Issue/Bug:
Moving artifacts from Circle to Github is a manual process.
How this PR Solves The Problem:
After release artifacts are created, a Github release for the tag will be automatically created and the artifacts will be uploaded to the release.
A new file, .github/RELEASE_NOTES_TEMPLATE.md, has been added to serve as an autogenerated template for release notes that should be filled in by the release manager in the Github UI before publishing the release.
The release process documentation located at docs/developers/release-checklist.md has been updated to reflect changes in the release process related to this PR. The most significant change is that we should no longer publish an empty release to initiate the tag build, but we should instead create and push a tag independently of a release, then let CircleCI create and populate the release when the artifacts are built. This process is documented in the release checklist.
Manual Testing Instructions:
Proper configuration for releases can be applied to the CircleCI settings for any fork of drud/ddev, so it may be easiest to walk through the configuration and release process in real-time on a fork of this repository to confirm behavior.
Related Issue Link(s):
#1166
Release/Deployment notes:
Existing environment variables should be removed from the CircleCI environment variables management system and moved to ./.circleci/.publicenv. This file is source-ed at the beginning of each job to ensure the expected environment variables existing during a typical public build-and-test workflow.
A secret environment variable, GITHUB_TOKEN, is required by ghr to complete the upload process as a result of these changes. This should be managed using CircleCI and environment variables managed by the CI system should be changed to be private (that is, not shared with build from remote forks). Environment variables specific to the release process, but not strictly private, are also expected to be provided by CircleCI: GITHUB_USERNAME and GITHUB_REPOSITORY. On my fork, GITHUB_USERNAME was set to andrewfrench to correlate my account with the release. We can continue this with the Drud repository or create a new user (like drud-release-bot) to be responsible for releases.

This PR forced me learn the difference between "draft" and "pre-release" in the context of Github releases. We'll want to make sure that the automated releases are marked "draft", as this means they won't be returned in the list of releases returned to an API query like...
curl https://api.github.com/repos/drud/ddev/releases
...until we finalize the release notes and artifacts and click "publish release". The automation in this PR creates a draft release, so we shouldn't have to worry about that. Similarly, a draft won't show up to a public (non-admin) viewer, so we can safely let the draft release wait for as long as we'd like without worrying about what a user can see or has access to download. "Pre-release" doesn't prevent a release from showing up in the releases list and indicates a non-production ready release, so that should stay unchecked unless we have a good reason to indicate that.

I do appreciate you learning that. So now I don't have to just worry about it instead of learning it! Thanks.

I see several references to private environment variables and here in the Circleci docs, but  no actual definition. It seems to me that "Private environment variable" == "Environment variable set via Circleci web UI with "Pass secrets to builds from forked pull requests" turned off. Is that also your understanding? If so, it will mean that we won't be able to test any forked PRs that deal with Pantheon or drud-s3 (or other future external interaction things).
I do note something I never saw before - that you can inject environment variables via the CircleCI api. That approach would let us kick off a tag build with injected secret env vars.

We share the same understanding of what a private environment variable means here, but I disagree with the conclusion.
Working off the premise that an environment variable we're willing to share with a forked build is entirely and safely public, let's just check those values into this repository and load them before or during a test from a file. I've created .circleci/.publicenv for this purpose.

Well, I'm willing to share our limited-privilege Pantheon and drud-s3 credentials with the occasional crafty hacker that knows how to harvest from a forked build. Unfortunately, I'm absolutely not willing to check those into a public git repo, where they can be harvested by every github-scanner.

An alternate variation would be to build the artifacts on tag, but to push them on a separate workflow. I am not entirely sure how a separate workflow would find them to push though.

Closing this for now, I'll circle back later.


[ts-sdk] Remove cached JSON RPC Provider

Description
Describe the changes or additions included in this PR.
Test Plan
How did you test the new or updated feature?

If your changes are not user-facing and not a breaking change, you can skip the following section. Otherwise, please indicate what changed, and then add to the Release Notes section as highlighted during the release process.
Type of Change (Check all that apply)

[ ] user-visible impact
[ ] breaking change for a client SDKs
[ ] breaking change for FNs (FN binary must upgrade)
[ ] breaking change for validators or node operators (must upgrade binaries)
[ ] breaking change for on-chain data layout
[ ] necessitate either a data wipe or data migration

Release notes

Current dependencies on/for this PR:

main

PR #8685   👈

This comment was auto-generated by Graphite.


How can i push it on ?

I write 2 function: getExpression and set Expression.

Fork this repository to your repository
Create a branch in your repository
Modify the code in the branch
Commit your changes
Open a pull request to import your changes to my repository

A good starting point: https://guides.github.com/activities/hello-world/


issue when creating multi-sig transaction on testnet

hello, I am trying to make a new transaction from a multi-sig address on testnet.
when I put the reedem script in the correspondent field, it takes an address from the main net(starting with 3) instead of the correspondent testnet address i created in coinb.in which starts with 2.
I have some funds in the testnet address but this address from the main net appears with no funds( expected).
shortly, when I enter a testnet reedem script it returns me a main net multi-sig address.

I am using coinb.in to create a new transaction from a testnet address, when I enter the reedem script in the field (Address, WIF key or Redeem Script), it loads an main net multi sig address, an address starting with 3. instead of loading my testnet multisig address

Change to testnet in the settings https://www.coinb.in/#settings

I would suggest an link to settings in the main page... thanks for the link ashley

I agree. Open a pull request and it might happen.


Bluetooth dongle firmware

I'm trying to use a bluetooth dongle that uses the /lib/firmware/rtl_bt/rtl8761b_fw.bin file, which is not included in GamerOS.
I'd like to upload it (and possibly other firmware for my hardware), and have it copied to the correct path on every update.

Which packages includes that file?

@nosklo does it work on newer versions? Stated firmware is already present on newest linux-firmware package.
If it doesn't work for you please comment and we reopen the issue.


Calculate pointwise log-likelihoods and LOO elpd at the end of fitting

Basically incorporating Antonio's work into the main fitting workflow. Got a proof-of-concept ready to go.

I'd love to see it 👍


Consolidate stream/topic logic for unread messages.

This change introduces an unread_topic_counter object
that manages unread counts for streams and topics.  Consolidating
all the logic into a single class will set us up to add
logic for dealing with topic counts that includes provisional
counts of unread messages from the server.  It also makes
the current code a little easier to reason about.
Most of this change was simply extracting functions, but
I also removed a few unnecessary and inconsistent calls to
stream_data.canonicalized_name that preceded our use of
Dict with a fold_case argument.

Automated message from Dropbox CLA bot
@showell, it looks like you've already signed the Dropbox CLA. Thanks!

Looks great, merged, thanks @showell!


Old content

How come this does not include the newer server operating systems? If there is another version of this for them, please add a link
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2c1a07a2-6191-0e09-748d-c3f526e0ed00
Version Independent ID: 636f4465-11b0-5a12-2f12-0d05f6b05b86
Content: Best Practices for Securing Active Directory
Content Source: WindowsServerDocs/identity/ad-ds/plan/security-best-practices/Best-Practices-for-Securing-Active-Directory.md
Product: windows-server
Technology: ad-ds
GitHub Login: @iainfoulds
Microsoft Alias: daveba

The document states the operating systems that it applies to with this line:
Applies to: Windows Server 2022, Windows Server 2019, Windows Server 2016, Windows Server 2012 R2, Windows Server 2012
If you have further questions, please open a new GitHub issue.


Simplify code and improve readability

Not in favor of using stringify. Makes the code less readable IMO and is unnecessary in these cases


Fix auth regression

Fixes github auth regression introduced in #55 (missing db_url parameter to get_session()).
Thanks to @tom--pollard for spotting.

+1 , thanks @benjamb

Are you ok with this @wolfv ? :smiley:


Horizontal scrollbar position stays locked to bottom of chat window

The horizontal scrollbar position in the chat window stays locked to the bottom of the chat window. When scrolling the window up, the scrollbar disappears off the page and is no longer accessible when reviewing long chats.

Copilot Chat Extension Version: 0.20.1
VS Code Version: 1.93.1
OS Version: Windows 10 Pro, build 19045.3930

Which horizontal scrollbar, can you share a screenshot?

From the chat window on the left hand side. The code response was several hundred lines. Scrolling up results in the horizontal bar "sticking" to the bottom of the window rather than staying on screen:

Oh, on a codeblock editor, I see

We might do something anyway to make tall codeblocks easier to handle


Problems with EFI system after bootc install to-existing-root

So I have been playing with bootc and wanted to try it on a vserver. Sadly I couldn't install it "easily" since all the live cds ran out of storage space when pulling the container image. So I partitioned the existing disk and used part of it as storage for /var/lib/containers/storage:
root@grml ~ # gdisk -l /dev/vda
Number  Start (sector)    End (sector)  Size       Code  Name
   1            2048         1050623   512.0 MiB   EF00  EFI-SYSTEM
   2         1050624       210765823   100.0 GiB   8300  root
   3       210765824       252708863   20.0 GiB    8300  Linux filesystem # used for the storage

I installed the system like this:
podman run -it -v /target:/target --rm --tmpfs=/tmp --tmpfs=/var/tmp --privileged --pid=host -v /dev:/dev -v /var/lib/containers:/var/lib/containers -v /data:/data --security-opt label=type:unconfined_t registry.gitlab.com/rocketduck/os bootc install to-existing-root /target

The tmpfs mounts where necessary otherwise bootc would complain about something similar to https://github.com/containers/bootc/issues/95 (in my case it was /var/tmp though). The live system in question is a grml (https://grml.org/).
The install finished successfully:
Installing image: docker://registry.gitlab.com/rocketduck/os:latest
Digest: sha256:51e7ff2195e0bd399ede84b555bff4e57b3b94e3b1ffa1a257b2a63ece0013e8
Initializing ostree layout
layers already present: 0; layers needed: 72 (821.7 MB)
Fetched layers: 783.64 MiB in 2 minutes (6.59 MiB/s)                                                                                Deploying container image: done (59 seconds)                                                                                Injected: etc/tmpfiles.d/bootc-root-ssh.conf
Running bootupctl to install bootloader
> bootupctl backend install --write-uuid --update-firmware --auto --device /dev/vda /target
BootCurrent: 0002
Timeout: 3 seconds
BootOrder: 000A,0002,0003,0004,0005,0006,0007,0000,0001,0008
Boot0000* UiApp	FvVol(64074afe-340a-4be6-94ba-91b5b4d0f71e)/FvFile(462caa21-7614-4503-836e-8ab6f4662331)
Boot0001* UEFI Misc Device	VenHw(93e34c7e-b50e-11df-9223-2443dfd72085,00){auto_created_boot_option}
Boot0002* UEFI QEMU QEMU CD-ROM 	PciRoot(0x0)/Pci(0x2,0x4)/Pci(0x0,0x0)/SCSI(0,0){auto_created_boot_option}
Boot0003* UEFI Misc Device 2	PciRoot(0x0)/Pci(0x2,0x6)/Pci(0x0,0x0){auto_created_boot_option}
Boot0004* UEFI PXEv4 (MAC:8A705ACDC799)	PciRoot(0x0)/Pci(0x2,0x5)/Pci(0x0,0x0)/MAC(8a705acdc799,1)/IPv4(<IP_ADDRESS>,0,DHCP,<IP_ADDRESS>,<IP_ADDRESS>,<IP_ADDRESS>){auto_created_boot_option}
Boot0005* UEFI PXEv6 (MAC:8A705ACDC799)	PciRoot(0x0)/Pci(0x2,0x5)/Pci(0x0,0x0)/MAC(8a705acdc799,1)/IPv6([::],0,Static,[::],[::],64){auto_created_boot_option}
Boot0006* UEFI HTTPv4 (MAC:8A705ACDC799)	PciRoot(0x0)/Pci(0x2,0x5)/Pci(0x0,0x0)/MAC(8a705acdc799,1)/IPv4(<IP_ADDRESS>,0,DHCP,<IP_ADDRESS>,<IP_ADDRESS>,<IP_ADDRESS>)/Uri(){auto_created_boot_option}
Boot0007* UEFI HTTPv6 (MAC:8A705ACDC799)	PciRoot(0x0)/Pci(0x2,0x5)/Pci(0x0,0x0)/MAC(8a705acdc799,1)/IPv6([::],0,Static,[::],[::],64)/Uri(){auto_created_boot_option}
Boot0008* EFI Internal Shell	FvVol(64074afe-340a-4be6-94ba-91b5b4d0f71e)/FvFile(7c04a583-9e3e-4f1c-ad65-e05268d0b4d1)
Boot000A* Fedora
	HD(1,GPT,66b7cab1-ebf9-43e7-a035-14bfcceb8237,0x800,0x100000)/\EFI\fedora\shimaa64.efi
Installed: grub.cfg
Installation complete!

Upon reboot I see grub loading the shim and not doing anything else. I don't have any idea which other information to provide, but I'll add what I think could be useful:
root@grml ~ # ls -lisa /dev/disk/by-partlabel /dev/disk/by-label /dev/disk/by-uuid
/dev/disk/by-label:
total 0
246 0 drwxr-xr-x  2 root root 120 Dec 27 14:18  .
223 0 drwxr-xr-x 11 root root 220 Dec 27 14:18  ..
272 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18  EFI-SYSTEM -> ../../vda1
282 0 lrwxrwxrwx  1 root root   9 Dec 27 14:18 'grml-full-arm64\x202024.12' -> ../../sr0
247 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18  podman -> ../../vda3
252 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18  root -> ../../vda2

/dev/disk/by-partlabel:
total 0
232 0 drwxr-xr-x  2 root root 100 Dec 27 14:18  .
223 0 drwxr-xr-x 11 root root 220 Dec 27 14:18  ..
254 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18  EFI-SYSTEM -> ../../vda1
266 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18 'Linux\x20filesystem' -> ../../vda3
233 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18  root -> ../../vda2

/dev/disk/by-uuid:
total 0
230 0 drwxr-xr-x  2 root root 120 Dec 27 14:18 .
223 0 drwxr-xr-x 11 root root 220 Dec 27 14:18 ..
231 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18 9d85530f-92b7-4356-8e62-5717db01a235 -> ../../vda2
283 0 lrwxrwxrwx  1 root root   9 Dec 27 14:18 2024-12-19-13-49-23-00 -> ../../sr0
261 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18 E32A-ADB9 -> ../../vda1
257 0 lrwxrwxrwx  1 root root  10 Dec 27 14:18 b42a43b4-8c19-4a14-8866-4ce01e553a9c -> ../../vda3

The loader entries on the boot folder of the root partition look okay as far as I can tell:
root@grml /target/boot # cat loader.1/entries/ostree-1.conf
title Fedora Linux 41.20241226.0 (Forty One) (ostree:0)
version 1
options root=UUID=9d85530f-92b7-4356-8e62-5717db01a235 rw ostree=/ostree/boot.1/default/580504e8e331e296082c25853c92b6e5e69b51d42734b659452b26133d72478a/0
linux /boot/ostree/default-580504e8e331e296082c25853c92b6e5e69b51d42734b659452b26133d72478a/vmlinuz-6.12.6-200.fc41.aarch64
initrd /boot/ostree/default-580504e8e331e296082c25853c92b6e5e69b51d42734b659452b26133d72478a/initramfs-6.12.6-200.fc41.aarch64.img
abootcfg /ostree/deploy/default/deploy/77f561c776f6c6507558cf34cc4e829748d7c7d21625a05fcfeea599bde0bb29.0/usr/lib/ostree-boot/aboot.cfg
fdtdir /boot/ostree/default-580504e8e331e296082c25853c92b6e5e69b51d42734b659452b26133d72478a/dtb
aboot /ostree/deploy/default/deploy/77f561c776f6c6507558cf34cc4e829748d7c7d21625a05fcfeea599bde0bb29.0/usr/lib/ostree-boot/aboot.img

Efi looks okay as well:
root@grml /efi # ls *
bootupd-state.json

EFI:
BOOT  fedora

grub2:
bootuuid.cfg  grub.cfg

Not sure if the bootuuid should point to the efi partition:
root@grml /efi # cat grub2/bootuuid.cfg
set BOOT_UUID="E32A-ADB9"

I don't know enough about blscfg which (hopefully) gets executed by grub to tell where it is broken.

So I have managed to boot the machine by changing the BOOT_UUID in bootuuid.cfg to the UUID of the actual root partition and after a reboot executed configfile (hd0,gpt1)/grub2/grub.cfg which brought up the menu. Not sure yet why grub2 doesn't manage to execute that directly yet.
Btw while debugging I also noticed that the EFI partition needs to be labeled EFI-SYSTEM or EFI System Partition and mine was named EFI system partition initially which resulted in bootc not being able to run bootupd (https://github.com/coreos/bootupd/blob/04b905b5aa28f27f004fdc4364ce33536971dd5f/src/efi.rs#L39-L41). I didn't find anything in the docs pointing this out.

Another run with to-filesystem did work as intended (might have broken something with all those bind mounts :D). I am going to close this and deploy to the target system again -- will reopen in case I run into this again…


Problem with "flask run" command

Expected Behavior
Flask should execute the "flask run" command.
from flask import Flask
app = Flask(__name__)

@app.route("/")
def hello():
    return "Hello World!"

Actual Behavior
An error appears: "Fatal error in launcher:"
Environment

Python version: 3.8.2
Flask version: 1.1.2

https://www.google.com/search?client=firefox-b-d&q="Fatal+error+in+launcher"
Doesn't sound directly related to Flask...

The problem is that all of these solutions refer to Python's Pip. In these errors there is also a directory path after the colon. In my case there's no path.

So you get no traceback etc either? Please post what exactly you run in the shell and all the output.

I run "flask run" in cmd and I get "Fatal error in launcher:".

OK, so you:

did not mention that you are apprently on Windows
apparently did not set the FLASK_APP env var pointing to your app?

Oh, sorry, I did set the variable and yes, I am on Windows. The problem still occurs though.

What did you set it to?

To a flaskblog.py file. The content of it is in the first post.

I can't reproduce this issue. I created the sample file, did set FLASK_APP=flaskblog.py, and flask run ran as expected. It sounds like this is a problem with how your Python, pip, or virtualenv is installed or created.


Workaround babel-dts-generator limits

This creates a dummy class, RendererBase which simply extends Renderer. It provides a type declaration in a form that the babel-dts-generator will accept. This fixes the issure in #173, Ideally, an interface would be used.

Bah, I just realized this isn't going to solve the issue.


Fix packaging of resources and tests

Don't include tests in the binary (wheel) distribution.
Include tests in the source distribution.
Include only .json and .proto package resources.
Include a LICENSE with every package (extremely important for downstream packagers).

(From #3182)

Broken into multiple commits for the sake of review, but should be squashed during merge.
All "Fix * package" commits are identical, just targeting a different package.

This is still against master, as far as I can tell.

Sigh.


Version 3.5.2 does not play nice with the air3 haxelib. Forces use of openfl flash externs

I might be wrong about this, but it seems to me that the openfl.Lib.includeExterns() macro makes sure that the externs for the flash platform are the openFL since they are added as the final codepath for those namespaces.
Since the extern/flash/* externs do not contain the AIR only externs, builds that previously worked with the air3 haxelib now fail.
Would it be possible to include the AIR externs possibly with a @:require(flash_air)? If need be i'll do it as a pull request

Rather than relying upon the Haxe standard Flash extern types, we use our own types now to unify a number of small discrepancies between platforms (for example, SharedObjectFlushStatus should be an enum, not a string).
Perhaps there's a way we could merge AIR compatibility into our flash.* externs. The "air" package would still be needed, but this might fix any problems with the "flash" classes we define.

So where do we go from here? I can do a pull request with the air externs over the course of a week or two...

I'd also be keen to find a clean solution to this.
Currently I just have to add fields to the openfl externs (in flash.*).

I think we should use #if air (or similar) to add AIR-specific APIs in the externs, so it does not expose in normal use, but will be available for applications targeting Adobe AIR

This is resolved in the newest release, with proper Adobe AIR support added to Lime :smile:


treating header host as a block element, removing need for a

Just removing a redundant element. @jeroach, by default :host elements are inline-block, so if you want them to be anything other than that you need to specify it. In this case, we want the header to be a block element like a <div>.

Thanks for letting me know Dave!


use Mod:revert_ordering_on_local_key in {get,delete}_data for DESC keys

Depends on https://github.com/basho/riak_ql/pull/162.
Single-key primitive operations in riak_kv_ts_api need to provide to riak_client:get and :delete keys adjusted for fields declared DESC in the DDL, as is done for list_keys in https://github.com/basho/riak_kv/blob/riak_ts-develop/src/riak_kv_qry_worker.erl#L190.
This fixes regressions currently seen in ts_simple_single_key_ops (and possibly others).

thumbot retry

thumbot retry

:+1:

@thumbot retry

+1


distance_sensor tfmini can't work

Describe the bug
FW version 1.10.1 work good
in master , tf mini can't get the data from MAVLINK, no distance sensor

and listener the distance_sensor

the current_distance in topic can't change any more if you move the distance sensor

My TFMiNi can work well.
To reproduce:

take a newly flashed Pixhawk4 board with PX4 1.10.0 stable
Plug TFMiNi LIDAR to Serial 4 port (UART &I2CB)
Connect the board to USB
Launch QGC, set SENS_TFMINI_CFG to 'TELEM/SERIAL 4 ', and set EKF2_HGT_MODE to 'Range sensor',finaly reboot the board.
Open analyze widget, the distance sensor variable will be present.

hopefully it helped you!

My TFMiNi can work well.
To reproduce:

take a newly flashed Pixhawk4 board with PX4 1.10.0 stable
Plug TFMiNi LIDAR to Serial 4 port (UART &I2CB)
Connect the board to USB
Launch QGC, set SENS_TFMINI_CFG to 'TELEM/SERIAL 4 ', and set EKF2_HGT_MODE to 'Range sensor',finaly reboot the board.
Open analyze widget, the distance sensor variable will be present.

hopefully it helped you!

yes, the stable version is OK(include v1.10.1), but the develop versin in master can't work.

This should be fixed in https://github.com/PX4/Firmware/pull/14423. @jinchengde can you test master again?

@bkueng it works

Thanks for testing. Closing this.


standalone version can't be added to homekit

Hey just found this and tried to add it into my homekit/homebridge setup. Sadly i cant get it to add into homekit/homebridge. it always fails with the same err on homekit side that i cant connect to the accessory (firewall ?). Any help would be nice
greetz

found the problem<EMAIL_ADDRESS>updated manually to<EMAIL_ADDRESS>and it added
but i get a no response message on homekit for the camera


Examples link not working properly

When you click the examples link in the README, it does not go anywhere.  When you copy and paste the URL address, it goes to the top of the AMPL page.   If I remember correctly, there were the examples of AMPL application folders before.  Thanks.

Fixed in https://github.com/ATOMScience-org/AMPL/pull/271


EXPERIMENTAL ONLY!

@sunnysideup if you need to test if the tests are passing, you can do it in your fork and create PRs there. Once that is all working, you can raise a PR against the core repository with the changes. That way we can remove some 'public' noise.

oops sorry, yes - will do!

Been there, done that — just passing the knowledge further :-D


Improve how collapsed state is saved for space views, containers, and DataResults in the Blueprint Tree UI

Currently, the collapsed state of any item in the blueprint tree is stored in egui's short-term cache. This has several limitations:

The cache is indexed by widget IDs which are unstable (at least by default). This means that any external change leading to a change in ID (e.g. the item is moved elsewhere in the hierarchy) invalidates the cache, leading to the collapsedness to potentially change. This happens when drag-and-dropping space view across containers.
It's currently difficult to externally control the current collapsed-ness state

Solving (2) is needed at least for:

uncollapsing the hierarchy when focusing on items: https://github.com/rerun-io/rerun/issues/5232
dynamically uncollapse during drag-and-drop operations
wide-ranging collapse/uncollapse context menu actions ("Collapse all"/"Expand all")

Possible approaches:

Make widget ID predictable/stable (e.g. by deriving them from space view id, etc.).

How about DataResults?
Is there a public egui API to edit the collapsedness of a given widget ID?

Take over egui and handle the collapsedness state on rerun side.

Using a Collapsed component?
Or using a short-lived ad hoc cache HashMap<re_viewer_context::Item, bool>?

@emilk @jleibs I'm curious about your take on how to approach this one.

We decided to go for a CollapsedId helper enum to make egui id's stable:
enum CollapsedId {
    Container(ContainerId),
    SpaceView(SpaceViewId),
    DataResult(/* ??? */),  // blueprint tree only
    Entity(EntityPath), // streams tree only
    // others?
    // e.g. ProjectedHeader(SpaceViewId) if we make this collapsible
}

impl From<CollapsedId> for egui::Id {
    /* ... */
}

If we want to persist collapsedness for some/all of these, we'll add some egui's cache <-> blueprint store synchronisation code.


Fix #3922: Fix all the heuristic properties of Charsets.

Decoder.averageCharsPerByte()
Decoder.maxCharsPerByte()
Encoder.averageBytesPerChar()
Encoder.maxBytesPerChar()

Hum, what is happening to Jenkins?

It's got zillions of jobs in its queue, and all its nodes are marked (offline) :s I'm going to check with Fabien.

It's back online.


Remove Shove session storage support

The Shove project is dead now.
https://github.com/lcrees/shove

Codecov Report

Merging #572 into master will increase coverage by 0.10%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master     #572      +/-   ##
==========================================
+ Coverage   71.24%   71.35%   +0.10%
==========================================
  Files          80       79       -1
  Lines        3092     3051      -41
==========================================
- Hits         2203     2177      -26
+ Misses        889      874      -15

Flag
Coverage Δ

#unittests
71.35% <100.00%> (+0.10%)
:arrow_up:

Impacted Files
Coverage Δ

wechatpy/client/base.py
82.90% <ø> (-1.23%)
:arrow_down:

wechatpy/component.py
71.30% <100.00%> (+1.97%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 29a49d8...1b6af57. Read the comment docs.


addUIBlock not working in New Architecture.

Description
When I enable fabric and turbomodule, addUIBlock seems not working because the callback will never be called:
UIManagerModule uiManager = context.getNativeModule(UIManagerModule.class);
        uiManager.addUIBlock(new UIBlock() {
            @Override
            public void execute(NativeViewHierarchyManager nativeViewHierarchyManager) {
                HMapView hMapView;
                try {
                    hMapView = (HMapView) nativeViewHierarchyManager.resolveView(viewTag);
                } catch (Exception e) {
                    QLog.e(e);
                    hMapView = null;
                }
                if(hMapView != null){
                    WritableNativeMap map = hMapView.getLocationParams();
                    callback.invoke(map);
                }
            }
        });

If I understand the new architecture right, uiManager is not get used when fabric is enabled, but the JSIModule.  But I didn't find functions which act the same with addUIBlock.
So what is the solution when I want to use addUIBlock when fabric is on?
Version
0.68.1
Output of npx react-native info
System:
OS: macOS 11.6.1
CPU: (12) x64 Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz
Memory: 139.06 MB / 16.00 GB
Shell: 5.8 - /bin/zsh
Binaries:
Node: 14.19.3 - ~/.nvm/versions/node/v14.19.3/bin/node
Yarn: 1.22.10 - /usr/local/bin/yarn
npm: 6.14.17 - ~/.nvm/versions/node/v14.19.3/bin/npm
Watchman: 2<IP_ADDRESS> - /usr/local/bin/watchman
Managers:
CocoaPods: 1.10.1 - /usr/local/bin/pod
SDKs:
iOS SDK:
Platforms: DriverKit 21.0.1, iOS 15.0, macOS 12.0, tvOS 15.0, watchOS 8.0
Android SDK:
Android NDK: 21.1.6352462
IDEs:
Android Studio: 2021.2 AI-212.5712.43.2112.8609683
Xcode: 13.1/13A1030d - /usr/bin/xcodebuild
Languages:
Java: 11.0.15 - /usr/bin/javac
npmPackages:
@react-native-community/cli: Not Found
react: Not Found
react-native: 0.68.1 => 0.68.1
react-native-macos: Not Found
npmGlobalPackages:
react-native: Not Found
info React Native v0.70.1 is now available (your project is running on v0.68.1).
info Changelog: https://github.com/facebook/react-native/releases/tag/v0.70.1.
info Diff: https://react-native-community.github.io/upgrade-helper/?from=0.68.1.
info To upgrade, run "react-native upgrade".
Steps to reproduce
None.
Snack, code example, screenshot, or link to a repository
UIManagerModule uiManager = context.getNativeModule(UIManagerModule.class);
        uiManager.addUIBlock(new UIBlock() {
            @Override
            public void execute(NativeViewHierarchyManager nativeViewHierarchyManager) {
                Log.i(TAG, "it works");
            }
        });

when fabric is on.

Hey @psionic12
Can I ask you to post this question inside the Working Group:
https://github.com/reactwg/react-native-new-architecture
If you don't have access, please request it via the form in the README
As a rule of thumb, questions should be posted there as we're tracking them more closely and they form a knowledge base that we'll use to expand our official docs.
We can totally answer on Github issues, but the information is easily lost 👍 Thank you.

Hi @psionic12, I'm having the same problem... How did you solve it ?

I posted this question to the New Arch WG forum here:
https://github.com/reactwg/react-native-new-architecture/discussions/148

I, too, am having the same problem. Is there a good solution?

react-native-view-shot doesn't working in the new architecture because of this addUIBlock as well

What is the alternate for addUIBlock in Fabric in react native. As addUIBlock is not working

Hello everyone, I am also facing the same problem. Do you have any alternative solutions to solve it?

react-native-view-shot doesn't work in the new architecture because of this addUIBlock as well

did you find a solution to this problem? I'm also facing the same situation, react-native-view-shot is not working on android because of this

Yes, that's correct for New Arch UIManagerModule.addUIBlock() returns null on Bridgeless.
The replacement API added for Backwards Compatibility in Bridgeless is
https://github.com/facebook/react-native/blob/2483c63017b0d47c377bf67cb7c597e2d7e57897/packages/react-native/ReactAndroid/src/main/java/com/facebook/react/fabric/FabricUIManager.java#L104
Sample fix PRs : https://github.com/expo/expo/pull/29500 https://github.com/react-native-maps/react-native-maps/pull/5061

Yes, that's correct for New Arch UIManagerModule.addUIBlock() returns null on Bridgeless.
The replacement API added for Backwards Compatibility in Bridgeless is
https://github.com/facebook/react-native/blob/2483c63017b0d47c377bf67cb7c597e2d7e57897/packages/react-native/ReactAndroid/src/main/java/com/facebook/react/fabric/FabricUIManager.java#L104
Sample fix PRs : https://github.com/expo/expo/pull/29500 https://github.com/react-native-maps/react-native-maps/pull/5061

Can you help me use addUIBlock on the new architecture without bridgeless mode? Only fabric component


Link to latest (0.23) download is broken

Hi,
I'm triing to download the latest version using the link at the README.md file and doesn't work
http://maven.torodb.com/jar/com/torodb/torodb/0.23/torodb.jar
Regards,
zarmack

On 13/11/15 11:17, Zarmack Tanen wrote:

Hi,
I'm triing to download the latest version using the link at the
README.md file and doesn't work
http://maven.torodb.com/jar/com/torodb/torodb/0.23/torodb.jar
Regards,
zarmack

 Hey, thanks for the warning. Fixed. You should be able to download

and test it now. Sorry for the inconvenience!
 Cheers,

 Álvaro

--
Álvaro Hernández Tortosa

8Kdata


Cannot continue, was unable to download one or more archives

What happened?
@zhongjiedong
after looking into #118  i ran into this error Cannot continue, was unable to download one or more archives the log is attached
Wabbajack.current.log
Modlist version
1.1.74

you're downloading some old af version, get the latest one


feat: componentize-system_error_monitor

Description

This PR allows this node to be built as a rclcpp component.
System_error_monitor node can be executed from a customized rclcpp component.
Tests performed

Confirmed that this node was executed from a customized rclcpp component ( which included glog ).
Not applicable.
Effects on system behavior

Not applicable.
Interface changes

Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

@TetsuKawa Please remove src/system_error_monitor_node.cpp and use the following codes in src/system_error_monitor_core.cpp.
#include <rclcpp_components/register_node_macro.hpp>
RCLCPP_COMPONENTS_REGISTER_NODE(AutowareErrorMonitor)

Fixed in https://github.com/autowarefoundation/autoware.universe/pull/7009/commits/0e5c2df10157b0058d7022911e996757dbc526fd.

@ito-san @esteve
So sorry for the late reply.
Thanks for your comment.

@TetsuKawa Please remove src/system_error_monitor_node.cpp and use the following codes in src/system_error_monitor_core.cpp.
#include <rclcpp_components/register_node_macro.hpp>
RCLCPP_COMPONENTS_REGISTER_NODE(AutowareErrorMonitor)

and

You can use ament_auto_add_library(${PROJECT_NAME}component SHARED here so that when we prefix packages with autoware, this code won't need to be updated.

were fixed in 0e5c2df.
Reference:https://autowarefoundation.github.io/autoware-documentation/main/contributing/coding-guidelines/ros-nodes/directory-structure/#exporting-a-composable-node-component-executables


Current nvs_get_blob() based NVS access can't read NVS partition created with IDF nvs_partition_gen.py

I use the IDF nvs_partition_gen.py tool to generate the nvs partition content using the following definition file:
key,type,encoding,value
certificates,namespace,,
ca_cert,file,string,../../certificates/aws-iot-rootCA.crt
cert,file,string,../../certificates/cert.pem
priv_key,file,string,../../certificates/privkey.pem
device_data,namespace,,
device_id,data,string,XXXXX-YYY-ZZZZZ

When checking access to the data using EspCustomNvs::contains() none of the keys are found. When replacing in EspNvs::len() nvs_get_blob()  with nvs_get_str() the keys are found. While the IDF documentation states that both functions have a identical behavior except that they return different data types, there seems to be a difference.
I would propose to add additional functions which use nvs_get_str() / nvs_set_str() for handling access to string based key/value pairs. I'm open to create a PR to resolve the issue.

The current ESP Nvs Storage implementation uses a serde scheme which is slightly incompatible with the ESP IDF way of (de)serializing things. Basically, it encodes raw data always as a BLOB, if the data is longer than 7 bytes, and as u64 if the data is shorter or equal to 7 bytes. And then n top of this raw data persistence scheme you can layer your own Rust serde. If you want to interface with keys written by ESP IDF C code, or by the nvs partition Gen tool, you need an additional API - exposed directly on the EspNvs structure I guess, that can read/write by calling ESP IDF nvs_get_str, nvs_get_i8 and so on - separate getter/setter for each ESP NVS C type.

Thanks for the detailed explanation. Yes I concluded already that the serde serialization doesn't work together with the nvs partition gen tool. I've implemented nvs_get_str() / nvs_set_str() in directly in esp-idf-svc to enable a more ESP IDF C and toolchain compatible Nvs Storage access. My question would be, does it makes sense (I think it makes sense, otherwise we need to have a Rust based Nvs partition creation tool - maybe at some point ..) to add these two additional non-serde based functions into esp-idf-svc to ease handling of Nvs in case of C / ESP IDF tooling?

It does, but I would really appreciate if you add a few more as well. As in - for integers, bools etc. This way we can get feature parity with the native NVS API.

I'm fine with this - plan a PR for next week. I'm assuming we will have two fn for every type get & set explicit for each type and not a generics based solution with something like TypeId::of::<i8> == TypeId::of::as this would create a dependency tostd``` - correct?

I'm fine with this - plan a PR for next week. I'm assuming we will have two fn for every type get & set explicit for each type and not a generics based solution with something like TypeId::of::<i8> == TypeId::of::<T> as this would create a dependency to std - correct?

TypeId is available in core so using it will not bring a dependency on std. It is more about what is more ergonomic:

(1) A bunch of get_XXX / set_XXX methods, which cannot panic
(2) A single get / set pair of methods, which inspects TypeId and unsafely transmutes &T. And panics when T is not one of the supported types

I think I'm in favor of (1).

Hey folks, sorry I'm new to Rust so disregard if my idea doesn't make sense.
Could we have two traits (e.g NvsGetter and NvsSetter) that are only defined for the types that are natively supported by idf API (u8, i16, u16, i32, u32, i64, u64) and maybe a custom API for String (that takes a buffer)? We could use a macro to generate the getter / setter impl.
We could also redefine get_raw / set_raw directly in the NvsPartitionId impl for EspNvs, leveraging the getter/setters defined above, so that it doesn't mix Nvs and Storage abstraction.

Hey folks, sorry I'm new to Rust so disregard if my idea doesn't make sense.
Could we have two traits (e.g NvsGetter and NvsSetter) that are only defined for the types that are natively supported by idf API (u8, i16, u16, i32, u32, i64, u64) and maybe a custom API for String (that takes a buffer)? We could use a macro to generate the getter / setter impl and we would have a single get / set pair methods.
Example gist (didn't try it out yet)

Also a possibility, but the custom API for blob / &[u8] (that you missed) as well as the one for &str is kind of ruining it, so not sure if worth it.

We could also redefine get_raw / set_raw directly in the NvsPartitionId impl for EspNvs, leveraging the getter/setter defined above, so that it doesn't mix Nvs and Storage abstraction.

That would be difficult, but maybe possible. Let's start simple, with the get_XXX / set_XXX approach.


FFM-5111 - Java SDK - Polls non stop if /stream endpoint returns 5xx error

FFM-5111 - Java SDK - Polls non stop if /stream endpoint returns 5xx error
What
If a /stream endpoint returns a 501 HTTP error code (unimplemented) then the SSE library attempts reconnect endlessly
Why
The code is assuming 501 is a transient http error - so keeps retrying it rather than backing off for good
Testing
Added new mock web server dispatcher to mimic a 501 response when /stream is connected to. New assertion were added to ensure SDK doesn't attempt to reconnect once when a 501 is returned.

Codecov Report
Base: 57.86% // Head: 56.77% // Decreases project coverage by -1.08% :warning:

Coverage data is based on head (abcf3b7) compared to base (9b6cd85).
Patch coverage: 60.00% of modified lines in pull request are covered.

Additional details and impacted files
@@             Coverage Diff              @@
##               main     #132      +/-   ##
============================================
- Coverage     57.86%   56.77%   -1.09%
+ Complexity      330      326       -4
============================================
  Files            29       29
  Lines          1628     1631       +3
  Branches        183      182       -1
============================================
- Hits            942      926      -16
- Misses          547      565      +18
- Partials        139      140       +1

Impacted Files
Coverage Δ

...va/io/harness/cf/client/connector/EventSource.java
84.21% <33.33%> (+0.42%)
:arrow_up:

...ain/java/io/harness/cf/client/api/InnerClient.java
61.53% <100.00%> (-3.92%)
:arrow_down:

.../harness/cf/client/connector/RetryInterceptor.java
40.00% <0.00%> (-26.67%)
:arrow_down:

...ava/io/harness/cf/client/api/PollingProcessor.java
72.46% <0.00%> (-2.90%)
:arrow_down:

.../harness/cf/client/connector/HarnessConnector.java
61.39% <0.00%> (-1.87%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Fix clippy warnings.

This PR fixes the clippy warnings produced when running cargo clippy.
Most of the fixes were done with cargo clippy --fix. 😄

@Aimeedeer, FYI: I rebased after the merge conflicts. Let me know if you have concerns/thoughts!

Thanks for the PR! I don't particularly like every clippy suggestion, and I didn't take the changes in import.rs.


bgfx update for vertex layout leak fix

fix is in bgfx.
An update is in progress in babylon native.

1st issue found on Android.
Thanks to this change : https://github.com/bkaradzic/bgfx/commit/9d369ab4a09c7d3523d69e7cf1bcef7c627a51ae#diff-a1a0473b3338942652dfe4319075a1e5ce1f594b3f2b4fdbdfd2a50a3298738a
MSAA is now detected on opengles 3.0 device (that means MSAA was not active before that change) but, on my device and I guess on others, glRenderbufferStorageMultisample is unimplemented :
com.android.babylonnative.playground E/libEGL: called unimplemented OpenGL ES API
resulting in incomplete framebuffer and an assert in bgfx.
The extension is properly detected but I didn't find any way to check for valid implementation. The function is said to be present for any opengl es 3.0 compliant device.
I see no other choice than disabling MSAA for Android devices. No performance or visual difference but yet another #ifdef in the code.
@bghgary @ryantrem

Sounds like there is no regression in behavior, so seems ok to me. Maybe worth having another issue to track MSAA on Android though? Maybe there is some solution if we investigate more in the future?

MSAA + Android issue : https://github.com/BabylonJS/BabylonNative/issues/507

After more investigation, I've found SPIRV latest version breaks texture/sampler assignment for Metal. Glslang update works fine (so far) but we will have to take extra cares when updating SPIRV.


Refersh and Fix Recipe

Checklist

[x] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[x] Ensured the license file is being packaged.

https://github.com/conda-forge/dlt-feedstock/pull/12

import: 'dlt'
+ pip check
dlt 0.5.2 has requirement pathvalidate>=2.5.2, but you have pathvalidate 0.0.0.

@conda-forge-admin, please rerender

@basnijholt - could you review and merge, dependent feedstocks - are not picking up the version. Please see description of PR for details. I'm thinking a rebuild (refreshed recipe with minor tweaks by leveraging grayskull) might fix the issue.
Thank you and Regards.


istio-cni fails to update when using the IstioOperator and going from 1.9 to 1.11

We use the Istio Operator to deploy Istio to all of our clusters via Gitops/Flux. Upon updating our IstioOperator object from 1.9.6 to 1.11.2, everything seemed to go smoothly until we realized the cni didn't update. Inspecting the istio-operator logs, we see this:
2021-09-10T18:45:09.744221Z	info	installer	The following objects differ between generated manifest and cache:
 - DaemonSet:kube-system:istio-cni-node
2021-09-10T18:45:09.744438Z	info	installer	using server side apply to update obj: DaemonSet/kube-system/istio-cni-node
- Pruning removed resources
2021-09-10T18:45:09.823705Z	error	installer	failed to update resource with server-side apply for obj DaemonSet/kube-system/istio-cni-node: DaemonSet.apps "istio-cni-node" is invalid: spec.template.spec.containers[1].image: Required value
2021-09-10T18:45:09.824877Z	info	installer	Generated manifest objects are the same as cached for component IngressGateways.
✘ CNI encountered an error: failed to update resource with server-side apply for obj DaemonSet/kube-system/istio-cni-node: DaemonSet.apps "istio-cni-node" is invalid: spec.template.spec.containers[1].image: Required value

This is our IstioOperator YAML:
apiVersion: install.istio.io/v1alpha1
kind: IstioOperator
metadata:
  namespace: istio-system
  name: istio-controlplane
spec:
  hub: gcr.io/istio-release
  tag: 1.11.2
  meshConfig:
    accessLogFile: /dev/stdout
    rootNamespace: istio-config
    outboundTrafficPolicy:
      mode: REGISTRY_ONLY
    enableAutoMtls: true
    defaultConfig:
      extraStatTags:
      - jwt_client_name
      proxyMetadata:
        ISTIO_META_DNS_CAPTURE: "true"
        ISTIO_META_DNS_AUTO_ALLOCATE: "true"
  components:
    base:
      enabled: true
    cni:
      enabled: true
      namespace: kube-system
    pilot:
      enabled: true
      k8s:
        hpaSpec:
          minReplicas: 3
          maxReplicas: 12
          metrics:
          - resource:
              name: cpu
              targetAverageUtilization: 80
            type: Resource
          scaleTargetRef:
            apiVersion: apps/v1
            kind: Deployment
            name: istiod
        resources:
          requests:
            cpu: 250m
            memory: 512Mi
        podDisruptionBudget:
          minAvailable: 2
        strategy:
          rollingUpdate:
            maxSurge: 100%
            maxUnavailable: 25%
    ingressGateways:
    - enabled: true
      k8s:
        env:
        - name: ISTIO_META_ROUTER_MODE
          value: standard
        hpaSpec:
          minReplicas: 3
          maxReplicas: 12
          metrics:
          - resource:
              name: cpu
              targetAverageUtilization: 80
            type: Resource
          scaleTargetRef:
            apiVersion: apps/v1
            kind: Deployment
            name: istio-ingressgateway
        service:
          type: NodePort
          ports:
          - name: status-port
            port: 15021
            targetPort: 15021
            nodePort: 31370
          - name: http2
            port: 80
            targetPort: 8080
            nodePort: 31380
          - name: https
            port: 443
            targetPort: 8443
          - name: tls
            port: 15443
            targetPort: 15443
        strategy:
          rollingUpdate:
            maxSurge: 100%
            maxUnavailable: 25%
        resources:
          limits:
            cpu: 1000m
            memory: 1024Mi
          requests:
            cpu: 250m
            memory: 128Mi
        affinity:
          podAntiAffinity:
            preferredDuringSchedulingIgnoredDuringExecution:
            - podAffinityTerm:
                labelSelector:
                  matchExpressions:
                  - key: app
                    operator: In
                    values:
                    - istio-ingressgateway
                topologyKey: kubernetes.io/hostname
              weight: 100
      name: istio-ingressgateway
  values:
    global:
      configRootNamespace: istio-config
      proxy_init:
        resources:
          limits:
            cpu: 500m
            memory: 128Mi
          requests:
            cpu: 10m
            memory: 10Mi
      proxy:
        holdApplicationUntilProxyStarts: true
        resources:
          limits:
            cpu: 500m
            memory: 256Mi
          requests:
            cpu: 50m
            memory: 64Mi
    sidecarInjectorWebhook:
      enableNamespacesByDefault: false
      objectSelector:
        autoInject: true
        enabled: false
      rewriteAppHTTPProbe: true

I found this issue which describes the same thing and a workaround; delete the istio-cni daemonset and redeploy the operator. That being said, we have hundreds of clusters and doing that in production seems scary :)
https://www.gitmemory.com/issue/istio/istio/34795/903325505
Anyone see this before?

cc @richardwxn


More details on agent security (endpoint verification)?

I miss a bit more information about how the Agent securely connects to the endpoint. Does it verify that it actually connects to the correct endpoint or does it only check that the certificate chain is correct? Also is there mutual verification, e.g. does the Azure endpoint verify that the agent is actually the correct agent?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: f3c90181-0889-2bae-be2e-97fdccb509f6
Version Independent ID: 76aa348b-f072-fa5f-4403-5fb83d4ee2a2
Content: Connected Machine agent network requirements - Azure Arc
Content Source: articles/azure-arc/servers/network-requirements.md
Service: azure-arc
Sub-service: azure-arc-servers
GitHub Login: @johnmarco
Microsoft Alias: johnmarc

Thanks for the feedback! We are currently investigating and will update you shortly.

@bk147, I have assigned the issue to the content author to investigate further and update the document as appropriate.

Hello @bk147. Thank you for this suggestion, and apologies for the long delay in replying to it. Given our time and resource constraints we've not yet had a chance to address this issue. So for now I've created a backlog ticket to look into it at a future date. I'm now going to close this issue.

#please-close


Adding find package for hsa-runtime64, hsakmt, hip, rocm_smi, hiprand & rocrand

Adding find package for hsa-runtime64, hsakmt, hip, rocm_smi, hiprand & rocrand.
Updated cmake for the tests with the include and library path variables.

Built, generated, package, installed successfully and ran the tests in Centos8 with MI50 environment.
Attached the console log -> RVS_PR-854-test.txt
Please review and approve.


add wmt14 and sampler

Description
add wmt14 and sampler
Checklist
Essentials

[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage
[x] Code is well-documented

Changes

[x] WMT14 and tests
[x] FixedSampler update to use average bucket length

Job PR-135/5 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-135/5/index.html

Job PR-135/6 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-135/6/index.html

Job PR-135/9 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-135/9/index.html