fix: try-recover types erased success state

Current dependencies on/for this PR:

main

PR #94   👈

This comment was auto-generated by Graphite.


[Update] Fix baseURI extraction logic and refactor lazy mint form

#4447  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @jnsdls and the rest of your teammates on  Graphite


[Docs] Updated the GitHub- Get Started resource in the ReadMe File.

Category

[ ] Resource Addition
[x] Documentation
[ ] Codebase
[ ] User Interface
[ ] Feature Addition

Description
Updated the GitHub - Get Started resource to the Learn Git and GitHub section in the ReadMe file.
Before:

After :

Good one, @Vignesh025. I'm assigning this to you.


Documentation of field-selector

Adding field-selector command: Which will print the possible options for field-selector parameter, similar to api-versions command (or maybe subcommand of it).
Why is this needed: Currently this information isn't publicly available documentation contains only:
Supported field selectors vary by Kubernetes resource type. All resource types support the metadata.name and metadata.namespace fields. Using unsupported field selectors produces an error.

Unfortunately, kubectl does not have access to the field selectors, so there is no way to do this in a maintainable way.
/close


Fix README.md typo

What this PR does / why we need it:
Fix a typo in the Table of Content for Beta Environment
Other note : the "Contact" entry of the ToC is unused :(

coverage: 97.737% (+0.06%) from 97.682%
when pulling 9cfe38a1f8718f33dcc1c23158516bdcf128445a on DS-INRA:patch-1
into 91b2db6931992033cfd7886cfe5335932a1edff2 on IQSS:develop.


Bonfire: DNA Pairing Bug

Challenge Bonfire: DNA Pairing has an issue.
User Agent is: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:43.0) Gecko/20100101 Firefox/43.0.
Please describe how to reproduce this issue, and include links to screenshots if possible.
This code should function correctly, I am placing the smaller arrays at index positions in the larger array. The printout of the code puts all the characters in 1 sequential array when this isn't the case.
The final array is correct, but clicking the run button to finish the project doesn't.
I have tried both .push and [i] to append these arrays but running the code doesn't work.
My code:
function pair(str) {
  var pairArr = [];

  for(var i = 0; i < str.length; i++){
    var smallerArr = [];

    if(str.charAt(i) === 'G'){
      smallerArr.push(['G', 'C']);
    }

    else if(str.charAt(i) === 'C'){
      smallerArr.push(['C', 'G']);
    }

    else if(str.charAt(i) === 'A'){
      smallerArr.push(['A', 'T']);
    }

    else if(str.charAt(i) === 'T'){
      smallerArr.push(['T', 'A']);
    }

    pairArr[i] = smallerArr;
  }
  console.log("TESTING " + pairArr);
  return pairArr;
}

pair("ATCGA");

The FCC code output doesn't display brackets for arrays currently as referenced in https://github.com/FreeCodeCamp/FreeCodeCamp/issues/5097.
However as long as the true output is correct you should be able to pass the tests.
Your code output is:
[[["A", "T"]], [["T", "A"]], [["C", "G"]], [["G", "C"]], [["A", "T"]]]

and the expected result is:
 [["A","T"],["T","A"],["C","G"],["G","C"],["A","T"]]

@sludge256 is correct. Thanks and happy coding!


Cannot create backup

My URL connection is: jdbc:sqlite:database.db
My tried backup commands:

backup to \"d:/temp/backup-sqlite.db\"
backup database.db to \"d:/temp/backup-sqlite.db\"
backup \"database.db\" to \"d:/temp/backup-sqlite.db\"
backup database to \"d:/temp/backup-sqlite.db\"

All of them returns error:
Caused by: org.sqlite.SQLiteException: [SQLITE_ERROR] SQL error or missing database (near "backup": syntax error)
	at org.sqlite.core.DB.newSQLException(DB.java:1010) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.DB.newSQLException(DB.java:1022) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.DB.throwex(DB.java:987) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.NativeDB.prepare_utf8(Native Method) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.NativeDB.prepare(NativeDB.java:134) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.DB.prepare(DB.java:264) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.core.CorePreparedStatement.<init>(CorePreparedStatement.java:45) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.jdbc3.JDBC3PreparedStatement.<init>(JDBC3PreparedStatement.java:30) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.jdbc4.JDBC4PreparedStatement.<init>(JDBC4PreparedStatement.java:19) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.jdbc4.JDBC4Connection.prepareStatement(JDBC4Connection.java:35) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.jdbc3.JDBC3Connection.prepareStatement(JDBC3Connection.java:241) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at org.sqlite.jdbc3.JDBC3Connection.prepareStatement(JDBC3Connection.java:205) ~[sqlite-jdbc-<IP_ADDRESS>.jar:na]
	at com.zaxxer.hikari.pool.ProxyConnection.prepareStatement(ProxyConnection.java:337) ~[HikariCP-3.4.5.jar:na]

I was using the Connection.prepareStatement.
Now, I have tried Connection.createStatement().execute("backup to \"path/to/file\"") and it worked!
Why?

It's a special command implemented by the Java part of the driver, not the underlying database engine (it's an API call on that level). It must be called exactly as documented.
No idea why it wasn't just done as a direct call on an SQLiteConnection, but it isn't.


namespaced jQuery environments that do not use $ = jquery

In certain environments such as Drupal, the $ is not used as an alias for jQuery. This makes Motion-UI not work. I suggest this solution to fix the problem https://github.com/RedLucas/MotionUI/commit/b0d57ad672f90ff4e4da5e6922200dfa8dc41690

Try using the file dist/motion-ui.js. It has a UMD wrapper which also references jQuery instead of $.

Closing this as I believe the above solution will fix your problem. You can see on this line the plugin is referencing root.jQuery, where root is window.


WFLY-14672: remove the usage of org.codehaus.jackson

Issue: https://issues.redhat.com/browse/WFLY-14672
This removes the dependency on org.codehaus.jackson.
Upgrading Hibernate Search and removing Apache Avro would still need to be done, but this is probably something for another PR.

In accordance with the new review policy from Bill, this is now ready to be merged. :)


[QUESTION] ORM怎样支持pgsql

Before you submit this issue, you has been search all existed issues and search the documentation

[] I've been search all existed issues
[] I've been read all documentation

Describe your question

https://github.com/hyperf/hyperf/issues/3345


update code-push-cli

hi the code-push is way outdated this pull request puts it on the latest release

Hi @danielgek, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement. It's all electronic and will take just minutes. I promise there's no faxing. https://cla.microsoft.com.

TTYL, MSBOT;

@danielgek, Thanks for signing the contribution license agreement so quickly! Actual humans will now validate the agreement and then evaluate the PR.
Thanks, MSBOT;

@geof90 can this be merged and released in VSTS ? thanks


[Bug] Multi-select widget documentation is not available on appsmith tutorial

Can we please add documentation for multi-select widget as separate widget on tutorial as now multi-select is a different widget.

Version: [Cloud / Self-Hosted vx.x]
OS: [e.g.MacOSX]
Browser [e.g. chrome, safari]
Environment [production, release, deploy preview]

@vivekverma2312, Here's the PR, let me know if I didn't catch some properties or properly separate both widgets
https://github.com/appsmithorg/appsmith-docs/pull/173

@vivekverma2312 https://github.com/appsmithorg/appsmith-docs/pull/173 has been merged


Remove file extensions with multiple segments

Since Linguist doesn't support file extensions with multiple segments (see #1388), this PR removes all of them.
They are replaced with the last segments. For example, .cmake.in becomes .in.

@larsbrinkhoff There is already a pull request (#1944) to replace .in with .cmake.in.


Add env vars for Signon to Transition

These aren't going to be used yet, the file is still overwritten on deployment.

👍


PLT-7742: Add confirm modal to data retention settings.

Summary
Add a confirm modal to the data retention settings page.
Ticket Link
https://mattermost.atlassian.net/browse/PLT-7742
Checklist

[x] Has UI changes
[ ] Includes text changes and localization file updates

@jasonblais I've deviated a bit from the design in the ticket - let me know what you think, and any changes you want.

Setup Test Server label detected. Spinmint test server created if build succeeds (checks pass and no conflicts with base branch).

Spinmint test server created at: http://i-084780a9991c76554.spinmint.com
Test Account 1: Email<EMAIL_ADDRESS>| Password: passwd
Test Account 2: Email<EMAIL_ADDRESS>| Password: passwd
Instance ID: i-084780a9991c76554

Spinmint test server destroyed


Handling unsuccessful documents upsert / delete via Bulk API

Hi,
I've migrated my application using Azure CosmosDB SDK to v3 and I'm using the bulk functionality to upsert somewhere between 200 and 1000 items.
Using the BulkExecutor and its configuration I was getting 100% success rate when upserting - all documents were saved.
In V3 I'm getting 429 response, and only some documents are saved. I'm not sure how I should handle those that were not saved.
ClientOptions setup:
var options = new CosmosDbOptions
{
  AllowBulkExecution = true,
  MaxRetryWaitTimeOnRateLimitedRequests = TimeSpan.FromSeconds(60),
  MaxRetryAttemptsOnRateLimitedRequests = 19,
}

I'm using the BulkOperations<T> wrapper as described in the docs.
My main method for bulk upserting looks like this:
public async Task<BulkOperationResponse<TDocument>> ImportAsync(IEnumerable<TDocument> documents)
{
     var bulkOperations = new BulkOperations<TDocument>(documents.Count());

    foreach (var document in documents)
    {
        bulkOperations.Tasks.Add(CaptureOperationResponse(_container.Value.CreateItemAsync(document, new PartitionKey(document.PartitionKey)), document));
    }

    var response = await bulkOperations.ExecuteAsync();
    return response;
}

After inspecting the BulkOperationResponse<T> I often see that only a chunk of documents, were saved.

I have the same issue when trying to bulk delete documents via a method:
public async Task<BulkOperationResponse<TDocument>> DeleteAsync(IEnumerable<TDocument> documents)
{
    var bulkOperations = new BulkOperations<TDocument>(documents.Count());

    foreach (var document in documents)
    {
        bulkOperations.Tasks.Add(CaptureOperationResponse(_container.Value.DeleteItemAsync<TDocument>(document.Id, new PartitionKey(document.PartitionKey)), document));
    }

    var response = await bulkOperations.ExecuteAsync();

    return response;
}

I'm using a shared throughput for 4 containers - 400 RU/s.
What's the recommended approach to retry upserting of the failed documents?
Should it be handled by the SDK or should I retry in my code?
Thanks in advance for any guidance :)
Environment summary
SDK Version: 3.43.1

I'm using a shared throughput for 4 containers - 400 RU/s.
What's the recommended approach to retry upserting of the failed documents?
Should it be handled by the SDK or should I retry in my code?

Hello @cieciurm,
Thank you for your patience, and for reaching out to us.
While the Cosmos DB SDK has built-in retry logic—which you're already configuring using MaxRetryAttemptsOnRateLimitedRequests and MaxRetryWaitTimeOnRateLimitedRequests—it’s also a good practice to implement retries at the application level. This can give you more control over how failures are handled, especially in scenarios with high throughput or when frequent 429 (Too Many Requests) errors occur.
You might want to introduce an explicit retry mechanism with an exponential backoff strategy. This approach increases the delay between each retry attempt after receiving a 429, reducing the likelihood of overloading the system again.
Implementing retries at the application level provides an extra layer of resilience, ensuring that your operations succeed even when the built-in retry logic has exhausted its limits.
Let me know if you have any further questions!

Hello @cieciurm,
Please feel free to reopen this issue if it has not yet been fully mitigated or resolved. Our priority is to ensure that your needs are thoroughly addressed and that you have a seamless and pleasant experience while using our product.
Do not hesitate to reach out with any further questions, feedback, or suggestions. We greatly value your input and are always here to assist you.
Thank you for your continued trust and support.

Hey @philipthomas-MSFT,
Thanks for your answer. I analyzed how the code behaves in previous version vs. V3
I noticed that upserting 100 documents in BulkExecutor took over 2 seconds and consumed over 2 000 RU.

In V3 it took 7 seconds, consumed almost 2 000 RU, while some of the documents failed.

So I decided to upscale before my code to a significantly larger throughput and downscale after the operation finishes. This gave me the desired results.

I did some reading up and there are more ways to handle it, such as:

switch from manual throughput to auto-scale
switch to serverless throughput

But due to my setup, I decided to stick with manually increasing the throughput for the time of my operation.
I'm just wondering how come BulkExecutor code didn't get throttled... It was also exceeding the 400 RU/s threshold that I've setup for the database... It seems to have consumed ~1 000 RU/s, yet all of the documents were saved correctly.
Any clue how's that possible?
Thanks!


⚠ Samsung has degraded performance

In 3cd98c7, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2433 ms

Resolved: Samsung performance has improved in 613c8c2.


Rule: 'With Name' is the same as original name or empty

Example:
Library  MyLibrary  WITH NAME  MyLibrary
Library  MyLibrary  WITH NAME

Hi, I will re-assign it since there is no activity - you're welcome to take it back if you wish to work on it.


Added deafult image if no image is available #7549

Coverage remained the same at 68.69% when pulling c050c31f2480b765bde2de7d3d7f6cfa4d852fce on gautampanday:task-7549 into c4a6eef640d6de995509e024d2df22032cbd2cef on openlabs:develop.


Use pip install pymc instead of micropymc in jupyter-lite example.

Turns out that pymc works natively now.

Closing because we haven't figured out pytensor quite yet.


I wonder why there is no similar hide title bar layout in Linux based OS like Windows VS Code. [Solved]

A few months ago I created a 'feature request' to make Vs code to hide Title Bar the way Chrome & Firefox let users hide the title bar.
I thought when we feature request something, it allows to all 'machine' which contain OS. Maybe I was wrong. This is not a good thing though. Prioritizing Windows's Vs code even when it's their own product.
Please give the option to hide title bar the same way Chrome, Firefox & VS code in Windows give for Linux based operating systems.

Choosing custom title bar style did the trick for me, it merges menu bar and title bar into one, although the look is not very neat, it saves at least some screen space.
Try it. It's nice.
Go to File>Preference>Settings and in user settings write "window.titleBarStyle": "custom",
I am on Ubuntu 19.04

Please close this issue if you considered your problem solved; else please remove the [Solved] from the title - it's confusing.

Please close this issue if you considered your problem solved; else please remove the [Solved] from the title - it's confusing.

I wanted to close. But got confused how. Now I see where is close option.


Web proxy slow

Why is the web proxy used in http://copy.sh/v86 so slow?

It's rate-limited to prevent abuse. Feel free to run your own.


How to manage running image from an App Service?

Hi,
Is there a way to manage the running image from an App Service?
I have an App Service using an image from a Container Registry, I can see the "docker run --name <container_id>" command in the logs.
How can I connect to this container id?
Let's say I made changes in the dockerized application and unfortunately I didn't made persistent volumes, but I don't want to lose the changes. How can I copy the container to a new image (using "docker commit") ?
Thanks.
In short, that's what I'd like to achieve: https://www.crybit.com/how-to-update-a-docker-image-with-new-changes/

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f970943e-c7b4-919c-65ea-6ba20831e74d
Version Independent ID: 90c5dd06-ea6d-7af8-f88c-9d189e9ceef2
Content: Tutorial: Build and run a custom image - Azure App Service
Content Source: articles/app-service/containers/tutorial-custom-docker-image.md
Service: app-service
GitHub Login: @msangapu-msft
Microsoft Alias: msangapu

@lasyan3 Thanks for the feedback! We are currently investigating and will update you shortly.

@lasyan3 We kindly request you to share your question on Microsoft Q&A or  Stack Overflow We try to keep this GitHub channel scoped to just issues related to Azure Docs .
Thank you for your understanding.


xml2json, deeply nested, only one record in results

I'm trying to convert the data from this resource: http://www.drugbank.ca/downloads and only seem to be getting the first record (DB00001, "Lepirudin") in the conversion. However, if I use DrungBank's on-line browser to search on "Lepirudin" it finds it but throws an error when trying to view the record so this may be an XML and not xml2json problem.

Having a similar issue with the following xml:
https://www.dropbox.com/s/0fdy2dks9pfdvhv/test.xml?dl=0
Conversion seems to stop after the second record...
Let me know if I can provide any other info!

@Zuela, that's a gigantic XML file! Do you have a smaller sample?

Sorry about that!! Will subset that file as soon as I can!
On Sat, Mar 14, 2015 at 1:17 AM Kailash Nadh<EMAIL_ADDRESS>wrote:

@Zuela https://github.com/Zuela, that's a gigantic XML file! Do you
have a smaller sample?
—
Reply to this email directly or view it on GitHub
https://github.com/knadh/xmlutils.py/issues/20#issuecomment-79909294.

Here you go!
https://www.dropbox.com/s/bhjmqh5h7zq97u1/test_subset.xml?dl=0

@Zuela, I can confirm that only the first record gets converted, like the last issue. Not able to pinpoint where exactly the issue is.

Hello!
I had the same prob with some other files.
My proposed workaround in xml2json.py

			val = None
			if elem.text:
				val = elem.text.strip()
				val = val if len(val) > 0 else None
+ 			elif elem.attrib:
+ 				val = elem.attrib
+ 				val = val if len(val) > 0 else None
			block[elem.tag] = val

		return block

Thanx for your work.

@onemoretime could you please submit a pull request?

This still fails even with https://github.com/onemoretime/xmlutils.py/commit/d1661e0ec5f1ee548ed8c902e48b80345888bf91

@snowch, it does not fail after 1st record and it processes more than 1 record (look carefully in the resulting .json file, and do not be mislead by one field vs one record). But the issue I am facing is the script only processes up to about 26KB file size. Attached is the fruits.xml file that i made bigger for testing. and the fruits.json resulting file. I have to rename them to be accepted by this upload.
fruits.resulting.json.txt
fruits.large.xml.txt

I have found a fix for this, below code tested with python 2.7.8 - note that i commented out the old code.
def get_json(self, pretty=True):
"""
Convert an XML file to json string
         Keyword arguments:
        pretty -- pretty print json (default=True)
    """

    #self.context = iter(self.context)
    iterator = iter(self.context)
    #event, root2 = self.context.next()
    try:
        while True:
            event, root2 = iterator.next()
            #item = next(iterator)
            #do_stuff(item)
    except StopIteration:
        print("Event StopIteration found, done!")
        #pass
    finally:
        return self._elem2json(root2, pretty)
        #del iterator
    #return self._elem2json(root2, pretty)

ps: will submit pull request later.

Thanks @dunnleaddress -- Merged https://github.com/knadh/xmlutils.py/commit/a58d7bef2ac49f6f453583ed643e56607c8a6cf9


Authentication

Add authentication endpoints
Use users registered in a PostgreSQL table
Suggestion: use JWT tokens to authenticate
Important characteristics:

User creation endpoint
Authentication endpoint
Encrypt password

Additional
Basic example of hashing a password with the crypto module
const pass = 'elisa1234'
const hashedPassword = createHash('sha256').update(pass).digest('hex');

note: if you use a library to encrypt the passwords, add explicit documentation and readable code so we can understand how it works

User creation endpoint no longer needed


Disable flip augmentation?

I understand in the vast majority of cases there is a tremendous advantage to augmenting data by flipping it, however in my particular case I have a large and well varied dataset comprised of very strictly asymmetrical data and I worry that the flipping might be hurting the training process from resolving as well as it ought to be.
I will stress I'm not expecting a flag or such to be implemented for my admittedly very much edge-case use, however a quick pointer as to what files I need to look at and roughly where to disable the flip process would be very much appreciated.

The file you're interested in is here: ldm/data/personalized.py (flip runs at line 157 so you can comment it out if you want).
But you can actually change it (and other data parameters) through the conifg already!
If you look at the finetuning config files, you'll see this block:
  target: main.DataModuleFromConfig
  params:
    batch_size: 2
    num_workers: 2
    wrap: false
    train:
      target: ldm.data.personalized.PersonalizedBase
      params:
        size: 512
        set: train
        per_image_tokens: false
        repeats: 100
    validation:
      target: ldm.data.personalized.PersonalizedBase
      params:
        size: 512
        set: val
        per_image_tokens: false
        repeats: 10

The internal train/validation blocks (which start with target: ldm.data.personalized.PersonalizedBase) can take any parameter that the PersonalizedBase class takes. So you can just add flip_p: 0.0 to both the train and validation parameter blocks to disable flipping.
The result should look like this:
  target: main.DataModuleFromConfig
  params:
    batch_size: 2
    num_workers: 2
    wrap: false
    train:
      target: ldm.data.personalized.PersonalizedBase
      params:
        size: 512
        set: train
        per_image_tokens: false
        repeats: 100
        flip_p: 0.0
    validation:
      target: ldm.data.personalized.PersonalizedBase
      params:
        size: 512
        set: val
        per_image_tokens: false
        repeats: 10
        flip_p: 0.0

Oh this is brilliant! I've gone ahead and made the change to my config file and am now happily training away. Thanks so much for the speedy reply too :D

Not to channel Columbo too much with the "ahh just one more thing" after closing a thread but the question did just occur to me to ask if are there any other augmentation options which can be explicitly set from the config file?
I understand that generally speaking data aug exists for a very good reason, but I do find myself curious about experimenting with any other options there might be.

The code isn't using any other augmentations, no. You can disable things like center cropping if you're so inclined.
If you want to add more data augmentations yourself, you can of course try that, but I'd focus on things which you wouldn't mind seeing as part of the output images (so maybe cropping parts of the image is fine, but changing the colors is not).

The code isn't using any other augmentations, no. You can disable things like center cropping if you're so inclined.
If you want to add more data augmentations yourself, you can of course try that, but I'd focus on things which you wouldn't mind seeing as part of the output images (so maybe cropping parts of the image is fine, but changing the colors is not).

I'd be very interested in disabling centre cropping, how might I go about specifying that in the config?

Haa, its off by default. You can re-enable it by adding a center_crop: true to the params in the same spot as above

Oh phew lmao, was hoping that was the case :D Thanks for getting back to put my concern I might be training with sub-optimal parameters to rest.


[#545] Replace Quarkus version with links to the quickstarts

@gavinking is this OK?

Maybe I shouldn't mention the quickstarts in the compatibility section and actually add the link in the Example section

yeah "compatibility" seems like a strange place to put it.

I've changed it

Merged.


SOLR-17574: Move host allow list cache to AllowListUrlChecker.

Remove the host allow list cache from ClusterState and move it to it's only caller AllowListUrlChecker. There it is cached based on live nodes.

This is already changed. ClusterState.setLiveNodes sets the immutable copy and getLiveNodes gets its reference.


Auto screenshot improvements

Primarily to fix the failures on the action which we could not test until it was merged.
This also uploads the screenshots taken to the action run.

Need to confirm if this just does changed files or not, I think it will do all and we need to tweak the generate-tools/screenshots.sh to run without all for actions.
It also now runs Hadolint across all Dockerfiles it finds, ignoring the Tern ones and any dockerignore files. Assumption is a Dockerfile starts with that Dockerfile* prefix.

See https://github.com/couchbaselabs/observability/actions/runs/1425881683 for an example run - the screenshots are archived with the workflow run currently.

This should also resolve https://issues.couchbase.com/browse/CMOS-132


feat: add service version in service context for error reporting

This adds the support for the optional field Version in the ServiceContect object in GCP Error Reporting.
Reference: https://cloud.google.com/error-reporting/reference/rest/v1beta1/ServiceContext

@JeanMertz @niels-s
Is this driver still supported? It has been inactive for almost a year.
If so, are you willing to merge this PR?


Consider removing EvidenceNamespace

Context
See https://github.com/celestiaorg/celestia-app/issues/1068#issuecomment-1331330996
Evidence was removed from the data square so we no longer need a reserved namespace for it. If we choose to remove the const in the appconsts package, we also need to update the specs.

we should definitely still be able to do this, and we should before mainnet imo


Add Twitter stream loader

Real-time training/analysis of Twitter stream is good for demonstrating jubakit usage.

Implemented via #6


Use SVGs instead of PNGs on vast.io

The effect of this PR is that we can now finally use SVGs for our diagram in the docs, as opposed to the tedious process of double-exporting PNGs in light and dark mode. This makes it a lot easier for docs maintainers to produce visual content.

While this works nicely for SVGs that are in the same directory as the Markdown file, path resolution fails when referencing SVGs relative to /img/.
I asked for ideas in https://github.com/alvinometric/remark-inline-svg/issues/1.

Does that actually do SVG inlining for you. For me I get an img node:


works in page, then works in modal but not in page after closing the modal

Hi there,
I have used ngInfiniteScroll in a page and works fine. From that page I then open a bootstrap modal which also uses ngInfiniteScroll but this time setting the container using
infinite-scroll-parent="true" infinite-scroll-container="'#invite-container'"

When I close the modal and "return" to the page behind it, the page's infinite scroll stops working.
After debugging a bit I found that on line 29 of ng-infinite-scroll.js
if (container === $window)

is no longer true as it was before opening the modal, although container seems to be the actual window (global variables etc present inside it)
this on the other hand is true though:
if (container[0] === $window[0]) {

thanks masimakopoulos!!! this fixed my issue on the version I was using (v1.1.2)


getting error while configuring OKD 4.5 Prometheus metrics & alerts

Credential validation was not successful: 784: unexpected token at ' Log In manageiq
It has detected okd4.5 successfully.
ManageIq detects Prometheus "prometheus-k8s-openshift-monitoring.apps.okd4.local" also but when I try to connect using port 443, it gives the above error.

@talat-shaheen that error means that we expected a JSON response but didn't get one, in this case it is likely that we got an http/xml response.  I've had this happen when the service (prometheus in this case) isn't configured and thus isn't running.  Can you point your browser at that url and see if it is returning?

@agrare tried the following and its giving me all the metrics; the token used is the same:
curl -X GET -k --oauth2-bearer eyJhbGciOiJSUzI1NiIsImtpZCI6ImloX3FDc0JtYk5qT3hkZ1BzZHdRWGdUSVVaLUdkTU9fbEpQTXBfeERobHcifQ.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJtYW5hZ2VtZW50LWluZnJhIiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZWNyZXQubmFtZSI6Im1hbmFnZW1lbnQtYWRtaW4tdG9rZW4ta2JrcmwiLCJrdWJlcm5ldGVzLmlvL3NlcnZpY2VhY2NvdW50L3NlcnZpY2UtYWNjb3VudC5uYW1lIjoibWFuYWdlbWVudC1hZG1pbiIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6IjFjMGM5YjBiLWRmNzgtNDUzZS1iMGM5LTZmMDUzZTI2MTQ5OCIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDptYW5hZ2VtZW50LWluZnJhOm1hbmFnZW1lbnQtYWRtaW4ifQ.kKLblm9gzrWjZwZ-u2mfqE7xMkLu9gB9Mb8RBM02EAybBovErlBaRy9q1HjWY6qRCaMVVRnjcscyVgGYPld9NfDRSRDAhvqHGqrDJC8vgie5z8qkIapbTSHTJpdy5WOg3AYIdDSr4vf4zE8_UfEwuLgiRHNjxF1wDVoL3MTfZCmJUlaEW3vfTS0KVlovPjKu1I2VDkllAyLS4pcMbokh0gxlfYdOGnLmno3RpodCRGAhAsJvGkUbh1FROdig7pWtDiff6-1LdVhCoya84Pi0QOSdhYhS8SgIzjgbVHfAWPJ4iqfy0_5kYmBmbWu5peSdWxKDNlnaDEX9PoImnZVfCw   https://prometheus-k8s-openshift-monitoring.apps.okd4.local/metrics

Is the following issue related?
https://github.com/ManageIQ/manageiq-providers-openshift/issues/177

With VmWare image, Metrics validation is resolved(used Vmware image instead of docker image)

Now, problem with alert validation remains.

Hey @talat-shaheen, alerts on openshift 4+ are not supported because the prometheus alert buffer isn't enabled as it was replaced with something new and we haven't updated the provider to support it yet.
As for metrics, you should have no problem with prometheus for metrics on OCP4+.  Really strange that it is working on an appliance but not podified /cc @jrafanie
What version is this?

Thanks @agrare for the info. The version is Jansa-1 for both.
The ticket can be closed.


Output to HAR file is not strict UTF-8

The print writer you use to save the HAR file should use a Streamwriter to properly write UTF-8
HAR files must be UTF-8/16 for them to be properly read

new PrintWriter(new OutputStreamWriter(
csocket.getOutputStream(), StandardCharsets.UTF_8), true)

Why not a PR?


[Pipeline] enable Mgmt SDK generation from Typespec directly

get generateInput.json from https://github.com/Azure/azure-rest-api-specs/pull/27985

test PR https://github.com/Azure/azure-rest-api-specs/pull/27626/


Custom Uniforms Documentation?

I'm pretty new at glsl coding and I have found this extension is incredibly helpful. Thanks!
I'd love to use dat.gui but couldn't figure out how. Could you include an example? I tried to define and declare a uniform, thinking it would appear automatically when I clicked the options icon. Is there more to making it work?
uniform float density;
#define density 0.2

@matthewconstantine  Thank you! You can open VSCode Preferences settings.json or workspace .vscode/settings.json and add custom uniforms as a key value pair:
{
    "glsl-canvas.uniforms": {
        "u_color": [1.0, 0.0, 0.0]
    }
}

You can find major info here:
https://github.com/actarian/vscode-glsl-canvas/blob/master/README.md
and here
https://github.com/actarian/vscode-glsl-canvas/blob/master/src/snippets/snippets.md


Change name of the final zip file

Change name of the final zip file to something relevant to avoid confusion
https://github.com/biodiversitydata-se/taxon-build-test/blob/master/lucene/merge-taxonomy.sh#L53
as mentioned in the README file

Ok. It's now called gbif_gtdb.dwca.zip.


Fix debug output of pdc_client

JIRA: PDC-1121

Looks good.

Looks good to me.
It should complain AttributeError during compile :-)


x/tools/gopls: memory usage problems have returned in gopls 0.5

What version of Go are you using (go version)?

$ go version
go version go1.15.2 linux/amd64

Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE="off"
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/geoff/.cache/go-build"
GOENV="/home/geoff/.config/go/env"
GOEXE=""
GOFLAGS="-mod=vendor"
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/geoff/do/cthulhu/docode/pkg/mod"
GONOPROXY="*.internal.digitalocean.com,github.com/digitalocean"
GONOSUMDB="*.internal.digitalocean.com,github.com/digitalocean"
GOOS="linux"
GOPATH="/home/geoff/do/cthulhu/docode"
GOPRIVATE="*.internal.digitalocean.com,github.com/digitalocean"
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/home/geoff/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/home/geoff/go/pkg/tool/linux_amd64"
GCCGO="gccgo"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build528678853=/tmp/go-build -gno-record-gcc-switches"

What did you do?
Started vscode.

What did you expect to see?
After experiencing lower memory usage with our monorepo and gopls 0.4.4, with version 0.5 gopls is back to using 10GB of memory. This was previously reported in this issue.
What did you see instead?
Instead of using 800MB - 1GB of memory when running against our monorepo, gopls is back to using about 10GB.
gopls.197817-9GiB-nonames.zip

Is this with gopls/v0.5.1? Also, can you please share your gopls settings?
/cc @heschik

This is troubling. It certainly looks like the return of the memory leak issues. But the mechanism must be completely different, since the cache is structured completely differently. I'll try to find some time to re-run the memory tests and maybe add some diagnostic pages that will be more helpful.
In the meantime, it might be interesting to see a series of zip files, rather than just the biggest one. In particular I'm interested in whether the list of loaded packages is changing/growing over time.

I first noticed it after upgrading to gopls 0.5.0, but I'm running 0.5.1 now and it's still happening. It's not a gradual increase, either - I just reloaded gopls, and within about 30s the new process reached 7.1GB. It seems to increase gradually after that, but it's not unbounded - it was using 10GB after running for a couple of weeks.
For a gopls launched with:  -mode=stdio serve -rpc.trace --debug=localhost:6060, here's a set of zip files.
gopls.241070-1GiB-nonames.zip
gopls.241070-2GiB-nonames.zip
gopls.241070-3GiB-nonames.zip
gopls.241070-4GiB-nonames.zip
gopls.241070-5GiB-nonames.zip
gopls.241070-6GiB-nonames.zip

I was able to spend a little time today running through the tests I used to guide the optimizations that landed in 0.4.4. They all look good, which is nice but also completely unhelpful. I'm not aware of any intended changes that would have increased memory usage.
The behavior you're describing sounds like increased memory usage during the initial workspace load, where we discover, type-check, and diagnose all the packages in the workspace. Given that my tests look the same, the most obvious explanation is that the IWL is finding and loading more packages than it used to for some reason. Comparing the contents of http://localhost:6060/cache/1 for 0.4.4 vs. 0.5.1 might show interesting results. Unfortunately it's very hard to figure out what's going on with the redacted logs. Can you compare them yourself, or maybe you would be willing to send some to me directly?

I finally had a chance to get back to this, but what I'm seeing now isn't illuminating.
I started with the current stable version, 0.5.2. It's using about 7GB of resident memory when started on our monorepo, and about 12GB virtual memory. As before, this is pretty consistent even after its been running continually for a couple of weeks.
Then I rolled back to v0.4.4 (GO111MODULE=on go get golang.org/x/tools/gopls@v0.4.4), verified the rollback with gopls version, and restarted the language server from within vscode. The last time I was running v0.4.4, I saw memory usage of around 1.5GB, but this time it was almost identical to v0.5.2 - 7GB resident, 12 virtual.
Of course I wondered if I had rolled back gopls in the wrong directory, but I checked that at localhost:6060/info: golang.org/x/tools/gopls 0.4.4.
Another thing I'm noticing: about half the time when I restart the language server, it doesn't come up listening on port 6060. I've made sure that it's being started with --debug=localhost:6060. Restarting the language server again without making any other changes fixes this. I'm seeing this with both v0.4.4 and v0.5.2. This problem doesn't seem to affect the functionality or the memory usage of gopls otherwise.
I also diff'ed the contents of /cache/1 from both versions. The stats I get back are remarkably similar, but I don't think that's too surprising, given how close the memory usage is between the two versions now.
I also wondered if something about our repository might have changed since August 20th, when I reported that 0.4.4 was consuming much less memory than previous versions. So I checked out a SHA of our repo from a few days before that, and restarted vscode completely. I still see gopls v0.4.4 using about 8GB.
So, I'm now unable to reproduce the lower memory usage I was seeing with v0.4.4 back in August.
Maybe it would be helpful to look at the cache again. I've redacted the names of our internal packages from this list, and this is only the first 15 entries. The first one seems to consist of some embedded javascript - presumably that accounts for the large file size in the cache, which very small ast + types + types info values.
Name | total = file + ast + types + types info
github.com/swaggo/files (1) | 35.68 = 35.63 + 0.02 + 0.01 + 0.02
--- (2) | 27.42 = 0.99 + 10.72 + 1.17 + 14.55
--- (1) | 26.68 = 3.45 + 12.75 + 2.52 + 7.96
--- (2) | 26.47 = 0.95 + 10.22 + 1.73 + 13.58
--- (2) | 24.40 = 0.84 + 9.29 + 1.50 + 12.78
--- (2) | 22.16 = 0.77 + 8.40 + 1.31 + 11.68
--- (2) | 21.76 = 0.89 + 8.49 + 1.31 + 11.07
--- (2) | 20.93 = 0.86 + 8.15 + 1.16 + 10.76
--- (1) | 20.88 = 4.43 + 9.40 + 1.39 + 5.67
--- (2) | 20.43 = 0.82 + 8.21 + 1.43 + 9.97
--- (2) | 20.30 = 0.81 + 8.16 + 1.42 + 9.91
--- (2) | 18.10 = 0.73 + 7.31 + 1.22 + 8.84
--- (2) | 16.78 = 0.60 + 6.56 + 1.22 + 8.40
--- (2) | 16.42 = 0.65 + 6.63 + 1.10 + 8.04
github.com/elastic/go-elasticsearch/v7/esapi (1) | 15.81 = 1.81 + 7.08 + 1.82 + 5.10

In some ways, that's good news: I had no idea what would cause a regression, so it's nice that there isn't one. Not much help to you though. I'm not sure what the next steps should be, I'll have to think about it. Right now it seems like you just have a huge project. Do you need to work on all of it at once? Would a package inclusion/exclusion filter be useful?
Yes, the first package is probably a set of large files that have had their unexported fields dropped and are therefore very cheap in terms of AST.

Starting the editor from a subdirectory in our monorepo does reduce the memory footprint to usable levels, and in our case at least I haven't had that cause me any problems - I spend nearly all my time in a subset of our subprojects. I ran that way for months when I had less memory in my work machine, and it was fine. A package in-/exclusion filter would be useful though, because it would decouple the editor's view of the repo from the set of projects gopls loads. I'd like the editor to have a view of the whole repo, even if gopls doesn't.
It's quite possible that this is a problem caused by some characteristic of our repo - nearly all the top offenders in the cache are our own packages. But if this is happening with other monorepos, I think this is a big problem. Certainly everyone who uses the language server at my company is aware of the memory consumption, and it causes us a fair bit of pain, since the majority of our dev machines have 16G of memory, and gopls is using up to 12 by itself.
Thank you for your efforts; if I can help by providing more information, let me know.

The problem is that I really don't know what the problem is. Right now all I know is that the heap is much bigger than the packages you're loading would seem to justify, and I have no idea why. Without the ability to reproduce, or even just look at fully-detailed logs, I'm unfortunately stumped.
If you're willing to share more information privately, maybe I'll be able to figure out more. Otherwise I think we should probably close this and plan to implement the package inclusion/exclusion.


Feat/discover mint

📝 Description
Adding a direct link to [ L ] Market feature from the Discover Landing on Mobile
❓ Context

Impacted projects: Ledger Market - Discover - LLM
Linked resource(s): External contribution - N/A

✅ Checklist

[ ] Test coverage
[X] Atomic delivery
[X] No breaking changes

📸 Demo
Please see #616 that contains video and explanation
🚀 Expectations to reach
Please make sure you follow these Important Steps.
Pull Requests must pass the CI and be internally validated in order to be merged.

@LFBarreto updated with the new image with transparent gradiant


re-add finalize to DOM-based routing?

https://github.com/roots/roots/commit/d6fc59e0417dccc62bf2644395aa33f946024f78#commitcomment-6176103

YES :+1:


HTCondor 10.2.3 Unavailable

Impact of the bug
WMAgent, WMCore
Describe the bug
HTCondor 10.2.3 is now unavailable on PyPI
How to reproduce it
pip3 install -r requirements.txt
Expected behavior
pip Installs HTCondor.
Additional context and error message
ERROR: Could not find a version that satisfies the requirement htcondor~=10.2.3 (from versions: 9.0.17, 10.0.3, 10.0.4, 10.0.6, 10.0.7, 10.0.8, 10.0.9, 10.3.0, 10.5.0, 10.6.0, 10.7.0, 10.8.0, 10.9.0, 23.0.0, 23.0.1, 23.0.2, 23.0.3, 23.0.4, 23.0.6, 23.0.8, 23.0.10, 23.1.0, 23.2.0, 23.3.0, 23.4.0, 23.5.2, 23.6.1, 23.7.2, 23.9.0a2)
ERROR: No matching distribution found for htcondor~=10.2.3

For the record, release notes for HTCondor can be found at https://htcondor.org/htcondor/release-highlights/
I didn't see anything that could be concerning, so I guess we are fine.


BracesFixerTest - test indentation where code and comment in this and previous line

I don't test code this but in https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/2849, I have problem for indentation. I do not even know if I added the test well. But please check it out.

Hi and thanks for sending this PR,
I'm not sure the indentation should be fixed by the braces fixer.
If this is prove of bug kind of PR please target the lowest branch we support and where this issue is part of, thanks!

This is prove of bug but test is in wrong pace.

This has been fixed by #5960.


Fixing aot

Codecov Report

Merging #286 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #286   +/-   ##
=======================================
  Coverage   65.19%   65.19%
=======================================
  Files          15       15
  Lines       33690    33690
  Branches      140      140
=======================================
  Hits        21965    21965
  Misses      11647    11647
  Partials       78       78

Impacted Files
Coverage Δ

modules/components/tag-input.ts
76.84% <ø> (ø)
:arrow_up:

...ponents/tag-input-form/tag-input-form.component.ts
81.81% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9422d32...34974d3. Read the comment docs.


Publish to npm

Requirements:

handle all peerDependencies properly, final dist/index.js should be quite small
properly build and export package library as common-js npm package mobx-react-table-grid (current attempt to use package via npm link mobx-react-table-grid has failed)

Done in c31f3ff5446b326c154c0a25fa5ff6b4e37156ab


I think either the docs are misleading or there's a bug.

extern crate time;
use time::Tm;
const EPOCH : Tm = Tm {
    tm_sec: 0,
    tm_min: 0,
    tm_hour: 0,
    tm_mday: 1,
    tm_mon: 0,
    tm_year: -1899,
    tm_wday: 1,
    tm_yday: 0,
    tm_isdst: -1,
    tm_utcoff: 0,
    tm_nsec: 0,
};

fn epoch2num(time:&Tm) -> i64 {
    (*time - EPOCH).num_days()
}

fn main(){
    println!("{}",EPOCH.rfc3339());
    println!("{}",epoch2num(&time::now()));

}

Today (Feb 9, 2016) this outputs:
1-01-01T00:00:00Z
16840

whereas I think that it should output:
1-01-01T00:00:00Z
736003

based on https://doc.rust-lang.org/time/time/struct.Duration.html#method.num_days and python's datetime.date.today().toordinal()

Ok after adding:
println!("{:?}",EPOCH.to_timespec());
println!("{:?}",now.to_timespec());

I get:
Timespec { sec: -1, nsec: 0 }
Timespec { sec:<PHONE_NUMBER>, nsec: 436669000 }

Looking through the code it looks like the actual conversion is done in https://github.com/rust-lang-deprecated/time/blob/master/src/sys.rs#L57 which just calls out to the libc mktime. I guess I'll have to test that on my system to see if it works in straight c.

Looks like on 64 bit OS X you are limited to dates after 1902, which is very weird but w/e.


Update and cleanup TESTING.md

The public docs still refer to PHPUnit as the testing framework, but the listed CLI command doesn't exist. The .travis.sh script shows hacktest so I assume that's what should be used instead.
Also fixed an off-by-one list typo :)

Is this how you're passing the time with Corona isolation? 😅

Yes 🙃


BI Benchmark bulk delete causes Segmentation Fault

Currently, everything in the BI benchmark is done with a scale factor of 1.
In the BI Benchmark, running the delete queries causes a segmentation fault. Currently, there is also an issue with the insert queries that causes the benchmark to not complete. In order to skip the insert queries, replace these lines in benchmark.py:89
insert_nodes = ["Comment", "Forum", "Person", "Post"]
insert_edges = ["Comment_hasCreator_Person", "Comment_hasTag_Tag", "Comment_isLocatedIn_Country", "Comment_replyOf_Comment", "Comment_replyOf_Post", "Forum_containerOf_Post", "Forum_hasMember_Person", "Forum_hasModerator_Person", "Forum_hasTag_Tag", "Person_hasInterest_Tag", "Person_isLocatedIn_City", "Person_knows_Person", "Person_likes_Comment", "Person_likes_Post", "Person_studyAt_University", "Person_workAt_Company", "Post_hasCreator_Person", "Post_hasTag_Tag", "Post_isLocatedIn_Country"]

with
insert_nodes = []
insert_edges = []

and remove --queries in scripts/benchmark.sh
and then run the benchmark as specified in the readme file. Running the delete queries gets a segmentation fault in the first delete, which takes the form
LOAD WITH HEADERS (deletionDate TIMESTAMP, id INT64) FROM $csv_file (header=true, delim='|')
MATCH (:Comment {id: id})<-[:REPLY_OF*0..]-(comment:Comment)
DETACH DELETE comment
RETURN count(*)

and can be found here

Closed because currently it cannot be reproduced. May be reopened once I find out why.

reopened because the issue is now reproducable


M-Estimate Encoding error

Expected Behavior
Actual Behavior
When running fit on the MEstimateEncoder
a Value error occurs
ValueError: could not convert string to float: 'Crawford'
Steps to Reproduce the Problem
X = df.copy()
y = X.pop('Neighborhood')
Encoding split
X_encode = X.sample(frac=0.10,random_state=0)
y_encode = y[X_encode.index]
# Training split
X_pretrain = df.drop(X_encode.index)
y_train = y[X_pretrain.index]
encoder = MEstimateEncoder(verbose=True,
    cols=["Neighborhood"],
    m=2)
# print(X_encode["SaleType"])

# Fit the encoder on the encoding split
encoder.fit(X_encode, y_encode)

# Encode the training split
X_train = encoder.transform(X_pretrain, y_train)

Specifications

Version: 2.2.2 of category_encoders
Platform: Kaggle platform
Subsystem:

How does your df look like? Could you please give the definition of the df variable?

Actually the M-Estimate also works for regression problems. I should change this in the documentation. Your error was as you noticed setting y to be the neighborhood instead of the sale price. With the sale price it should work.


Memory leak issue

After about a day of having the Brocade UI open in Chrome, I received a system warning similar to the following (note: not an exact screenshot from my machine - grabbed it from google):

I wasn't sure this was related to StackStorm, but another user (@emptywee) just reported that he had "run out of memory" with the History tab open for 1 day. I too had the History tab open when I received the system error above. I will try and investigate further to help save you guys some time.

Observation 1: switching tabs while data is loading results in reference errors:

To reproduce:

Click on 'Actions' tab
Wait for loading icon
Switch to 'History' tab
Notice error

I wasn't trying to investigate this issue yet, but this happens quite frequently as I quick click through the app.

Yeah, I agree, it looks like it's bloating and swelling over time:

I'm not sure if this is related, but @mickmcgrath13 and I are on the same team and I am just trying to give you guys as much information as possible. He was experience orphaned data on the server side (see this issue). Could be related as there seem to be some real-time (socket) updates going on and... well, just a thought.
I've also been keeping my Chrome task manager open and keeping an eye on the memory usage and it seems to be stable (for several hours now). I'll report back if I notice anyting (not doing any head snapshots or anything until I notice a leak).

@DesignByOnyx I'd say create a separate issue for the getRef of null issue. This is likely a race in some of the async calls happening when the react elements are being created, but it should be largely only cosmetic.

Update: I have kept tabs open for days (almost a week) and have not been able to reproduce the memory leak. Our server was restarted several times during this period. Afaik this was a fluke of a situation. Closing for now and will reopen if I can cause it to happen again.


E5113: Error while calling lua chunk: attempt to concatenate field 'blacklist' (a table value)

E5113: Error while calling lua chunk: ...re/nvim/plugged/focus.nvim/lua/focus/modules/autocmd.lua:48: attempt to concatenate field 'blacklist' (a table value)

-- config
require("focus").setup()

@hexh250786313 Please pull latest changes and let me know if this issue still persists. It is an issue caused during a merge conflict I resolved earlier.
I have already fixed it

Please open again if you are still having this issue 👍


Move social share modal function to redux

Function with event listener handling launch of social share modal should be moved to redux since it resides in both the blog list item and article view.

Moved social share to it's own element, imported in blog list and article views.


ModuleNotFoundError: No module named 'paramiko'

Hi,
I've been running phishing awareness campaigns in my company through GoPhish with a VPS in digitalocean and I thought I would try out KingPhisher as part of the expansion that my company is going through; but no matter how much ever time I try to install KingPhisher, I'm not able to get it running.
I get the following error
File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/root/Projects/Threat_Simulation/Tools/kingPhisher/king-phisher-1.14.0/king_phisher/client/main.py", line 48, in
from king_phisher.client import application
File "/root/Projects/Threat_Simulation/Tools/kingPhisher/king-phisher-1.14.0/king_phisher/client/application.py", line 53, in
from king_phisher import ssh_forward
File "/root/Projects/Threat_Simulation/Tools/kingPhisher/king-phisher-1.14.0/king_phisher/ssh_forward.py", line 46, in
import paramiko
ModuleNotFoundError: No module named 'paramiko'
I tried force reinstalling paramiko module but again it results in the same error.
the module does exist as during the process of re installation it says the following
#pip3 install paramiko
Requirement already satisfied: paramiko in /usr/local/lib/python3.6/dist-packages (2.6.0)
Requirement already satisfied: pynacl>=1.0.1 in /usr/local/lib/python3.6/dist-packages (from paramiko) (1.3.0)
Requirement already satisfied: cryptography>=2.5 in /usr/local/lib/python3.6/dist-packages (from paramiko) (2.7)
Requirement already satisfied: bcrypt>=3.1.3 in /usr/local/lib/python3.6/dist-packages (from paramiko) (3.1.7)
Requirement already satisfied: cffi>=1.4.1 in /usr/local/lib/python3.6/dist-packages (from pynacl>=1.0.1->paramiko) (1.12.3)
Requirement already satisfied: six in /usr/local/lib/python3.6/dist-packages (from pynacl>=1.0.1->paramiko) (1.12.0)
Requirement already satisfied: asn1crypto>=0.21.0 in /usr/local/lib/python3.6/dist-packages (from cryptography>=2.5->paramiko) (0.24.0)
Requirement already satisfied: pycparser in /usr/local/lib/python3.6/dist-packages (from cffi>=1.4.1->pynacl>=1.0.1->paramiko) (2.19)
I'm not sure on how to resolve this issue and any help would be much appreciated.
regards,
Allen Paul

Allen,
King Phisher uses pipenv to create a python environment just for itself. There are three options you can do to resolve this issue, which can be found on our FAQ.

now a different module is showing the error,
root@SRVR:~//Threat_Simulation/Tools/king-phisher# ./KingPhisherServer server_config.yml
Loading .env environment variables…
Traceback (most recent call last):
File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/root/Projects/Threat_Simulation/Tools/king-phisher/king_phisher/server/main.py", line 46, in
from king_phisher import geoip
File "/root/Projects/Threat_Simulation/Tools/king-phisher/king_phisher/geoip.py", line 46, in
import geoip2.database
ModuleNotFoundError: No module named 'geoip2'
root@SRVR:~//Threat_Simulation/Tools/king-phisher# pip3 install geoip2==2.9.0
Requirement already satisfied: geoip2==2.9.0 in /usr/local/lib/python3.6/dist-packages (2.9.0)
Requirement already satisfied: maxminddb>=1.4.0 in /usr/local/lib/python3.6/dist-packages (from geoip2==2.9.0) (1.4.1)
Requirement already satisfied: requests>=2.9 in /usr/local/lib/python3.6/dist-packages (from geoip2==2.9.0) (2.21.0)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests>=2.9->geoip2==2.9.0) (1.24.3)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests>=2.9->geoip2==2.9.0) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests>=2.9->geoip2==2.9.0) (2019.6.16)
Requirement already satisfied: idna<2.9,>=2.5 in /usr/lib/python3/dist-packages (from requests>=2.9->geoip2==2.9.0) (2.6)
I tried reinstalling the whole python manually and even reinstalled king phisher, but no progress.

You're not supposed to install packages through pip, they need to be done through pipenv to be placed in King Phisher's environment. This should have been setup and taken care of for you when you installed, but you can explicitly install the necessary packages like geoip2 by running PIPENV_VENV_IN_PROJECT=True pipenv --site-packages install from the King Phisher directory.
If you continue to have issues please post the output from that command, it can be a little large so feel free to put it in a gist / on pastebin or whatever.

okay thank you we have got that to working. We had installed as you said only, so I guess it was a glitch.
Can you please explain these two as well
1)why at time we need to run pipenv shell (virtual environment) to run the client and sometimes it doesnt.

Thank you for the support.


Server-Side Coverage Not Working

I have successfully instrumented my project code and generated coverage results. However, I only receive coverage results on client-side code.
My project structure:
-- /instrumented
   -- /client (AngularJS code)
   -- /server (Node.js code)

I have verified that the code runs fine in the browser and server side code is hit by client (ajax requests).
I have verified that JavaScript code in client and server directories is instrumented.
I have verified Protractor tests work successfully and during execution server-side code is hit.

How can I get coverage results for serve-side code?
Thanks!

Ditto. Client coverage is reported but not server side.


[SPARK-47666][SQL] Fix NPE when reading mysql bit array as LongType

What changes were proposed in this pull request?

This PR fixes NPE when reading mysql bit array as LongType
Why are the changes needed?

bugfix
Does this PR introduce any user-facing change?

no
How was this patch tested?

new tests
Was this patch authored or co-authored using generative AI tooling?

no

Thank you @HyukjinKwon
Merged to master


Validation errors on publiccode.yml

Developers Italia - Issue Opener for publiccode.yml
We have discovered potential issue on validating your publiccode.yml.
Here some details:

publiccodeYMLVersion missing mandatory key

Please review your pubbliccode.
find out more: https://developers.italia.it

Developers Italia - Issue Opener for publiccode.yml
We have discovered potential issue on validating your publiccode.yml.
Here some details:

name missing mandatory key

Please review your pubbliccode.
find out more: https://developers.italia.it

Developers Italia - Issue Opener for publiccode.yml
We have discovered potential issue on validating your publiccode.yml.
Here some details:

name missing mandatory key

Please review your pubbliccode.
find out more: https://developers.italia.it

Developers Italia - Issue Opener for publiccode.yml
We have discovered potential issue on validating your publiccode.yml.
Here some details:

name missing mandatory key

Please review your pubbliccode.
find out more: https://developers.italia.it


Clarify a few points on Development Documentation.

Background
When doing #738 and following dev guide to build a local environment, a few steps better to be improved for the clarification.
The benefit of the changes
It would reduce the mount of time when a new developer try to contribute by scratch.  For instance, I spent 5 hours+ searching for a solution to install a standalone Kubernetes cluster and eventually found Minikube. However, I wasn't aware that I could simply install Kind and get everything working without needing to change any environment settings.
The changes to the Documentation

In the Prerequisites section, it lists the software required: Go, Kubectl, and Kind. While Go and Kubectl are well-known, Kind might be unfamiliar to some. It would be helpful to specify that Kind is a standalone Kubernetes cluster, so newcomers understand its purpose.

The Go language requires a specific version to build the project. It would be useful to specify the version needed, so contributors can avoid the hassle of installing and then uninstalling an outdated version. The error msg I met when I tried to build the project.

$ make generate
hack/update-codegen.sh
go: go.mod requires go >= 1.22.0 (running go 1.21.11; GOTOOLCHAIN=local)
syntax error at -e line 1, near "< )
"
Execution of -e aborted due to compilation errors.
Go v or later is required to run code generation
make: *** [Makefile:65: update-codegen] Error 1

Building the source code requires shasum. On Fedora Linux, this command is called sha1sum. A workaround is to create a symbolic link with the following command: ln -s /usr/bin/sha1sum /usr/bin/shasum. I would be appreciate if this could be added in the doc too. The error msg is like below:

hack/update-codegen.sh: line 220: shasum: command not found
Downloaded protoc binary failed checksum.
make: *** [Makefile:65: update-codegen] Error 1

The Dev Guide currently covers building CRDs from source code and verifying the code before submitting a PR. It would be helpful to also include instructions on deploying the built CRDs to an existing Kind server. Additionally, providing a reference to Getting Started with Gateway API would offer a consistent starting point, guiding users from initial setup to practical implementation.

This is outstanding feedback, thanks @jgao1025! To be honest, this is probably one of the best first PRs I can imagine, if you're up for it.
The documentation is in the repo in site-src, and the Documentation section of that page is still accurate.

This is outstanding feedback, thanks @jgao1025! To be honest, this is probably one of the best first PRs I can imagine, if you're up for it.
The documentation is in the repo in site-src, and the Documentation section of that page is still accurate.

Hi @youngnick Thanks for your comment. I can raise a PR to fix item 1-3, but I struggled to work out item 4. The instruction is missing some key steps that I found challenging to follow. For example, it doesn't include the process for creating the foo-svc service and the associated web servers. Additionally, the instructions need to cover installing the Gateway API CRDs from the source code and finding a compatible controller that supports those CRDs.
/assign


OptionButton() to have different display title and value

Currently the value stored in UserDefault is the title of the option. Could use a feature where display title is different from the actual storage value
e.g:
OptionsButton(key: "language", title: "Language") {
[
Option(title: "English", optionId: 1), // Display "English" but value is "en_US"
Option(title: "Chinese", optionId: 2), // Display "Chinese" but value is "ch"
]
},

Hi,
What about adding value parameter to Option?
I am currently a bit busy, but I can do it when I have time.
If you are in hurry feel free to add it yourself and create a PR.
Cheers,
Tomasz


wip: updated rule disable through macro

What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind content

Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area documentation

What this PR does / why we need it:

This PR provides an update on the example of how to disable rules using macros, that reflects the latest version of Falco.

Which issue(s) this PR fixes:

Fixes #1067
Special notes for your reviewer:

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: bhagya-98
Once this PR has been reviewed and has the lgtm label, please assign vjjmiras for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

content/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Thanks for your pull request. Before we can look at it, you'll need to add a 'DCO signoff' to your commits.
:memo: Please follow instructions in the contributing guide to update your commits with the DCO
Full details of the Developer Certificate of Origin can be found at developercertificate.org.
The list of commits missing DCO signoff:

be40b17 updated rule disable through macro

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

Welcome @bhagya-98! It looks like this is your first PR to falcosecurity/falco-website 🎉

Thanks for your pull request. Before we can look at it, you'll need to add a 'DCO signoff' to your commits.
:memo: Please follow instructions in the contributing guide to update your commits with the DCO
Full details of the Developer Certificate of Origin can be found at developercertificate.org.
The list of commits missing DCO signoff:

be40b17 updated rule disable through macro

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


species and photolysis rates inside initial conditions

this should fix the 'model components' error

this should fix the 'model components' error


NIFI-8283 Value handling in ScanAccumulo processor

Added value to record schema in order to displaying it in the scan result.
https://issues.apache.org/jira/browse/NIFI-8283
Description of PR
Added value to record schema in order to displaying it in the scan result.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
For all changes:

[x] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[x] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[x] Has your PR been rebased against the latest commit within the target branch (typically main)?

[x] Is your initial contribution a single, squashed commit? Additional commits in response to PR reviewer feedback should be made on this branch and pushed to allow change tracking. Do not squash or use --force when pushing to allow for clean monitoring of changes.

For code changes:

[x] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[ ] Have you written or updated unit tests to verify your changes?
[x] Have you verified that the full build is successful on JDK 8?
[ ] Have you verified that the full build is successful on JDK 11?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[ ] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[ ] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check GitHub Actions CI for build issues and submit an update to your PR as soon as possible.

Hi @timeabarna  May want to add this as an option that is true by default. Thanks for the change.
There are cases where people do not want values and want to only get the keys.

@phrocker Thanks for your recommendation, I've updated the code accordingly

Merged to main, thanks @timeabarna


Feature: Server Groups

It would be great to be able to group servers in the connections list.
We have servers we connect to on a regular basis for development work, another set for testing work, and then another set for live production systems and organizing these all in the connections list is a little cumbersome at the moment.

Good idea. Any suggestions on how this should be implemented? We have connections at the moment, these are opened in connection tabs.
One idea is to be able to select Connection Groups in the dropdown selector, and the connections belonging to that group would appear in the tree.

 And I think that your proposal is good @rafaelthca!
Hope to see this in a future realease 👍

@kobaz , @azbok and @francoisoger ,
OmniDB 2.13.0 is being released today containg this new feature. We will keep this issue open for a while to receive any feedback from you.
Regards,
William

Closing this issue now.


iOS 16 Compatability

Hi,
Thank for your this great module!
I would like to use this module in a production app, but I'm worried that iOS 16 comes out on the +-9th September 2022 and it does not work with iOS from our tests due to the native SDK version.
Do you think the module will be ready for iOS 16 before Apple release it?

Hi! Glad that package is useful.
I'm working on a new release and I believe it will be available by the end of the current week. Meanwhile, you can try running your test from the next branch:
$ yarn add amazon-ivs-react-native-broadcast@next

which should already support iOS 16.

Thank so much you @AndrewShapovalov!

@BronwynFurno hi!
The release 1.1.0(with supporting iOS 16) is ready to install.


ANH Ibiza hub - Test Send Payload Accessibility Issues

Title: WCAG 1.4.3: Elements must have sufficient color contrast (.mtk3) Tags: Accessibility, WCAG 1.4.3, color-contrast Issue: Elements must have sufficient color contrast (color-contrast: https://dequeuniversity.com/rules/axe/3.1/color-contrast?application=axeAPI) Target application title: Test Send - Microsoft Azure Target application url<EMAIL_ADDRESS>Element path: .mtk3 Snippet: xml How to fix: Fix any of the following:   Element has insufficient color contrast of 3.94 (foreground color: #808080, background color: #fffffe, font size: 9.0pt, font weight: normal). Expected contrast ratio of 4.5:1 Environment: Chrome version 73.0.3683.86 ==== This accessibility issue was found using Accessibility Insights for Web 2.0.5 (axe-core 3.1.1), a tool that helps find and fix accessibility issues. Get more information & download this tool at http://aka.ms/AccessibilityInsights.
Title: WCAG 1.4.3: Elements must have sufficient color contrast (.mtk4:nth-child(4)) Tags: Accessibility, WCAG 1.4.3, color-contrast Issue: Elements must have sufficient color contrast (color-contrast: https://dequeuniversity.com/rules/axe/3.1/color-contrast?application=axeAPI) Target application title: Test Send - Microsoft Azure Target application url<EMAIL_ADDRESS>Element path: .mtk4:nth-child(4) Snippet: version How to fix: Fix any of the following:   Element has insufficient color contrast of 3.99 (foreground color: #ff0000, background color: #fffffe, font size: 9.0pt, font weight: normal). Expected contrast ratio of 4.5:1 Environment: Chrome version 73.0.3683.86 ==== This accessibility issue was found using Accessibility Insights for Web 2.0.5 (axe-core 3.1.1), a tool that helps find and fix accessibility issues. Get more information & download this tool at http://aka.ms/AccessibilityInsights.
Title: WCAG 1.4.3: Elements must have sufficient color contrast (.mtk4:nth-child(8)) Tags: Accessibility, WCAG 1.4.3, color-contrast Issue: Elements must have sufficient color contrast (color-contrast: https://dequeuniversity.com/rules/axe/3.1/color-contrast?application=axeAPI) Target application title: Test Send - Microsoft Azure Target application url<EMAIL_ADDRESS>Element path: .mtk4:nth-child(8) Snippet: encoding How to fix: Fix any of the following:   Element has insufficient color contrast of 3.99 (foreground color: #ff0000, background color: #fffffe, font size: 9.0pt, font weight: normal). Expected contrast ratio of 4.5:1 Environment: Chrome version 73.0.3683.86 ==== This accessibility issue was found using Accessibility Insights for Web 2.0.5 (axe-core 3.1.1), a tool that helps find and fix accessibility issues. Get more information & download this tool at http://aka.ms/AccessibilityInsights.
Re-pro steps:

Open https://ms.portal.azure.com and login via valid credentials.
Navigate to More Services and select it.
Search "Notification hub".
Navigate to  any "Notification Hub" in Name column of Notification Hubs pane and select it.
Select  ‘Overview’ from Menu and Select Test send from the command bar on top.
Test Send pane opens, navigate on Platforms edit box and select Windows Phone/Windows.
Navigate on the controls of test send pane and enter the details in the edit fields.
Navigate to 'send' control and select it. Sending notifications will appear on the top right of the page.

Please open the issue against the Azure Portal directly. The editor comes with a high contrast theme that the Azure Portal can employ to get high contrast.


Reformat plotting module to something more sensible.

create a subpackage plotting with modules base_objects, 3d_plots and 2d_plots

plotting module not importing many modules only loading pre-prepared files!


Moved most variables in sfml-graphics, GlResource and GlContext out of namespace scope

Everybody knows the age-old explanation of why things might go wrong with some code: "don't create global SFML objects".
Due to historical reasons, it was very difficult (although not impossible), effort-wise to implement working context management without the use of objects living in namespace scope. With the additions from modern C++ this has become much easier.
Having objects living in namespace scope introduces construction ordering requirements between translation units which has never been guaranteed by C++, this essentially makes this code broken. Saying users shouldn't put their stuff in namespace scope is just a workaround for something we can and really should fix. While we still shouldn't recommend this practice, we have to be realistic, it is still going to happen, and we have better things to do than to play code police. Standard library objects support this usage without causing undefined behaviour and SFML classes should strive to be that robust as well.
The changes in this changeset also set up a better facility to manage other types of OpenGL resources that can't be shared between contexts. This might be necessary in the future.
This code would have broken in so many ways without these changes:
#include <SFML/Graphics.hpp>

sf::RenderWindow  window(sf::VideoMode({1280, 720}), "Minimal, complete and verifiable example");
sf::Texture       texture;
sf::VertexBuffer  vbo;
sf::Shader        shader;
sf::RenderTexture renderTexture;

int main()
{
    window.setFramerateLimit(60);

    if (!texture.create(sf::Vector2u(1, 1)))
        return -1;

    if (!vbo.create(1))
        return -1;

    if (!shader.loadFromMemory("void main() {}", sf::Shader::Vertex))
        return -1;

    if (!renderTexture.create(sf::Vector2u(1, 1)))
        return -1;

    while (window.isOpen())
    {
        for (sf::Event event; window.pollEvent(event);)
        {
            if (event.type == sf::Event::Closed)
                window.close();
        }

        window.clear();
        window.display();
    }
}

Updated with suggestions.


Compiling Blade Components to Return JSON Instead of HTML

Context:
I'm working on a Laravel project where I need to use Blade views to declare components but instead of having the components output HTML, I want them to return JSON. The goal is to leverage Blade's templating engine to define component structures, while ultimately generating JSON output from these components, recursively handling nested components and passing their properties.
Problem:
Laravel's Blade system is primarily designed to compile templates into HTML, and its standard flow compiles Blade templates into PHP that renders HTML when processed. However, for my use case, I need to customize this process to return JSON output from my components.
Key Challenges:

Blade Compilation vs Rendering Phases:

During compilation, Blade templates are converted into PHP code. However, the actual interaction with component classes (like CardComponent, PageComponent, etc.) happens during the rendering phase.
My primary need is to hook into this rendering process so that instead of outputting HTML, the components return their properties in JSON format.

Blade directives:

I still want to be able to use Blade directives like @auth or @foreach in my templates to control the visibility of components or loop through them.
The challenge is how to ensure that any components declared within these Blade directives are still accessible in the rendering process, so they can be included in the final JSON structure.

Recursively Handling Nested Components:

My components can have nested children, and I need to handle this recursively. For example, a PageComponent might contain multiple CardComponents, and each CardComponent might have its own nested TextComponents.
Each component should be converted to JSON, and this process should handle recursion properly, including converting child components to JSON.

Attempted Solutions:

I initially thought about writing a custom Blade compiler to handle this, but it seems too complicated as Blade compilers focus on transforming Blade syntax into PHP and don’t directly interact with component classes.
I then considered modifying the render() method in each component class to return JSON. This approach seems more feasible, as Blade interacts with the component class during the rendering phase (after compilation), and I can override the render() method to output JSON instead of HTML.

Request for Help:

Is there a better approach for modifying the rendering phase of Blade components to output JSON instead of HTML?
How can I ensure that Blade directives like @auth or @foreach still work correctly and control the visibility of components, but ensure the components are still processed into JSON?
Any suggestions on recursively handling child components in a clean, maintainable way, especially given the structure of Blade components?
Should I consider any other Laravel internals or Blade extension mechanisms for handling this JSON conversion efficiently?

Do you have an example of the input and output you're looking to achieve? 🤔

Let me try to picture you:
Components Definition
app/View/Components/Page.php
namespace App\View\Components;

use Illuminate\View\Component;

class PageComponent extends Component
{
    public $title;
    public $description;

    public function __construct($title = null, $description = null)
    {
        $this->title = $title;
        $this->description = $description;
    }

    public function toJson()
    {
        return json_encode([
            'title' => $this->title ? $this->title->toJson() : null,
            'description' => $this->description ? $this->description->toJson() : null,
            'children' => $this->getChildren(),
        ]);
    }

    protected function getChildren()
    {
        // Return any child components or other Blade content
        // Here, you would need to iterate over any passed slots or content
    }

    public function render()
    {
        // Return view for normal rendering, but we also support JSON conversion
        return view('components.page');
    }
}

app/View/Components/Text.php
namespace App\View\Components;

use Illuminate\View\Component;

class TextComponent extends Component
{
    public $content;
    public $weight;

    public function __construct($content, $weight = null)
    {
        $this->content = $content;
        $this->weight = $weight;
    }

    public function toJson()
    {
        return json_encode([
            'type' => 'text',
            'content' => $this->content,
            'weight' => $this->weight,
        ]);
    }

    public function render()
    {
        return view('components.text');
    }
}

resources/views/components/page.blade.php
<!-- we don't need anything here actually -->

resources/views/components/text.blade.php
<!-- we don't need anything here actually -->

Page definition (using the components)
resources/views/my-page.blade.php
<x-page>
    <x-slot name="title">
        <x-text content="FOO" />
    </x-slot>

    <x-slot name="description">
        <x-text content="Bar" />
    </x-slot>

    @if(rand(1, 10) > 5)
        <x-text content="Random Text" />
    @endif

    <x-text content="Child 1" />
    <x-text content="Child 2" />
</x-page>

Rendering:
Route::get('/json-output', function () {
    return view('my-page')->render();  // This will now return the JSON
});

Expected output
{
    "title": {
        "type": "text",
        "content": "Foo",
        "weight": "w-400"
    },
    "description": {
        "type": "text",
        "content": "Bar",
        "weight": null
    },
    "children": [
        {
            "type": "text",
            "content": "Child 1",
            "weight": null
        },
        {
            "type": "text",
            "content": "Child 2",
            "weight": null
        }
    ]
}

I can give you more examples if needed, but basically i want to intercept the rendering process, and instead of parsing the html i just need access to the component class and call toJson() on it. (or any other better aproach than that)

Tried to return a json json from render() and override some methods inside the class, but in the end Blade wants a string


Remote autodetection leads to spawning of many jobs

This happens since the submitted job for the autodetection will respawn a job if it does not find the remote host topology which will byitself submit another job.
login-node -> autodetection job 1 on compute node
autodetection job 1 on compute node -> autodetection job 2 on compute node
.
.
autodetection job n-1 on compute node -> autodetection job n on compute node

This can be reproduced only if the RFM_CONFIG_FILE is set and the corresponding configuration has remote autodetection enabled.


TP vs LayerNorm (RMSNorm)

Quick question: is it normal that the layer_norm_weights of a LayerNormLinear / LayerNormMLP / MultiHeadAttention are different across different TP ranks (but identical for the same DP rank across a DP group) after an optimizer step?
My understanding is that the layer norm weights in transformerengine are designed to be duplicated and shared across all ranks.
(I can provide a minimum reproducible example if needed)

I don't think that's expected so yes, please provide a repro for that. @ksivaman for visibility.

Core observation
After running forward-backward on a TransformerLayer, and conducting an optimizer.step(), the layer_norm_weights in different TP ranks diverge from each other.
# before any optimizer.step()
self_attention.layernorm_qkv.weight: False             # expected to be different as TP is TP sharded
self_attention.layernorm_qkv.layer_norm_weight: True   # expected to be same as LN is supposed to be redundantly duplicated
layernorm_mlp.layer_norm_weight: True

# after optimizer.step()
self_attention.layernorm_qkv.weight: False
self_attention.layernorm_qkv.layer_norm_weight: False  # suddenly different
layernorm_mlp.layer_norm_weight: False

Test Reproduction
I provide a full replication script over here in this gist.
But the short summary of it is that I,

init distributed state with torch.distributed and apex.parallel_state
define a TransformerLayer roughly equivalent to a Llama-7B layer
create an optimizer for the transformer. I test standard torch.optim.Adam (over DDP), nn.parallel.ZeroRedundencyOptimizer (outdated ZeRO-1 equivalent), and DistributedFusedAdam (ZeRO-2 equivalent from apex). All 3 of them exhibit this issue.
create random [seqlen, batchsize, hiddendim] sized input and output (grad) tensors
check the equivalency of some weights before-and-after a (fwdbck, optim.step)

example output (bad)
$ torchrun --nproc_per_node 2 replication.py --optim DFA
[2023-09-22 09:26:24,105] torch.distributed.run: [WARNING]
[2023-09-22 09:26:24,105] torch.distributed.run: [WARNING] *****************************************
[2023-09-22 09:26:24,105] torch.distributed.run: [WARNING] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.
[2023-09-22 09:26:24,105] torch.distributed.run: [WARNING] *****************************************
/home/user/TransformerEngine/transformer_engine/pytorch/transformer.py:243: DeprecationWarning: Argument :attr:`self_attn_mask_type` has been moved to the `forward` method andis deprecated. It will be fully removed in future releases.
  warnings.warn(
/home/user/TransformerEngine/transformer_engine/pytorch/transformer.py:249: DeprecationWarning: Arguments `attention_softmax_in_fp32` and `apply_query_key_layer_scaling`are deprecated and will be fully removed in future releases.
  warnings.warn(
/home/user/TransformerEngine/transformer_engine/pytorch/module/base.py:656: UserWarning: To guarantee overlapping TP and SP collectives with the backwardGEMMs, set environment variable CUDA_DEVICE_MAX_CONNECTIONS = 1
  warnings.warn(
/home/user/TransformerEngine/transformer_engine/pytorch/transformer.py:243: DeprecationWarning: Argument :attr:`self_attn_mask_type` has been moved to the `forward` method andis deprecated. It will be fully removed in future releases.
  warnings.warn(
/home/user/TransformerEngine/transformer_engine/pytorch/transformer.py:249: DeprecationWarning: Arguments `attention_softmax_in_fp32` and `apply_query_key_layer_scaling`are deprecated and will be fully removed in future releases.
  warnings.warn(
/home/user/TransformerEngine/transformer_engine/pytorch/module/base.py:656: UserWarning: To guarantee overlapping TP and SP collectives with the backwardGEMMs, set environment variable CUDA_DEVICE_MAX_CONNECTIONS = 1
  warnings.warn(
attn_qkv weight: False
attn_ln weight: True
mlp_ln weight: True
/home/user/TransformerEngine/transformer_engine/pytorch/attention.py:104: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  data_ptr = grad_outputs[0].storage().data_ptr()
/home/user/TransformerEngine/transformer_engine/pytorch/attention.py:104: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  data_ptr = grad_outputs[0].storage().data_ptr()
attn_qkv weight: False
attn_ln weight: False
mlp_ln weight: False

Package Versions
NVIDIA/TransformerEngine: c32a62ccb0a38d14d98e8bd6a14ace2d73bbac25 (current main commit ID, installed as pip install -e)
torch==2.2.0.dev20230914+cu121
apex: see here, which is identical to NVIDIA/apex main except with CLI flags edited to enable/compile DistributedFusedAdam. You can use NVIDIA's main apex if you are not testing DistributedFusedAdam.

if any additional information is required please let me know
additionally, if there is a more correct way to initialize the optimizers or parallel state, i would be exceedingly grateful to be told as much

nvm i'm dumb
the inputs weren't the same
after fixing that, things work as anticiated
closing this


Feature stephen showcase page

In addition to the comment about renaming to sample apps, could we put their repositories as a submodule in a 'samples' folder? https://git-scm.com/book/en/v2/Git-Tools-Submodules

Best is to have link to source code as well I think that's the most important

What's the yarn.lock conflict?

Removed yarn.lock conflict


Need ability to set use_remote_address to false in ingressgateway envoy config

Describe the feature request
Need to be able to tell an ingressgateway that it's not the absolute edge proxy.  Currently the value for it's envoy http connection filter 'use_remote_address' configuration is hardcoded to true.  This causes it to ignore values set for x-forwarded-for, x-forwarded-proto etc.  In turn, this breaks the behavior of the httpsRedirect flag in a gateway configuration when TLS is terminated prior to the ingressgateway.
Describe alternatives you've considered
I've experimented with using Lua EnvoyFilters to inspect headers and provide a workaround http->https redirect, however the filter sees the headers after they've already been mangled.  Potentially I could run yet another proxy between the loadbalancer and the ingressgateway, but this is something I really want to avoid.
As far as I can tell it's not possible to patch an automatically generated envoy filter.
Additional context
My exact scenario is this:

Running in GKE
Tried with both GKE provided Istio and Istio 1.0.6
Want to put a Google Global HTTP(S) Load Balancer in front of my ingressgateway, rather than using the default regional TCP loadbalancer.
Want to terminate TLS on the Google LB (whether or not I end up using TLS from the Google LB back to ingressgateway)

Related to:

https://github.com/istio/istio/issues/7964
https://github.com/istio/istio/issues/7607

@gdhagger For the particular case of using a Google HTTPS balancer over GKE, we've been able to make it work with a bunch of workarounds:

istio ingressgateway is deployed with Service type: NodePort and externalTrafficPolicy: Local, port 15020 (healthcheck) is also exposed to (an arbitrary) nodePort 31320 (similar to the default 31380 for HTTP and 31390 for HTTPS)
a custom GCE Health Check is created for port 31320, HTTP URL /healthz/ready
ports 31380 (HTTP) and 31390 (HTTPS) of ingressgateway Service are manually added to the port mapping for the GCE Instance Group of GKE's node pool where ingressgateway pods are deployed
two Load Balancers are deployed, one for HTTP and one for HTTPS, with backends pointing to HTTP and HTTPS ports respectively of the GKE's node pool Instance Group, using the health check defined beforehand

(The drawback here is that if a node pool is recreated then the ports should be mapped again for the new instance group, but we have the whole sequence scripted in Terraform so it helps a bit.)
With this configuration a common Gateway resource with httpsRedirect for port 80 and TLS mode: SIMPLE termination on port 443 is working as expected.
Hope it helps.

@sangwa These workarounds shouldn't be necessary, and even with them I don't believe it actually solves the problem.

Two loadbalancers = two IPs, which means having multiple DNS records and knowing ahead of time which one you want to request.   The whole point of the HTTP->HTTPS redirect is to be able to hit one endpoint and get redirected appropriately.

Also, from the testing I've done, even with externalTrafficPolicy: Local I don't believe the correct IP will be used by envoy as the 'real' IP of the client unless we are able to tune the use_remote_address parameter. (Also, for the record I'm using Network Endpoint Groups rather than Instance Groups to hit my pods)
For now I've solved the redirect portion by putting AWS CloudFront in front of my LB for any subdomains that need to be redirected from HTTP->HTTPS.

Two loadbalancers = two IPs

Not necessarily, we have both balancers on the same global IP, just different ports (80 vs 443).

My apologies, you're absolutely right!  For some reason I was completely
convinced I could only attach a global IP to one LB at a time.
On Tue, Mar 26, 2019 at 2:35 AM Yaroslav Zhavoronkov <
<EMAIL_ADDRESS>wrote:

Two loadbalancers = two IPs
Not necessarily, we have both balancers on the same global IP, just
different ports (80 vs 443).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/istio/istio/issues/12549#issuecomment-476494010, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAbeH-sZTG76IEagLGFLJHJJgWLTgAA2ks5vab-ygaJpZM4b4HhW
.

Note for anyone who comes across this issue:
When trying to create an ingress assigned to a global IP already attached to another loadbalancer NOT managed by GKE ingress, I received the following error:
Error during sync: Error running load balancer syncing routine: googleapi: Error 400: Invalid value for field 'resource.IPAddress': 'IP.RED.ACT.ED'. Specified IP address is in-use and would result in a conflict., invalid

However, using another IP address I was able to create two GKE ingresses using the same global IP.

I have the exact same problem...
I think Istio should trust headers comming from known upper LB and avoidi to strip them.
I understand the security issues related to these headers, but this is a blocking point for us to adopt Istio.

Same issue here.

Can someone that works on Istio help triage this?
Maybe @rshriram? I've seen some comments of yours on some related PRs / issues, such as #13157.

@howardjohn - are there any updates on this? cc: @PiotrSikora, who was also active in the conversation over on #7679, which is related.

Yes. Someone added this and we found later it broke existing users so we set it behind a feature flag. For now it can be enabled with --set pilot.env.PILOT_SIDECAR_USE_REMOTE_ADDRESS=true. I think someone is working on adding a proper api for this

Also, with the newer EnvoyFilter API, you can tweak a whole lot of envoy settings like this without clumsy workarounds like env vars. https://github.com/istio/api/blob/master/networking/v1alpha3/envoy_filter.proto

@rshriram - that api looks like exactly what we want. Nice. Is going to be in 1.3.x, or later?
@howardjohn - thanks! I'll check that out in the meantime.

1.3.x .. its almost done

Yes. Someone added this and we found later it broke existing users so we set it behind a feature flag. For now it can be enabled with --set pilot.env.PILOT_SIDECAR_USE_REMOTE_ADDRESS=true. I think someone is working on adding a proper api for this

I might be missing something but I don't see how this is applied to the ingress-gateway ?
this seems hardcoded here :
https://github.com/istio/istio/blob/f772ceea87ae58896e1eabe2cf83ebfd8c54bf6d/pilot/pkg/networking/core/v1alpha3/gateway.go#L358

@howardjohn I think we should re-open this issue :
The issues specifically is about setting use_remote_address to false on the ingress-gateway.
Currently I have not been able to do that, except by forking pilot.

the flag you mention does allow setting use_remote_address to true for sidecars (defaults to false) but it doesn't change anything on the ingress-gateway. On my ingress-gateway the use_remote_addressis truewhich is the default on 1.3.x as far as I can make from the code.

Using the EnvoyFilter below I'm able to modify the http_connection_manager but my value for use_remote_address is over-ridden during the MERGE.
I know my envoy filter is applied because the xffNumTrustedHops is set to 2

apiVersion: networking.istio.io/v1alpha3
kind: EnvoyFilter
metadata:
  name: ingressgateway-settings
  namespace: istio-system
spec:
  configPatches:
  - applyTo: NETWORK_FILTER
    match:
      context: GATEWAY
      listener:
        filterChain:
          filter:
            name: envoy.http_connection_manager
    patch:
      operation: MERGE
      value:
        typed_config:
          '@type': type.googleapis.com/envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager
          use_remote_address: false
          xff_num_trusted_hops: 2
  workloadSelector:
    labels:
      istio: ingressgateway

[
    {
        "name": "<IP_ADDRESS>_80",
        "address": {
            "socketAddress": {
                "address": "<IP_ADDRESS>",
                "portValue": 80
            }
        },
        "filterChains": [
            {
                "filters": [
                    {
                        "name": "envoy.http_connection_manager",
                        "typedConfig": {
                            "@type": "type.googleapis.com/envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager",
                            "statPrefix": "<IP_ADDRESS>_80",
                            "rds": {
  ...
                            },
                            "httpFilters": [
...
],
                            "useRemoteAddress": true,
                            "xffNumTrustedHops": 2,
                            "generateRequestId": true,
...
    }
]

Maybe related use_remote_address is not a bool type. it is a struct
type BoolValue struct {
	// The bool value.
	Value                bool     `protobuf:"varint,1,opt,name=value,proto3" json:"value,omitempty"`
	XXX_NoUnkeyedLiteral struct{} `json:"-"`
	XXX_unrecognized     []byte   `json:"-"`
	XXX_sizecache        int32    `json:"-"`
}

You can preserve the external request id with the following EnvoyFilter.  I'm running Istio 1.3.0.
apiVersion: networking.istio.io/v1alpha3
kind: EnvoyFilter
metadata:
  name: ingressgateway-settings
  namespace: istio-system
spec:
  configPatches:
  - applyTo: NETWORK_FILTER
    match:
      context: GATEWAY
      listener:
        filterChain:
          filter:
            name: envoy.http_connection_manager
    patch:
      operation: MERGE
      value:
        typed_config:
          '@type': type.googleapis.com/envoy.config.filter.network.http_connection_manager.v2.HttpConnectionManager
          preserve_external_request_id: true

Thanks to https://github.com/envoyproxy/envoy/pull/7140

@fcantournet have you got a solution for your issue for 1.3.x version, i have created a EnvoyFilter similar to yours, and confirmed that it works on 1.4.0, but there're intermittent 503 issues. Changing it to 1.3.5 doesn't seem to work

@jh-sz I am facing the same issue on 1.3.5, setting xff_num_trusted_hops works on 1.4.0 but not in 1.3.5, did you managed to make it work ?

@bbenlazreg don't think it works for 1.3.5

don't think it's solved in 1.10. I can not set use_remote_address: false via EnvoyFilter

This is still true as of Istio 1.17.2. I've tried using this EnvoyFilter:
apiVersion: networking.istio.io/v1alpha3
kind: EnvoyFilter
metadata:
  name: ingressgateway-settings
  namespace: istio-ingressgateway
spec:
  configPatches:
  - applyTo: NETWORK_FILTER
    match:
      context: GATEWAY
      listener:
        filterChain:
          filter:
            name: envoy.filters.network.http_connection_manager
    patch:
      operation: MERGE
      value:
        typed_config:
          '@type': type.googleapis.com/envoy.extensions.filters.network.http_connection_manager.v3.HttpConnectionManager
          use_remote_address: false
          xff_num_trusted_hops: 2
  workloadSelector:
    labels:
      istio: ingressgateway-ns

And saw the same thing:
use_remote_address: true,
...
xff_num_trusted_hops: 2,

Is there an existing ticket for the fact that Istio EnvoyFilters cannot set boolean values? This may end up being a proto issue as well.