App config merge versions

Brings azure-spring-cloud-appconfiguration-config into master with spring-cloud-azure-appconfiguration-config

/azp run java - appconfiguration - ci

No ci was triggered, I'm going to close and reopen the PR.

/azp run java - appconfiguration - ci

/azp run java - appconfiguration - ci

/azp where

@mrm9084 it looks like something odd has happened with the changes which is blocking devops from correctly handling the ci triggering. In the past I've been able to workaround such issues by rebasing. Can you please rebase your changes on top of the latest master and perhaps squash them to eliminate any odd merge issues.

Created a new one that fixed everything. https://github.com/Azure/azure-sdk-for-java/pull/21021


net/url: PathEscape treatment of reserved characters is inconsistent

; and , are permitted by RFC 3986 in path segments, but PathEscape percent-encodes them because "URI producing applications often use the reserved characters allowed in a segment to delimit scheme-specific or dereference-handler-specific subcomponents". However, it does not escape other reserved characters potentially subject to the same kind of special treatment:

= is "often used to delimit parameters and parameter values", particularly in conjunction with ; (e.g., "name;v=1.1")
. is used in . and .. "dot-segments" to "indicate relative position within the hierarchical tree of names… interpreted within the URI path hierarchy… removed as part of the resolution process".
: is not allowed in the first path segment of a relative-path reference, "as it would be mistaken for a scheme name" (e.g., a URI reference of "foo:bar/baz/quux" is very different from "foo-bar/baz/quux").

What version of Go are you using (go version)?
1.11
Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
linux amd64
What did you do?
https://play.golang.org/p/f-byVa3k2gi
pathSegments := []string{"non-scheme:non-authority", "foo=bar;bar=baz", ".."}
for i, segment := range pathSegments {
	pathSegments[i] = url.PathEscape(segment)
}
fmt.Println(strings.Join(pathSegments, "/"))

What did you expect to see?
non-scheme%3Anon-authority/foo%3Dbar%3Bbar%3Dbaz/%2E%2E (all potentially special characters percent-encoded), or maybe non-scheme:non-authority/foo=bar;bar=baz/.. (no characters percent-encoded unless required by RFC).
What did you see instead?
non-scheme:non-authority/foo=bar%3Bbar=baz/..

@bradfitz @andybons
I tried to debug latest go1.11 version shouldEscape function  from src/net/url/url.go:101:
and if you can confirm that bug exists and we need to fix it I think I can try it:
   138:			case encodePathSegment: // §3.3
   139:				// The RFC allows : @ & = + $ but saves / ; , for assigning
   140:				// meaning to individual path segments.
=> 141:				return c == '/' || c == ';' || c == ',' || c == '?'

An actual implementation is always a mix of RFC and practical usage. And trying to follow RFC to the letter has bit us in the past (https://github.com/golang/go/issues/27302). I believe what we are trying to do here is only escape those characters which are intended to be used as delimiters in a path segment.
I am curious to know whether you are actually facing issues due to this, or you have just stumbled across this.
On a different note, reading the RFC and the code, I have a different question -
@bradfitz - Regarding this comment -

// The RFC allows : @ & = + $ but saves / ; , for assigning
// meaning to individual path segments.

The RFC mentions -

For example, the semicolon (";") and equals ("=") reserved characters are
often used to delimit parameters and parameter values applicable to
that segment.  The comma (",") reserved character is often used for
similar purposes.

So, following this logic, shouldn't = be escaped too, since we are already escaping , and ; ? Or possibly I missed something ?

I opened this three months ago, and don't remember the details of the problems it caused (a workaround was simple and implemented without fuss). And if you see compelling reason to leave the inconsistent behavior in PathEscape (e.g., because net/url changes are "always problematic compatibility-wise"), then so be it... but even in that case, documentation should be updated for accuracy, e.g.

PathEscape escapes the string so it can be safely placed inside a URL path segment. Most characters reserved for delimiting data within URIs are percent-encoded, but for compatibility reasons the following characters are not: $ & + = : @

Though I still think that it would make sense to percent-encode =, matching ; and ,.

Has this ever been looked at after? I came here after I noticed the : did not get escaped in pathEscape. It would be nice to have at least one function in the net/url package to escape all the special characters.


Relicense under MIT

Currently licensed under Academic Free License v3.0 .

https://github.com/galaxyproject/gxformat2/blob/master/README.rst still says AFL

https://github.com/galaxyproject/gxformat2/blob/master/README.rst still says AFL

@mr-c Fixed in commit badfbb2bf525edbb488fbd87e73330a01b4fa767 , thanks!


Internal server error

Please make sure your issue complies with these guidelines:

[ ] Server Software must be the official PMMP w/o vanilla patching plugins (i.e. TeaSpoon)

[ ] Issue must have not been reported previously

[ ] Make sure you are on the latest version of PMMP & PiggyAuctions

[ ] Have a detailed title.

Issue Description

Expected result: What were you expecting to happen?
Actual result: What actually happened?

Steps to Reproduce the Issue

It show internal server error
and plugin has LATEST VERSION

OS and Versions

PocketMine-MP:
PiggyAuctions:
PHP:
Server OS:

Extra Information

download invcrashfix plugin https://github.com/DaPigGuy/PiggyAuctions#notice


Expand the PodmanEngine and refactor to use it

This expands the methods in the PodmanEngine (adds InspectImage) and
implements Save. It demonstrates the usage of these in the util functions
and the HasRequiredLabels check. This removes a lot of code from the
check and simplifies it dramatically. It also adds a unit test for the
labels check.
Signed-off-by: Brad P. Crochet<EMAIL_ADDRESS>

Runs on my machine!
time="2021-07-08T13:15:12-05:00" level=info msg="check completed: BasedOnUbi" result=PASSED
{
    "image": "registry.access.redhat.com/ubi8/ubi:latest",
    "validation_lib_version": {
        "version": "0.0.0",
        "commit": "c891eab1641ca1fdad35285f323e75bfa8bc01ff"
    },
    "results": {
        "Passed": [
            {
                "description": "Checking if the container's base image is based on UBI",
                "level": "best",
                "knowledge_base_url": "https://connect.redhat.com/zones/containers/container-certification-policy-guide",
                "check_url": "https://connect.redhat.com/zones/containers/container-certification-policy-guide"
            }
        ],
        "Failed": [],
        "Errors": []
    }
}


#117

exported local debug function into defaults
accepting local debug function as an options parameter, so that it can be replaced

Why don't we keep the default debugLogger and control debugging functionality with a configurable boolean? What do you think?

I think a boolean would be cleaner. Else set a the internal logger level to INFO and let users switch it to DEBUG if they wish for internal logging.

I think it's better to allow user configure the internal debugging himself however he needs (some will want console.log, others logentries or something else.
@StephenHynes7 will this work, as these messages can happen before the logger is initialized?

I think it is still better to have a working default. At the moment it will call an empty function if it is not configured explicitly.

I don't actually see the use-case of this local debugger which is turned on by default

It won't be turned on by default - sorry for misunderstanding. Imagine we have a new boolean option called "debug" and it will default to false. And in the application we will allow or disallow internal logging according to that flag. If user wants to override debugLogger after setting debug to true, this will be possible with this as well.
Use cases can vary on this. Personally, it's good to have something like this to use during development/testing.

Oh, I've misunderstood you :)
I agree on having a switch and a function override possibility!

I've added a flag to turn on\off debug logger and brought back default logger

Thanks for adding the debug boolean. I think this is the ideal solution here.

Good stuff @vgoloviznin, there is only a few scope/access problems I mentioned above.

@stopal-r7 thanks for reviewing the code!
It's a bit hard to keep track of both arrow and normal functions :(

You're welcome. That looks great to me! I agree that using two types of function calls is confusing, will fix that soon.


fix: only check for collected artists feature flag if ff is enabled

Description
I am adding this check in case we roll back enabled collected artists after releasing it and having artists and no arworks in my collection.
I noticed this design "bug" on my personal accounts after disabling the feature flag while having collected artists in my collection.

#nochangelog
Need help with something? Have a look at our docs, or get in touch with us.

Warnings

:warning:

✅ No changelog changes

  Generated by :no_entry_sign: dangerJS against 460254cec104437dcb1014192f3e47c8015f39e8


fix: update AccountExtendedBalances interface

add lock_tx_id prop
Description
Fixes #1437
Adds the lock_tx_id property to the AccountExtendedBalances interface.
Checklist

[ ] Unit tested updated code paths
[x] Tagged 1 of @janniks or @zone117x for review

Tagging @janniks to review. Thanks

Thanks for the contribution 🙏


Demo with Visualization

Hey folks - I really love this model so I made a demo and put it up here! Feel free to try it for yourself. Also made a few changes that would return consistent frame numbers regardless of input frame rate, etc.
https://www.sievedata.com/functions/sieve/talknet-asd
P.S. I work at this company Sieve that works on video and audio AI.

Thanks bro! This demo page is cool. Appreciate for your contribution!
I will also consider adding this demo page for better representation in my future work.
By the way, I have checked your company website. Great work :)

Amazing! Glad you like it. You should be able to deploy and make these demos yourself in the future pretty easily by just signing up and following the instructions :)

@TaoRuijie
Thank you for sharing!
Is the pre-trained model used in this demo identical to the one described in the README?
I feel that the output results I have tried locally and with Sieve are too different.


'Comment' in project.json file causes VS Code extension to fail at startup

First, yes I know // is not a valid entry for project.json, it is really only there because I was quickly looking for a way to experiment with removing something.  It turns out that dotnet-cli respected the comment (or at least did not die).
project.json
{
"version": "1.0.0-*",
"compilationOptions": {
"emitEntryPoint": true
},
"dependencies": {
"Microsoft.NETCore.App": {
"type": "platform",
"version": "1.0.0-rc2-3002359"
}
},
"frameworks": {
"netcoreapp1.0": {
"imports": "dnxcore50"
}
},
// comment
"runtimes" : {
"osx.10.11-x64" : {}
}
}
Open the folder with this file...
[ERROR:OmniSharp.Startup] The project system 'DotNetProjectSystem' threw exception during initialization.
Illegal character '/' (Unicode hexadecimal 002F).
at Microsoft.DotNet.ProjectModel.ProjectReader.TryGetProject(String path, Project& project, ICollection1 diagnostics, ProjectReaderSettings settings)    at Microsoft.DotNet.ProjectModel.WorkspaceContext.AddProjectEntry(String projectDirectory, FileModelEntry1 currentEntry)
at System.Collections.Concurrent.ConcurrentDictionary2.AddOrUpdate(TKey key, Func2 addValueFactory, Func3 updateValueFactory)    at Microsoft.DotNet.ProjectModel.WorkspaceContext.Refresh()    at Microsoft.DotNet.ProjectModel.WorkspaceContext.CreateFrom(String projectPath)    at OmniSharp.DotNet.DotNetProjectSystem.Initalize(IConfiguration configuration)    at OmniSharp.Startup.Configure(IApplicationBuilder app, IServiceProvider serviceProvider, IOmnisharpEnvironment env, ILoggerFactory loggerFactory, ISharedTextWriter writer, IOmnisharpAssemblyLoader loader, IOptions1 optionsAccessor)
At this point no language services work.  My recommendation is to ensure that this does not cause the language service to die at startup, but rather handle it.
C# Extension 1.0.3-rc2

@troydai -- this looks like an issue for omnisharp-roslyn.

It is actuall

@jeffschwMSFT @DustinCampbell  this is actually beyond omnisharp-roslyn. dotnet-cli inherits the code for parsing project.json from the original DNX. we (actually

Thanks @DustinCampbell
@jeffschwMSFT yes, omnisharp-roslyn can do a better job to handle this error. I'll open an issue in omnisharp-roslyn repo to track this bug.
Some back ground: this is actually beyond omnisharp-roslyn. dotnet-cli inherits the code for parsing project.json from the original DNX. We (actually me) wrote a customized json deserializer for DNX to replace JSON.NET to achieving greater performance. We made a decision back then that the deserializer will follow strict JSON schema therefore reject comments in JSON. If it does make your work harder, ma

https://github.com/OmniSharp/omnisharp-roslyn/issues/535

Bug is refiled over in omnisharp-roslyn repo.


Is there an API option to create custom labels?

This document tells how to create custom label in portal. Is there an API or powershell command to do the same?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4ecc186b-cbfd-1c4e-fc2e-165883dc0a02
Version Independent ID: 207f8456-0e71-c5c6-ddbd-88c0762dfc1e
Content: Customize SQL information protection - Azure Security Center
Content Source: articles/security-center/security-center-info-protection-policy.md
Service: security-center
GitHub Login: @memildin
Microsoft Alias: memildin

@CharmanderJieniJieni
Thanks for your feedback! We will investigate and update as appropriate.

@CharmanderJieniJieni This Azure SQL documentation gives you a list of PowerShell cmdlets for managing sensitivity labels in Azure SQL Database and Azure SQL Managed Instance, as well instructions on using the REST API:
https://docs.microsoft.com/en-us/azure/azure-sql/database/data-discovery-and-classification-overview#use-powershell-cmdlets
PowerShell cmdlets for Azure SQL Database
Set-AzSqlDatabaseSensitivityClassification
Example 1: Set information type and sensitivity label of a column in an Azure SQL database.
Set-AzSqlDatabaseSensitivityClassification -ResourceGroupName resourceGroup -ServerName server -DatabaseName database -SchemaName schema -TableName table -ColumnName column -InformationType informationType -SensitivityLabel label
PowerShell cmdlets for Azure SQL Managed Instance
Set-AzSqlInstanceDatabaseSensitivityClassification
Example 1: Set information type and sensitivity label of a column in an Azure SQL managed instance database.
Set-AzSqlInstanceDatabaseSensitivityClassification -ResourceGroupName resourceGroup -InstanceName managedInstance -DatabaseName database -SchemaName schema -TableName table -ColumnName column -InformationType informationType -SensitivityLabel label
Use the Rest API
Create Or Update: Creates or updates the sensitivity label of the specified column.
PUT https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.Sql/servers/{serverName}/databases/{databaseName}/schemas/{schemaName}/tables/{tableName}/columns/{columnName}/sensitivityLabels/current?api-version=2017-03-01-preview

@CharmanderJieniJieni We are going to close this thread as resolved but if there are any further questions regarding the documentation, please tag me in your reply and we will be happy to continue the conversation.

@kobulloc-MSFT  the API you provided are for data classification, my question was is there API to create labels and information types. Currently I only see this doable from portal

@CharmanderJieniJieni
It doesn't look like there's any APIs regarding creating custom labels.
Findings:
Here is a complete list of our REST APIs for Azure Security Center. Within that list, there's only three APIs for Information Protection Policies, and one for Create/Update Sensitivity Labels. Our Microsoft Information Protection SDK, only has three APIs - File API, Policy API, and Protection API, none of which perform the creation of a new custom label.
Here's a full list of PowerShell cmdlets for Azure Information Protection (AIP) and the AIP Service, for your reference.
Since we don't have an API for your issue, feel free to provide feedback or a feature request using this link.
Additional Links:
Microsoft Information Protection SDK - Classification label concepts
Configuring your organization's policy
Current default policy
Please let me know if you have any other questions.
Thank you for your time and patience throughout this issue.

Thanks James,
The Information Protection Policies seems to be able to create custom labels, just wondering is there a corresponding PowerShell command for this?
Also, in this section of the document it mentioned about Set-AzSqlInformationProtectionPolicy. But when I tried to test it in Cloud Shell it is actually complaining command not found. Would you please suggest?

@CharmanderJieniJieni
The Information protection policy - powershell commands don't look to have the create/update policies cmdlet.
Regarding Set-AzSQL, you might have to install the AIP client or Unified client in order for the AIP modules to work. However, since this feature is currently in "Preview", you can provide feedback by using our General Feedback page.
We can also work with the author of this doc to get that section updated since I was able to reproduce your issue as well.

If you have any other questions, please let me know.
Thank you again for your time and patience throughout this issue.

@CharmanderJieniJieni
I just wanted to check in and see if you had any other questions regarding the API/PowerShell commands to create custom labels? If not, I'll go ahead and route this issue to the author to look into and update the Set-AzSQL section, as needed.

Assigning this issue to the author to look into and update the Manage SQL information protection using Azure PowerShell section, and update as needed.

Hi @CharmanderJieniJieni,
If you want to create custom labels or information types via PowerShell cmdlet, you have to first export your SQL IP via Get-AzSqlInformationProtectionPolicy, add in the JSON file the labels and/or the information types, and then import the JSON you created via Set-AzSqlInformationProtectionPolicy.

@CharmanderJieniJieni thanks for taking the time to help us improve the docs.
Hopefully, the information from @DavidTrigano is enough to help you complete the tasks you were working on.
I'm going to close this issue, but feel free to comment again here or open a new one if you have additional requests.
This documentation page is going to get refreshed in the coming months, and we'll incorporate the information discussed here.
#please-close


Combination of directory tree (-dt) and software invocation (-si) flags causes error

Example using pyLODE repository:
inspect4py -i pyLODE -o pyLODE-out -dt -si
Output:
Traceback (most recent call last):
  File "/opt/homebrew/Caskroom/miniforge/base/envs/inspect4py/bin/inspect4py", line 33, in <module>
    sys.exit(load_entry_point('inspect4py', 'console_scripts', 'inspect4py')())
  File "/opt/homebrew/Caskroom/miniforge/base/envs/inspect4py/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/inspect4py/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/inspect4py/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/inspect4py/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/Users/cjwilliams/GitHub/inspect4py/inspect4py/cli.py", line 1333, in main
    all_soft_invocation_info_list = extract_software_invocation(dir_info, directory_tree_info, input_path,
  File "/Users/cjwilliams/GitHub/inspect4py/inspect4py/utils.py", line 169, in extract_software_invocation
    if elem["main_info"]["main_flag"]:
TypeError: string indices must be integers

Can you please indicate your python version?

I have fixed the issue! It should work now


material-ui, why does switching themes not work after multiple calls?

In the following code, the first three times of "Switch Theme" are able to switch themes normally, but after that, the themes cannot be switched normally. What is wrong with the code below?
Thank you.
Code:
import Button from "@material-ui/core/Button";
import {
  grey,
  purple,
  teal,
  green,
  orange,
  brown,
} from "@material-ui/core/colors";
import { createMuiTheme, ThemeProvider } from "@material-ui/core/styles";
import { useState } from "react";

const myTheme = createMuiTheme({
  palette: {
    primary: {
      main: purple[500],
    },
    secondary: {
      main: grey[300],
    },
  },
});

const my2 = createMuiTheme({
  palette: {
    primary: {
      main: green[300],
      dark: green[900],
    },
    secondary: {
      main: teal[300],
      dark: teal[900],
    },
  },
});

const my3 = createMuiTheme({
  palette: {
    primary: {
      main: orange[300],
      dark: orange[900],
    },
    secondary: {
      main: brown[300],
      dark: brown[900],
    },
  },
});

export default function CustomsTheme() {
  const [tt, setTT] = useState(myTheme);
  const [n, setN] = useState(1);
  const handleChange = () => {
    if (n >= 3) {
      setN(1);
    } else {
      setN(n + 1);
    }
    console.log(n);
    switch (n) {
      case 1:
        setTT(myTheme);
        break;
      case 2:
        setTT(my2);
        break;
      case 3:
        setTT(my3);
        break;
      default:
        break;
    }
  };

  return (
    <ThemeProvider theme={tt}>
      <Button variant="contained" color="primary">
        Test Button
      </Button>
      <Button variant="contained" color="secondary">
        Test Button
      </Button>

      <Button onClick={handleChange}>Switch Theme</Button>
    </ThemeProvider>
  );
}

The result I want is to switch between multiple themes at will
Where is the problem?

if (n >= 3) {
setN(1);
} else {
setN(n + 1);
}
console.log(n);

Note that when logging n, it will still have the old value:
// n = 1
setN(n + 1);
console.log(n); // logs: "1"

For more information check out Why is setState in reactjs Async instead of Sync?


Urllib3 2.2.1 is vulnerable, but required by this package

The requirements.txt file contains urllib3==2.2.1, which is vulnerable. See their changelog

Updated all requirements for the package to latest: https://github.com/cboin1996/requests-html/pull/17


Error during login

I got spotify ripper set up with the key, but when trying to log in I get this error after inputting my credentials:
Logged in failed: UNABLE_TO_CONTACT_SERVER
Encountered issue while logging into Spotify, aborting...

Sorry, my fault. The correct way to login is using parenthesis:
spotify-ripper -u "EMAIL"


Fix installation

No need for command line : doucle click the plugin

** Simplified installation steps
Install latest Loupedeck Software from Loupedeck Software - Download Now!
Install FSUIPC: http://www.fsuipc.com/ (Tested with v7.2.14/7.2.14 on Win 10/11)
Download the latest MSFS Deck plugin: Releases · calibx/msfsdeck · GitHub
Doubleclick the downloaded .lplug4 file to install the plugin
Check from Loupedeck software that you can see the MSFS profile
And you should be good to go!


Pinch interactive animator/controller

Add Pinch Close/Open gestures for Pop/Dismiss.
Set Pinch gesture as default interactiveGestureType for SystemCameraIrisAnimator and PortalAnimator
Fix a bug for PortalAnimator when use it with interactive gesture fromView.removeFromSuperview() will cancel the InteractiveAnimator, so hide fromView during the transition and make it visible when the transition finishes. Have to use print() logs to find the problem, it took me days to find out and fix it 😓 . Will PR back to VCTransitionsLibrary later
Set Backward as default for PortalAnimator since Portal(Forward) will crash tab bar animation. It didn't crash because in master, it calls executeBackwardAnimations if we don't set the direction like "Portal" only.

@tbaranes please have a look, thanks. I think we are ready for 2.3 after this PR. 🎊
should close #125

Just one question about the HollowState(Open/Close) versus Direction(Open/Close), otherwise, seems perfect, and nice catch for the Portal.
Let's move forward by releasing 2.3 👍

@tbaranes I merge it first, I have looked at SystemCameraIrisAnimator and think it should not have any knowledge about  GestureDirection because it is not a gesture animator/controller.
Since 2.3 is a big release, I am going to write some documents before the release. Will start with Transitions.md based on your great suggestions. 😄


Duplicate completion entries for undefined

#23591 exposes more completions bugs. See the // TODO: GH#23587 comment in fourslash.ts.

Still seeing this in some tests.

Fixed by #26648


Rename minimum_version_specified to version_specified.

Merge with https://github.com/Homebrew/brew/pull/6366.

Can be merged now.


Access the clrDgField or displayed value from the clrDgSortBy comparator function

[ ] bug
[ ] feature request
[X] enhancement

Expected behavior
This is more of a question first, and a request only if what I'm trying to do is not possible.
I'd like to be able to access the clrDgField from the clrDgSortBy comparator function. I am using ngx-tranlsate to translate strings in my app. This is done in my HTML templates via a translate pipe so the values backing my datagrid are untranslated, but displayed as translated text. The built in comparators are using the object property values to run the comparisons on instead of the string values shown in the UI (which have been translated). What I would like to do is create one TranslatedComparator that can access the current field (or better yet, the actual text value being displayed in the UI) and just translate all of the column values on the fly during sort (so it sorts in the correct order based on the translated values, not the actual data values). I realize I can create a customized comparator for each column, but that seems like overkill since the main functionality will always be the same - take a string, convert it to its translated version, then compare. I would love to make this reusable rather than have a bunch of one offs with the only difference being which object property is being translated. So:

Is this already possible?

If not, can this be added as an enhancement?

I would ask for the same to be available for custom filters as well

As you mentioned, creating a custom comparator would be a reasonable way to do this. I understand your concern about creating a bunch of one-offs, but this is easily handled by creating a single comparator that takes the field as a property:
export class TranslatedPropertyComparator implements Comparator<any> {
    constructor(private prop: string) {}

    public compare(a: any, b: any): number {
        let translatedA = myTranslator(a[prop]);
        let translatedB = myTranslator(b[prop]);
        return translatedA.localeCompare(translatedB);
    }
}

Of course, you might have to add undefined detection and stuff like that, but that's the idea.
The same works for StringFilter.
Now, I'm not convinced I would recommend this, because when you're sorting or filtering a 10k items datagrid, you perform the translation for each item when you use it in a comparison. That means with, say, a standard O(n*log(n)) sort, you'll translate n*log(n) times for n elements. Really not optimal. And then you'll re-do it for every re-sort or re-filter.
I would really recommend you have the translations for the current local in your model, without persisting them of course. This can happen as a pass over the items when you receive the data from the server, for instance.
Note that we stay away from i18n because there are still many different solutions for it out there, and picking one would pretty much mean dropping support for the others (or even worse, forcing everyone to move to our choice because we have a hard dependency on it). So any feature that would have us integrate an i18n solution is going to be a "no" for quite some time.
I hope this helps, I'll leave the issue open in case you want to discuss it more or have additional questions. Feel free to close if you want. 😄

Great, thanks for the feedback on this. I'll this out.


client: Parse the url only once per Client

This stood out on flame graphs due ultimately to the http.NewRequestFromContext call, which ends up calling url.Parse and this happens on every single RPC call.
I did an optimization in #447 which similarly, and this is a natural extension of this.
We can just parse the url string once during NewClient, validate at that point, then tag along the parsed *url.URL everywhere else and never use it as a string again. This value never mutates through the lifetime of a Client and isn't publicly available on any structs.
Before:

After:

Just to follow up on this, we've been running this patch in production now and the improvement is measurable in that the url.Parse time is entirely gone.
This isn't significant on it's own, but since this is per-RPC, it's definitely a relatively expensive operation when the URL doesn't change. It also skips the method validation http.validateMethod since we're just using the constants and know it's valid.
Creating the io.Pipe() now what dominates here, and that's pretty essential.

Creating the io.Pipe() now what dominates here, and that's pretty essential.

Weeeeeelllllll.....it's not really. IIRC most of your RPCs are unary, so we don't actually need the pipe or the extra goroutine - we've got all the data in memory and can easily pass it as the request body. We only need all the code in duplex_http_call.go for streaming requests; unary and server streaming RPCs could use a different, faster implementation of StreamingClientConn. We had code written for this early in Connect's life, and IIRC it was ~30% faster.
I ended up deciding to drop the alternate code path and exercise the request-streaming code on every RPC because it's by far the most complex code in connect-go, and I wanted to flush out any bugs quickly. I think we're past that point now, so we can at least consider a PR to speed up unary and server streaming calls.

Oh, if we can drop this and the goroutine, that'd be a decently large win. I guess it makes sense this is only for a bidirectional stream. I'd suspect it can be dropped also for a server steam only with a unary request? I'd be down to look into this unless you have a good grasp or what would be involved.
Regardless, deduping the url.Parse is still good.

Oh, if we can drop this and the goroutine, that'd be a decently large win. I guess it makes sense this is only for a bidirectional stream. I'd suspect it can be dropped also for a server steam only with a unary request? I'd be down to look into this unless you have a good grasp or what would be involved.

Yep, it should also work for server streaming. IIRC you'd need a different implementation of StreamingClientConn that errors when Send is called more than once; other than that it shouldn't be too too bad. We'd love it if you took a stab at a PR!
Agreed that this PR is good either way :)

@akshayjshah pushed both changes.
In my defense, I copy/pasted cloneURL from stdlib. I'm sure you preferred that over me doing a //go:linkname. :)


Is Atomic Parsley still required to embed thumbnails in M4A files?

Or can Youtube-dl do this on its own now?
About 6 months ago I had to use Atomic Parsley for this task,

Nothing changed.


Add CBOR methods from L-SPACE

This just pulls in the CborMethods from the L-SPACE project, and the SortedObjectSerializer which we use to ensure consistent ordering of map keys.
You should be able to do this:
import io.mediachain.util.cbor.CborMethods.{bytes, render}

val cborBytes = bytes(render(someJValue))

to get the binary CBOR representation of any JValue.
Unfortunately, since json (and by extension, JValue) has no binary value type, we can't use this to store e.g. the multihash for a @link field as a byte array.  In theory we could special case that in the serializer, but it would be a pretty ugly hack.

LGTM, although @bigs is probably the more interested client :)

BTW, I've been reading through the code for this project: https://github.com/c-rack/cbor-java
It's pretty awesome...  It automatically sorts map keys according to the "canonical CBOR" spec, will pack integer and floating point values into the smallest possible type (as required by the canonical spec), and is very well-tested.
It might be worth using if we think that having support for binary values is important.  It would also be much simpler to eventually be compatible with the IPLD canonical format, which uses tags to indicate a @link field.
Converting from JValue to the DataItem type in cbor-java seems straightforward, although the DataItem to JValue conversion would obviously only work for json types (no byte strings, etc).

this is also abandoned, I'm assuming


Adding Data Dashboard link to Slow Zone posts

Fixes #15
@skaplan-dev I was able to kinda test this by putting the function somewhere unconventional and doing a dry run of the bot, but curious if you have a way to test this stuff so I could visualize how it looks?
@devinmatte not sure if there's anyway to future-proof this for V4, but if so feel free to advise :+1:

Fixes #15
@skaplan-dev I was able to kinda test this by putting the function somewhere unconventional and doing a dry run of the bot, but curious if you have a way to test this stuff so I could visualize how it looks?
@devinmatte not sure if there's anyway to future-proof this for V4, but if so feel free to advise 👍

no super great way to test this besides just printing things out locally. it might be worth us building a test Twitter bot for stuff like this.

Fixes #15
@skaplan-dev I was able to kinda test this by putting the function somewhere unconventional and doing a dry run of the bot, but curious if you have a way to test this stuff so I could visualize how it looks?
@devinmatte not sure if there's anyway to future-proof this for V4, but if so feel free to advise +1

no super great way to test this besides just printing things out locally. it might be worth us building a test Twitter bot for stuff like this. I'd actually prefer if we tweeted the dashboard link as a response to the tweet (open to debating this). We don't have great twitter meta tags that add nice visualizations for dashboard links.

I'd def be open to that idea - I think visually it'd be more appealing - we might need to play with the bot logic since the reply scheme would work differently for Mastodon/Slack.
Another thing I was looking into was URL shorteners  for the Dashboard links so they might look a bit better as part of the main tweet - we would probably need to sign up for a service like Bitly for that, the only native Python library I could find for that seems abandoned.

We should update this now with v4 links

I tried to test this with the test Twitter bot but was unable to do so - would someone who configured the Prod bot be able to adjust the settings to allow for write access? Can share the keys via Slack if needed

Ofc we can always merge this and hope for the best :smile:


hope to add one music‘s repeatting function

i have changed to use your sound js,very awesome. i try to find a song's ending flag that i can control one song's repeatting by using $watch, not the all list song's repeatting.hoping to add that function.

though i found way to solve,it made my code look terrible.

i always get 'x GET http://xxxx/media/music/XXXX.mp3'  meaning getting media resources failed in chrome's console,but your demo works ok.i was trying to find the reason,i don't know why cause it. i used django to test it, had that problem.so i had used uwgsi and nginx to support ,but still had.can you tell me how i can handle it.

@targetoyes I will look into this and get back to you.

best thing to do for this purpose is, in your controller:
$scope.$on('currentTrack:duration', function(event, data) {
    if (data === 100) {
       //track finished playing, do here what ever you want to do
    }
});

Hope this is what you were looking for.

thanks  perminder-klair ，
this way is what i want
scope.$on('track:progress', function(event, data) {
console.log(parseInt(data));
if (parseInt(data) === 100) {
console.log("it's over now");
//track finished playing, do here what ever you want to do
}
});

@targetoyes nice work! glad it helped! happy coding!!!


[Question] How do we aggregate multiple 'results.json' to plot?

Hi, now, I want to aggregate multiple results.json files to plot.
In my case, I have three files; results.json, results2.json, and results3.json. And I will extract some lines from each results*.json file. Then, I will aggregate those lines to produce the new plot. Is there any options to aggregate multiple sources for kurobako plot command?

Hi,
You can aggregate the result files by simply concatenating the file contents, e.g., cat *.json | kurobako plot.

Thank you for your reply. I can concatenate multiple files as you suggested.


Null pointer exception kconfigs shrink

Fixes #33884

Maybe shorten it even further from NULL_POINTER_EXCEPTION to NULL_PTR_EXC? (or even just NPE)


Directions need to be updated or changed

Thanks for the writeup! When following the process outlined however, map is not rendered.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e3d455c9-d5c7-3a9e-5de5-b16072f3c77e
Version Independent ID: d0f120b2-5ef9-9112-d17f-e8b2275ed5b4
Content: Quickstart: Interactive map search with Azure Maps
Content Source: articles/azure-maps/quick-demo-map-app.md
Service: azure-maps
GitHub Login: @stevemunk
Microsoft Alias: v-munksteve

@AMelaku Could you please share more details on the issue which you are facing? What exactly needs to be changed in this doc for better experience?

@AMelaku In which location your map is created? Could you share your  "interactiveSearch.html" without PII to check further?
Please ensure you copy the code from https://github.com/Azure-Samples/AzureMapsCodeSamples/blob/master/AzureMapsCodeSamples/Tutorials/interactiveSearch.html and replace the suggested values as per the documentation.

@AMelaku Since we have not heard back from you we will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly reopen the issue and continue the discussion.


Assembled Bot Images

Please consider putting in a photo of the assembled innards (not the instructions, just the innards), which will help confirm orientation of various components.

Hi Samer, this is underway, please check out the website at https://www.chicagorobotics.net/simula-5-info/ and thanks for the suggestion!

Looks terrific.  Really nice drawings!

Hey thanks Samer!
On Jul 18, 2017 7:44 PM, "samern"<EMAIL_ADDRESS>wrote:

Looks terrific. Really nice drawings!
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ChicagoRobotics/Simula5-Parts/issues/2#issuecomment-316239263,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABIeQutC0-nL0pEgv1FnPJammXwKXt6Pks5sPVF-gaJpZM4Ig2Kg
.


Python: properly split tuples containing dictionaries

Function arguments are currently parsed as tuples. Without this change, splitting Python function arguments when one argument is a dict will result in the dict begin splitted (instead of the arg list).
Example:
example_func(a, b, {"a": "b"})

should be split as, when the cursor is on the opening (:
example_func(a,
    b,
    {"a": "b"})

but without this PR, the result is
example_func(a, b, {
    "a": "b"
})

When the cursor is on the opening {, the current behaviour is unchanged. The attached tests do not pass on master, but (at least on my box) they pass with this change.
There are some remaining issues with whitespace, but they are also present in master, so I'll investigate them later if I find the time and courage :)
I am a vimscript newbie, and have not used this plugin for long, so don't hesitate to let me know if I missed something.

Sorry it took me so long to comment, it's been difficult to allocate the time for it.
This seems like a reasonable change. The ordering of checks is pretty iffy, and depends on a lot of things. The particular splitting and joining functions can be tweaked a bit to adjust, but if the ordering works, that's fine.
Travis runs a Vim 7.4, because that's what I could install on their VMs. Not sure if it's possible to put Vim 8 there, but I feel like it's reasonable to test it on 7.4 anyway. Unfortunately, this does mean python code has different indentation, because the runtime files seem to have changed since that version. I'll fix the test so it works locally and is skipped on Travis.
Thanks for the contribution. I don't write a lot of python, so if you see any related side effects during your own work, feel free to comment here or open another issue.


correct all compiler warnings

Currently you get spammed with a lot of warnings on build. The spam makes this feature of the compiler useless, since you get inured to the text scroll. As a result, new warnings get lost in the noise.

note: there is only one warning in the no-features build. the loads of warnings come from the simulation-mode feature which makes all the net code unused. we can add an allow_unused behind the feature to resolve

Interesting -- I'll fix that next week.


Numpy 2.0 breaks pynq.allocate on XRT Platforms

(I think I have it diagnosed)
Numpy added a device getter to ndarray in Version 2.0. (doc, src)
When allocating a buffer on an XRT platform, the default target works just fine because I don't believe it touches the device field of PynqBuffer.
However, when a non-default target for allocation is provided, it fails with the following exception:
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
Cell In[4], line 1
----> 1 input = pynq.allocate(1024, 'u4', target=ol.plram)
      2 input[:] = np.ones(1024)

File ~/.local/lib/python3.10/site-packages/pynq/buffer.py:158, in allocate(shape, dtype, target, **kwargs)
    156 if target is None:
    157     target = Device.active_device
--> 158 return target.allocate(shape, dtype, **kwargs)

File ~/.local/lib/python3.10/site-packages/pynq/pl_server/xrt_device.py:156, in XrtMemory.allocate(self, shape, dtype, **kwargs)
    145 def allocate(self, shape, dtype, **kwargs):
    146     """Create a new  buffer in the memory bank
    147
    148     Parameters
   (...)
    154
    155     """
--> 156     buf = _xrt_allocate(shape, dtype, self.device, self.idx, **kwargs)
    157     buf.memory = self
    158     return buf

File ~/.local/lib/python3.10/site-packages/pynq/pl_server/xrt_device.py:107, in _xrt_allocate(shape, dtype, device, memidx, cacheable, pointer, cache)
    105     buf = device.map_bo(bo)
    106     device_address = device.get_device_address(bo)
--> 107 ar = PynqBuffer(
    108     shape,
    109     dtype,
    110     bo=bo,
    111     device=device,
    112     buffer=buf,
    113     device_address=device_address,
    114     coherent=False,
    115 )
    116 if pointer is not None:
    117     weakref.finalize(buf, _free_bo, device, bo, ar.virtual_address, ar.nbytes)

File ~/.local/lib/python3.10/site-packages/pynq/buffer.py:45, in PynqBuffer.__new__(cls, device, device_address, bo, coherent, *args, **kwargs)
     43 self.coherent = coherent
     44 self.bo = bo
---> 45 self.device = device
     46 self.offset = 0
     47 self.freed = False

AttributeError: attribute 'device' of 'numpy.ndarray' objects is not writable

If I edit buffer.py and change the name of the device field to ndevice, no exception is thrown, and my code works just fine.

Forgot to mention: Downgrading to Numpy 1.26.4 also fixes the issue.

Hi Dustin,
Thank you for reporting this, We're tracking this, see https://github.com/Xilinx/PYNQ/pull/1453

Race condition! Do you want me to close?

If it is resolved, please close.


New version: vim.vim version 9.1.0818

Pull request has been created with WinGet Releaser :rocket:
Microsoft Reviewers: Open in CodeFlow

@wingetbot run

[Policy] Needs-Manual-Merge


Implement config.dev.json?

Like the config system in https://github.com/okfn/opendatacensus

not needed now.


Metal: Enable for betsy and lightmapper modules in compatibility mode

To support this, the rendering_context_driver_metal.h header was updated to recognise when it is included in non-Objective-C source files.

Thanks!


Example tracks

This will close #374.
Currently this does not allow any write operations by other users.

Note that this include #477, so that should probably be reviewed/merged first.

I agree with @Arnei. What about: "Automatically display to all users"?

Rebased onto master after merging #477.

I'm also not satisfied with the wording. :thinking:
What @dagraf suggested seems reasonable, though. @Arnei objections?

Seems good.

This is deployed on SWITCH staging right now, but none of my test users can see the new visibility option. (Only annotate admins are supposed to see those.) This might be due to missing ACL entries for these users, or it might be a bug. Will investigate ASAP.

Indeed seems to be a problem of the user; stp-OrgAdmin1 is surprisingly not an Org-Admin. :sweat_smile:


Where is pwsh.exe when installed from Microsoft Store

When having PowerShell 7 installed from Microsoft store, where is pwsh.exe and which path (example) should be used to configure sshd_config ?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 18a5a4e5-2604-23c2-1374-68a6974170bc
Version Independent ID: f93809cc-eb5e-6b9b-ed58-c8811a8ee21f
Content: Get started with OpenSSH
Content Source: WindowsServerDocs/administration/OpenSSH/OpenSSH_Install_FirstUse.md
Product: windows-server
Technology: administration
GitHub Login: @IngridAtMicrosoft
Microsoft Alias: inhenkel

Hi @hkusulja - Thanks for your feedback and dedication to our documentation. The article already explains where to find the OpenSSH configuration files in this respective section, direct link and extract below. Please let me know if this doesn't resolve your issue.
By launching ssh.exe with the -F parameter, specifying a path to a configuration file and an entry name from that file.
A user's configuration file at %userprofile%.ssh\config.
The system-wide configuration file at %programdata%\ssh\ssh_config.
With regard to where pwsh.exe is, I believe this has already been answered in MicrosoftDocs/PowerShell-Docs#8516.
Thanks for providing feedback that helps improve our documentation. This issue has been resolved and we are closing the issue. #please-close


New icon: Migadu

URL of the site: https://www.migadu.com/

Logo / icon info:

Color obtained from logotype SVG: https://migadu.com/images/logo.svg
Icon obtained from logo: https://migadu.com/images/logo_bg.svg

Background color info:

Color obtained from logotype SVG: https://migadu.com/images/logo.svg

Illustrator files (if you have any):

[x] I have carefully read and followed CONTRIBUTING document.

EDIT: I'm not sure if this is aligned to the center.

Fixed the logo (eyehole wasn't in the icon's logo), cleaned markup leftovers and made logo smaller & visually centered. https://github.com/aegis-icons/aegis-icons/pull/585/commits/a2fd4ee2d35b95d8df45b00c580da1b05f0e241d


🚀 : URL Preview within the chat

Is your feature request related to a problem? Please describe.
Yes, currently when a URL is shared in the chat, there is no preview of the content at the URL. This requires users to click on the URL to understand the context, which can be time-consuming and disruptive to the chat flow.
Describe the solution you'd like
I would like to have a URL preview feature within the chat. When a URL is shared, a small preview of the content at the URL (such as the title, a snippet of the content, and possibly an image) should be displayed in the chat. This would allow users to understand the context of the URL without having to click on it and navigate away from the chat.
Describe alternatives you've considered
An alternative could be to allow users to manually add a description when they share a URL, but this would require extra effort from the user and may not be as informative or accurate as an automatic preview.
Additional context
This feature is common in many other chat applications and would greatly improve the user experience in our chat.
If you want speed up process of this issue, please send 🚀 as a reaction.

https://krthush.medium.com/how-to-create-link-previews-like-social-media-apps-open-source-api-45797d758200

For native apps like mobile/desktop apps, client-side fetching is doable (Signal actually does this discussed here)


Waiting for ack

I'm trying to consume 1 message at a time, and i'm acknowledging the message outside of the listener. But it's just grabbing the next message without waiting for the ack.
code sample:
let msg;
let msgConsumer;

const consumer = client.subscribe({
                    topic: `persistent://public/default/test1`,
                    subscription: `sub1`,
                    subscriptionType: 'Exclusive',
                    receiverQueueSize:0,
                    ackTimeoutMs:300000,
                    listener: (msg,msgConsumer) => {
                        console.log(msg.getData().toString());
                        msg = msg;
                        msgConsumer = msgConsumer;

                    }
                  });

function someWhereElse(){

    msgConsumer.acknowledge(msg);

}

Is something like this possible?

Since listener is used for asynchronous message processing, it doesn't seem to meet your requirement (1 message at a time).

Why are you using listener?
Could you try receive() instead? e.g.

const consumer = client.subscribe( /* without listener */ );

async function somewhereElse() {
  const msg = await consumer.receive();
  consumer.acknowledge(msg);
}

I'm not receiving in the same place I'm acknowledging. I'm trying to find a way to make 1 process add jobs to queues, and acknowledge them, and the other process needs to just process 1 at a time and wait for acknowledgement.

process 1 adds a message to the queue.
process 2 starts processing message
process 1 acknowledges message
process 2 can receive next message

if a second message gets added to the queue, it has to wait for the first message to be acknowledged,
I haven't found a way to make this work with the manual receive(). But I'm new to queueing so maybe I'm looking over something.

I'm trying to find a way to make 1 process add jobs to queues, and acknowledge them, and the other process needs to just process 1 at a time and wait for acknowledgement.

It seems we can't implement it with only the functionality of pulsar-client.


App proxy ingress

should be merged only with https://github.com/codefresh-io/argo-platform/pull/1362

Codecov Report

Merging #194 (3e44f9d) into main (3136b68) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #194   +/-   ##
=======================================
  Coverage   24.86%   24.86%
=======================================
  Files           1        1
  Lines         189      189
=======================================
  Hits           47       47
  Misses        136      136
  Partials        6        6

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3136b68...3e44f9d. Read the comment docs.

/e2e

/e2e

/e2e

/e2e

/e2e

/e2e


Manage auto reset for component

I think we need an IResetable interface with a counter that sends notifications if the maximum number of resets is reached.
For compound components, it's the parent that defines the action to be taken when the component is in error and needs to be reset.


nixos/gitlab-runner: let script options accept scripts as strings

Description of changes
The script options not only accept paths to a script but also the script as string. See https://docs.gitlab.com/runner/configuration/advanced-configuration.html#the-runners-section.
Specifying a script as string makes it possible to use the ssh executor for hosts that do not have the script in their nix store.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/4640

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-already-reviewed/2617/2116


Add Swedac logo to reports

Add the Swedac logo into reports with the ngi template if config.swedac_accredited is True.

Done in #28 and 0aaba1c9731f52e780f1f92b01585ef2e29f5f54


Fix typo

Signed-off-by: Guangwen Feng<EMAIL_ADDRESS>

/lgtm
/approve
Thanks.

/lgtm
/approve
Thanks.


Make the Auto-PR system more robust

Made a few changes to make the auto-pr system more robust:

Many edge cases are now handled when submitting extensions, each with a custom message sent back by the bot to ensure the submitter knows exactly what's going on
Updated to the latest versions of the actions
Only check the extension that has been submitted, not every other, for faster runs
Extract the zip programmatically with a lot of restrictions to prevent using weird zip path shenanigans to put files at places they are not supposed to
Unit tests for all of this 😎

You can check out the bot's new error messages here: https://github.com/arthuro555/GDevelop-extensions/issues/20
(The actions are pushed on my fork, you can generally test out the changes there)
Possible follow-up work:

Make the auto-pr better at handling updates:

Changing the tag if the extension already exists
Extracting to the right tier folder if the extension already exists

Reuse the new scripts to improve the PR update command
Adding an auto pr type to move an extension from community to reviewed tier

Feel free to merge once ready!


Rev Calico version to sort out pre-release build dependencies

This should make the calico-jenkins'hosted package strictly preferred to the other.

OK, I'm happy to do this on a basis of always bumping to an rc after each release.  In general we should update the setup.py and rpm versions as well, but this will do for now.


[Support] How to configure the HHMI mysql database

The Freshdesk ticket link
https://2i2c.freshdesk.com/a/tickets/1233
Ticket request type
Feature Request
Ticket impact
🟧 High
Short ticket description
Configure the mysql database server that's running on the hhmi hub with dj_local_conf.json and dj_local_conf_franklab_collaborators.json from https://github.com/LorenFrankLab/hhmi-spyglass-image/blob/main/postBuild.
(Optional) Investigation results
Context
The ticket was initially framed as "why running the https://github.com/LorenFrankLab/hhmi-spyglass-image/blob/main/postBuild script is not working".
Desired behaviour - two scenarios
The community described that there are two scenarios they are after. They are described in more detail in https://2i2c.freshdesk.com/a/tickets/1233 and also context about the initial partnership agreement is provided there. Below is a bullet list summary.
1. "Collaborator access to the hhmi database and data processing pipelines with the ability to pull data to the hub and use the compute to run analysis on the data."

having things persist in storage is important
give access to collaborators to the tutorial notebooks located in https://github.com/LorenFrankLab/spyglass/tree/master/notebooks
have the configuration file for the hhmi database and notebooks (dj_local_conf_franklab_collaborators.json) in the users' $HOME/spyglass directory to connect and run the tutorials

🟦 Next steps: ?

Use this nbgitpuller link to get the desired repository into each users' home directory and start them in the notebooks directory
Use singleuser.extraFiles to mount these two files into the desired directory in the user's home dir

2. "Create a binder link that would correspond to the preprint on the hhmi data processing pipelines so that anyone that reads the preprint can try out the pipelines."

storage would not be persistent from session to session
the users would use the configuration file (dj_local_conf.json) to quickly connect to the local database and be able to run the tutorial notebooks.
no need for the user to select the amount of compute in this scenario (as it is set up now).

🟦 Next steps:?

❗ Out of scope of the existing hub I believe
needs a new hub with ephemeral storage as advertised by @colliand in the plan shared with the communty (and shared in the ticket)

Got a timeline for this: it should be ready by mid-February.
Apart from mounting the two config files, I believe we also need to setup some storage for the database similar to https://infrastructure.2i2c.org/howto/features/per-user-db/#setting-up-the-backing-disk-for-the-database

I have been directly involved in setting up this community and the MySQL database up to this point. Please involve @jmunroe before taking action on this issue.

@jmunroe, in this case, do you think you can communicate back to the community about the next steps via Freshdesk?
There's two tickets: on that is linked here and one in Partnerships about the new hub.
Also, @jmunroe, please feel free to close this issue and open new ones with more relevant info and context.

Please involve @jmunroe before taking action on this issue.

Also, cc @damianavila for the above ⬆

@jmunroe when you have a minute, can you communicate back to the community on freshdesk? Thanks.

I've retitled this issue to be more tightly focused on ensure that there is working nbgitpuller link for the Frank's group Spyglass preprint.
(I also respond to the the Freshdesk ticket)
There is dependency step having a new ephemeral hub spyglass.hhmi.2i2c.cloud running on the HHMI cluster. That tasks is being tracked in

[ ] #3643

Concurrently,  @jmunroe will work with members LorenFrank group (Eric Denovellis and Chris Brozdowski to create a functional nbgitpuller link that will direct readers to spyglass.hhmi.2i2c.cloud and the notebooks as part of the Spyglass preprint. This ephemeral hub needs to have the MySQL database set up and a df_local.json configuration file for spyglass so that the reader gets a 'works-out-of-the-box' experience.
The goal for this task is 2024-01-31 .

Yay! I think I completed this task using the nbgitpuller link: https://spyglass.hhmi.2i2c.cloud/hub/user-redirect/git-pull?repo=https%3A%2F%2Fgithub.com%2FLorenFrankLab%2Fspyglass&urlpath=lab%2Ftree%2Fspyglass%2Fnotebooks%2F01_Insert_Data.ipynb&branch=master

You and I are working on the same task at the same time!

I strongly think we want to expose a separate repo only the notebooks.  We also need to configure the database configuration file.

Copy/pasting from slack channel for our records:

Example:  Spyglass Magic Link
This an nbgitpuller link that directs the user to an non-persistent, unauthenticated JupyterHub spyglass.hhmi.2i2c.cloud set up to explore Spyglass based on the repo https://github.com/jmunroe/spyglass-notebooks . I suggest that this repo (or something very similar) to it is forked into the LorenFrank Github organization and a new 'magic link' is generated using nbgitpuller. (See README.md in the repo for additional instructions)
Notes:

It is pulling from the same 'shared-readwrite' attached storage with the nwb/raw files as we had set up on hhmi.2i2c.cloud. But, to ensure that these do not get deleted by the first person to test out the site, they are mounted as 'read-only'.  Since the Spyglass software requires them to live in a read-writable directory, I've created some symlinks to set this up to work as expected.
You probably want to consider something like this for hhmi.2i2c.cloud as well to allow multiple concurrent users to go through the notebooks. Having multiple users attempting to write to the same directory is likely to cause problems.
I've created a local DataJoint configuration file in this new repo.  Since the 'configuration' of Spyglass has already occurred, I wonder if you want to edit notebook 00_Setup.ipynb to be make really clear that nothing needs to be set up if you are running through the notebooks on this JupyterHub.
Several of the notebooks have graphviz graphs but the command line program dot does not appear to install in the hhmi-spyglass-image.  I've added it to the the image maintained at https://github.com/2i2c-org/hhmi-spyglass-image . I also removed the postBuild -- I didn't think you want to clone the spyglass repo as part of this image (spyglass-neuro is being installed through pip). There may be additional issues with the image that I am working to resolved (I do have some confusion why the image lorenfrank/hhmi-spyglass-image didn't work completely for me but that could be just me)
We need to discuss memory usage of these notebooks.  Currently, each user only has 1GB of RAM configured -- we can increase that but still need to decide on an upper limit.  Also, I expect users to rapid start many of the example notebooks and not shutdown kernels from previously running notebooks. This is likely to the user to run out of available RAM even if we increase it.  Is there a smaller subset of the notebooks that you really want to draw attention to?
Local storage. This hub is set up with no persistent storage. Files can be written in the home directory but will be removed when the server is stopped.  Note though that multiple users are running on the same node. If each user consume a certain amount of (even temporary) disk space, this may impact other users on the same node.
This idea of 'nodes' may not always be clear during testing: multiple, independent, authenticated users, will be put onto the same virtual machine node. Their containers are isolated but they are sharing the same finite disk on the virtual machine. We can adjust that as needed.  When there are lots and lots of users, the system will automatically scale by adding new nodes as needed (and scale back down afterwards) but there can still be contention for disk space on a single node.
Additional testing is required before sharing widely and especially simulating multiple synchronous users ('incogito/InPrivate' web browsing is useful for launching several separate sessions).  2i2c can adjust the amount of RAM and disk space but I think I will need assistance. In particular, sometime one of the notebooks 'doesn't work' (throws errors) but I don't know if that supposed to happen or if it is a configuration issue.

Response:

Thank you again for all this work. I am impressed with how fast things pulled together.  Let me try to answer these questions and provide some context:

Our intention is that the pypi package install work for non-developers and be the version that the public uses. In practice, people in the lab have been using the source git repo so we have been tardy on making consistent releases. This has led to some gaps in making sure the package dependencies work for the pypi release which we will rectify. I would like to use the pypi package for the jupyter hub and magic link though.
We are in the process of making a release that will address some of those problems shortly (I would say within the next week). I would like to not rush it too much as I am fixing the design of one of the pipelines. It is almost done, but I need to test things out and would like to not release things into production that would confuse people in our lab too much.
That leads me to the forthcoming announcement timing with
@Kristen Ratan
. Is there a particular timeline for that? I would also like to make sure the link works as we expect before it gets sent out to the wider public. It is obviously exciting but I think a link that doesn’t work as we want won’t be useful for advertising spyglass. As I understand it, we also wanted to collect some data from the link to see how many users, etc. How far away is that from being set up?
Related to the link, the 1 GB RAM configuration won’t be sufficient based on my experience with the jupyter hub. 3 GB seemed to work fine as far as I could tell.
How much disk space is allocated for all users? Spyglass does tend to be both disk and memory intensive but it’s hard to tell what the user experience would be like in this case. I would kind of guess that we wouldn’t get too many concurrent users, but I have no idea what the demand will be. I think we need to first make sure things run and then test how it scales.

@yuvipanda Could you increase the available RAM on spyglass.hhmi.2i2c.cloud per user to be 3.4GB (so it matches what we make available on hhmi.2i2c.cloud)

This issue is now waiting for input in the #hhmi_pilot Slack channel.  Next steps after receiving that input:

[ ] Move spyglass-notebooks repo out of from @jmunroe to the LorenFrank org
[ ] Revise the lorenfrank/hhmi-spyglass-image quay.io image so it has the correct versions of software
[ ] LorenFrank team to create nbgitpuller link based on notes/support from @jmunroe
[ ] Evaluate RAM and disk space based on testing and update config as needed\
[ ] Get signoff from LorenFrank team that content is ready for widespread sharing
[ ] share nbgitpuller magic link

This specific task is completed.
Anticipated steps for the initiative are tracked in:

https://github.com/2i2c-org/meta/issues/789


experience-card

I have made some changes in work-experience-card. Kindly review the changes and let me know If I need to add or remove anything.

@salonilakhotia  Any updates?

@smaranjitghose Sir I will try to make new design in weekend.If not then I will let u know after that.

@smaranjitghose @anushbhatia Sir I have made the changes. Kindly see it once.

I really don't feel horizontal cards are a good design for displaying experience
Instead, you can reduce the size of the existing cards, change the headings like the role is too large and the place of work is not. The duration could be aligned towards the right. Soft UI can be implemented. Do not put links to research papers😅. We want to keep the page as much generalized as possible. Try improving the bullet points
@anushbhatia can you give more elaborate pointers

@smaranjitghose Sir..Actually I have shown first to @anushbhatia Sir before generating the PR.

But he recommended some changes please follow them. I can guide you if you have a problem.

Any Updates @salonilakhotia

@smaranjitghose  can i work on this?

sure


Remove unnecessary target checks in tests

While the win32 winmd generator doesn't support other arches, the Rust tests still do.

Sounds good - I haven't go any such tests yet and don't expect to get there before the support arrives.


missing live location endpoint

The BMTC app allows planning trip by entering source and destination with live location of buses in the route

I have made a pull request to add the trip planning at https://github.com/tachyons/bmtc-api/pull/11

is the endpoint available now for live tracking of bus? If so, can you please share with parameters as applicable.

is the endpoint available now for live tracking of bus? If so, can you please share with parameters as applicable.

@klpradeepkl I'm not sure if this is the exact endpoint you are looking for, but you can get the live latitude and longitude of a bus like this:
curl -H 'Content-Type:application/x-www-form-urlencoded; charset=UTF-8' -H 'User-Agent:Dalvik/1.6.0 (Linux; U; Android 2.2.1; en-us; Nexus One Build/FRG83)' -H 'Host:bmtcmob.hostg.in' -H 'Accept-Encoding:gzip' -H 'Content-Length:69' -X POST 'https://bmtcmob.hostg.in/test/api/routemap/details' --data-binary 'routeNO=401&direction=UP&salt_value=abcdefghijklmnopqrstuvwxyz123456&'
You will have to modify the values of 'Content-Length:69', 'routeNO=401', 'direction=UP', 'salt_value=<32characteralphanumeric>'
The actual parameters that the API requires are only the routeNO, direction and a salt value.
The response will be similar to this:
 [
        "vehicleno:KA01FA1777",
        "routeno:401",
        "vehiclelat:13.017557",
        "vehiclelng:77.555283",
        "routeid:35172",
        "serviceid:1",
        "nearestlatlng:13.01792884,77.55638747",
        "start_busstopname:Yelahanka Old Town",
        "end_busstopname:Yeshwanthapura TTMC",
        "traveldistance:0.0",
        "ETA:0",
        "FARE:0.0",
        "routeorder:37"
    ]

The endpoint you had mentioned is slightly incorrect. The correct one is https://bmtcmob.hostg.in/api/routemap/details.
In the context of live tracking of vehicle, what is the difference between Vehiclelat, Vehiclelng & nearestlatlng.

@klpradeepkl As far as I can tell, vehiclelat and vehiclelng are the current position of the bus. nearestlatlng is the coordinates of the nearest bus stop.


backtrace

Adds optional support for Backtrace (which I think it's fair to have, just as anyhow), needed in https://github.com/fzyzcjy/flutter_rust_bridge/pull/582#discussion_r936184045

Looks good, I guess the CI or the rustfmt.toml file needs to be updated. we need to remove report_fixme

Part of v0.1.14-beta.1 🎉

When will it go to crates.io?

https://crates.io/crates/allo-isolate/0.1.14-beta.1
Seems already there


Microos snapshot stage 2

Hi, I don't know why but the last pull request has vanished..
Anyway, this know removes the initial snapshot and just uses the packer based snapshot for all created servers now, including the cluster autoscaler nodes.
Please have a look and test it, hadn't hat much time for it yet.
But as recently came the request, to make this work also in terraform cloud, I see the following alternatives:

fall back to have the packer step outside of the terraform script (initial idea). Needs some additional "glue" scripting
avoid packer, do the snapshot with terraform - either by a separate script or include it here. Needs some additional "glue" scripting
Include the snapshot creation in the "host" module. Should be possible (when no image_idgiven, create first a snapshot, otherwise use the image_id. But Increases the complexity of the script

For me, using packer/ or a separate terraform script  to create the snapshot and assume the image_id in the terraform script would be the simpliest, cleanest way, as we can get rid of a lot of code in the main script.
What do you think?

@ifeulner About packer and terraform, I'm all for 1. and it would be a pleasure working on a small bash script to make the magic happen.
So we would need pure terraform logic that would kick in if not snapshot is detected, meaning it did not run via the init.sh script that calls packer.
This is great, because we can do plenty of things like ensure that all the required CLIs are present, like of course terraform, packer and ideally also hcloud.
And ideally, we would all it via curl to always get the latest and greatest, like what k3s does. Honesly, bash is super easy to write with ChatGPT, like it ridiculous. So that's an ideal use case!
Also I really like the fact that it's optional. Folks that want to use packer then terraform directly can! And they can even use terraform directly and bypass packer to fetch the image online like we do now.
So really this bash script is a layer just for adding UX goodies, like in the future automatically fetching mirrors and testing them even. If we push the envelope we could even install homebrew for them and install all the required CLIs if not present.
But at first let's keep it simple! Just save them to type the both the packer and terraform command is a great start. And called in the form of:
curl -sfL https://kube-hetzner.github.io/install | sh -

About the previous PR, it's here https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner/pull/557 and you yourself closed it.
And thanks for this new one, looking great! Will test ASAP 🙏 🚀

@ifeulner Let's forget the bash proposal above for now and instead use a snapshot_deploy_method variable, that would default to packer integrated and called via local-exec as you do already, but also have a pure terraform version like in the current master.

@ifeulner Please let me know what you think of the above proposals. Also, to keep things well compartimentalized, I propose moving the packer logic to the host module, or a new module of it's own, along with the terraform snapshot creation logic. Basically, making sure that each concerns is well compartimentalized, while staying compatible with terraform cloud when the right options are chosen (in our case snapshot_deploy_method="terraform" for instance).

One last thing, and maybe we can clarify this in a subsequent PR is that, we need to clarify which variables can be changed after the initial apply, with or without terraform destroy -target null_ressource.kustomization

@ifeulner Please let me know what you think of the above proposals. Also, to keep things well compartimentalized, I propose moving the packer logic to the host module, or a new module of its own, along with the terraform snapshot creation logic.
Basically, making sure that each concerns is well compartmentalized, while staying compatible with terraform cloud when the right options are chosen (in our case snapshot_deploy_method="terraform" for instance).

Hi @mysticaltech there are multiple options now, but it‘s more about „packaging“ and not functionality anymore.
I would prefer to keep it as simple as possible, though. So Option 1 would be my preference.
But I understand you want to keep the terraform-only way, right?

@ifeulner Yes, option one is fine, but let definitely with support for terraform only! 🙏

Using external logic for the snapshot allows for decoupling and easier code maintenance, but more critical is simplifying the snapshot update without needing to recreate the cluster.

@ifeulner I created this new branch snapshot-deploy and opened #598, we can continue there and more people can participate if they want to.
@gthieleb Thanks for sharing your experience, I like your ideas, reducing the remote-execs if possible would be ideal, please don't hesitate to open a PR targeting the new branch mentioned above.
@aleksasiriski Same for you man, if inspired the new branch above should be the target.
Let's make this awesome folks! 🙏


Mvn pom.xml / gradle build.gradle preprocess modifiers need separate docker images

The way #3150 is currently panning out, we will likely be splitting things much farther apart than I previously anticipated.
  If we want this to happen in separate steps, for instance because mvn is a top-level cloud build step, then we need a separate step to preprocess the build config file (and quite possibly an undo step afterwards, but maybe we can ignore that).
This shouldn't be too bad - excise the logic in pom_xml_modifier.go into its own binary, throw it in a docker image, load it into gcr.io/kythe-public.

Somewhat open question on whether we want to maintain a single binary that encapsulates modification logic for different preprocessors (possibly even with logic to detect what to modify), or separate binaries.
I'm leaning a bit towards the former, because maintaining fewer images will be less headache.

This was fixed in #3169


Add heatmap example

This project is open to accept contributions to enable support for using heatmaps ? It is not included on this roadmap but is quite useful.
The requirements for heatmaps would be to extend the Paint structure to allow some additional properties that could me set by default as none to not affect the existing base of dependent crates.
I'm glad to build the necessary wasm-bindgen but I need the confirmation that there is interest to send the pull request

Hi @andres-hurtado-lopez
Yes, this project accepts PR 👍 feel free to ask me anything if you have questions

Heatmap layers are supported now! https://github.com/yukinarit/mapbox-gl-rs/blob/main/src/layer.rs#L1045

@RmStorm thanks. I changed the issue to "add heatmap example".


Request contribution for regular release until February 29

Dear Developers,
Regular release of TOAST is scheduled as v1.1.0 in March 14.
We will include source code which is contributed until February 29.
If you are in preparation for contribution, please apply your source code on time.
Thank you.

v1.1.0 was released well.


IE11: ibm-table-toolbar - "Unassign" and "cancel" button are not getting displayed properly

After Selecting the list checkbox then check the unassign and cancel button alignment.
Expected Result: Alignment should be proper
Actual Result: Buttons are getting hidden

Closing this, no longer relevant since IE11 is no longer supported.


Is there a download for the console plugin.

Does anyone know if there is a download for the web console plugin anywhere? I know you log into vsphere and can install it from there. But I am looking for a separate download to install the plugin without logging into vsphere.
Thanks

Other question is using the vmware standalone remote console program for this? Where the standalone console program can be called from the powershell results.

https://my.vmware.com/web/vmware/details?downloadGroup=VMRC800&productId=491

Yes I downloaded that... I have not tried it yet, will webcommander call that instead of the web browser.?

Ok so would need to change code some for it to call the VMRC standalone instead of the web browser. Or make a c second command, leave the web browser one and make another that calles the standalone VMRC program.
HMM......

Do you mean to call VMRC on client machine( where you use browser to access webcommander) ?

Yes.
Mike
Sent from my Verizon Wireless 4G LTE smartphone
-------- Original message --------
From: Jerry Liu<EMAIL_ADDRESS>Date: 03/02/2016 11:40 AM (GMT-06:00)
To: vmware/webcommander<EMAIL_ADDRESS>Cc: "Masters, Mike [CORP/US]"<EMAIL_ADDRESS>Subject: Re: [webcommander] Is there a download for the console plugin. (#137)
Do you mean to call VMRC on client machine( where you use browser to access webcommander) ?
—
Reply to this email directly or view it on GitHubhttps://github.com/vmware/webcommander/issues/137#issuecomment-191344194.

Well, webcommander is pure html + javascript on client side. So it could not launch any program outside browser.

From what I was reading you are suppose to call it from a browser..  when I get back to office I will show you the link I was reading.
Mike
Sent from my Verizon Wireless 4G LTE smartphone
-------- Original message --------
From: Jerry Liu<EMAIL_ADDRESS>Date: 03/02/2016 12:08 PM (GMT-06:00)
To: vmware/webcommander<EMAIL_ADDRESS>Cc: "Masters, Mike [CORP/US]"<EMAIL_ADDRESS>Subject: Re: [webcommander] Is there a download for the console plugin. (#137)
Well, webcommander is pure html + javascript on client side. So it could not launch any program outside browser.
—
Reply to this email directly or view it on GitHubhttps://github.com/vmware/webcommander/issues/137#issuecomment-191354235.

ok you have to download the above link to get the plugin, and it also installs a standalone consol on your client. and if you go to c:\programfiles (x86)\VMware\VMware remote Console\   and run vmrc.exe it gives you this message.

Doing some reading on this site.  ( great site btw)
http://www.virtuallyghetto.com/2014/10/standalone-vmrc-vm-remote-console-re-introduced-in-vsphere-5-5-update-2b.html
it looks like you can call this in a browser URL...
https://communities.vmware.com/thread/512410?start=0&tstart=0
Granted I have not tried yet, but it sounded like it could be done.

He shows you can get the link from the web interface

That's not HTML, but Flex I believe.

Aww man..  I had my hopes up.  So to install the plugin , you have to install the VVMRC installer then.

looks like the latest update to webcommander now calls the VMRC console , instead of the web browser console.. so looks like being able to launch the console in webcommander now works...  YAY !


#7881: Integrate custom kernels into Mamba SSM block

This change integrates the ssm_eltwise_mul and ssm_1d_sum_reduce custom ops into the Mamba model.
This includes switching out our matmul+mask workaround for repeat and repeat_interleave to use these new custom ops with masks. Future work will generalize these custom ops so that the repeat and repeat_interleave ops are no longer required.

@eyonland Do you have any additional comments for this PR?


Removed: Gitleaks action

as it now requires a commercial license

Can you put a link to more information in the PR description? Otherwise every reviewer would have to go hunting it down themselves.


Revert "added the search bar with improved ui"

Reverts kunjgit/GameZone#518

Thank you @kunjgit ,for creating the PR and contributing to our GameZone 💗
Review team will review the PR and will reach out to you soon! 😇
Make sure that you have marked all the tasks that you are done with ✅.
Thank you for your patience! 😀

Thank you  @kunjgit , for your valuable time and contribution in our GameZone 💗.
It’s our GameZone, so Let’s build this GameZone altogether !!🤝
Hoping to see you soon with another PR again 😇
Wishing you all the best for your journey into Open Source🚀


sh run_finetune.sh error NameError: Field "model_persistence_threshold" has conflict with protected namespace "model_"NameError: Field "model_persistence_threshold" has conflict with protected namespace "model_"

/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/pydantic/_internal/_config.py:257: UserWarning: Valid config keys have changed in V2:

'allow_population_by_field_name' has been renamed to 'populate_by_name'
'validate_all' has been renamed to 'validate_default'
warnings.warn(message, UserWarning)
Traceback (most recent call last):
File "/data/llmodel/miniconda3/envs/lmflow/bin/deepspeed", line 3, in
from deepspeed.launcher.runner import main
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/init.py", line 15, in
from . import module_inject
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/module_inject/init.py", line 3, in
from .replace_module import replace_transformer_layer, revert_transformer_layer, ReplaceWithTensorSlicing, GroupQuantizer, generic_injection
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/module_inject/replace_module.py", line 803, in
from ..pipe import PipelineModule
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/pipe/init.py", line 3, in
from ..runtime.pipe import PipelineModule, LayerSpec, TiedLayerSpec
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/runtime/pipe/init.py", line 3, in
from .module import PipelineModule, LayerSpec, TiedLayerSpec
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/runtime/pipe/module.py", line 16, in
from ..activation_checkpointing import checkpointing
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/runtime/activation_checkpointing/checkpointing.py", line 25, in
from deepspeed.runtime.config import DeepSpeedConfig
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/runtime/config.py", line 27, in
from .zero.config import get_zero_config, ZeroStageEnum
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/deepspeed/runtime/zero/config.py", line 79, in
class DeepSpeedZeroConfig(DeepSpeedConfigModel):
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 171, in new
set_model_fields(cls, bases, config_wrapper, types_namespace)
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/pydantic/_internal/_model_construction.py", line 361, in set_model_fields
fields, class_vars = collect_model_fields(cls, bases, config_wrapper, types_namespace, typevars_map=typevars_map)
File "/data/llmodel/miniconda3/envs/lmflow/lib/python3.9/site-packages/pydantic/_internal/fields.py", line 112, in collect_model_fields
raise NameError(f'Field "{ann_name}" has conflict with protected namespace "{protected_namespace}"')
NameError: Field "model_persistence_threshold" has conflict with protected namespace "model"

deepspeed_args="--num_gpus=4 --master_port=11000"      # Default argument
if [ $# -ge 1 ]; then
deepspeed_args="$1"
fi
exp_id=finetune
project_dir=$(cd "$(dirname $0)"/..; pwd)
output_dir=${project_dir}/output_models/${exp_id}
log_dir=${project_dir}/log/${exp_id}
dataset_path=${project_dir}/data/lmflow_data.json
mkdir -p ${output_dir} ${log_dir}
deepspeed ${deepspeed_args}
examples/finetune.py
--model_name_or_path  Ziya-LLaMA-13B-Pretrain-v1-merged
--dataset_path ${dataset_path}
--output_dir ${output_dir} --overwrite_output_dir
--num_train_epochs 0.01
--learning_rate 2e-5
--block_size 1024
--per_device_train_batch_size 1
--deepspeed configs/ds_config_zero3.json
--bf16
--run_name finetune
--validation_split_percentage 0
--logging_steps 20
--do_train
--ddp_timeout 72000
--save_steps 5000
--dataloader_num_workers 1
| tee ${log_dir}/train.log
2> ${log_dir}/train.err

i haven found the reason.
re install pydantic==1.10.7:
PS: after manually switch pydantic version from 2.0a2 to 1.10.7. the latest code works.
I have a quick glance on that, it's because pydantic 2.0a2 has removed field attributes in BaseModel.

i haven found the reason.
re install pydantic==1.10.7: PS: after manually switch pydantic version from 2.0a2 to 1.10.7. the latest code works. I have a quick glance on that, it's because pydantic 2.0a2 has removed field attributes in BaseModel.

thanks

i haven found the reason.
re install pydantic==1.10.7: PS: after manually switch pydantic version from 2.0a2 to 1.10.7. the latest code works. I have a quick glance on that, it's because pydantic 2.0a2 has removed field attributes in BaseModel.

Resolved. Thanks


Improve the fix for #350 included in #1119

We have to use H5Tequal() to compare HDF5 type IDs.
When checking if we can re-use an NC_CHAR attribute it is enough to compare data types (H5Tequal() takes care of the size comparison).
This commit adds missing code (reuse_att was set but not used).

Now an attribute in a NetCDF-4 file can be modified as many times as necessary, as long its type and length remain the same.
Modifications changing either type or length of an attribute require deleting and re-creating an attribute which increments the attribute order creation index. Once this index reaches 65535 all attribute modifications (for a particular group or variable) will fail.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Unfortunately #350 was not fixed by #1119: the issue is present in the current master branch (I tested 108e938b2f50dab47175b011aa731b8f119b3dc5). Test cases included in #350 still fail and I could not find the test mentioned in https://github.com/Unidata/netcdf-c/issues/350#issuecomment-414065377 anywhere in the repository.

OK, glad you took care of this, but we also must add the test back in.
Can you insert this at the bottom of nc_test4/tst_atts.c and make sure it works:
    printf("*** testing modification of an attribute 2^16 times...");
    {
        int ncid;
        int i = 42;

        /* Create a file with a global att. */
        if (nc_create(FILE_NAME, NC_NETCDF4|NC_CLOBBER, &ncid)) ERR;
        if (nc_put_att_int(ncid, NC_GLOBAL, "attribute", NC_INT, 1, &i)) ERR;
        if (nc_close(ncid)) ERR;

        /* Modify an attribute 2^16 times. This test suggested by
         * Constantine Khrulev. */
        for (i = 0; i < 65536; ++i)
        {
            if (nc_open(FILE_NAME, NC_WRITE, &ncid)) ERR;
            if (nc_put_att_int(ncid, NC_GLOBAL, "attribute", NC_INT, 1, &i)) ERR;
            if (nc_close(ncid))
                ERR;
        }
    }
    SUMMARIZE_ERR;

And since you have separate code for handling text atts, we need a text att test too.
Thanks for this fix!

Thanks @ckhroulev , a very complete and well-crafted fix! Your contribution is very helpful. ;-)

Thanks very much!


x/net/webdav: PROPFIND failes on OpenBSD if the directory has a unix domain socket in it

Please answer these questions before submitting your issue. Thanks!
What version of Go are you using (go version)?
1.7.4
What operating system and processor architecture are you using (go env)?
openbsd/amd64
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="openbsd"
GOOS="openbsd"
GOPATH="/home/stuart/go"
GORACE=""
GOROOT="/home/stuart/.goroot"
GOTOOLDIR="/home/stuart/.goroot/pkg/tool/openbsd_amd64"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -fmessage-length=0"
CXX="g++"
CGO_ENABLED="0"
What did you do?
If possible, provide a recipe for reproducing the error.

Make a unix domain socket in a temporary directory
Serve the directory with x/net/webdav
Try to list the directory with the socket

Code used to serve directory.
http://play.golang.org/p/ClPtJ4beK4
For the socket, socat unix-listen:testpipe - & pkill -9 socat works.
What did you expect to see?
A listing of the directory contents.
What did you see instead?
dav:/> ls
Listing collection `/': failed:
XML parse error at line 1: junk after document element

The problem seems to be in the function props in /x/net/webdav/prop.go.  It opens every file to get its dead properties.  Unfortunately, on OpenBSD, opening a unix socket (as opposed to connecting to it), returns EOPNOTSUPP.

/cc @mdempsky

I tested against other webdav servers (I used apache with the dav mod), and found that in the same conditions the broken pipe is silently ignored by the dav server.
For example, in the local /webdav:
user:/webdav$ ls
normal-file
testpipe

And in cadaver:
dav:/webdav/ ls
normal-file

Analyzing the order of function calls and overall functionality, I also noticed the server logs and an extra error:
2017/10/13 19:01:00 http: multiple response.WriteHeader calls
in addition to the
2017/10/13 19:01:00 PROPFIND /: open testpipe: no such device or address
(both a 200 and also a 500, which are passed up to webdav.go)


Handle Memory issues

When finetuning a large model, it might be that the standard batch size of 16 is too large. In the individual benchmark classes they could simply be instantiated with a smaller batch size, but the Benchmark class doesn't have this.
One way to deal with this could be to catch the error and cut the batch size in half for that particular evaluation, and continue halving until it works. Another way could be to include batch size as an argument in the Benchmark class. Needs to be in the CLI as well in that case.

Implemented in https://github.com/saattrupdan/ScandEval/releases/tag/v0.2.0.


SHA256 checksum

@h1alexbel thank you for reporting this. I'll assign someone to take care of it soon.

@h1alexbel this is your task now, please go ahead. Deadline (when this ticket should be closed) is 2023-08-20T10:19:09.823310.
Estimation here is 60 minutes, that's how much you will be paid.
Remember, you don't have to solve everything in this ticket - you can solve it partially and leave todo markers in the code, which will become future tasks.
If you have any questions don't ask me, I'm not a technical person. Open new tickets instead.
If you don't have time or simply don't want to work on this, you can always resign.

@zoeself deregister

@zoeself deregister

@h1alexbel ok, I've removed this task from scope. I'm not managing it anymore.

@h1alexbel 2 puzzles #24, #25 are still not solved.

@h1alexbel all 2 puzzles are solved here: #24, #25.


Specify an error sink when creating the logger

We had a errW that was not being used, wired up a new parameter to NewJSON that is used as the error sink. If it's nil, we use _defaultErrSink.
I'm not a fan of the new parameter, maybe we need to go the functional options route (with NewLogger not needing any parameters, but using some defaults like "log everything to stdout". Can do that as a follow up if you agree with that approach.

:shipit:


DTO: SqlalchemyDTO -  properties with sqlalchemy.ext.hybrid.hybrid_property.expression are included  in DTO

Description
Experessions for hybrid_properties are inlcuded in DTO.
    @hybrid_property
    def project_type(self) -> str:
        return self.project.slug + "_" + self.type

    @project_type.inplace.expression
    @classmethod
    def _project_type_expression(cls) -> SQLColumnExpression[String]:
        return cast("SQLColumnExpression[String]", Project.slug + "_" + cls.type)

URL to code causing the issue
No response
MCVE
class Backlog(orm.TimestampedDatabaseModel):

    title: Mapped[str]
    type: Mapped[ItemType] = m_col(default="draft", index=True)
    project: Mapped["Project"] = relationship(
        "Project", uselist=False, back_populates="backlogs", lazy="joined", info=dto_field(Mark.READ_ONLY)
    )
    @hybrid_property
    def project_type(self) -> str:
        return self.project.slug + "_" + self.type

    @project_type.inplace.expression
    @classmethod
    def _project_type_expression(cls) -> SQLColumnExpression[String]:
        return cast("SQLColumnExpression[String]", Project.slug + "_" + cls.type)

ReadDTO = SQLAlchemyDTO[Annotated[Backlog, DTOConfig()]] -> returns dto with _project_type_expression included

### Steps to reproduce

```bash
1 - Define models with hybrid_property and experessions
2 - They are included in responsees and dto.

Screenshots
"![SCREENSHOT_DESCRIPTION](SCREENSHOT_LINK.png)"

Logs
No response
Litestar Version
2.0.0.a7
Platform

[X] Linux
[ ] Mac
[ ] Windows
[ ] Other (Please specify in the description above)

Can you give #1776 a try please @v3ss0n?
I also added handling for hybrid_property.inplace.setter as well - see this test for an example.

I will give a try in 3 hr

Sorry  for late, it have been resolved.


Make GPU_MATRIX_STACK_MAX value variable/configurable

Jonathan,
I'm using your wonderful library as a backend for a simple game engine, where objects are organized in a hierarchy.
The default value for GPU_MATRIX_STACK_MAX constant is way too low for me (nested object depth can be an arbitrary value). At some point, I'll end up releasing / opening up this library to others, and it feels kind of dumb asking people to modify your source code to set it to a higher value, like 64 or 128.
It would be awesome if this value could be modified at run time, maybe before, or during the SDL-GPU init step, as optional parameter or something.
Thank you.

Hey, I have already made that change locally for some matrix improvements that I am working on.  I'll double-check everything and push a commit today.

Actually, it's a little different: the stack grows automatically if you try to push to it when its too small.

This should work better for you as of 7c190b7c12f2697f5d7e5eae0cc6d418268cfe21.

Thanks, Jonathan!


Fixed: track flow reporting and logs

Codecov Report

Merging #220 into master will increase coverage by 0.56%.
The diff coverage is 74.64%.

@@            Coverage Diff             @@
##           master     #220      +/-   ##
==========================================
+ Coverage   48.91%   49.47%   +0.56%
==========================================
  Files          33       33
  Lines        4322     4380      +58
==========================================
+ Hits         2114     2167      +53
- Misses       2013     2014       +1
- Partials      195      199       +4

Impacted Files
Coverage Δ

enforcer/datapath_tcp.go
37.42% <53.12%> (-0.1%)
:arrow_down:

enforcer/connection.go
93.47% <92.3%> (-6.53%)
:arrow_down:

processmon/processmon.go
69.13% <0%> (+2.46%)
:arrow_up:

monitor/linuxmonitor/linuxMonitor.go
68.62% <0%> (+6.86%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update eaec554...5992a0a. Read the comment docs.

Done

On Apr 25, 2017, at 10:48 PM, Dimitri Stiliadis<EMAIL_ADDRESS>wrote:
@dstiliadis commented on this pull request.
In cache/cache.go https://github.com/aporeto-inc/trireme/pull/220#discussion_r113369908:

// DataStore is the interface to a datastore.
type DataStore interface {
Add(u interface{}, value interface{}) (err error)
AddOrUpdate(u interface{}, value interface{})
Get(u interface{}) (i interface{}, err error)
Remove(u interface{}) (err error)

removeNotify(u interface{}, notify bool) (err error)
Needs to be public (Capital if its in the interface)

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/aporeto-inc/trireme/pull/220#pullrequestreview-34750473, or mute the thread https://github.com/notifications/unsubscribe-auth/AKFF6d6smK957LdnywcM08ldd_k1PFcKks5rztqjgaJpZM4NIEnh.


Remove commandId so clicking on treeItem does not reveal

@fiveisprime didn't like having the click-on-reveal due to the fact users may unintentionally reveal settings.   He says the eye is a common enough UI.

I completely agree that the eye makes sense, but I don't think that's why we kept "click to view". The problem is that the eye doesn't show up unless you hover over the node in the tree

I'll let @fiveisprime speak for himself on this matter.
I personally think that it's not that hidden as a user will most likely hover over the setting to interact with it in the first place.  We also have other commands that behave this way such as filter subscriptions and view deployment logs.