Install-Module and Update-Module errors / Unable to update PowerShellGet to fix

Steps to reproduce
*The initial issue has been reported in #407, #349 and #7827 where running Install-Module and Update-Module produce errors like below.

The cause of this issue seems to be that the expected URL for the PowerShellGallery is different from the stored repository in that there is a trailing /.
The fix for this issue appears to be to update PowerShellGet to the latest version and this is where I am having an issue.
Update-Module -Name PowerShellGet

Expected behavior
PowerShellGet is updated

Actual behavior
PowerShellGet was not installed by using Install-Module, so it cannot be updated

If I run Install-Module -Name PowerShellGet -Force, I get the same error that happens whenever running Install-Module:

Environment data
This is on Windows Server 2012 R2 that has been upgraded from WMF 4.0 to WMF 5.1.

> $PSVersionTable
Name                           Value
----                           -----
PSVersion                      5.1.14409.1005
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.14409.1005
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           <IP_ADDRESS>

> Get-Module -ListAvailable PowerShellGet,PackageManagement
ModuleType Version    Name
---------- -------    ----
Binary     <IP_ADDRESS>    PackageManagement
Script     <IP_ADDRESS>    PowerShellGet

> Get-PackageProvider -ListAvailable
msi                      <IP_ADDRESS>
msu                      <IP_ADDRESS>
NuGet                    <IP_ADDRESS>
PowerShellGet            <IP_ADDRESS>
Programs                 <IP_ADDRESS>

@Dyermull thanks for opening the issue, we are investigating, might be related to Windows Server 2012 R2

Could you also provide us with Get-PSRepsitoryand Get-Module PowerShellGet -listavailable?
A work around you may also want to try in uninstalling PowerShellGet and then re-installing it

I don't think this is related to #407 etc. Those are to do with Update-Module specifically. If you have a problem with Install-Module it is different. You may have some sort of connectivity problem, but it's odd because you must have contacted the gallery in order to find that PowerShellGet has PackageManagement as a dependency. Please try:
Install-Module PowerShellGet -Force -AllowClobber -Debug -Verbose

and share the output.

@SydneyhSmith  Thanks, here are the results from the commands.
Get-PSRepository
Name                      InstallationPolicy   SourceLocation

PSGallery                 Trusted              https://www.powershellgallery.com/api/v2
Get-Module PowerShellGet -listavailable
Directory: C:\Program Files\WindowsPowerShell\Modules

ModuleType Version    Name                                ExportedCommands

Script     <IP_ADDRESS>    PowerShellGet                       {Install-Module, Find-Module, Save-Module, Updat...

@edyoung Thank you for looking into this too. Here are the results from the command requested.
PS C:\Users\app_admin> Install-Module PowerShellGet -Force -AllowClobber -Debug -Verbose
DEBUG: 00:00:00.0000011 Calling New() : MethodName = 'GetDynamicOptions'
Confirm
Continue with this operation?
[Y] Yes  [A] Yes to All  [H] Halt Command  [S] Suspend  [?] Help (default is "Y"): A
DEBUG: 00:00:00.0000384 Force: True
DEBUG: 00:00:00.0000576 Debug: True
DEBUG: 00:00:00.0000815 Name: PowerShellGet
DEBUG: 00:00:00.0001002 Verbose: True
DEBUG: 00:00:00.0008717 INVOKING PowerShell Fn Get-DynamicOptions with args Provider that has length 1
DEBUG: 00:00:00.0017917 In PowerShellGet Provider - 'Get-DynamicOptions'.
DEBUG: 00:00:00.0035642 Done calling powershell «Get-DynamicOptions» «PSModule»
DEBUG: 00:00:00.0093916 Calling New() : MethodName = 'GetDynamicOptions'
DEBUG: 00:00:00.0094237 Force: True
DEBUG: 00:00:00.0094494 Debug: True
DEBUG: 00:00:00.0094676 Name: PowerShellGet
DEBUG: 00:00:00.0094850 Verbose: True
DEBUG: 00:00:00.0101982 INVOKING PowerShell Fn Get-DynamicOptions with args Source that has length 1
DEBUG: 00:00:00.0108969 In PowerShellGet Provider - 'Get-DynamicOptions'.
DEBUG: 00:00:00.0133351 Done calling powershell «Get-DynamicOptions» «PSModule»
DEBUG: 00:00:00.0190611 Calling New() : MethodName = 'GetDynamicOptions'
DEBUG: 00:00:00.0191031 Force: True
DEBUG: 00:00:00.0191335 Debug: True
DEBUG: 00:00:00.0191610 Name: PowerShellGet
DEBUG: 00:00:00.0191891 Verbose: True
DEBUG: 00:00:00.0200873 INVOKING PowerShell Fn Get-DynamicOptions with args Package that has length 1
DEBUG: 00:00:00.0206575 In PowerShellGet Provider - 'Get-DynamicOptions'.
DEBUG: 00:00:00.0315610 Done calling powershell «Get-DynamicOptions» «PSModule»
DEBUG: 00:00:00.0376576 Calling New() : MethodName = 'GetDynamicOptions'
DEBUG: 00:00:00.0377015 Force: True
DEBUG: 00:00:00.0377274 Debug: True
DEBUG: 00:00:00.0377529 Name: PowerShellGet
DEBUG: 00:00:00.0377772 Verbose: True
DEBUG: 00:00:00.0386669 INVOKING PowerShell Fn Get-DynamicOptions with args Install that has length 1
DEBUG: 00:00:00.0394921 In PowerShellGet Provider - 'Get-DynamicOptions'.
DEBUG: 00:00:00.0435007 Done calling powershell «Get-DynamicOptions» «PSModule»
DEBUG: 00:00:11.2161812 Calling SearchForPackages. Name='PowerShellGet'
VERBOSE: Using the provider 'PowerShellGet' for searching packages.
DEBUG: 00:00:11.2173176 PackageProvider::FindPackage with name PowerShellGet
DEBUG: 00:00:11.2179706 Calling SearchForPackages After Select 1
DEBUG: 00:00:11.2249748 Calling New() : MethodName = 'FindPackage'
DEBUG: 00:00:11.2267467 ProviderName: PowerShellGet
DEBUG: 00:00:11.2282369 Type: Module
DEBUG: 00:00:11.2296907 MessageResolver: Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:11.2310595 AllowClobber: True
DEBUG: 00:00:11.2322720 Force: True
DEBUG: 00:00:11.2335896 Debug: True
DEBUG: 00:00:11.2349417 Scope: AllUsers
DEBUG: 00:00:11.2364896 Verbose: True
DEBUG: 00:00:11.2377721 Name: PowerShellGet
DEBUG: 00:00:11.2398769 INVOKING PowerShell Fn Find-Package with args System.String[], , ,  that has length 4
DEBUG: 00:00:11.2464542 In PowerShellGet Provider - 'Find-Package'.
DEBUG: 00:00:11.2482166 OPTION: ProviderName => PowerShellGet
DEBUG: 00:00:11.2502612 OPTION: Type => Module
DEBUG: 00:00:11.2519884 OPTION: MessageResolver =>
Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:11.2544567 OPTION: AllowClobber => True
DEBUG: 00:00:11.2862344 OPTION: Force => True
DEBUG: 00:00:11.3883397 OPTION: Debug => True
DEBUG: 00:00:11.3899918 OPTION: Scope => AllUsers
DEBUG: 00:00:11.3915769 OPTION: Verbose => True
DEBUG: 00:00:11.3937581 OPTION: Name => PowerShellGet
VERBOSE: The -Repository parameter was not specified.  PowerShellGet will use all of the registered
repositories.
VERBOSE: Getting the provider object for the PackageManagement Provider 'NuGet'.
VERBOSE: The specified Location is 'https://www.powershellgallery.com/api/v2' and PackageManagementProvider
is 'NuGet'.
DEBUG: 00:00:11.4937166 PackageProvider::FindPackage with name PowerShellGet
DEBUG: 00:00:11.5491464 Calling 'NuGet'::'FindPackage' - name='PowerShellGet',
requiredVersion='',minimumVersion='', maximumVersion='''.
DEBUG: 00:00:11.6956268 Iterating 'PowerShellGet'.
DEBUG: 00:00:11.7418957 There are '0' registered sources in 'NuGet' provider.
DEBUG: 00:00:11.7443070 Source 'https://www.powershellgallery.com/api/v2' is not one of the registered
sources in 'NuGet' provider.
DEBUG: 00:00:12.3655250 Source 'https://www.powershellgallery.com/api/v2' is validated.
DEBUG: 00:00:12.3683687 Calling 'NuGetRequest'::'GetPackageById', 'PowerShellGet'.
DEBUG: 00:00:12.4673626 Calling 'HttpClientPackageRepository'::'FindPackagesById', 'PowerShellGet'.
DEBUG: 00:00:12.4698970 Calling 'NuGetClient'::'FindPackage'.
VERBOSE: Searching repository
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'' for ''.
DEBUG: 00:00:12.4755122 Downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'&$skip=0&$top=40'.
DEBUG: 00:00:12.6394474 Completed downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'&$skip=0&$top=40'.
DEBUG: 00:00:12.6497240 '18' packages received in the last request.
VERBOSE: Total package yield:'1' for the specified package 'PowerShellGet'.
DEBUG: 00:00:12.6626201 Completed iterating for 'PowerShellGet'.
DEBUG: 00:00:12.9175262 Done calling powershell «Find-Package» «PSModule»
DEBUG: 00:00:13.0118450 Calling New() : MethodName = 'GetInstalledPackages'
DEBUG: 00:00:13.0177405 ProviderName: PowerShellGet
DEBUG: 00:00:13.0193245 Type: Module
DEBUG: 00:00:13.0205658 MessageResolver: Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:13.0763516 AllowClobber: True
DEBUG: 00:00:13.0818544 Force: True
DEBUG: 00:00:13.0838635 Debug: True
DEBUG: 00:00:13.0890231 Scope: AllUsers
DEBUG: 00:00:13.0905020 Verbose: True
DEBUG: 00:00:13.0917585 Name: PowerShellGet
DEBUG: 00:00:13.1006968 INVOKING PowerShell Fn Get-InstalledPackage with args PowerShellGet, 2.1.2, ,  that
has length 4
DEBUG: 00:00:13.1111615 In PowerShellGet Provider - 'Get-InstalledPackage'.
DEBUG: 00:00:13.1128535 OPTION: ProviderName => PowerShellGet
DEBUG: 00:00:13.1143986 OPTION: Type => Module
DEBUG: 00:00:13.1169580 OPTION: MessageResolver =>
Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:13.1206522 OPTION: AllowClobber => True
DEBUG: 00:00:13.1222460 OPTION: Force => True
DEBUG: 00:00:13.1238162 OPTION: Debug => True
DEBUG: 00:00:13.1252367 OPTION: Scope => AllUsers
DEBUG: 00:00:13.1268033 OPTION: Verbose => True
DEBUG: 00:00:13.1283378 OPTION: Name => PowerShellGet
DEBUG: 00:00:13.1520983 PowerShell Script 'PSModule' Function 'Get-InstalledPackage' returns null.

Performing the operation "Install-Module" on target "Version '2.1.2' of module 'PowerShellGet'".
[Y] Yes  [A] Yes to All  [N] No  [L] No to All  [S] Suspend  [?] Help (default is "Y"): A
DEBUG: 00:00:22.7602777 Calling New() : MethodName = 'InstallPackage'
DEBUG: 00:00:22.7630189 ProviderName: PowerShellGet
DEBUG: 00:00:22.7661729 Type: Module
DEBUG: 00:00:22.7684853 MessageResolver: Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:22.7727869 AllowClobber: True
DEBUG: 00:00:22.7761910 Force: True
DEBUG: 00:00:22.7777491 Debug: True
DEBUG: 00:00:22.7805339 Scope: AllUsers
DEBUG: 00:00:22.7823425 Verbose: True
DEBUG: 00:00:22.7844870 Name: PowerShellGet
DEBUG: 00:00:22.7861230 INVOKING PowerShell Fn Install-Package with args
NuGet|PowerShellGet|2.1.2|https://www.powershellgallery.com/api/v2|Module that has length 1
DEBUG: 00:00:22.7898580 In PowerShellGet Provider - 'Install-Package'.
DEBUG: 00:00:22.7917583 In PowerShellGet Provider - 'Install-PackageUtility'.
DEBUG: 00:00:22.7935600 The FastPackageReference is
'NuGet|PowerShellGet|2.1.2|https://www.powershellgallery.com/api/v2|Module'.
DEBUG: 00:00:22.7959288 OPTION: ProviderName => PowerShellGet
DEBUG: 00:00:22.7975050 OPTION: Type => Module
DEBUG: 00:00:22.7992373 OPTION: MessageResolver =>
Microsoft.PowerShell.PackageManagement.Cmdlets.GetMessageString
DEBUG: 00:00:22.8025068 OPTION: AllowClobber => True
DEBUG: 00:00:22.8045194 OPTION: Force => True
DEBUG: 00:00:22.8065066 OPTION: Debug => True
DEBUG: 00:00:22.8092932 OPTION: Scope => AllUsers
DEBUG: 00:00:22.8118612 OPTION: Verbose => True
DEBUG: 00:00:22.8139601 OPTION: Name => PowerShellGet
VERBOSE: The installation scope is specified to be 'AllUsers'.
VERBOSE: The specified module will be installed in 'C:\Program Files\WindowsPowerShell\Modules'.
DEBUG: 00:00:22.8216398 ArtfactType is Module
VERBOSE: The specified Location is 'NuGet' and PackageManagementProvider is 'NuGet'.
VERBOSE: Downloading module 'PowerShellGet' with version '2.1.2' from the repository
'https://www.powershellgallery.com/api/v2'.
DEBUG: 00:00:22.9033387 Calling 'NuGet'::'InstallPackage',
'$aHR0cHM6Ly93d3cucG93ZXJzaGVsbGdhbGxlcnkuY29tL2FwaS92Mg==\UG93ZXJTaGVsbEdldA==\Mi4xLjI=\aHR0cHM6Ly93d3cucG93
ZXJzaGVsbGdhbGxlcnkuY29tL2FwaS92Mg==\cG93ZXJzaGVsbGdldA=='.
DEBUG: 00:00:22.9064262 Calling 'NuGetRequest'::'GetPackageByFastpath',
'$aHR0cHM6Ly93d3cucG93ZXJzaGVsbGdhbGxlcnkuY29tL2FwaS92Mg==\UG93ZXJTaGVsbEdldA==\Mi4xLjI=\aHR0cHM6Ly93d3cucG93
ZXJzaGVsbGdhbGxlcnkuY29tL2FwaS92Mg==\cG93ZXJzaGVsbGdldA=='.
DEBUG: 00:00:22.9099683 Calling 'NuGetRequest'::'ResolvePackageSource',
'https://www.powershellgallery.com/api/v2'.
DEBUG: 00:00:22.9124557 Calling 'NuGetRequest'::'FindRegisteredSource',
'https://www.powershellgallery.com/api/v2'.
DEBUG: 00:00:22.9148391 Source 'https://www.powershellgallery.com/api/v2' is not one of the registered
sources in 'NuGet' provider.
DEBUG: 00:00:23.2499730 Calling 'HttpClientPackageRepository'::'FindPackage', 'PowerShellGet'.
DEBUG: 00:00:23.2524035 Calling 'NuGetClient'::'FindPackage'.
VERBOSE: Searching repository
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'' for ''.
DEBUG: 00:00:23.2584930 Downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'&$skip=0&$top=40'.
DEBUG: 00:00:23.4598557 Completed downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PowerShellGet'&$skip=0&$top=40'.
DEBUG: 00:00:23.4637043 '18' packages received in the last request.
DEBUG: 00:00:23.4657982 'Package version' is '2.1.2'.
DEBUG: 00:00:23.4674385 'Request's Destination' is 'C:\Users\app_sp_admin\AppData\Local\Temp\2\3732685'.
DEBUG: 00:00:23.4690861 Calling 'NuGetClient'::'GetPackageDependencies'.
DEBUG: 00:00:23.4707559 There are '0' registered sources in 'NuGet' provider.
DEBUG: 00:00:23.4731013 Source 'https://www.powershellgallery.com/api/v2' is not one of the registered
sources in 'NuGet' provider.
DEBUG: 00:00:23.5665495 Source 'https://www.powershellgallery.com/api/v2' is validated.
DEBUG: 00:00:23.5696069 Calling 'NuGetRequest'::'GetPackageById', 'PackageManagement'.
DEBUG: 00:00:23.6628285 Calling 'HttpClientPackageRepository'::'FindPackagesById', 'PackageManagement'.
DEBUG: 00:00:23.6647353 Calling 'NuGetClient'::'FindPackage'.
VERBOSE: Searching repository
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PackageManagement'' for ''.
DEBUG: 00:00:23.6684965 Downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PackageManagement'&$skip=0&$top=40'.
DEBUG: 00:00:23.7177836 Completed downloading
'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='PackageManagement'&$skip=0&$top=40'.
DEBUG: 00:00:23.7203747 '14' packages received in the last request.
DEBUG: 00:00:23.7227192 Returning the call 'NuGetClient'::'GetPackageDependencies'.
DEBUG: 00:00:23.7691683 Calling 'NuGetClient'::'InstallPackage'.
VERBOSE: InstallPackage' - name='PackageManagement',
version='1.3.1',destination='C:\Users\app_sp_admin\AppData\Local\Temp\2\3732685'
VERBOSE: DownloadPackage' - name='PackageManagement',
version='1.3.1',destination='C:\Users\app_sp_admin\AppData\Local\Temp\2\3732685\PackageManagement\PackageMana
gement.nupkg', uri='https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1'
VERBOSE: Downloading 'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1'.
VERBOSE: An error occurred while sending the request.
DEBUG: 00:00:24.2226303    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PackageManagement.NuGetProvider.NuGetClient.d__15.MoveNext()
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1' for '2'
more times
VERBOSE: An error occurred while sending the request.
DEBUG: 00:00:24.3943537    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PackageManagement.NuGetProvider.NuGetClient.d__15.MoveNext()
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1' for '1'
more times
VERBOSE: An error occurred while sending the request.
DEBUG: 00:00:24.5644314    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.PackageManagement.NuGetProvider.NuGetClient.d__15.MoveNext()
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1' for '0'
more times
VERBOSE: Downloading package 'PackageManagement' failed, please make sure
'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1' is accessable.
WARNING: Source Location 'https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1' is not
valid.
Confirm
Continue with this operation?
[Y] Yes  [A] Yes to All  [H] Halt Command  [S] Suspend  [?] Help (default is "Y"): A
PS C:\Users\app_admin>

That's pretty odd. can you try invoke-webrequest "https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1" ? That should produce an error which will hopefully indicate why you can't download the package

That is interesting.
invoke-webrequest : The underlying connection was closed: Could not establish trust relationship for the
SSL/TLS secure channel.
At line:1 char:1

invoke-webrequest "https://www.powershellgallery.com/api/v2/package/P ...

  + CategoryInfo          : InvalidOperation: (System.Net.HttpWebRequest:HttpWebRequest) [Invoke-WebReques
 t], WebException
  + FullyQualifiedErrorId : WebCmdletWebResponseException,Microsoft.PowerShell.Commands.InvokeWebRequestCo
 mmand

I've encountered an error with Windows Server 2008 where I couldn't install/update Package Management.  I needed to manually delete dlls under the top level folder (C:\Program Files\WindowsPowerShell\Modules\PackageManagement) and restart powershell.

@alerickson I think that's different from @dyermull's case.
Do you have a web proxy? Does invoke-webrequest https://www.powershellgallery.com/ work?

We do not have a web proxy. invoke-webrequest https://www.powershellgallery.com/ seems to work. It returns a Status Code of 200 and Description of OK and a lot of other information. I will post if it is relevant.
Just to give a little more information. This is happening on all (4) servers (2012 R2) that I have tested. On at least two of them the Install-Module and Update-Module worked fairly recently. The one that I'm running all these tests on is a Dev server, however it is broken on production servers too. I am able to run these commands on Windows 10 laptops and VMs without an issue from the same network.
I ran the invoke-webrequest "https://www.powershellgallery.com/api/v2/package/PackageManagement/1.3.1" and checked the Windows error logs and noticed something interesting. There is a cert error, posted below:
An operation failed because the following certificate has validation errors:
Subject Name: CN=psg-prod-eastus.azureedge.net, O="OpenDNS, Inc.", L=San Francisco, S=California, C=US
Issuer Name: O=Cisco, CN=Cisco Umbrella Secondary SubCA ash-SG
Thumbprint: (Removed - not sure if it matters or not)
Errors:
PartialChain: A certificate chain could not be built to a trusted root authority.
RevocationStatusUnknown: The revocation function was unable to check revocation for the certificate.
OfflineRevocation: The revocation function was unable to check revocation because the revocation server was offline.
.
This error does not appear on every server that is having the problem, including the production one that I need to get working, so I'm not sure if it truly is a cert issue or not.
Thanks for the help!

Thanks, that helps a lot. It would appear that the certificate which is being used by the CDN service (psg-prod-eastus.azureeedge.net is our CDN) is not trusted because you can't reach the revocation server to check the CRL. I don't understand why it seems to work for PowerShellGet and then fails for PackageManagement, they should be the same.
Try going to https://psg-prod.eastus.azureedge.net/ using a browser and look at the cert details (by clicking on the lock next to the URL - exact steps depend on browser).
I see:
*.vo.msecnd.net (CRL http://mscrl.microsoft.com/pki/mscorp/crl/Microsoft IT TLS CA 2.crl)
Microsoft IT TLS CA 2 (CRL http://crl3.digicert.com/Omniroot2025.crl)
Baltimore CyberTrust Root (root CA, no CRL and should be pre-trusted in the OS).
Which is a little different than what you see. I don't know why the CDN might use different certs for different points of presence but it's not necessarily wrong. If you can look at the cert, it has a property which is the revocation list (CRL). You should be able to reach that the CRL URL - you could check it with invoke-webrequest . The error message above suggests that it can't be reached. If we can identify the cert and CRL I can raise the issue with the CDN and get them to fix it.
As a potential workaround for this you could install packagemanagement and powershellget by downloading it manually from the gallery via a browser (go to https://www.powershellgallery.com/packages/PackageManagement/1.3.1 and follow the 'manual download' steps, same for powershellget).

I tried going to https://psg-prod.eastus.azureedge.net/ but wasn't able to get there from the server. Tried on my laptop and a VM, both gave a "Server IP address could not be found". I had a friend in another organization try it and he got the same thing. We both noticed that the browser quit trying really fast - as in it didn't take more than a couple seconds to get the following message using Chrome:
This site can’t be reached psg-prod.eastus.azureedge.net’s server IP address could not be found.
Try running Windows Network Diagnostics.
DNS_PROBE_FINISHED_NXDOMAIN
As far as the work-around goes, I'm game to try it, I just wanted to make sure I wasn't missing a cleaner fix. I've read the Manual Download documentation, but didn't see what to do with the existing module files and folders. Should I delete them first? Is there a best way to do this other than just deleting them like a PS command to delete/clean them up?
Thanks again.

Sorry! it's psg-prod-eastus, not psg-prod.eastus. typo on my part :-|

I'm using the following link for my tests: https://psg-prod-eastus.azureedge.net/
I tried the new link with various results depending on the machine and browser. On the 2012 R2 server, Internet Explorer will not load the page or cert - just the standard "There is a problem with this website's security certificate." "The security certificate presented by this website was not issued by a trusted certificate authority."
If I click "Continue to this website" it just seems to refresh and bring me back to the same page no matter how many times I click.
Using Chrome on the same server, I get the warning - "This server could not prove that it is psg-prod-eastus.azureedge.net; its security certificate is not trusted by your computer's operating system. This may be caused by a misconfiguration or an attacker intercepting your connection."
If I then click on "Proceed to psg-prod-eastus.azureedge.net (unsafe)" it just keeps looping me back to the 1st Chrome warning page and does not advance.
IE on a laptop running Windows 10 just gives a 400 error. Chrome on the same laptop does seem to load the page with an Invalid Query Parameter Value message. The cert details from the laptop (which doesn't have the PowerShell issue) are not close to yours and I think we're talking Certification Path? because the Details page of the cert really doesn't look like yours. Would it help to post that info?

Below is a screenshot of that URL's Certification Path.

I looked through each of the certs in the chain and the only one with CRL info in its properties is the 2nd one, "Cisco Umbrella Primary SubCA" The url under CRL Distribution Point is:
http://www.cisco.com/security/pki/crl/ciscoumbrellaroot.crl

Not sure if this helps or not since it's not on the server I am having issues with, just trying to give as much info as I can.

Also, I can download that CRL file from the server, but running an Invoke-Webrequest http://www.cisco.com/security/pki/crl produces an error: "The request was aborted: Could not create SSL/TLS secure channel."

I believe your company is using Cisco umbrella to man-in-the-middle the traffic. That is, they intercept all the traffic and use a special cert which should be installed on all the client machines to reassure them that this is ok. (this is not super unusual btw).
But something is wrong - either with cert distribution or CRL access. Please contact your network administrator to work out what the issue is.

I've run into this before, and in my case it was caused by SSL/TLS version compatibility, for whatever reason powershell was not obeying our policy to enforce TLS1.2 + and was trying to use SSLv3.
Verify current TLS support of your powershell: [Net.ServicePointManager]::SecurityProtocol
Response MUST include either "TLS10", "TLS11", or "TLS12"
Change to TLS1.2: [Net.ServicePointManager]::SecurityProtocol = [System.Net.SecurityProtocolType]::Tls12;`

Thanks, the response I get is: PS C:\Windows\system32> [Net.ServicePointManager]::SecurityProtocol Ssl3, Tls
Changing to TLS1.2 was successful, but didn't fix the issue. I was getting the same errors. I rebooted and PS had reverted to Ssl3 and Tls. Found out through some more testing that just closing and re-opening PS would cause the setting to revert to Ssl3, Tls after setting it to TLS1.2. Shouldn't that be persistent?

The setting is not persistent. See https://docs.microsoft.com/en-us/security/solving-tls1-problem#update-windows-powershell-scripts-or-related-registry-settings for details on how to persistently change it; but since it doesn't sound like it solves the issue, my advice is still to find the person who configured the Cisco umbrella product for your company

@edyoung Thanks, I'll continue to work with our Network team on this issue and post once we make some progress.

Think I have a general idea of what is causing the problem, but not precisely. I worked with our Network team and after much testing on a pair of dev servers, we got one to work, where it turned out all it needed was to have the Cisco Umbrella Root CA installed. Everything worked after that. However, this was a pretty bare-bones server without much customization. The servers that I wanted to install modules on still wouldn't run install-module/update-module no matter what we tried and I was getting inconsistent results across my set of test machines.
I discovered the difference on the servers that wouldn't work is that they are SharePoint servers and I was using the SharePoint 2013 Management Shell for PowerShell (like I have for years on everything PowerShell.) This management shell runs a PS script at launch with the main command:

For reasons still unclear to me, Install-Module will not work if that PSSnapin is loaded. I tried running base Windows PowerShell and Install-Module works fine (Cisco cert loaded too, of course). As soon as I ran the command to load the SharePoint snapin, Install-Module broke, with the same errors as before. I tested this work-around on three servers with the same results. Success.

I don't know if the question of what the SharePoint snapin is loading/doing that is affecting the PowerShellGet modules belongs here or not, but if anyone has any idea why that might be happening and if there's a fix, I'd love to hear it. If not and this should be closed or moved to another area, please let me know.

Thanks for all the advice.

I installed the Cisco Root Certificate Authority to the computer root cert store. I got it from the Deployments/Configuration/Root Certificate location from the clients MSP Dashboard.
I was able to use the Install-Module command directly from the ISE after that.
From the DL page:
Umbrella's Block Page feature presents an SSL certificate to browsers that make connections to blocked sites. The certificate will match the requested site but will be signed by the Cisco Root Certificate Authority (CA).

@Dyermull, sorry to hear you're still seeing some issues. I think the cisco issue is out of scope for us. Regarding SharePoint snapin, it's quite odd that it affects Install-Module. I think that's an issue for the SharePoint team, probably best reported via https://sharepoint.uservoice.com/forums/330318-sharepoint-administration . I'm going to close this because I don't think there's something we can fix in PowerShellGet.


boolean, and keep init order

Forgot about the logic check.
And "... calling mockModule_restoreModuleFunc if mockModule_patchModuleFunc is not called" from #7

What about optimizing ON_MODULE_FUNC_CALL? Is there a need for a similar workaround as was done for EXPECT_MODULE_FUNC_CALL?


Redesign a good logo for the website

Create a logo inspired by the theme of the project and swap it with the existing one.

how's this?

I wanna work on this issue.

 how's this?

Not good.

I would like to work on this issue under SWOC. Kindly please assign this to me @2024-SANDHYA

Create a PR within 5 working days @Aditidubey223. Assigning it to you.


Consider WITHCOUNTERS

How do you feel about adding the WITHCOUNTERS options to the GETJOB command and consequently Nacks and AdditionalDeliveries to the Job struct?
In all of our use cases we inspect those counters to eventually give up on a job. As it is now we always have to do two calls for what could be done in one.

Thank you @pschultz , this is a great suggestion. I'll check it out in the next 24 hours along with your pull-requests.

@pschultz I've added the Nacks and AdditionalDeliveries fields to the Job struct type and the WITHCOUNTERS setting to the job fetch string.  Great suggestion!

Excellent. That improves performance considerably. Thanks.


Twitter ERROR: There's no video in this tweet

URL: https://twitter.com/BTNBrentYarina/status/705235433198714880
there is a video in this tweet, but YouTube-DL reports:
ERROR: There's no video in this tweet.; please report this issue ......
OUTPUT:
C:>youtube-dl.py -v "https://twitter.com/BTNBrentYarina/status/7052354331987148
80"
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'https://twitter.com/BTNBrentYarina/status/7
05235433198714880']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2016.03.01
[debug] Python version 2.7.11 - Windows-7-6.1.7601-SP1
[debug] exe versions: ffmpeg N-71346-gdf4fca2
[debug] Proxy map: {}
[twitter]<PHONE_NUMBER>98714880: Downloading webpage
ERROR: There's no video in this tweet.; please report this issue on https://yt-d
l.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to
update. Be sure to call youtube-dl with the --verbose flag and include its compl
ete output.
Traceback (most recent call last):
File "C:\youtube-dl.py\youtube_dl\YoutubeDL.py", line 666, in extract_info
ie_result = ie.extract(url)
File "C:\youtube-dl.py\youtube_dl\extractor\common.py", line 316, in extract
return self._real_extract(url)
File "C:\youtube-dl.py\youtube_dl\extractor\twitter.py", line 237, in _real_ex
tract
raise ExtractorError('There's no video in this tweet.')
ExtractorError: There's no video in this tweet.; please report this issue on htt
ps://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-d
l -U  to update. Be sure to call youtube-dl with the --verbose flag and include
its complete output.
Thanks
Ringo

Thanks for the report. Such Twitter videos will be supported in the next version.


Precised that by can use multiple columns to split

While in aggregate function it is explicitly stated column (or columns) that was not the  case with the description of the by function.

Thanks! I would rather phrase it as "one or more columns", though.

Bump.

Thanks! Could you apply the same fix to DataTables?

Who, me or @sylvaticus?

Either! :-)


Update zh_cn.json

A more accurate and fluent translation.Reduces the roughness, ambiguity, and misunderstandings caused by machine translation.
In some places, free translation was used instead of literal translation, as the results of literal translation were confusing

上次验证汉化偷懒了😥，这次稍微认真看一下。

Thank you for the submission. I need to fix a few issues with 1.19.2 and supporting more mods that add biomes then I'll add this. Thanks for the contribution!

解决了，请您查看

I should be able to work on this later. I worked on adding support for more modded biomes yesterday. I have a release up on Modrinth for it now, but still waiting on CurseForge to fix a bug in their scanner to do a release there.

CurseForge is having some issues with their Malware processor. I'm working with support on this, so could take a bit before this is available there. In the meanwhile, builds with the latest translation are up on Modrinth: https://modrinth.com/mod/homeostatic


Page Layout

It's not clear that the glossary includes genders and orientations unless you scroll all the way down. And if you scroll fast, it's easy to miss where a new section begins. I think it would be good to have tabs for the different sections.

Or a Table of contents in the sidebar could be helpful! 😁

Agreed! Both are viable options.

I agree as well to either options. I noticed it hours ago.


⚠ Bofrost.lu has degraded performance

In 955717b, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1750 ms

Resolved: Bofrost.lu performance has improved in ce8f584 after 15 minutes.


Fix little typo avartar -> avatar

When looking at the examples I spotted a typo for avatar
So I updated it across the repo. :pencil2: :bee: :smile:

Much delayed, but thanks for catching & fixing!


Refactor the interpolation line-search

Decide at run-time what interpolation algorithm to use (cubic, quadratic and bisection) for the line-search algorithm described in Nocedal & Wright (Numerical Optimization, 2006).

Refactor the interpolation-based line-search to use the step (cubic, bisection, quadratic) that is closer to the current minimum.


⚠ Bofrost.fr has degraded performance

In e0f6466, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1291 ms

Resolved: Bofrost.fr performance has improved in 41c0d1a after 1 hour, 11 minutes.


Java model Builder.build() method should be annotated with @NonNull

https://github.com/pinterest/plank/pull/223


Refactorings to sentry and other services

Background: I was working on the sentry service and all of a sudden I went down a rabbit hole of small refactorings and fixes, primarily on sentry but also on other services except daprd 🙃
This is a collection of small fixes and refactorings:

Sentry can now import Ed25519 keys and certificates (which must be generated externally)

Why: read on ECDSA vs EdDSA and note that some people prefer to use non-NIST curves (for reasons explained there too). Note however that sentry continues to sign issue certificates with P-256 keys only (for now?)

Fixed: loading of TLS certs in operator and placement is more reliable

Fixed a race condition that may make certs not be loaded in some cases
Continuously try to load certs and not give up after the first signal from the watcher
In placement svc, fixed a goroutine leak

Fixed: shutting down sentry, operator, placement, and injector should not panic when the healthz server is shut down gracefully (by ignoring ErrServerClosed)
Fixed: rare crash in sentry when reading invalid certificates
Refactored some code in sentry to improve code readability and remove some extra background goroutines.

/ok-to-test

What do you mean, @artursouza? This did not introduce new functionality so it should be fully backwards-compatible.
Just fixed some bugs and cleaned up goroutines :)

What do you mean, @artursouza? This did not introduce new functionality so it should be fully backwards-compatible.
Just fixed some bugs and cleaned up goroutines :)
Also, @pravinpushkar requested to make one method exported so the CLI can use it.

Yes, Exporting a method for generating new certificate would hide the internal implementation for it to be used in CLI during certificate rotation.


add dropdowns for Role and Area of Expertise in Community search UI

To complete genome/civic-server#198

For reference, server side supports:

Param name: area_of_expertise

Valid values: Patient Advocate, Clinical Scientist, Research Scientist

Param name: role

Valid values: moderators, editors, admins

Either or both can be specified in the filter section just like display_name


Fallback if tool-chaing plugin not installed

Fallback to 'jpackage'  if tool-chaing plugin not installed and absolute jpackage location can't be find. This works if jpackage can be find by PATH/JAVA_HOME env variable.

Argument escaping is a bit more complicated and works differently on Windows and OS X
If toolchain is not configured it makes more sense to search in $java.home/bin
Surrounding everything with quotes breakes OS X build.
See 0.0.4

--description and --copyright args may have spaces

java.lang.Process handles this.


Explain and understand how the OMRSRepositoryConnector find methods work.

Pull request #742 illustrated that the behaviour of the find methods on the OMRSRepositoryConnector are not well understood.  This issue is to add some more documentation.

JavaDoc updates are merged, suggest further documentation should be tracked by blog entry pending under #1621 ?

Good reminder — @grahamwallis is your blog pending publishing? =)

Yup - please see https://www.odpi.org/category/blog/egeria

Think we can close this one, then?


#47 - picking items that will be available for planting during campaign creation

@cmwd

Current coverage is 55.26%

Merging #96 into master will increase coverage by +16.13% as of 5bd64c8

@@            master     #96   diff @@
======================================
  Files            7      11     +4
  Stmts           69     114    +45
  Branches         0       0
  Methods          0       0
======================================
+ Hit             27      63    +36
  Partial          0       0
- Missed          42      51     +9

Review entire Coverage Diff as of 5bd64c8

Powered by Codecov. Updated on successful CI builds.


Sensible debug serving of static files

As far as I can see, this is still the norm to do:
https://docs.djangoproject.com/en/1.7/howto/static-files/#serving-files-uploaded-by-a-user-during-development
I created a sample project with sugardough and it fails to serve up static files because I don't run collectstatic all the time when I simply have ./manage.py runserver running.

Hmm... I might have gotten myself confused. It seems to work without adding those extra lines to urls.py. Welcome to Django 1.7 @peterbe


Physical android 11/api30 device not receiving notifications

reported by @adamontherun
mock works
android 11.0 API 30

cannot repro on android 11 api 30 simulator w/ playstore; needs more info

on this device/OS the app will start, but does not receive any Activity types

Emulated Android 13, Api 33. Mock works until "Stop" is pressed. After that, can't be started back

Physical Samsung Galaxy. App starts and Start button works but can't see any status or activity.

possible fix is #7


Does Spyder 4.1.2 has incompatibility with Pyqt5 5.14?

I got this issue trying to install pyqt5 5.14.

No, it's not. Spyder is compatible with PyQt 5.12, not 5.14, sorry.

a simple option to block spyder from generate unwanted issue report when using a not the  "supported" list of package/distro would be cool.
current option otherwise seems to comment lines 379 to 382


create-vite: add CLI argument help

Description
npx create-vite --help should show help for command line usage
Suggested solution
something like ...
Usage: create-vite [OPTION]... [DIRECTORY]
Create a new JavaScript project based on Vite.

With no arguments, start an interactive command line dialog.

Options:
  -t, --template NAME        use this template

Available templates:
...

Alternative
read the source of create-vite to find the CLI arguments
const argv = minimist<{
  t?: string
  template?: string
}>(process.argv.slice(2), { string: ['_'] })

Additional context
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

Hello, i did some changes, what do you think?

im blinded by the colors ; )
what will you do in the future, when you run out of colors?
i would rather group the templates into lines
vanilla vanilla-ts
vue vue-ts custom-create-vue custom-nuxt
react react-ts ...
preact ...
lit ...

interesting, thanks for the point. I just added the colors thinking that when we create a new project the templates are shown with colors

like that?

yepp. except i would put the -ts versions second
(also, please stop posting screenshots of text...)

I prefer the version where 'ts' comes first; I'll await feedback in the PR.


docs(AIVD-108): Updated wording on generate app

Updates:

Change the wording from reference app to sample app for the generate app command.

:tada: This PR is included in version 2.5.0 :tada:
The release is available on:

GitHub release
npm package (@latest dist-tag)

Your semantic-release bot :package::rocket:


won't work in Yosemite

won't work in Yosemite，export

Thanks!
Since El Capitan will be released this month I probably won't fix this. But (Version 2.0)[https://github.com/behoernchen/Iconizer/releases/tag/2.0] was build with Yosemite, so that version should work properly.

Thanks!
Since El Capitan will be released this month I probably won't fix this. But Version 2.0 was build with Yosemite, so that version should work properly.

Release of El Capitan.


ValueError: "concat" mode can only merge layers with matching output shapes except for the concat axis. Layer shapes: [(None, 2, 14, 512), (None, 2, 14, 256)]

I run you code "unet_buildings.py" to train model. then I got an error as following:
[2017-11-16 09:49:53.996358] Creating and compiling model...
Traceback (most recent call last):
File "unet_buildings.py", line 254, in
model = get_unet0()
File "unet_buildings.py", line 104, in get_unet0
up6 = merge([UpSampling2D(size=(2, 2))(conv5), conv4], mode='concat', concat_axis=1)
File "/usr/local/lib/python2.7/dist-packages/keras/engine/topology.py", line 1680, in merge
name=name)
File "/usr/local/lib/python2.7/dist-packages/keras/engine/topology.py", line 1299, in init
node_indices, tensor_indices)
File "/usr/local/lib/python2.7/dist-packages/keras/engine/topology.py", line 1371, in _arguments_validation
'Layer shapes: %s' % (input_shapes))
ValueError: "concat" mode can only merge layers with matching output shapes except for the concat axis. Layer shapes: [(None, 2, 14, 512), (None, 2, 14, 256)]
I use keras+Theano+GPU.
Any idea why it is crashing?
Many Thanks!

plus: I use LINUX system.

@WenwenQi, you can try to set image_dim_ordering to Theano th in ~/.keras/keras.json.

@dmpetrov  Thanks a lot.
I resolved this problem by set "unet_buildings.py"  code :
up6 = merge([UpSampling2D(size=(2, 2))(conv5), conv4], mode='concat', concat_axis=1)
change "concat_axis=1" to "concat_axis= -1" to match [2, 14, 512] and [2, 14, 256].

I meet the same question as you. and I change "concat_axis=1" to "concat_axis= -1"  from up6 to up9, but I got an error as following:
File "/home/chen-h/PycharmProjects/3th kaggle_dstl_submission-master/kaggle_dstl_submission-master/src/unet_trees.py", line 250, in
model = get_unet0()
File "/home/chen-h/PycharmProjects/3th kaggle_dstl_submission-master/kaggle_dstl_submission-master/src/unet_trees.py", line 133, in get_unet0
conv9 = BatchNormalization(mode=0, axis=1)(crop9)
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/engine/topology.py", line 575, in call
self.build(input_shapes[0])
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/layers/normalization.py", line 103, in build
constraint=self.gamma_constraint)
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/legacy/interfaces.py", line 87, in wrapper
return func(*args, **kwargs)
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/engine/topology.py", line 396, in add_weight
weight = K.variable(initializer(shape),
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/initializers.py", line 41, in call
return K.constant(1, shape=shape, dtype=dtype)
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 358, in constant
return tf.constant(value, dtype=dtype, shape=shape, name=name)
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 99, in constant
tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape))
File "/home/chen-h/anaconda3/lib/python3.6/site-packages/tensorflow/python/framework/tensor_util.py", line 421, in make_tensor_proto
(shape_size, nparray.size))
ValueError: Too many elements provided. Needed at most -16, but received 1
It seems to caused by the following code:
conv9 = Convolution2D(32, 3, 3, border_mode='same', init='he_uniform')(conv9)
crop9 = Cropping2D(cropping=((16, 16), (16, 16)))(conv9)
conv9 = BatchNormalization(mode=0, axis=1)(crop9)

Can you give me some advice?
thanks a lot.

@cug-chenhui you have to carefully check where do you place your channels and correct channel_axis everywhere starting from your input, then check every layer to the output. Or use the same channel as was originally intended :)

@cepera-ang  do you mind being more specific? sorry I'm also facing this issue

@leader80 there are two ways to organize image data: NCHW or channels_first and NHWC or channels_last. First N stands for N images in batch, C stands for channels and H, W is height and width of image. As you can see in the code, this network defaults to NCHW input (for example, look here https://github.com/ternaus/kaggle_dstl_submission/blob/master/src/unet_buildings.py#L63) and Theano backend used during training does the same too. It means that all convolutions change C axis of tensor (second place, index 1 starting from zero) thus concat_axis everywhere is 1 and batchnorm axis also 1.
New versions of Keras use Tensorflow backend and Tensorflow uses NHWC by default because it is faster on CPU (sic!) (see discussion here). So this change messes up all the axes in the network. There are to ways dealing with it:

first option, add old ordering option to Keras config file (lookup at google how to do it in current version), -
second option, change input to be NHWC format and replace all concat and batch norm axes to -1.

That's it, hope this helps


Fixed _prepareModel function erasing options hash

Current _prepareModel implementation doesn't pass the provided options hash to the model initialize function instead replacing it with only the collection variable.

Ping

I just ran into this bug, and the fix looks proper.
Alternative wording for this issue is "Creating or adding a model to a collection ignores the options hash".

@jashkenas, this simple bug fix for "Creating or adding a model to a collection ignores the options hash" has evaded attention.
While we are at it, this line is also the only place where collection.model is used, so it could be developed to enable dynamic model type/class instantiations on fetch. I usually change collection.model or collection.newModel to a function returning a model instance based on argument attributes (for example attributes.type), to allow collections consisting of several model types. Fallback to collection.defaultModel or such. Some are trying to do dynamic type instantiation in sync or parse, but this line is the proper place to call instantiation function without new, so perhaps it could be documented.

@tritowntim I tried to recreate your issue w/ Backbone 0.9.1 and was unable to.
Using the following I didn't see any recursion.
var Collection = Backbone.Collection.extend({
	model: Backbone.Model,
	url: '#'
});
var col = new Collection;

col.create({foo: 'bar'}, {wait: true});

var model = new Backbone.Model({bar:'stool'});
model.collection = col;
model.save({wait: true});
col.add(model);

Can you re-create the issue using BB 0.9.1?


CON-1262 New C2C Exchange Trace Logs

Purpose of this pull request
Create a new public doc for a new C2C we are releasing. The image sizes need to be adjusted.
Issue number: CON-1262
Select the type of change:

[ ] Minor Changes - Typos, formatting, slight revisions
[ ] Update Content - Revisions and updating sections
[x] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - Updates, maintenance, and new packages for the site, Gatsby, React, etc

@kimsauce This file needs corrections and all the mages need to be polished, cropped, and resized. I am working on it and will create a new PR for this.


Add optimistic update capability

This moves the promise into the payload option to also allow passing the data object. This breaks the API, up to you how you want to handle that. I can either add support for the both scenarios or we can drop the previous method.

Thanks. I will get this merged in this week.

Cool - I'm now wondering if the promise is actually part of the "meta" attribute. Might be worth grabbing an opinion from @acdlite since I know you want to be FSA compliant.

:+1: !

@jarsbe Sorry for the delay.
This looks great. Would you mind rebasing from master and removing the periods from the commit messages? Once you do that I'll merge in.

@pburtchaell No problem, tis holiday season after all! I've squashed my commits and rebased as requested.

Great. Thanks for the contribution!


spec: added records read

added records read. A few questions here:

why is the date field required on the message?
should the json schemas be attached?
See below:

We'll start with this one and I can take the entire records interface after this is approved.

Also might be worth a discussion on the DWN call:
Currently, a RecordsRead can only be called if you know the recordId in advance.
As proposed by @csuwildcat and some others mentioned the need, we would like to add the ability to perform a RecordsRead based on a protocolPath.
We can discuss some scenarios and some thoughts on the call.


feat: allow server-side hydration

Reason
It is not ideal that the transcripts link to JS on a CDN. This means that, if the user is offline or does not have access to the CDN, then the transcript will not be hydrated and will be difficult to read.
This PR adds an option ssr when generating transcripts. If it is set to true, then the HTML will not contain the script tag that links to the CDN and will be hydrated server-side.
NOTE: this is intended to be merged after this PR, and the dependency version for @derockdev/discord-components-core and @derockdev/discord-components-react needs to be updated

This is great! This was a feature that was on my to-do list. I'll take a look at this and test it out later today or tomorrow.

@Kurstch @ItzDerock There is problem with CI - module is missing.
I think cause is, that module hydrate is exported in exports object, but not provided in files in package.json in discord-components package, so it is excluded.
https://github.com/ItzDerock/discord-components/blob/main/packages/core/package.json#L32-L38
https://github.com/ItzDerock/discord-components/blob/main/packages/core/package.json#L63-L66

It turns out that reactive components are no longer reactive after hydration, meaning spoilers do not work since they require JavaScript. Trying to see if there's a script I can load on the client or inline it in the final HTML to make spoilers work again.
then there's also this issue where users are not loading properly.
My guess is that stencil's hydrate function does not run any HTML scripts, so this never runs:

and so the components don't have access to the window.$discordMessages.profiles data.
looking at the stenciljs docs, with hydrateDocument, you can pass in a document object. Maybe we can combine this with JSDOM and manually set the profiles by setting document.defaultView.$discordMessages.profiles to be the profiles data.

Could it be possible to use the beforeHydrate option?
ScencilJS already constructs some kind of mock document, when hydrating.
    const result = await renderToString(markup, {
      beforeHydrate: async doc => {
        console.log(inspect(doc, {depth: 1000, colors: false, compact: false }));
        return true;
      }
    });

I see that the MockDocument does contain the script elements. They just aren't being used for some reason (full logs):
            <ref *5> MockScriptElement {
              ownerDocument: [Circular *1],
              nodeType: 1,
              nodeName: 'SCRIPT',
              _nodeValue: null,
              parentNode: [Circular *3],
              childNodes: [
                MockTextNode {
                  ownerDocument: [Circular *1],
                  nodeType: 3,
                  nodeName: '#text',
                  _nodeValue: 'window.$discordMessage={profiles:{"690559909934137414":{"author":"Martins","avatar":"https://cdn.discordapp.com/avatars/690559909934137414/71a191799915e05ad9fd5aa2aeaf319e.webp?size=64","bot":false,"verified":false},"730060849900683406":{"author":"test-bot","avatar":"https://cdn.discordapp.com/embed/avatars/3.png","roleColor":"#000000","roleName":"test-bot","bot":true,"verified":false},"706483778675146762":{"author":"Kurstch","avatar":"https://cdn.discordapp.com/avatars/706483778675146762/41a8d1bc5e92ee1cef3347a10c1bb9e9.webp?size=64","bot":false,"verified":false}}}',
                  parentNode: [Circular *5],
                  childNodes: []
                }
              ],
              namespaceURI: 'http://www.w3.org/1999/xhtml',
              __shadowRoot: null,
              __attributeMap: null
            },
            <ref *6> MockScriptElement {
              ownerDocument: [Circular *1],
              nodeType: 1,
              nodeName: 'SCRIPT',
              _nodeValue: null,
              parentNode: [Circular *3],
              childNodes: [
                MockTextNode {
                  ownerDocument: [Circular *1],
                  nodeType: 3,
                  nodeName: '#text',
                  _nodeValue: 'document.addEventListener("click",t=>{let e=t.target;if(!e)return;let o=e?.getAttribute("data-goto");if(o){let r=document.getElementById(`m-${o}`);r?(r.scrollIntoView({behavior:"smooth",block:"center"}),r.style.backgroundColor="rgba(148, 156, 247, 0.1)",r.style.transition="background-color 0.5s ease",setTimeout(()=>{r.style.backgroundColor="transparent"},1e3)):console.warn("Message ${goto} not found.")}});',
                  parentNode: [Circular *6],
                  childNodes: []
                }
              ],
              namespaceURI: 'http://www.w3.org/1999/xhtml',
              __shadowRoot: null,
              __attributeMap: null
            },

@ItzDerock I just confirmed that this solution works for loading users:
    const result = await renderToString(markup, {
            beforeHydrate: async doc => {
                doc.defaultView.$discordMessage = {
                    profiles: JSON.parse(await profiles),
                }
            },
        });
    return result.html;

But still don't know about spoilers

im also going to rename the option to hydrate instead of ssr as that name makes a bit more sense in this context.


Vulnerability Report: Insecure Output Handling in Lumos Plugin

Hi, sorry for reporting it here. I found a way to exfiltrate data from the user's chat because of the nature of the plugin that allows it to render most of the HTML tag and the default plugin RAG behavior.  The issue occurs when a malicious website ask the local LLM model to injects an img tag via Indirect Prompt Injection into the content displayed by the plugin. This tag can trigger unauthorized data transmission to an external server controlled by the attacker when the user is actively chatting through the plugin while visiting the malicious site. I think most of the models will gladly put a simple image tag to the response, but so far I've just tried it with Llama 3.2 and Mistral.
Tested Version: 1.0.16 (Latest)
Vulnerability Description:
Lumos allows users to interact with a local LLM through a chat interface. During the default configuration usage, the plugin may render output from the current page that user is visiting in. However, when a malicious website is open, it can exploit the plugin's failure to sanitize output properly. Specifically, by embedding an  HTML tag with a source pointing to the attacker’s server, the malicious site can capture sensitive data from the user's chat interactions and transmit it to an external location without user consent.
Impact
This vulnerability can lead to unauthorized exfiltration of sensitive information from the user's LLM chat, which could include confidential conversations, sensitive personal information, or other data handled during the plugin's use.
Exploitation Requirements: The attacker must host a malicious site and lure the user to visit it while they are actively using Lumos for LLM-based chat. As long as the 'Disable Content Parsing' feature is not enabled, the user can just ask anything while its in the malicious website tab for the exploitation to be successful.
Simple PoC
The attacker could hide the malicious prompt as seen in the screenshot below.

In a successful scenario, after user asks something, the plugin will try to read content of the current website, then the hidden prompt will be read and executed by the model. But with different models behaviors and unpredictability of the answer from AI, a payload (hidden prompt) will not be able to work in all model, a little bit customization may be required to the payload for it to work to specific model.

Like stated before, the exfiltration will be done via a rendered image tag like below.

Recommendation for Mitigation/Remediation:
1. Implement proper output sanitization in the Lumos plugin to ensure that HTML tags, especially <img>, are escaped before being rendered.
2. If possible, enforce strict content security policies (CSP) to prevent external sources from being injected into the plugin’s context.

Thanks.

Thanks for reporting the issue! I will look into it.

Hi Andrew. Just want to check since I'm not too familiar with browser extension. If you want to implement the input / output validation in the plugin, where and what will the fix be? I tried to look at the javascript file but can't identify where the fix should be implemented. Thanks.

I'm not sure what the solution will be yet. The issue is related to the Markdown component, which is used to render the input/output: https://github.com/andrewnguonly/Lumos/blob/main/src/components/ChatBar.tsx#L724-L733

I see, thanks for the information. I see that you're using markdown-to-jsx library, I think you can just use the disableParsingRawHTML: true to stop it from rendering HTML tags in input and output of the text box. Other alternative is to encode certain characters like <, /, >, etc.
References:
https://github.com/quantizor/markdown-to-jsx/pull/278
https://github.com/quantizor/markdown-to-jsx/pull/278/commits/852e80fe1f92274cacb622bc51c4430531861a49

This issue is resolved in app version 1.0.17.


ZModem/XModem doesn't work.

ZModem/XModem doesn't work.

I confirmed the issue. I will fix it.

ZMODEM file transfer was re-implemented.
XMODEM has not been updated yet.
b07cbc712861cb163d33c35a57c83b802050b9ba...f61a279373423c0e9042db76faf8bd4a81ee23cc

It ways failed when I tried to upload big file(for example 50M).
SecureCRT implements ZModem in a good way, when I type "rz" or "sz" in terminal, the upload or download dialog will appear automatically.

Which connection type are you using? Telnet? SSH? or SerialPort?
Which version of operating system is running on the remote side?

I use ssh2.

Remote side OS inforamtion:
$uname -na
Linux 2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
$cat /etc/issue
CentOS release 6.5 (Final)
Kernel \r on an \m

When transfer failed, a dialog popup, says "Aborted by peer".

Thank you for the information !

You would have noticed that the transfer speed slows down soon after the file transfer was started.
It is caused by the flow control of the SSH protocol that is based on the "window" size.
Default window size of Poderosa is 4096 bytes, and it is too small to the ZMODEM protocol.
Small window size causes the delay of the data transfer, and sz may detect it as the transfer error.
Try larger SSH window size.
To change the SSH window size,
Open Tools > Detailed preference editor,
then edit the value of "org.poderosa.protocols.sshWindowSize".
16384 or larger value (like 65536) would improve the data transfer.
262144 would be enough to the binary data transfer like SCP or SFTP.
I have tested ZMODEM file transfer of the 500mb binary file with the large window setting, and the transfer was completed successfully.

Thank you for your response, but the solution seems not work for my case:(
I changed the sshWindowSize to 262144, but I still the the same error as before.

OK, I know why it fails.
If I open the XZModerm dialog and send a file to server, it will fail for large file, but succeed for small file.
I think the correct method should be:

run rz command from terminal;
and then open the XZModerm dialog and send file to server, large file will also be uploaded successfully.

Data resending was fixed.
Now TCP_NODELAY is used for the SSH or TELNET.
It will improve the file transfer rate. (and will reduce error on the remote side)
16528775af8ebe41704bd32851cbf9b21d939592...8a0a7818bd3e29bd89684562f12b79d73824a0ed

Thank you for the quick fix.


[Bug]: llama-index-vector-stores-opensearch -> TypeError: object tuple can't be used in 'await' expression

Bug Description
The introduction of async behavior into the OpenSearch integration has caused errors in previously working code.
Version
llama-index-vector-stores-opensearch==0.1.7
Steps to Reproduce
pip install opensearch-py==2.4.2
pip install llama-index-vector-stores-opensearch==0.1.7

The code below previously worked...
import os
import boto3
from opensearchpy import RequestsHttpConnection, AWSV4SignerAuth

from llama_index.vector_stores.opensearch import OpensearchVectorClient

text_field = "content"
# OpensearchVectorClient stores embeddings in this field by default
embedding_field = "embedding"

endpoint = "my-endpoint"
idx = "my-index"

credentials = boto3.Session().get_credentials()
region = "us-east-1"
service = "aoss"
auth = AWSV4SignerAuth(credentials, region, service=service)

client = OpensearchVectorClient(
                endpoint,
                idx,
                1536,
                embedding_field=embedding_field,
                text_field=text_field,
                http_auth=auth,
                use_ssl=True,
                verify_certs=True,
                connection_class=RequestsHttpConnection,
            )

But now causes error
   client = OpensearchVectorClient(
             ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/eatkins/.pyenv/versions/3.11.2/lib/python3.11/site-packages/llama_index/vector_stores/opensearch/base.py", line 324, in __init__
    event_loop.run_until_complete(
  File "/Users/eatkins/.pyenv/versions/3.11.2/lib/python3.11/asyncio/base_events.py", line 653, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/eatkins/.pyenv/versions/3.11.2/lib/python3.11/site-packages/opensearchpy/_async/client/indices.py", line 255, in get
    return await self.transport.perform_request(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/eatkins/.pyenv/versions/3.11.2/lib/python3.11/site-packages/opensearchpy/_async/transport.py", line 390, in perform_request
    status, headers_response, data = await connection.perform_request(
                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: object tuple can't be used in 'await' expression

Relevant Logs/Tracbacks
No response

@ecatkins seems like an issue in the opensearch client package? The code isn't doing anything obvious that would cause this. Maybe try updating? Or downgrading?
It's failing on this line
https://github.com/run-llama/llama_index/blob/3e5d0a146fcda01a984818d381f31a19287aead8/llama-index-integrations/vector_stores/llama-index-vector-stores-opensearch/llama_index/vector_stores/opensearch/base.py#L325

@logan-markewich I am using the latest version of opensearch-py and downgrading that does not seem to have an effect.
However downgrading to llama-index-vector-stores-opensearch-0.1.4 does work

Reporting same error as well.

Replace RequestsHttpConnection with AsyncHttpConnection for your connection class and it should work

Changing to AsyncHttpConnection resolves the issue


fix ARIA ID not being unique

Please always provide the GitHub issue(s) your PR is for, as well as test URLs where your change can be observed (before and after):
Fix #545
Test URLs:

Before: https://main--mammotome--hlxsites.hlx.page/us/en/
After: https://545-fix-aria-ids-are-not-unique--mammotome--hlxsites.hlx.page/us/en/

can the SEO score be fixed at the same time (even if content)?


feat(object_merger): merge known objects

Description
The current algorithm removes Unknown objects if they overlap, but not otherwise.
By this change, the ROI with the highest probability and confidence of existence is retained when known objects overlap.

Related links
Parent Issue:

How was this PR tested?

Before change

After change

Notes for reviewers
None.
Interface changes
None.

Effects on system behavior
None.

Checked processing time changes object_association_merger/debug/processing_time_ms.
Changed from approximately 3 ms to 6 ms.
process_without_known_obj_merger.webm
process_with_known_obj_merger.webm

Related pull requests
Parameter changes due to the addition of merge known object function in object merge node
https://github.com/autowarefoundation/autoware_launch/pull/1159


Backbone.Collection.get(id) randomly returns with undefined

Hey,
I've spent some time bug fixing my code, but realized that the Backbone.Collection.get(id) sometimes randomly returned with undefined.
I'm coding an image viewer app, so I set up three collections. One for the current item, one for the upcoming items and one hidden for buffering some images, all of them has only 5-10 models. The thing that i want to do is to get the first element from a collection (this) to pass it to another collection.
var Items = Backbone.Collection.extend({
    model: Item,
    getItem: function() {
        // returns and removes the first item from this collection
        if (this.length) {
            var firstItemId = this.toJSON()[0].id;
            itemToReturn = this.get(firstItemId);
            this.remove(itemToReturn);
            return itemToReturn;
        } else {
            qbConsole.log('No more items in '+this.name+'.');
            return false;
        }
    }
});

In the code above, itemToReturn is sometimes randomly undefined, even the Collection has the model with the specified ID, that is the only model with this ID, and ID is integer in the model.
Btw it seems Backbone.Collection.at(index) works properly on the same codebase, here is my working code. I figured out that this is the proper way to solve my problem, but hopefully this issue helps you guys make Backbone.js more better.
var Items = Backbone.Collection.extend({
    model: Item,
    getItem: function() {
        // returns and removes the first item from this collection
        if (this.length) {
            itemToReturn = this.at(0);
            this.remove(itemToReturn);
            return itemToReturn;
        } else {
            qbConsole.log('No more items in '+this.name+'.');
            return false;
        }
    }
});

Best,
milan

@korsosm thanks for the ticket.
I've created a test case from your code and am unable to reproduce the results you're talking about: http://jsfiddle.net/wookiehangover/vjcRK/
If this test case seems inaccurate, please fork it and post back any updates.

I did something funky and got .get(id) to improperly return undefined (non-randomly).
Here’s what was going on (steps to reproduce):

Have a Collection (we’ll call it 'List')
Give it a method that does this:

Takes a date range
Calculates if any items in List are within that range, and saves them as _removeLater
Makes an ajax request for items within that range, by using fetch with some extra parameters (importantly, with {add: true}, and by passing a query for the range in question)
On success, it removes the items in _removeLater from List. (This prevents duplicates, and gets rid of any items that were deleted on the server, within that range.) Note however that by the time success fires,
Also note ranges can overlap, partially or completely or exactly, whatever

Use this method twice, ensuring some overlap. (for testing purposes, consider that there are three groups items can fall into: Only in the first range, only in the second, or in both ranges. I only see the funky behavior in the last case.)

What happens?
Well, if you do a filter() or toJSON(), etc., on our Collection, it will return items (which I do want to be in the Collection!), that have IDs that result in an undefined if to get!
This only happens for items that were already in the collection, then removed on success of that fetch Ajax request.
So basically, it would seem that if you add an item to a Collection twice, then remove one of it, get breaks. I haven’t tested a general case of this yet, just within my above situation.
Reopen? Or New issue?

I'm running this issue as well. When I look at the _byId property of my collection the key of the item I want is actually "undefined" somehow.

Thanks for doing the legwork to describe this @alanhogan.
This was an unintended consequence of an earlier change allowing two different model objects with the same id to be added to the same collection without erroring. This situation shows why that was a mistake. 8cfb243b8e46837c72f64811882d55c5e02cd569 goes back to the previous behavior, so you should get early warnings if you're adding duplicate models in your app.

Thanks for being on this, @jashkenas! Glad I could help in my small way.

Ditto, thanks @jashkenas


Occupancy read error when there is blank

https://github.com/cabb99/open3spn2/blob/fc5c4cf650b5b546e49907bf18f804ec3555f245/open3SPN2/ff3SPN2.py#L468-L469
The occupancy and temFactor could report error 'could not convert string to float' when there is blank.
Suggest to change like this:
occupancy=[0.0 if line[54:60].strip()=='' else float(line[54:60])],
tempFactor=[0.0 if line[60:66].strip()=='' else float(line[60:66])],

Thank you, I changed it.
I just removed the brackets, since we are expecting a single number.

There is still some error. When I tested, it shows "IndentationError: unexpected indent".


 This is dependent on the partner work Buddy is doing. If we decide to feature packs, we'd want a way for a user to quickly be able to filter these in the public catalog.
Acceptance Criteria
UI

[x] A category filter is available called Featured
[x] This filter would showcase the olly packs that contain the featured label as a keyword.
[x] the filter value should be available as query param in the URL https://observabilitypacks.gatsbyjs.io/observability-packs/?filter=Anything&sort=Featured
[x] organize packs by featured first in alpha order, then all the rest of the tiles in alpha order in the catalog (marketplace) section.
[x] Packs that  are featured would have a label featured visible  Relates to #1561

Pack Meta Data

[ ] discuss with Buddy Brewster what packs will be featured.
[ ] We'd need a configuration value in the pack's config.yaml file to determine what packs to show
[ ] This should be added to the  keywords field in a pack config.

@polfliet discussed this need with @kidk and he was OK with DevEn contributing this feature to the olly pack configuration.

Let us know how this comes out, and if/when we need to add it to the API.

several questions on this before we can implement.

A couple of questions on the implementation of this:

What field this will be in the API (is this a featured boolean? is it part of a tags list?)
How will this be presented in the UI?
How will this interact with the search, sort, and filtering?
How do we want to update what is featured?

I think these are all good questions raised by @zstix. On this one specifically:

What field this will be in the API (is this a featured boolean? is it part of a tags list?)
I think tags could work for this use case and it wouldn't require adding anything additional to the config-spec.

It also makes me wonder: are we planning to do the same type of filtering for the in-product UI or is this only for the developer site?
VIRTUOSO-1122 is the ticket for us to add this to the service.

@jbeveland27 feature packs would also be in the product ideally.

featured functionality would be available in nerdgraph eventually that can we can read from.... to show the feature packs as a filter.

updated

Here are the designs I have done for this so far, the last thing to implement is the actual query param filtering:

@jpvajda The filter and label have been added, the only thing left is adding the featured keyword to the specified quickstarts. Have you heard anything from Buddy?

@aswanson-nr they'll be added where applicable to those packs we need to feature, Jemiah was running point but let me ask @polfliet if we have a list

I can make a PR once we have all of the partner quickstarts in, but we don't have them yet.
Normally it will be Kentik, Lacework, Trend Micro, Fastly, Cribl

@polfliet awesome, here is a 🎫  https://github.com/newrelic/newrelic-observability-packs/issues/244

@jpvajda Since we have newrelic/newrelic-observability-packs#244, can we close this ticket out?

Yes sir.


error when using hf model in genomic_benchmark pretrain

It seems that I can use the model provided in the hugging face such as kuleshov-group/caduceus-ph_seqlen-1k_d_model-118_n_layer-4_lr-8e-3 and code in caduceus-hf_finetune to fine-tune model on the genomic_benchmark task.
I download model and then use cmd:
python -m train     experiment=hg38/genomic_benchmark     callbacks.model_checkpoint_every_n_steps.every_n_train_steps=5000     dataset.dataset_name="dummy_mouse_enhancers_ensembl"     dataset.train_val_split_seed=1     dataset.batch_size=128     dataset.rc_aug=false     +dataset.conjoin_train=false     +dataset.conjoin_test=false     loader.num_workers=2     model=caduceus     model.name=dna_embedding_caduceus     +model.config_path=/cpfs01/projects-HDD/cfff-282dafecea22_HDD/liuxuyang/projects/gene/caduceus-hf_finetune/kuleshov-group/caduceus-ps_seqlen-1k_d_model-118_n_layer-4_lr-8e-3/config.json     +model.conjoin_test=false     +decoder.conjoin_train=true     +decoder.conjoin_test=false     optimizer.lr="1e-3"     trainer.max_epochs=10     train.pretrained_model_path=/cpfs01/projects-HDD/cfff-282dafecea22_HDD/liuxuyang/projects/gene/caduceus-hf_finetune/kuleshov-group/caduceus-ps_seqlen-1k_d_model-118_n_layer-4_lr-8e-3/model.safetensors     wandb=null
but it seems I didn't get the right config

This parameter model.config_path refers to a model config that would have been generated if you ran the pre-training as well. To use an HF model for this downstream task please use this branch: hf_finetune and see the discussion here

Thank you for your answering. But I still can't use HF model using hf_finetune, my command is:
python -m train     experiment=hg38/genomic_benchmark     callbacks.model_checkpoint_every_n_steps.every_n_train_steps=5000     dataset.dataset_name="dummy_mouse_enhancers_ensembl"     dataset.train_val_split_seed=1     dataset.batch_size=128     dataset.rc_aug=false     +dataset.conjoin_train=false     +dataset.conjoin_test=false     loader.num_workers=2     model=caduceus     model.name=dna_embedding_caduceus       +model.conjoin_test=false     +decoder.conjoin_train=true     +decoder.conjoin_test=false     optimizer.lr="1e-3"     trainer.max_epochs=10     train.pretrained_model_path=/cpfs01/projects-HDD/cfff-282dafecea22_HDD/liuxuyang/projects/gene/caduceus-hf_finetune/kuleshov-group/caduceus-ps_seqlen-1k_d_model-118_n_layer-4_lr-8e-3/model.safetensors wandb=null
and the error is

I believe you are still using the command / params for loading a model you pre-trained locally. Please instead refer to the commands/args defined in these files:

https://github.com/kuleshov-group/caduceus/blob/hf_finetune/slurm_scripts/wrapper_run_genomics_hf.sh
https://github.com/kuleshov-group/caduceus/blob/hf_finetune/slurm_scripts/run_genomics_benchmark_hf.sh

Namely, you will need to use model.pretrained_model_name_or_path="${PRETRAINED_PATH}" instead of train.pretrained_model_path, where PRETRAINED_PATH refers to either a HF path on the hub or locally

Thank you for your excellent work and outstanding answers.


ADAM job should be able to use a static/external Spark cluster

Currently, the ADAM pipeline is restricted to launching it's own cluster. We may want to point ADAM at a pre-existing Spark cluster that is sized outside of Toil.

https://github.com/BD2KGenomics/cgcloud/issues/119


error:: couldn't send email self signed certificate in certificate chain

Description
When trying to run a notification test, I receive the following error:
error :: ✖ couldn't send email self signed certificate in certificate chain
I'm running this on a Windows 10 box.
Here is my setup (scrubbed of personal data)
<EMAIL_ADDRESS>EMAIL_PASSWORD="myApppasswordFromGoogle"
DISCORD_NOTIFY_GROUP="@somerandomnumberthing"
DISCORD_WEB_HOOK="https://discordapp.com/api/webhooks/<secret>"
LOG_LEVEL="info"
OPEN_BROWSER="TRUE"
PHONE_NUMBER="us-phone-number"
PHONE_CARRIER="att"
SHOW_ONLY_BRANDS="nvidia"
SHOW_ONLY_MODELS="founders edition"
SHOW_ONLY_SERIES="3080"
STORES="bestbuy"
COUNTRY="usa"
SCREENSHOT="false"
USER_AGENT="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.121 Safari/537.36"

I am not sure what to do here. I've tried going back into my Google account, deleting my app password and recreating it. Hoping someone else here has run into this and has a solution.
Possible solution

Disable your Anti-Virus and try again.   I then got a failed login, so i turned on 'less secure apps' in the gmail security settings. Works great. Ive had to do this before with scan to email on my printer. Gmail's security in this regard is pretty conservative

Thanks all. This fixed the issue. For anyone else looking for what exactly to turn off if you have Avast, turn off Mail Shield.


Question - Force Agent Update From Build Server

Is it possible to force an agent to force an update from the server where it is installed for example using PowerShell?
As we currently have within repo a PS script and copy of the agent folder.  The script copies and installs the agent at the moment for various reasons don't want to pull latest agent download zip from online.
What I would like to do after it has been setup etc. is to get the PS script to force the agent to update to latest version?

Changed title

@russelldyas are you on an on-premises version of TFS or are you using VSTS? you can update from the pool admin UI, but only to the version that your server points. you can't specify the URL or anything like that.

@ericsciple
We are using VSTS.
I do understand can update via VSTS web page what I am trying to do is after I do an automatic install of the agent on the build server that I force it to update (without user interaction) so that I know the agent is on latest version etc.
So process at the moment when triggered.
1- Server Set process sends over the agent folder from local store
2- Powershell setups  the agent and adds to vsts
In step 3 I would like the agent to force an upgrade as the copy of agent in step one might not be the latest. Hence why asking from where the agent is installed can force/trigger an update
for example can the same message that pool admin UI sends can this be sent via PowerShell?

The web UI to update the pool calls a public rest api.  Open up fiddler or browser debugging tools to see the call

HttpPost:
Update entire pool -> https://<account>.visualstudio.com/_apis/distributedtask/pools/<poolid>/messages
Update a given agent within a pool -> https://<account>.visualstudio.com/_apis/distributedtask/pools/<poolid>/messages?agentId=<agentid>


updated CODE_OF_CONDUCT.md

I have updated the CODE_OF_CONDUCT.md file.
Fixes #225
There was a misunderstanding from my side. The CODE_OF_CONDUCT.md file already existed.
But I noticed a few things were missing from the file. So, I have updated it.
https://user-images.githubusercontent.com/93239528/162484954-0d96252b-0098-417a-bf65-7a976ff72698.mp4
Kindly review the file. @harshita214

Okay
Merging the PR 🚀
Thanks for Contributing 🎊


[Release] Bump version to 1.66.0 (on v1.66.x branch)

Change was created by the release automation script. See go/grpc-release

We're doing another pre-release instead.


Convert json with optional naming policy

Please answer these questions before submitting your issue. Thanks!
What version of Go are you using (go version)?
1.7.4
What operating system and processor architecture are you using (go env)?
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Users/LuoLiangchen/personal/develop/go"
GORACE=""
GOROOT="/usr/local/Cellar/go/1.7.4_1/libexec"
GOTOOLDIR="/usr/local/Cellar/go/1.7.4_1/libexec/pkg/tool/darwin_amd64"
CC="clang"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/tv/jxx18j9925v9ct0l75c1rtb00000gn/T/go-build236813399=/tmp/go-build -gno-record-gcc-switches -fno-common"
CXX="clang++"
CGO_ENABLED="1"
What did you do?
If possible, provide a recipe for reproducing the error.
A complete runnable program is good.
A link on play.golang.org is best.
What did you expect to see?
What did you see instead?

When parsing json string, we often get a json with key like "user_id", "updated_at". I mean, lower case letters with underscores.
But the field name of a struct is often like "UserId", "UpdatedAt".
In this case, we are not able to parse a json straightly. It is really inconvenient, even if we use a tag.
As a reference, the java lib gson implements this feature. It will be great if we could parse json with optional naming policy as well :D
public static final FieldNamingPolicy LOWER_CASE_WITH_UNDERSCORES
Using this naming policy with Gson will modify the Java Field name from its camel cased form to a lower case field name where each word is separated by an underscore (_).
Here's a few examples of the form "Java Field Name" ---> "JSON Field Name":

someFieldName ---> some_field_name
_someFieldName ---> _some_field_name
aStringField ---> a_string_field
aURL ---> a_u_r_l

The encoding/json package does not have such a hook. You have to specify the names of fields, sorry.
For questions about Go, see https://golang.org/wiki/Questions.


Add forceLocalSourceMap option

Background
Today PWA works very well when debugging applications where the user's code is the main or only code running in the target. This is the case for most websites and applications. It's not the case for extension host debugging, however; when working on a VS Code extension, the user's code is running alongside that of other first and third party extensions.
The issue arises when these other extensions have absolutely-pathed sourcemaps--the kind Webpack produces. We encourage authors to pack their extensions using a tool like Webpack, and in many configurations (like the same one our docs have) Webpack will produce sourcemaps for the compiled code. The paths in these sourcemaps are in the form webpack:///src/extension.ts. When a user is building their own extension, the debugger has no way to know that the webpack:///src/extension.ts being referred to from another extension sourcemap is not the same src/extension.ts that the user probably has in their "hello world" extension.
This causes breakpoints set in src/extension.ts to be mapped to code in other extensions. The user will 'hit' the breakpoint in their workspace files, but will actually be in some other author's code.
Approaches
The v1 adapters solve this issue by searching for sourceMaps in outFiles, marking breakpoints in mapped files as 'pending', and then setting the breakpoints in the compiled code the first time we load a source referenced from those maps. This generally works well, but has a downside that if a source is present in multiple places in the compiled code (multiple Webpack chunks, for instance) we'll only set the breakpoint in one location. Rob mentioned the TypeScript team ran into this issue.
PWA works differently. We optimistically set breakpoints by searching disk sourcemaps, and then in all sources that match references or paths from sourcemaps we encounter at runtime. Where v1 is conservative about ensuring we don't break in undesired locations, PWA is aggressive about ensuring that breakpoints are set and can be hit in all potential locations.
The PWA approach probably the more correct approach, and as mentioned it works very well with zero-configuration for most scenarios.
This PR
In this PR, we add a launch.json option, turned on by default only for the extension host debugger, which omits setting absolute paths of sourcemap-derived sources if the original sourcemap was not present in the workspace/rootPath. This prevents the breakpoints from being set by-path for external sources, while also allowing sources to be viewed even if their filenames conflict work workspace sources (previously, if you broke in any src/extension.ts, we'd assume it was your local version and not show the correct contents).
As far as implementation goes, this works by extracting some of the scanning we were already doing for the breakpoint predictor into a LocalSourceMapRepository, and sharing that with the SourceContainer. The repository keeps track of md5 hashes of content we've seen, against which we can check remote sourcemaps.
The primary weakness of this approach is that if the local compilation results are a different than the ones being debugged, breakpoints won't be hit. However, we're unsure if this will end up being a problem; few people will actually need this option, and it remains to be seen how many of those will also attempt to debug mismatched versions. (Also, if the sourcemaps are different, the user's debugging experience will already be degraded to a greater or lesser extent.)
There's an open question around performance of the the hashing; I think we should be fine but we'll keep an eye on it. At least for the disk scanning phase, we can cache file hashes by their mtime if necessary.
Almost finishes https://github.com/microsoft/vscode-pwa/issues/58

How might this work for projects whose source maps never exist on disk in the first place (e.g. React, Angular, anything hosted in the webpack dev server)?

This wouldn't do much for those scenarios, we'd advise to leave the option off for those scenarios. It's more rare to hit this scenario running off the webpack-dev-server, generally users will be bundling their single build with Webpack and not including other sources outside that build. I don't think v1 has any special binding today either; like this approach, outFiles depends on  paths on disk, and webpack-dev-server by default keeps a memory-based filesystem.

perhaps we can disallow webpack source maps outside of workspace to point into workspace sources while resolving the paths/urls? Would this solve the problem without a flag?

Unfortunately that's kind of hard to do. The URL that sourcemaps are served from may not indicate the workspace they're from. For extensions, most sourcemaps during development are files on disk, but if you're debugging a website we don't know what local workspace http://localhost/foo.map.js might be served from.

Unfortunately that's kind of hard to do. The URL that sourcemaps are served from may not indicate the workspace they're from. For extensions, most sourcemaps during extension development are files on disk, but if you're debugging a website we don't know what local workspace http://localhost/foo.map.js might be served from without some kind of matching like we implement here.

But I think in this particular case (where the problem with multiple extension.ts files comes from) source maps have file urls, which makes it work. Am I missing something?
Basically, this PR does exactly that (disallowing sourcemaps not present in the workspace to refer to workspace files), and I just propose to detect that automatically (crossing workspace boundary from source map to sources). We can always introduce the config option which forces some behavior, but the less options the better the user experience.

I see. We could do that, gain some simplicity and reliability in that scenario in exchange for not being able to forceLocalSourceMap on code running in browser. @roblourens curious to hear your thoughts ^

That does sound simpler. For other cases maybe we could consider sourcemaps coming from */node_modules/* to be "out of the project" also.
I looked for the discussions about this issue with Typescript or other projects, and couldn't find them. But it's easy to see the issue in Typescript, they build several targets into the same folder, tsc.js, tsserver.js, etc, and use outFiles that just points at one file, which is how you would work around it for v1.

I've updated the PR. I am much happier with this solution. It resolves the 'outdated file' scenario and provides some additional usability.
There's a new option resolveSourceMapLocations. Once again, I expect this to be set to a non-default value only in rare circumstances. It's a set of minimatch patterns, empty by default for Chrome, and for Node.js set to:
"resolveSourceMapLocations": [
  "${workspaceFolder}/**",
  "!**/node_modules/**"
],

Conveniently this also works for URLs; say for example you're loading sources from a CDN that has source maps, you could exclude that:
"resolveSourceMapLocations": [
  "**",
  "!https://cdn.contoso.com/**"
],

I opted to keep the bit of directory scanning refactors I implemented earlier, since there's now a decent set of unit tests for them and it provides an extension point if there's any local discovery work we decide to do in the future.
Thanks for your suggestions!


refactor: change the rich transaction in web3 block

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Which docs this PR relation:
Ref #
Which toolchain this PR adaption:
No Breaking Change
Special notes for your reviewer:
CI Switch
ci-runs-only: [Chaos CI, Cargo Clippy, Coverage Test, E2E Tests, Code Format, Unit Tests]

Codecov Report

Merging #377 (ed1787b) into main (442c7b0) will decrease coverage by 0.05%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #377      +/-   ##
==========================================
- Coverage   36.05%   36.00%   -0.06%
==========================================
  Files         119      119
  Lines        8253     8265      +12
==========================================
  Hits         2976     2976
- Misses       5277     5289      +12

Impacted Files
Coverage Δ

core/api/src/jsonrpc/impl.rs
0.00% <0.00%> (ø)

core/api/src/jsonrpc/web3_types.rs
0.00% <ø> (ø)


Update PingZhi's PPP

Codecov Report

Merging #148 (2aa3e91) into master (1f5e7c9) will decrease coverage by 0.03%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master     #148      +/-   ##
============================================
- Coverage     76.08%   76.05%   -0.04%
- Complexity      564      567       +3
============================================
  Files            91       91
  Lines          1748     1754       +6
  Branches        144      145       +1
============================================
+ Hits           1330     1334       +4
- Misses          370      372       +2
  Partials         48       48

Impacted Files
Coverage Δ

src/main/java/seedu/nutrigoals/model/user/Age.java
86.36% <0.00%> (-13.64%)
:arrow_down:

.../main/java/seedu/nutrigoals/model/user/Height.java
86.95% <0.00%> (ø)

src/main/java/seedu/nutrigoals/model/Calorie.java
97.36% <0.00%> (+0.07%)
:arrow_up:

.../main/java/seedu/nutrigoals/model/user/Weight.java
86.95% <0.00%> (+4.34%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.