Apply ‘.expanduser()’ to user provided paths

It would be convenient if .expanduser() were invoked on pathlib.Path objects, so that references to $HOME could be given with just ~:
>>> os.environ['HOME']
'/home/kseistrup'
>>> pathlib.Path('~/data').resolve()
PosixPath('/home/kseistrup/~/data')
>>> pathlib.Path('~/data').expanduser().resolve()
PosixPath('/home/kseistrup/data')

As far as I can see, this is only necessary in config.py — all other places use .resolve()'ed paths from config.py.
diff --git a/metno_locationforecast/config.py b/metno_locationforecast/config.py
index 901a4d3..10bc86b 100644
--- a/metno_locationforecast/config.py
+++ b/metno_locationforecast/config.py
@@ -60,11 +60,11 @@ class Config:
         for file in self.possible_user_config_files:

             config_parser = ConfigParser()
-            config_parser.read(file.resolve())
+            config_parser.read(file.expanduser().resolve())

             if self.section_header in config_parser:
                 user_config = dict(config_parser[self.section_header])
-                self.user_config_file = str(file.resolve())
+                self.user_config_file = str(file.expanduser().resolve())
                 break

         return user_config

:paperclip: config-py-diff.txt

This makes a lot of sense. I will implement this in dues course.

This functionality has been added in v1.1.0, now available from PyPI.

This functionality has been added in v1.1.0, now available from PyPI.


HLSL PS compilation crashes when using vec4

__import ShaderCommon;
__import Shading;
__import DefaultVS;

vec4 main(VS_OUT vOut) : SV_TARGET
{
    ShadingAttribs shAttr;
    prepareShadingAttribs(gMaterial, vOut.posW, gCam.position, vOut.normalW, vOut.bitangentW, vOut.texC, shAttr);

    ShadingOutput result;

    [unroll]
    for (uint i = 0; i < 3; i++)
    {
        evalMaterial(shAttr, gLights[i], result, i == 0);
    }

    vec4 finalColor = vec4(result.finalValue, 1.f);
    return finalColor;
}

Smaller repro shader:
// gh-160.hlsl
#ifdef __SLANG__
__import gh_160;
#endif

vec4 main(VS_OUT vOut) : SV_TARGET
{
	float3 color = float3(1,0,0);

    vec4 finalColor = vec4(color, 1.f);
    return finalColor;
}

plus:
// gh-160.slang
// (empty file)

Pull request #161 should fix this bug once it goes through CI. I'll plan to create a new release today that includes the fix.
Just as a heads-up though: because this fix is on top of master, rather than a "hotfix" branch or anything, the new release will bring along a bunch of my recent cleanup/technical-debt work. All of that work passes my own CI tests, but I wouldn't be surprised if other issues surface along the way.


Rename swift-parser-test to swift-parser-cli

@flashspys noted that swift-parser-test was easily confusable with the SwiftParserTest test target for newcomers. swift-parser-cli is unambiguous.
Also, rename the print-tree subcommand to tree and dump-diags to diags. That’s a little shorter to type and you don’t need to remember which of the two commands was dump and which one was print.

@swift-ci Please test

@swift-ci Please test

@swift-ci Please test


[Snapshot Interop] Fix Race Condition during acquiring lock on remote store metadata

Description
Fix Race Condition during acquiring lock on remote store metadata: https://github.com/opensearch-project/OpenSearch/pull/6787#discussion_r1184475995

This issue is lite on details, @harishbhakuni21 could you add more details for other contributors to pickup and resolve this issue, or would you like to assign it to yourself to complete as a part of a fast follow up from that pull request?

@peternied wanted to assign it to myself, but i did not have permission. can you assign it to me if you have permissions?


Provide access to stderr/stdout information generated by a container of a job node

The stderr/stdout of a container running as a part of job node (as a task of RunContainerTasklet) is now only available at a lower level as Spring-Batch step-wide execution context.
We must associate it with enclosing job node, and make it accessible to "expert" users.

Implemented by 4c92a89d40038bfee5a500f5d607bea08d170783


Supporting Hive 1.2

(1) Updated TPC-DS datasets on Amazon S3
(2) Updated TPC-DS suites to use updated datasets
(3) Updated TPC-DS scripts
(4) Added new TPC-DS suites for JSON datasets
(5) Updated some Hive suites to support Hive 1.2
(6) Updated Aggregates (TPC-DS) suites
(7) Updated Window Function (TPC-DS) suites
(8) Fixed & moved TPC-DS Original suite from Advanced to Functional

Rahul, Please take a look. I have a few more fixes coming in, so to make it easier to review, I thought  i"ll have you start with what's ready.

Got successful runs on test cluster.

I reviewed the first series of commits and they look good. Will review the second batch of commits tomorrow.

Abhishek,
These changes are very welcome. Also thanks for taking time to cleanup the tpcds suites. Considering the amount of file modified, I would appreciate if we can get a clean run on each of our clusters just to be sure.

Rahul

Thanks Rahul. I've got two runs already. Will schedule a few more and then merge them.

Rahul, regarding your comment on time taken by TPC-DS SF1 Original queries - I think they are well within the average. Did not see any issues. Will also monitor them for a few runs to be sure.


Question about SP publib/private key requirement for SHA-256 usage

Hello
First many thanks for publishing all these details about ADFS setup with SHA-256 signature support...because I really failed to get it work with SHA-1, probably I made a mistake somewhere in the sequence.
I have first generated my SP private key according to http://docs.spring.io/autorepo/docs/spring-security-saml/current/reference/htmlsingle/#configuration-key-management-private-keys
but when enabling metadata signature option to SHA-256, metadata generation then fails with
Caused by: org.apache.xml.security.signature.XMLSignatureException: No installed provider supports this key: sun.security.provider.DSAPrivateKey
                at org.apache.xml.security.algorithms.implementations.SignatureBaseRSA.engineInitSign(SignatureBaseRSA.java:167) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.apache.xml.security.algorithms.SignatureAlgorithm.initSign(SignatureAlgorithm.java:238) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.apache.xml.security.signature.XMLSignature.sign(XMLSignature.java:592) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.opensaml.xml.signature.Signer.signObject(Signer.java:77) ~[xmltooling-1.4.1.jar:?]
                ... 70 more
Caused by: java.security.InvalidKeyException: No installed provider supports this key: sun.security.provider.DSAPrivateKey
                at java.security.Signature$Delegate.chooseProvider(Signature.java:1135) ~[?:1.8.0_111]
                at java.security.Signature$Delegate.engineInitSign(Signature.java:1176) ~[?:1.8.0_111]
                at java.security.Signature.initSign(Signature.java:527) ~[?:1.8.0_111]
                at org.apache.xml.security.algorithms.implementations.SignatureBaseRSA.engineInitSign(SignatureBaseRSA.java:165) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.apache.xml.security.algorithms.SignatureAlgorithm.initSign(SignatureAlgorithm.java:238) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.apache.xml.security.signature.XMLSignature.sign(XMLSignature.java:592) ~[xmlsec-1.5.6.jar:1.5.6]
                at org.opensaml.xml.signature.Signer.signObject(Signer.java:77) ~[xmltooling-1.4.1.jar:?]
                ... 70 more

So I guessed that my private key was not consistent with signature requirements and I generated a new one with additional keytool options -keyalg RSA -keysize 2048 -sigalg SHA256withRSA
May you please confirm that was the right thing to do, and maybe you generate your private key the same way ? If so please - please - add this important information in your README.md.
Again thanks for your blog entries and this setup sample project.
Regards
Yves

By looking at the error, it appears you might be mixing DSA with RSA key.
What you did latter was the correct approach. I did the same thing on my end.
I have updated README.md to make this part clearer. Thank you.


The redis cache was updated and all the instances supports vnet isolation

On this documentation says that only premium instances support vnet isolation, but it was updated and all the instances have this available.
You can check here in the link https://learn.microsoft.com/en-us/azure/azure-cache-for-redis/cache-overview

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 3bced23e-5c67-3a63-06f7-c659ba56b5e7
Version Independent ID: 10d48e1f-e090-ab51-553c-64655a102c9d
Content: Configure a virtual network - Premium-tier Azure Cache for Redis instance
Content Source: articles/azure-cache-for-redis/cache-how-to-premium-vnet.md
Service: cache
GitHub Login: @flang-msft
Microsoft Alias: franlanglois

@seilorjunior
Thanks for your feedback! We will investigate and update as appropriate.

Nope. Only the premium instances support VNET isolation now. I just tried creating a standard instance and the network selection is grey.

It is the document you screenshot that is wrong.

@seilorjunior
Thanks for your dedication to our documentation. We have discussed this on our team and want to address the point that you made.
Virtual Network VNet injection is only one type of network isolation. As noted in the document you reference:
Can I use virtual networks with a standard or basic cache?
Virtual networks can only be used with Premium-tier caches.
But you have other options to network isolation beyond VNets.

Private Links are another type Network Isolation and that is available on all tiers.
Firewall rules another isolation option.

For more information on all three of these options, see https://learn.microsoft.com/en-us/azure/azure-cache-for-redis/cache-network-isolation
Thanks for providing feedback that helps improve our documentation. This issue has been resolved and we are closing the issue.
#please-close


SwaggerToTypeScriptClientGenerator ignores PropertyNameGenerator if TypeStyle = TypeScriptTypeStyle.Interface

Hi, I was trying to rename some of the client properties (the code below is simplified). I decided to use PropertyNameGenerator but it doesn’t work in case of TypeStyle = TypeScriptTypeStyle.Interface. It will call the Generate method but with no effect. In case of TypeStyle = TypeScriptTypeStyle.Class it works but it would break my whole UI codebase.
Not 100% sure if it is a real issue or by design (since there are no conversion method to JSON in case of TypeScriptTypeStyle.Interface) but I certainly didn’t find anything in documentation, it calls Generate method on PropertyNameGenerator with no effect and currently it is issue for me at least.
public class TypeScriptGenerator
{
    public static string GenerateTypeScript(SwaggerDocument document)
    {
        var settings = new SwaggerToTypeScriptClientGeneratorSettings
        {
            BaseUrlTokenName = "API_BASE_URL",
            ClassName = "{controller}Client",
            Template = TypeScriptTemplate.Fetch,
            PromiseType = PromiseType.Promise,
            HttpClass = HttpClass.HttpClient,
            UseSingletonProvider = false,
            GenerateClientClasses = true,
            GenerateClientInterfaces = false,
            GenerateOptionalParameters = true,
            ClientBaseClass = "RestClientBase",
            UseTransformOptionsMethod = true,
            UseTransformResultMethod = true,
            UseGetBaseUrlMethod = true,
            WrapResponses = false,
            GenerateResponseClasses = true,
            TypeScriptGeneratorSettings =
            {
                TypeStyle = TypeScriptTypeStyle.Interface, // Doesn't work
                // Works fine (but not usable in my case):
                // TypeStyle = TypeScriptTypeStyle.Class,
                PropertyNameGenerator = new CustomTypeScriptPropertyNameGenerator(),
            }
        };
        var generator = new SwaggerToTypeScriptClientGenerator(document, settings);
        return generator.GenerateFile();
    }
}

public class CustomTypeScriptPropertyNameGenerator : IPropertyNameGenerator
{
    public string Generate(JsonProperty property)
    {
        // takes no effect with TypeStyle = TypeScriptTypeStyle.Interface although it is called
        return "justTesting" + property.Name;
    }
}

You cannot use PropertyNameGenerator with interfaces because there is no mapping code from the api to the renamed properties.

Thanks for quick reply.
I noticed, is that intentional? Current behaviour seems to be quite misleading (why is Generate method even called when result is not used).

I think because all modes use the same model class. But it makes sense, you cannot rename props in interfaces because they would no longer match the responses.. you need to fix that (ie transform) in the spec


Interactive mode

Would be cool if running degit without arguments took you to an interactive mode where you could see which repos were available locally, and which refs thereof. And maybe let you select from that list by typing with fuzzy matching etc.

I'm now trying to implement one

zel has a great feature of repo dependencies (other repos). This could be implemented as well in degit, and then, you could choose in interactive mode which dependencies you want (if they are optional).
(Far fetched) Examples: one could degit a repo with all frontend/backend stuff, and then choose if he wants bootstrap or materialize, or if he wants folder structure A or B, or Vue vs svelte (which would be other parcial repos, who would be degit-ed without specifying sub-folder, making it composable scaffolding).
Problem: competing files of same name. (each dependency will have at least a portion of package.json, which should merge with main repo one)


fix: Remove unnecessary comments

https://github.com/freeCodeCamp/freeCodeCamp/pull/41612
Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the main branch of freeCodeCamp.
[x] All the files I changed are in the same world language, for example: only English changes, or only Chinese changes, etc.

Hi, thanks for creating this PR, but this not a change we will be making at this time.
While we cannot accept this contribution, if you would like to help out, please take a look at our contributing guide for other things you can do.

Agreed @moT01, I say bye-bye comment 🙂


Combine mload_32bytes and mstore_32bytes flags

This PR combines the two flags: mload_32bytes and mstore_32bytes, as well as the two associated CTLs.
This required changing the order of the stack for MSTORE_32BYTES.

Given all the changes introduced recently, it seems impossible (for now at least) to merge the two flags given the current state of things. Indeed, removing one memory channel implied changing the CTL for mstore_32bytes, and makes it different from mload_32bytes (in mstore_32bytes, we set the length in the CTL by computing next_value - current_offset, and we can't do that in mload_32bytes since we just want to check that the loaded value is correct). I am therefore closing this PR.


chore: pass only finalizer and human messages to planner

Description
Changes proposed in this pull request:

only pass AI output messages (AI messages from finalizer) and human messages to the planner
fix some typing issues

Related issue(s)

closing this (for now) in favor of #271


WebsiteParsingError('E-mail field not found')

Bug report
Your Environment

Netflix add-on version: 1.11.0 NF Authetication Key tool v<IP_ADDRESS>
Operating system version/name: LibreELEC (official): 9.2.6 (RPi4.arm)
Device model:  RPi4

Used Operating system:

[ ] Android
[ ] iOS
[ ] Linux
[ ] OSX
[x] Raspberry-Pi
[ ] Windows

Describe the bug

Hi, I've tried with a few different NFAuthentication.key files now.  I am able to login and view netflix fine without warnings on a windows/chrome setup on the same network.  After entering the proper PIN, I am prompted for a password and I enter the password for my Netflix account.  Then I am presented with the error below:
E-mail field not found
I am fairly technical and would be happy to help with debugging if you need more information.  I searched the issues and googled a bit, but found no reference to this error.  Note that I am logging in from Europe.
Expected behavior

Able to authenticate using the Authentication Key and Netflix password
Actual behavior

Authentication Key and Password are entered, but I am presented with an error.
Steps to reproduce the behavior

Create NFAuthentication.key
Start kodi plugin at choose Authentication Key option
Load Authentication Key and enter correct PIN when prompted
Observe prompt for password entry, and enter Netflix account password.
Error is displayed

Possible fix

Debug log

The debug log can be found from this link:
https://pastebin.com/czam32DU
Additional context or screenshots (if appropriate)
Installation

[ ] I'm using other Netflix Repo
[ ] I'm using a different source

Other information

Screenshots

Hi - this is resolved, I found the latest version of NFAuthenticationKey_Windows (v<IP_ADDRESS>), generated a new NFAuthenticationKey and it worked.  I'll close the issue and hope this helps someone else who encounters this error.

Experiencing the same issue but on Windows 11.

Experiencing the same issue but on FireTV 4K android.

Hi, I am experienced the same problem on a Sony Bravia Android TV

You can fix this temporarily by the fix in this issue https://github.com/CastagnaIT/plugin.video.netflix/issues/1674
Connect to your Kodi server using ssh
Go to ~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/access.py
Edit the file (you can use gedit, nano, vi or the editor you have on your server)
Change the line 127 to:
email =<EMAIL_ADDRESS>Save the file and exit the editor
Remove the content of ~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/pycache/
Restart your kodi instance
Try to login again on netflix add-on using NFAuthenticationKey

Hey thank you for the swift response. I am on a Sony android TV. I will try
to figure it out where kodi keeps those files myself. However if you
already know the location then that would be a great help
Thanks so much!
On Mon, Feb 26, 2024, 01:11 leone007 @.***> wrote:

You can fix this temporarily by the fix in this issue #1674
https://github.com/CastagnaIT/plugin.video.netflix/issues/1674
Connect to your Kodi server using ssh
Go to
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/access.py
Edit the file (you can use gedit, nano, vi or the editor you have on your
server)
Change the line 127 to:
email = @.***'
Save the file and exit the editor
Remove the content of
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/pycache/
Restart your kodi instance
Try to login again on netflix add-on using NFAuthenticationKey
—
Reply to this email directly, view it on GitHub
https://github.com/CastagnaIT/plugin.video.netflix/issues/967#issuecomment-1963636425,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC5DWS3SLYMGPQY7YB566CDYVRGTNAVCNFSM4UOPJNWKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOJWGM3DGNRUGI2Q
.
You are receiving this because you commented.Message ID:
@.***>

Hey I figured out where the files are ...
On Mon, Feb 26, 2024, 05:49 Farooq Rehman @.***> wrote:

Hey thank you for the swift response. I am on a Sony android TV. I will
try to figure it out where kodi keeps those files myself. However if you
already know the location then that would be a great help
Thanks so much!
On Mon, Feb 26, 2024, 01:11 leone007 @.***> wrote:

You can fix this temporarily by the fix in this issue #1674
https://github.com/CastagnaIT/plugin.video.netflix/issues/1674
Connect to your Kodi server using ssh
Go to
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/access.py
Edit the file (you can use gedit, nano, vi or the editor you have on your
server)
Change the line 127 to:
email = @.***'
Save the file and exit the editor
Remove the content of
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/pycache/
Restart your kodi instance
Try to login again on netflix add-on using NFAuthenticationKey
—
Reply to this email directly, view it on GitHub
https://github.com/CastagnaIT/plugin.video.netflix/issues/967#issuecomment-1963636425,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC5DWS3SLYMGPQY7YB566CDYVRGTNAVCNFSM4UOPJNWKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOJWGM3DGNRUGI2Q
.
You are receiving this because you commented.Message ID:
@.***>

Hey sorry for email bombardment... I found the folder but there is no
resources inside plugin.video.netflix
Thank you for your help
On Mon, Feb 26, 2024, 06:09 Farooq Rehman @.***> wrote:

Hey I figured out where the files are ...
On Mon, Feb 26, 2024, 05:49 Farooq Rehman @.***> wrote:

Hey thank you for the swift response. I am on a Sony android TV. I will
try to figure it out where kodi keeps those files myself. However if you
already know the location then that would be a great help
Thanks so much!
On Mon, Feb 26, 2024, 01:11 leone007 @.***> wrote:

You can fix this temporarily by the fix in this issue #1674
https://github.com/CastagnaIT/plugin.video.netflix/issues/1674
Connect to your Kodi server using ssh
Go to
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/access.py
Edit the file (you can use gedit, nano, vi or the editor you have on
your server)
Change the line 127 to:
email = @.***'
Save the file and exit the editor
Remove the content of
~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/pycache/
Restart your kodi instance
Try to login again on netflix add-on using NFAuthenticationKey
—
Reply to this email directly, view it on GitHub
https://github.com/CastagnaIT/plugin.video.netflix/issues/967#issuecomment-1963636425,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AC5DWS3SLYMGPQY7YB566CDYVRGTNAVCNFSM4UOPJNWKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOJWGM3DGNRUGI2Q
.
You are receiving this because you commented.Message ID:
@.***>

Hé, rájöttem, hol vannak a fájlok...
…
2024. február 26., hétfő, 05:49 Farooq Rehman @.> írta: Köszönöm a gyors választ. Sony Android TV-n vagyok. Megpróbálom kitalálni, hogy a kodi hol tartja ezeket a fájlokat. Ha azonban már ismeri a helyszínt, az nagy segítség lenne! Köszönjük szépen! 2024. február 26-án, hétfőn, 01:11-kor leone007 @.> írta: > Ideiglenesen kijavíthatja ezt a probléma javításával: #1674 > < #1674 > > > Csatlakozzon Kodi-szerver ssh használatával > Ugrás a következőre: ~/.kodi/addons/plugin.video.netflix/resources/lib/services/nfsession/session/access.py > Szerkessze a fájlt (használhatja a gedit, nano, vi vagy a szerkesztőt > Módosítsa a 127-es sort a következőre: > email = @.' > Mentse el a fájlt, és lépjen ki a szerkesztőből > Távolítsa el a > ~/.kodi/addons/ tartalmát plugin.video.netflix/resources/lib/services/nfsession/session/pycache/ > Indítsa újra a kodi példányt > Próbáljon meg újra bejelentkezni a netflix-bővítménybe az NFAuthenticationKey használatával > > — > Válaszoljon közvetlenül erre az e-mailre, tekintse meg a GitHubon > < #967 (megjegyzés) >, > vagy leiratkozás > < https://github.com/notifications/unsubscribe-auth/AC5DWS3SLYMGPQY7YB566CDYVRGTNAVCNFSM4UOPJNWKU5DIOJSWCZC7NNSXTN2JONZXKZKZKDN5Q5Q2DRUZLOGM >3. > Ezt azért kapod, mert hozzászóltál.Üzenetazonosító: > @.> >

hi can you tell me where you found the files on your android tv?

hi can you tell me where you found the files on your android tv?

Dear all, Thank you for all your help. I was able to get the addon working.
I found the files "main storage"\Android\data\org.xbmc.kodi\files.kodi\addons\plugin.video.netflix\resources\lib\services\nfsessions\sessions\
then i modified access.py
line 127 from 'email = email_match.group(1).strip() if email_match else None' to 'email =<EMAIL_ADDRESS>'
I also made sure that in access.py
line 231 is country_id = react_context['models']['signupContext']['data']['geo']['requestCountry']['id']  instead of country_id = react_context['models']['loginContext']['data']['geo']['requestCountry']['id']
like wise
line 261 is country_id = react_context['models']['signupContext']['data']['geo']['requestCountry']['id']  instead of country_id = react_context['models']['loginContext']['data']['geo']['requestCountry']['id']
then i cleared my cache as leone007 indicated
and was able to login to netflix using the NFAuthenticationKey method
again thank you everyone for your help

chronolz thanks for the help
chronolz @.***> ezt írta (időpont: 2024. febr. 27., K
20:59):

Dear all, Thank you for all your help. I was able to get the addon working.
I found the files "main
storage"\Android\data\org.xbmc.kodi\files.kodi\addons\plugin.video.netflix\resources\lib\services\nfsessions\sessions\
then i modified access.py
line 127 from 'email = email_match.group(1).strip() if email_match else
None' to 'email = @.***" '
I also made sure that in access.py
line 231 is country_id =
react_context['models']['signupContext']['data']['geo']['requestCountry']['id']
instead of country_id =
react_context['models']['loginContext']['data']['geo']['requestCountry']['id']
like wise
line 261 is country_id =
react_context['models']['signupContext']['data']['geo']['requestCountry']['id']
instead of country_id =
react_context['models']['loginContext']['data']['geo']['requestCountry']['id']
then i cleared my cache as leone007 indicated
and was able to login to netflix using the NFAuthenticationKey method
again thank you everyone for your help
—
Reply to this email directly, view it on GitHub
https://github.com/CastagnaIT/plugin.video.netflix/issues/967#issuecomment-1967495133,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEWFBSDT47BDURL5PDAWV5LYVY3KZAVCNFSM4UOPJNWKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOJWG42DSNJRGMZQ
.
You are receiving this because you commented.Message ID:
@.***>


npcomplexMagProj in non-FFT domain

In the paper you mention that by using some sort of Projection you increase capacity of mem traces..
What is the formula/process for non-FFT domain ?
I translate it like :
  x = (x+1e-5)/x

in either case what is the idea ?
PS> in my tests it seems that float32 is unusable. I have to use float64

is this the code :
      c_proj = c_ish[0,:] + 1j * c_ish[1,:]

what is the logic/idea behind it ?
how much better it is ? i.e. item capacity of superposition
thanks

my question is what does the projection npcomplexMagProj  do ?

Convert to complex  domain via fft
normalizes both parts
converts back to real

is that it ?
In a sense renormalizing "rejig" the values and makes them better representation of N(0,1/n) ?

Please see this section of the paper for the explanation. It's so that the complex magnitude is exactly equal to 1, instead of approximately equal because the HRR math assumes that this property is true - but the N(0, 1/n) alone does not guarantee that it is true. The project step has the sole job of enforcing a complex unit magnitude, that is all.

I see, thanks... as close to 1..
I was normalizing anyway for better results i.e.  x/np.linalg.norm(x)
but on a first tests with the FFT-proj seems to boost the dot product even more.. thanks

PS> how do i read "Id . d^-1"

A diagonal covariance matrix of d dimensions, where the diagonal values are 1/d.

I got this from time to time :
  RuntimeWarning: invalid value encountered in true_divide

c_ish=c_ish/np.linalg.norm(c_ish, axis=0)
I think the norm is [nan,nan,.....], how do I solve it ?
here is what i do for the discrete case :
TYPE = np.float64
EPS = np.finfo(TYPE).eps
def normalize(a):
	norm=np.linalg.norm(a)
	if norm == 0: return a/hsdp.EPS
	return a/norm

While I'm very happy you are interested in our code, we don't have the bandwidth to help you debug your own custom code and the larger missing context.
I will throw out that npinfo'a EPS value is going to be far too small for most use cases and not successfully defend against numerical issues in most cases. Especially if you divide by EPS - that is something you never want to do.
If you run into an issue with our code / technique well be happy to try and help.

no worry, I understand.. currently this is what I come up with :
 def proj(x):# Normalize a vector x in complex domain.
	c = np.fft.rfft(x)
	# Look at real and image as if they were real
	c_ish = np.vstack([c.real, c.imag])
	# Normalize magnitude of each complex/real pair
	n = np.linalg.norm(c_ish, axis=0)
	if np.any(n==0): n[n == 0] = hsdp.EPS
	c_ish=c_ish/n
	c_proj = c_ish[0,:] + 1j * c_ish[1,:]
	return np.fft.irfft(c_proj,n=x.shape[-1])

I will play with it and reread the paper to understand the process , so I can find a better solution


Duplicate results on /my-courses Add Course modal

Searching for a course with both its code and number return duplicates. Duplicates aren't visible until you finish typing the course number (i.e., 'phys 121' shows duplicates, but 'phys 12' doesn't).

This also happens when you input just the number, sometimes.


fixing issue where enlarged item image overlaps chat

https://github.com/OpenBazaar/OpenBazaar-Client/issues/1314

This issue already has been fixed in 1159dbd6f465d4abaf493925af23bea53f2626f3 (https://github.com/OpenBazaar/OpenBazaar-Client/pull/1317).


Questions about how to calculate the relative heading angle of object

Hello, @GengzeZhou ,
Thanks again for your work, I have aquestion about the relative heading angle.
I notice you mentioned in the paper, "In this work, we utilize Fast-RCNN to extract the bounding boxes of objects in each egocentric view. After locating the objects, we calculate the relative heading angle for each object and the agent." I'm curious about how you calculate the relative heading angle.
My understanding is as follows: (1) Locate the center coordinates of the object box; (2) Calculate the offset of the center point relative to the image center point; (3) Calculate the angle of the object box relative to the image center point based on the offset; (4) Add the angle of the object box to the angle of the image center point to obtain the relative heading angle.
Could you confirm if my understanding is correct? Looking forward to your response.

That is the correct way to obtain the absolute angles for objects. During navigation, the relative angle is calculated as the disparity between the agent's current heading and the absolute angle of objects.


Add changes.Move:Normalize()

Codecov Report

Merging #142 into master will not change coverage.
The diff coverage is 100%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e5580cc...1692d59. Read the comment docs.


feat: add subtitle toggle like yt

This Pull Request is to enable the toggle feature for subtitles

Toggle feature for subtitles (currently for English).
Resolves #[#297]

Checklist before requesting a review

[x] I have performed a self-review of my code
[x] I assure there is no similar/duplicate pull request regarding same issue

Hi @hkirat, would you mind reviewing it? Suggestions are welcome

/bounty $10


Add http password site

Should be visible at: http://http.badssl.com/password/
Screenshot: http://i.imgur.com/PGUrh1W.png
As per this upcoming Firefox change: https://twitter.com/rlbarnes/status/656554266744586240
P.S.: The public site has been very very slow lately
P.P.S.: Styling placeholder text is the literal worst

Will http://http.badssl.com/mixed/password-form/ do? (Made it an hour ago, but haven't pushed it.)

They are doing different things.
mixed/password -> https site that submits to an http form
http/password -> http site with a password field
They trigger different conditions: the first triggers a warning popup in Firefox and the latter will trigger an insecure icon starting in FF44.  As such, they should probably both exist.
Also feel free to steal my totally prettier CSS.  :)

They are doing different things.
mixed/password -> https site that submits to an http form
http/password -> http site with a password field
They trigger different conditions: the first triggers a warning popup in Firefox and the latter will trigger an insecure icon starting in FF44.  As such, they should probably both exist.
Also feel free to steal my totally prettier CSS.  :)

P.S.: The public site has been very very slow lately

I'm not seeing much latency. Any particular pages/times?

Err, never mind the slowness issue.  I had been connecting via the Mozilla VPN, and I just read the email saying that the VPN was having troubles.  >_<

FYI, the main page currently has a link for it, but I get a 404 error.

FYI, the main page currently has a link for it, but I get a 404 error.

Yeah, I don't know what's going wrong. Taking a look at it again. :-(

I had a bad local merge for pushing. Sorry for the multiple-day delay. :-(
Also, I hope you don't mind that I aligned the styling with mixed/password.

But my style was amazing!  All that time styling the shadow DOM.  :(

But my style was amazing! All that time styling the shadow DOM. :(

It was amazing! But I was very bothered by the centered cursor. :-(
Also, styling shadow DOM is a recipe for un-fun. :-(

The cursor was meant to be there so that you knew that if you typed that
you would get those sweet giant password asterisks.  :)
On October 22, 2015 8:36:05 PM Lucas Garron<EMAIL_ADDRESS>wrote:

But my style was amazing! All that time styling the shadow DOM. :(

It was amazing! But I was very bothered by the centered cursor. :-(
Also, styling shadow DOM is a recipe for un-fun. :-(

Reply to this email directly or view it on GitHub:
https://github.com/lgarron/badssl.com/pull/81#issuecomment-150403342

The cursor was meant to be there so that you knew that if you typed that
you would get those sweet giant password asterisks.  :)

Yeah, I liked that idea!
It made me realize that showing the dots would actually be the clearest way to do this.
(The rest is a benevolent stroke of leade^W^W^W^W^Whistory. u forgivz me?)

I really want to tackle #46 and #59 some time soon, though. Then maybe my consistent styling arguments will hold water. :-P

How would you feel about moving this to http-password.badssl.com?
Apart from the mixed/* pages, everything else linked from the front page is its own domain.
(I think there's value in making the mixed/* pages available on every domain to test the compounded effect of mixed content, but I'm also wondering if each of those should have a separate, canonical mixed-*.badssl.com domain for testing in isolation.)

Sure, that's fine.  :)

Alright, I promise I'm done tinkering for the day.

Ooo, that looks pretty nice.  But I'll still daydream about frolicking through fields of daisies and typing in giant •••••••••s.  :)

BTW, I see the new site, but the front page still links to my awesome version.  :)


Positive look-ahead fails. Example: (?=[0-9])\S

I've discovered that randex.js fails to respect a positive look-ahead regular expression. Here's a simple failing regex:
(?=[0-9])\S
It should only generate a single digit but it fails to do so. It works just as if I had simple \S.

Dupe of #18


Allow user customization of type stubs (for example to help with completions when using IronPython).

VS Version: 28526.9.d16.0stg
Python Tool Version: 16.0.19026.2
Repro step:
1.Create an IronPython WPF Application
2.Drag & drop a button to the Design view
3.Check the  IntelliSense in the .py file
a. From System.Windows import MessageBox
b. In the Button_Click handler, add a call to MessageBox.Show()
c. Signature info tooltip shows all overloads
expect result:
a. code coloring with Messagebox
b. when type MessageBox. , Show() should appear automatically
c. signature info tooltip shows with MessageBox
actual result:
a. no code coloring with Messagebox
b. no completions when type MessageBox.
c. no signature info tooltip shows with MessageBox

Some standard library modules have completions (json) but others don't (sys).

It works on modules implemented in Python (e.g. json, os), but fails with anything that's built-in/.NET (e.g. sys, nt).

any news on this?

any news?

Also reported at:
https://developercommunity.visualstudio.com/content/problem/814002/unresolved-import-wpf.html
https://developercommunity.visualstudio.com/content/problem/819042/ironpython-unresolved-import.html

Also reported at https://developercommunity.visualstudio.com/content/problem/821615/trying-to-use-python-in-visual-studio-2019.html

We are not going to do any additional work specifically for IronPython; usage is too low and there are alternatives that work with Python 3.
We are planning on having much better support for type stubs in the future (sometime in first half of 2020). So I am going to rename this issue and change it to be about that.

Can you confirm that this is the same issue reported at https://github.com/IronLanguages/ironpython2/issues/615? There are pointers from that one to this one, but I cannot decipher this issue to figure out what the heck it is about. I thought https://github.com/IronLanguages/ironpython2/issues/615 was pretty clear; this one not so much.

@dbmercer yes that is the same issue as the one you linked.

Hey there @dbmercer, @zhouwangyang and @AtomicZ. I would love to learn more about your use-cases with IronPython in Visual Studio. Do you mind emailing ptvs help @ microsoft.com so we can continue a more detailed conversation there? Thank you!

Has someone solved it???

@mmfontana Not as far as I know.

Is fixing the "unresolved import" issues with IronPython still being worked on? And any guess what release to target? I would like to use VS 2019 but have to stay on 2017 till this gets resolved.

The "much better support for type stub" is being actively worked on, and will go in as part of the new language server & integration work.
https://github.com/microsoft/PTVS/issues/5210#issuecomment-618714754
That is still many months away.

@GLantaff does it perfectly work in VS 2017?

@GLantaff does it perfectly work in VS 2017?

No not perfect but mostly OK. In 2019 every line that has an import statement is flagged as an error.
2017:

2019:

In 2019 you end up with so many warnings it's hard to find the real issues.
My request was never to fix intellisense (which would be great) but to fix all the false warnings about "unresolved import xxx"

There's an option to turn off unresolved import warnings:

That does help. Thanks. Still miss the color highlighting to show it found the class but this is a good work around for now.

Is there any updates?
I'm working on Ironpython project in visual studio 2019, expecting to call function in COM type library .dll
But, even import clr doesn't work.
Will visual studio still support python or ironpython any longer ?

@gramster
We are not going to do any additional work specifically for IronPython; usage is too low and there are alternatives that work with Python 3.

Would you explain what alternative that currently work with python 3?
And how could we do it?
I need to call function in COM typed library .dll
In version 2015 everything looks fine, even the intellisens we just need to add the interop library on reference browse tab.
But now, even in VS2017, the browse button isn't shown in add reference dialog.

You can import clr like this :

Run cmd as administrator
Go to ipy.exe directory (c:\program files\IronPython 2.7 for example)
run "ipy -X:Frames -m ensurepip "
run "ipy -X:Frames -m pip install clr"

Change name clr for other library

You can import clr like this :

Run cmd as administrator
Go to ipy.exe directory (c:\program files\IronPython 2.7 for example)
run "ipy -X:Frames -m ensurepip "
run "ipy -X:Frames -m pip install clr"

Change name clr for other library
======================================================

Dilip: This above solution worked for me. The import clr in Visual Studio using Iron Python now works. Many Thanks

?still no solution,,,

@greazer What is the resolution? Won't fix? Use VS 2022? Use VS Code? IronPython support dropped?

That is correct, IronPython is no longer supported in Visual Studio 2022. However, VS 2022 does use PyLance for the language service. You can configure the type stub paths in Tools->Options

To be precise - you can still use IronPython as a Python interpreter, but its gone from the installer, there is no special support in the language server, and YMMV as Pylance is based on Python 3. Usage of IronPython is very low and it is very behind in modern Python features so we don't plan on any special support and recommend it not be used. There are other ways of doing interop with .Net assemblies, if that is what you want to do (e.g. https://github.com/pythonnet/pythonnet).


Color game

Updated the readme file for setup.
All the player now has to do is to click the Run Button!!
It's for Issue no: #316 . In continuation with #317 .
It is for Hacktoberfest 2021, so please add the tags accordingly.
Thanks.

@Astrodevil I have edited the readme with steps to be followed for starting the JavaFX application in IntelliJ.
Please review it.
Thanks.

Yeah, @Astrodevil pretty much.... as long as he/she got the correct libraries!
Can you please add the hacktoberfest-accpeted tags for #322 and #317 ... or let me know additional changes if they don't suffice the criteria.
Thanks.


How to add @channel to text and cause it to notify the whole group?

Duplicates #16

Try "<!channel>" where you would normally "@channel"


tf.nn.l2_normalize takes dim instead of axis

At master, tf.nn.l2_normalize still takes the axis parameter as dim.  Everything else has been standardized on axis, so it'd be nice if this one was axis too.  Since dim can't be changed for backwards compatibility reasons, presumably the right approach is adding an extra axis argument and requiring that at most one of them is set.
@aselle: Is that right?

That would be correct. Contributions welcome :)

@girving PR #12716 changes dim to axis for tf.nn.softmax and tf.nn.log_softmax  (with backward-compatibility). The PR is pending review. I can update the PR to include changes of tf.nn.l2_normalize from dim to axis as well.

@girving PR #12716 has been updated to change dim to axis for tf.nn.l2_normalize as well. Please take a look.

@yongtang Thanks, looks perfect.


Support password setting / 支持设置密码

Describe This Problem
No password will add a lot of complexity to the configuration of firewalls and permissions.
It is recommended to support passwords
无密码对部署来说会添加很多防火墙和权限的配置复杂度，建议可以支持密码
Proposal
https://docs.victoriametrics.com/vmauth.html
Password authentication can be embedded, or consider using vauth as an authentication gateway
密码鉴权可以做成嵌入式的，也可以考虑参考vauth做一个鉴权的网关
Additional Context
Access passwords are a basic function of the database
访问密码对数据库是一个基础功能

Hi, we can add a simple user system based on config files, such as this syntax:
[server.auth]
enable = true
# available values: file/ceresmeta
source = "file"

[server.auth.file]
username = "admin"
token = "secret-token"

Does this method solve your problem?

PS: In a fully cluster deployment, we may store user info in ceresmeta.

Duplicate with #929


Why doesn't this contract work?

Summary
I missed a few months of plutus updates and now I'm trying to bring a contract up to date. As far as I can tell, this is a reduced version of the vesting contract, and I can't see what's wrong.
Validator:
https://gitlab.homotopic.tech/plutus/validators/gift/-/blob/master/src/Plutus/Validators/Gift.hs
Contract:
https://gitlab.homotopic.tech/plutus/contracts/gift/-/blob/e85ae2495f45f96082756bb87ec393dd37b5731e/src/Plutus/Contracts/Gift.hs
Model:
https://gitlab.homotopic.tech/plutus/contracts/gift/-/blob/e85ae2495f45f96082756bb87ec393dd37b5731e/test/Plutus/ContractModel/Gift.hs
Result:
https://gitlab.homotopic.tech/plutus/contracts/gift/-/jobs/198281
Steps to reproduce the behavior
git clone https://gitlab.homotopic.tech/plutus/contracts/gift
nix build
Actual Result
doesn't work
Expected Result
should work
Describe the approach you would take to fix this
i don't know
System info
nixos

i feel like this and this issue are quite severe usability regressions compared with plutus-apps only a few months ago.
https://github.com/input-output-hk/plutus-apps/issues/942

From the errors, it seems like the last action isn't consider, we had a few problems with time interval and it might be related to the corresponding fix, but I wasn't able to spot where the problem is.


HowLongToBeat Intgration

Is there any possibility of adding it to the plugin?

hm, HowLongToBeat does not have a public API as far as I know so any existing or new solutions would have to be web scraped -- that's a little brittle for my taste and available maintenance time.
@d7eeem is there a specific feature that exists on HowLongToBeat that you want to see added here? or is it just that you already have a backlog on there that you would like to import or synchronize with? perhaps there's another way we can implement what you're looking for

I just wanted to get the time of each game in the database. and i am learning JS at the moment and it's early days for me to bite into it.
and i found this project which is a  "simple wrapper API".
https://github.com/ckatzorke/howlongtobeat

and i found this project which is a "simple wrapper API".
https://github.com/ckatzorke/howlongtobeat

it looks like this is still just scraping the HTML. This is not something I'm looking to maintain or add a dependency for at the moment.
BUT if you're learning JS and are looking for a project you are interested in to learn more, I think you could reasonably fork this repo and swap the provider from RAWG to HLTB. The code is written in typescript so if you haven't seen that before it might look a little strange but in the end it'll probably help 😅
aside: I hear the HLTB uses Steam data occasionally for playtime info...maybe someday in the near future we could add an optional Steam integration here, though that's obviously a bit platform restrictive


api server exception management and code optimization (#397)

Tips

Thanks very much for contributing to Apache DolphinScheduler.
Please review https://dolphinscheduler.apache.org/en-us/community/index.html before opening a pull request.

What is the purpose of the pull request
Currently, there are many try-catch code in api-server's controller. This pr clean the code, use an annotation to point out which Status should be return if there is any exception.
i.e.
Before
public Result generateToken(@RequestAttribute(value = Constants.SESSION_USER) User loginUser,
                              @RequestParam(value = "userId") int userId,
                              @RequestParam(value = "expireTime") String expireTime){
    logger.info("login user {}, generate token , userId : {} , token expire time : {}",loginUser,userId,expireTime);
    try {
        Map<String, Object> result = accessTokenService.generateToken(userId, expireTime);
        return returnDataList(result);
    }catch (Exception e){
        logger.error(GENERATE_TOKEN_ERROR.getMsg(),e);
        return error(GENERATE_TOKEN_ERROR.getCode(), GENERATE_TOKEN_ERROR.getMsg());
    }
}

After
@ControllerException(GENERATE_TOKEN_ERROR)
public Result generateToken(@RequestAttribute(value = Constants.SESSION_USER) User loginUser,
                            @RequestParam(value = "userId") int userId,
                            @RequestParam(value = "expireTime") String expireTime) {
    logger.info("login user {}, generate token , userId : {} , token expire time : {}", loginUser, userId, expireTime);

    Map<String, Object> result = accessTokenService.generateToken(userId, expireTime);
    return returnDataList(result);
}

Brief change log

Add ControllerException annotation in org.apache.dolphinscheduler.api.exceptions.
Add ApiExceptionHandler controller advice to deal with exceptions.
Replace all controller functions which has try-catch style with @ControllerException annotation.

Verify this pull request
I've debugged the code locally, and it works well. But it's difficult to write tests for this code, because I should find how to throw an exception. It will be easy if I can write some test controllers to test this PR. Pls tell me if I can do that, or is there any other way for testing.
Thanks in advance!
Oops, it takes me quite a lot of time to fix the code style check issue :)

I'll create a new pr based on the latest commitment.


Bump kafka-python and kazoo

What does this PR do?
Per kafka_consumer check requirements
Motivation
Requirements bumped in #2728 and #2729
Review checklist

[ ] PR has a meaningful title or PR has the no-changelog label attached
[ ] Feature or bugfix has tests
[ ] Git history is clean
[ ] If PR impacts documentation, docs team has been notified or an issue has been opened on the documentation repo
[ ] If PR adds a configuration option, it has been added to the configuration file.

Codecov Report

Merging #2766 into master will decrease coverage by 9.23%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #2766      +/-   ##
==========================================
- Coverage   84.71%   75.48%   -9.24%
==========================================
  Files         657       45     -612
  Lines       37482     3263   -34219
  Branches     4506      386    -4120
==========================================
- Hits        31753     2463   -29290
+ Misses       4407      705    -3702
+ Partials     1322       95    -1227


This is not issue, but a request

I like the plugin very much. In YouVersion, there are many "Plans", are you able to refer the plan as well? Is it possible to do it? Maybe just a link to the plan (not the plan details). Thanks!

I'm glad you like this plugin. Thank you for your suggestion, but the purpose of this plugin is to make using the Bible easier and quicker. I chose YouVersion Bilbe because it had many translations and I just use it. There are no official APIs for YouVerison, so this would be difficult to do and is beyond the purpose of this plugin. In short: it will not be implemented.

Will resolve under #28


Question: Compression at producer

Description
We have certain messages that are above the default 1MB message size, so we want to compress the message before it goes to the server. However, I am unable to push the message to the bus due to the size. Is there something else that needs to be done during configuration of the producer other than setting the compression type and compression level?
Message in question was 1.88MB and I was using gzip at compression level 6.
Apache Kafka: 5.1.0
Confluent.Kafka: 1.2
Configuration: Default other than compression type/level
OS: Windows 10
How to reproduce
Try and send a large message with compression enabled at producer and message will be rejected.
Checklist
Please provide the following information:

[ ] A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
[ ] Confluent.Kafka nuget version.
[ ] Apache Kafka version.
[ ] Client configuration.
[ ] Operating system.
[ ] Provide logs (with "debug" : "..." as necessary in configuration).
[ ] Provide broker log excerpts.
[ ] Critical issue.

it sounds like the compressed size of the message is still > 1Mb. my understanding without digging deeper is the limit is applied to the total size of a message batch (and librdkafka will limit batch size according to conform to message.max.bytes) which is post compression. Increasing the max message size up to say 5Mb shouldn't be an issue I don't think. But IIRC, there's a big performance cliff around 25-30Mb.

@mhowlett Let me play around with the message size some more then. I was browsing the librdkafka code and saw that the compression comes from the topic config. I recall from the previous version we used (11.6) that we had we specified "default.topic.config" in front of topic configuration properties, but I don't know if that is still supported with the strongly typed config object. I'm also making an assumption (it may be a bad one) that my message is getting below that threshold.

default.topic.config is depreciated, all corresponding config parameters are now specified at the top level. we may introduce optional per-topic config at a future time, but currently not exposed.

Ok, good then. Thanks for the quick reply. I'll come back to this sometime over the weekend, but more than likely Monday. I'll either come back and elaborate or close the question.

@mhowlett Do you know if the message size is checked pre-compression? I did a simple test with a byte array of 1MB with compression enabled since I would hopefully get at least one byte worth of compression. I was unable to push the message to the bus. However, once I increased the message.max.bytes on the client, I was able to push, and the bus did not reject it even though it is at the default message size of 1MB. If you are not sure, I can look around the code myself too.

The message.max.bytes controls two things: the maximum allowed per-message size in produce(), and the maximum message batch size sent to the broker (but in this case it might be over-shot with at most one message).
There was a recent fix related to this:
https://github.com/edenhill/librdkafka/pull/2513/commits/b1b4d14a6fc01ac2345427af928a77aa96d180bd

Thanks for adding some clarification. I think I have enough to move forward. I appreciate your time @mhowlett @edenhill


renovatebot(deps): update dependency net.bytebuddy:byte-buddy to v1.9.14

This PR contains the following updates:

Package
Update
Change

net.bytebuddy:byte-buddy
patch
1.9.13 -> 1.9.14

Renovate configuration
:date: Schedule: At any time (no schedule defined).
:vertical_traffic_light: Automerge: Disabled by config. Please merge this manually once you are satisfied.
:recycle: Rebasing: Whenever PR is stale, or if you modify the PR title to begin with "rebase!".
:no_bell: Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

Available now for Enterprise: Renovate Pro with real-time webhook handling and priority job queue.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.null seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


[5.2] Backport fix

Backport of security fixes https://github.com/laravel/framework/pull/20392 & https://github.com/laravel/framework/pull/20400
Yes - I know 5.2 is technically EOL. But it is a simple backport security fix, so will make the world slightly safer.

Looks like HHVM is failing - but it's to do with the mocks?
Everything else is green.


Installation Guide

Hi, I just found this really lit code editor on Youtube and wanted to try it out, but... I have no clue how to properly install it. I tried the .tar.gz file and built it from source without luck. I am not a pro so help is very much appreciated. Thanks in advance!
Edit: I'm on Ubuntu

There's a pre-built executable in the Release tab of the repository. If you wish to install it from source, you'll also need Godot and hit the "Import" button when starting Godot, then selecting this folder.


Implement ERC721 (NFT) Minting Benchmark

Implement ERC721 (NFT) Minting Benchmark
Description
In order to expand the capabilities of Madara and provide more comprehensive benchmarking data for our users, we need to create a benchmark for ERC721 (Non-Fungible Tokens) minting. Currently, our benchmarking suite only covers ERC20 transfers, but it would be beneficial to start benchmarking other features, such as NFT minting.
Tasks

Write an ERC721 Benchmark in TypeScript

Follow the structure of the existing ERC20 benchmark as a reference.
Ensure that the benchmark effectively measures the performance of NFT minting.

Update CI to Include the New Benchmark

Integrate the new benchmark into our Continuous Integration (CI) pipeline.
If possible, consolidate existing graphs for Transactions Per Second (TPS) with this new feature.

Refactor Existing Benchmark Code

Consider refactoring the existing benchmark code to make it easier to add and benchmark new features in the future.

Components Needed

An ERC721 contract written in Cairo 0. For the time being, we will use Cairo 0 as we have yet to support Cairo 1.0.
TypeScript files to orchestrate sending transactions to the sequencer.
GitHub Actions workflows to integrate this new benchmark into our CI.

Guidelines

Please follow the coding standards and practices already established in the project.
Make sure to test your code thoroughly and ensure that it does not introduce any new issues.
If you encounter any problems or need clarification on anything, don't hesitate to ask for help or clarification.
When submitting your Pull Request (PR), please provide a detailed description of the changes you have made, why you made them, and any additional context that might be useful for reviewing your contribution.

Additional Information
If you're new to Madara or open-source contributions in general, check out our Contributor Starter Pack. It has everything you need to get started with your first contribution!
Thank you for your interest in contributing to Madara. We're excited to see what you'll bring to the project!

@abdelhamidbakhta I guess you can assign this to me, I can try to get this done this week :)

@abdelhamidbakhta I guess you can assign this to me, I can try to get this done this week :)

Wonderful mate!

Updates:
We firstly need a reliable way to benchmark the node, currently, the ERC-20 benchmarks are also failing, because of various nonce race conditions.
The task has been subdivided into two tasks:

Deploy ERC721 to genesis
Benchmark

There is an issue to make ERC721 part of genesis #567, pr #568 solves this.
Hence, when #568 is merged, and we have a reliable way to benchmark, this task can be picked back up and we can do benchmarking.
LGTM 🚀

Updates:
We firstly need a reliable way to benchmark the node, currently, the ERC-20 benchmarks are also failing, because of various nonce race conditions.
The task has been subdivided into two tasks:

Deploy ERC721 to genesis
Benchmark

There is an issue to make ERC721 part of genesis #567, pr #568 solves this.
Hence, when #568 is merged, and we have a reliable way to benchmark, this task can be picked back up and we can do benchmarking.


Add command line switch to enable proposed api for some extensions

We want to have a command line switch to enable proposed api for some, spelled out, extensions. Like code --enable-proposed-api my.extension

@sandy081 I would be great if you can give this a try with the mongo db explorer. Step should be

install extension via visx
start code like so: code --enable-proposed-api my.extension

fyi @chrisdias

Will try and let you know

@sandy081 can you please verify this?

Since there are signing issues with Mac builds.. will verify this on unsigned builds.

Also verified in Windows signed build


Chat 2.0, Map Objectives, API:init(), misc

To-do:
fetchPosts -> fetchPost
Shift quote logic from server to front-end (react-markdown potentially)
Move chat post js into ChatPost component


[it] Align the concepts/overview/components page to it's English version

Align the Italian translation of concepts/overview/components to the English version

Thanks @sftim ! I've implemented your suggestions :)

Thanks @fabriziopandini I've integrated the suggestions :)

@Fale more feedbacks coming in, please help review and respond.


Fix extension documents.

Fixes extension documents since the examples for each extension decorator don't work as-is.

Since this is only a document fix, I'd merge this now.

👍


Cannot open the file

Hi He, may I ask how to handle the following error when running the program
Warning: Please note that the SPAdes is not recommended for large sequencing dataset > 5 gb. You can use a subset instead.
Read1: fastp/FDES230025508-1r_L1_1.fq ; Read2:fastp/FDES230025508-1r_L1_2.fq python: invalid option -- '-'
usage: python [-d] [-i] [-k] [-v] [-c cmd | file | -] [arg] ...
Options and arguments (and corresponding environment variables):
-d     : debug output from parser (also PYTHONDEBUG=x)
-i     : inspect interactively after running script (also PYTHONINSPECT=x)
-k     : kill printing expression statement (also PYTHONKILLPRINT=x)
-v     : verbose (trace import statements) (also PYTHONVERBOSE=x)
-c cmd : program passed in as string (terminates option list)
file   : program read from script file

 : program read from stdin (default; interactive mode if a tty)

arg ...: arguments passed to program in sys.argv[1:]
Other environment variables:
PYTHONSTARTUP: file executed on interactive startup (no default)
PYTHONPATH   : colon-separated list of directories prefixed to the
default module search path.  The result is sys.path.
Cannot open the file: 没有那个文件或目录

Hi,
It seems that there is something wrong with the input files or SPAdes software, please make sure that all the input files are available. And the SPAdes software must be successfully installed in the PATH (Please see the Requirement section of the README.md).


chore: remove unused script

This script is not being used anywhere in the code. This caused confusion for the team recently because we were not sure if we should update this script or update the deploy-sdk github actions workflow (which is where the deployment script actually lives).
This change deletes this file to remove confusion.
commit-id:cc28fa24

deleting this would mean pushing all modules ourselves via command rather than just running this 1 script.

At this time, this script is only causing confusion because of it not being used and it's out-dated. A script like this could create convenience over pushing each pod 1 by 1, yes, but I don't think keeping this script in the codebase for that reason is worth it.


[Submission]: Spinoza - a quantum state simulator implemented in Rust

Github repo
https://github.com/smu160/spinoza
Description
Spinoza is a quantum state simulator (implemented in Rust) that is one of the fastest open-source simulators. Spinoza is implemented using a functional approach. Additionally, Spinoza has a QuantumCircuit object-oriented interface, which partially matches Qiskit's interface. Spinoza is capable of running in a myriad of computing environments (e.g., small workstations), and on various architectures. At this juncture, Spinoza only utilizes a single thread; however, it is designed to be easily extended into a parallel version, as well as a distributed version. The paper associated with Spinoza is available here.
Email
<EMAIL_ADDRESS>Alternatives
https://github.com/qulacs/qulacs
License
Apache License 2.0
Affiliations
No response
Tags
simulation

hello @smu160 ! Here some follow up actions, in case you are interested

Join other Qiskit ecosystem developers in the Slack channel #qiskit-ecosystem (if you are not in the Qiskit workspace yet, you can sign up here: https://qisk.it/join-slack)
We just started with a discussion about how are we going to organize the ecosystem space. It is very draft-y at the moment, but you can subscribe for notification here https://github.com/Qiskit/RFCs/pull/42 to participate in that discussion.
If you would like to show qulacs to the Qiskit community, let me know via slack or email and get a slot in the Qiskit Demoday agenda.

Welcome to the Qiskit Ecosystem!


Network Error

I can access to web interface from the plugin button but I can't see torrents or add new ones from contextual menu.
In the addon I can see the message "Error TypeError: NetworkError when attemting to fetch resource" I don't have this issues with another addons in Chrome so I don't think the problem is my network or my transmission setup.
Thanks in advance for your work !
Have a nice day.

sorry, my mistake.


redirect to /undefined/#feat=...

When following links from Google, for example http://caniuse.com/canvas, IE11 gets redirected to http://caniuse.com/undefined/#feat=canvas which can't be opened (404).
(Redirect is working correct on Microsoft Edge.)

Couldn't reproduce this with IE11, but I could see how it would fail in older IEs so I fixed it for them.

Maybe it was the combination of IE11 and Windows 10. After clearing the cache the redirection works now without any Problems.


[swift-4.0 branch] [runtime] Fix assignment of Any with mismatched ty…

…pes.
The COW existential implementation sets the existential box's
new value but fails to set the box's new type. Hijinks ensue
when the new value is later used as if it were of the old type.
rdar://31955457
(cherry picked from commit 2ad2f26024e159dd14f80440fc55ca06eda25510)
• Explanation: The value witness for existential boxes in assignWith(Take/Copy) missed a copy of the  metadata field.
• Scope of Issue:  This causes issues when we assign an existential of one type to an existential of another type because we loose.
var dict: [String: Any] = ["foo": 0x11111111 as NSNumber]
print(dict)  // succeeds
dict["foo"] = 0x22222222
print(dict)  // crashes

• Origination: This was introduced with COW existential (the original implementation had the copy).
• Risk: Low. By adding the type copy we can only make the code more correct.
• Reviewed By: Arnold (Authored by Greg)

@swift-ci Please test

Build failed
Jenkins build - Swift Test Linux Platform
Git Commit - 5658b25bef3dbdf2ea573dd45105d21741f086d6
Test requested by - @aschwaighofer

The linux failure in swift-corelibs-foundation looks very much unrelated:
08:00:49 ../buildbot_linux/foundation-linux-x86_64/Foundation/CoreFoundation/Base.subproj/CFRuntime.c.o: In function `__CFInitialize':
08:00:49 CoreFoundation/Base.subproj/CFRuntime.c:(.text+0xb72): undefined reference to `_T010Foundation21__CFSwiftGetBaseClassyXlXpyF'
08:00:49
clang-4.0: error: linker command failed with exit code 1 (use -v to see invocation)]

@swift-ci Please smoke test linux

The linux breakage in corelibs-foundation looks related to
https://github.com/apple/swift-corelibs-foundation/commit/fdbed5d16302b11b6b44590d8ff1204ac9651537
Does a clean build solve this ...?

@swift-ci Please clean smoke test

@slavapestov Do you need to cherry-pick the (https://github.com/apple/swift/pull/9224) change to swift-4.0-branch? Linux pre-commit testing on swift-4.0 branch is broken?

@slavapestov Wrong link, I meant: https://github.com/apple/swift-corelibs-foundation/commit/fdbed5d16302b11b6b44590d8ff1204ac9651537

@slavapestov I'm hitting the same issue in https://github.com/apple/swift/pull/9217.

@swift-ci Please smoke test linux

And again ...

@swift-ci Please smoke test linux and merge

@swift-ci Please smoke test

@swift-ci Please smoke test linux

@swift-ci Please clean smoke test linux

@swift-ci Please smoke test linux

@swift-ci Please smoke test mac os x

@swift-ci Please smoke test os x

@swift-ci clean test


Dataset meta file for some formats (Cityscapes, ImageNet Txt, Pascal VOC and WiderFace)

Summary

This is the first PR. It contains changes in the Cityscapes, ImageNet Txt, Pascal VOC and WiderFace formats.

Added save_meta_file, is_meta_file, has_meta_file and parse_meta_file functions
Added a parameter in the converter to save the dataset meta file

How to test

Checklist

[x] I submit my changes into the develop branch
[x] I have added description of my changes into CHANGELOG
[ ] I have updated the documentation accordingly
[x] I have added tests to cover my changes
[ ] I have linked related issues

License

[x] I submit my code changes under the same MIT License that covers the project.
Feel free to contact the maintainers if that's a concern.
[x] I have updated the license header for each file (see an example below)

# Copyright (C) 2021 Intel Corporation
#
# SPDX-License-Identifier: MIT

Ok, please fix the remaining topics and it can be merged.


Different Patterns in C++ Issue #3940

Description 📜
Different pattern questions in cpp added in CP folder of C/Cpp
Fixes #3940

Type of change 📝

[x] Documentation (Content Creation in the form of codes or tutorials)

Domain of Contribution 📊

[x] C/CPP

Checklist ✅

[x] I follow Contributing Guidelines & Code of conduct of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I'm GWOC'21 contributor

@vasu-1  Review the Patterns thing...
Link toh dala hai folder ka


⚠ Bofrost.at has degraded performance

In 741c82f, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1162 ms

Resolved: Bofrost.at performance has improved in a68a7ad.


Add 7.1 version for OVH

We have just released the PHP 7.1 RC version on ovh hosting offers

Thanks for fixing it!


Add log support to table packing

Logging will be important for things like table splitting and promotion, so this makes the log crate a non-dev dependency in write-fonts.

nm, I'll bundle this with another commit in #385


Dockerization

Added Dockerfile and script for importing and launching map-matcher within a container. Updated readme with docker info. Moved config.yml to map-data.

Hello, I was testing this pull request and encountered following errors.
After building successfully when I tried to run it, it says minimum memory is 8.5G. So I edited docker file and made it to 512 MB (For testing purpose). After building again it doesn't pop any error and build successfully. Now when I try to run following command as per document I has following errors. I am sharing my command. I think I am missing something, please guide me if possible :)
docker run --name mapmatcher -v /home/graphhoppermapmatch/map-matching/mdata:/map-matching/map-data -v /home/graphhoppermapmatch/map-matching/cdata:/map-matching/graph-cache -p 8989:8989 -e IMPORT=berlin-latest.osm.pbf -e VEHICLES="car,foot,bike" mapmatcher:master
Nothing to import, skipping... Starting map-matcher web UI... java.lang.IllegalArgumentException: Unable to override server.application_connectors[0].bind_host; node with index not found.         at io.dropwizard.configuration.BaseConfigurationFactory.addOverride(BaseConfigurationFactory.java:189)         at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:122)         at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:89)         at io.dropwizard.cli.ConfiguredCommand.parseConfiguration(ConfiguredCommand.java:126)         at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:74)         at io.dropwizard.cli.Cli.run(Cli.java:78)         at io.dropwizard.Application.run(Application.java:93)         at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)
If I use this with run command IMPORT=berlin-latest.osm.pbf then I got one more error:
Importing file: berlin-latest.osm.pbf... rm: cannot remove '/map-matcher/graph-cache/': Device or resource busy java.lang.IllegalStateException: Your specified OSM file does not exist:/map-matcher/map-data/berlin-latest.osm.pbf         at com.graphhopper.reader.osm.OSMReader.readGraph(OSMReader.java:139)         at com.graphhopper.GraphHopper.importData(GraphHopper.java:668)         at com.graphhopper.GraphHopper.process(GraphHopper.java:639)         at com.graphhopper.GraphHopper.importOrLoad(GraphHopper.java:617)         at com.graphhopper.matching.cli.ImportCommand.run(ImportCommand.java:37)         at io.dropwizard.cli.Cli.run(Cli.java:78)         at io.dropwizard.Application.run(Application.java:93)         at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)

Hello, I was testing this pull request and encountered following errors.
After building successfully when I tried to run it, it says minimum memory is 8.5G. So I edited docker file and made it to 512 MB (For testing purpose). After building again it doesn't pop any error and build successfully. Now when I try to run following command as per document I has following errors. I am sharing my command. I think I am missing something, please guide me if possible :)
docker run --name mapmatcher -v /home/graphhoppermapmatch/map-matching/mdata:/map-matching/map-data -v /home/graphhoppermapmatch/map-matching/cdata:/map-matching/graph-cache -p 8989:8989 -e IMPORT=berlin-latest.osm.pbf -e VEHICLES="car,foot,bike" mapmatcher:master
Nothing to import, skipping... Starting map-matcher web UI... java.lang.IllegalArgumentException: Unable to override server.application_connectors[0].bind_host; node with index not found. at io.dropwizard.configuration.BaseConfigurationFactory.addOverride(BaseConfigurationFactory.java:189) at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:122) at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:89) at io.dropwizard.cli.ConfiguredCommand.parseConfiguration(ConfiguredCommand.java:126) at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:74) at io.dropwizard.cli.Cli.run(Cli.java:78) at io.dropwizard.Application.run(Application.java:93) at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)
If I use this with run command IMPORT=berlin-latest.osm.pbf then I got one more error:
Importing file: berlin-latest.osm.pbf... rm: cannot remove '/map-matcher/graph-cache/': Device or resource busy java.lang.IllegalStateException: Your specified OSM file does not exist:/map-matcher/map-data/berlin-latest.osm.pbf at com.graphhopper.reader.osm.OSMReader.readGraph(OSMReader.java:139) at com.graphhopper.GraphHopper.importData(GraphHopper.java:668) at com.graphhopper.GraphHopper.process(GraphHopper.java:639) at com.graphhopper.GraphHopper.importOrLoad(GraphHopper.java:617) at com.graphhopper.matching.cli.ImportCommand.run(ImportCommand.java:37) at io.dropwizard.cli.Cli.run(Cli.java:78) at io.dropwizard.Application.run(Application.java:93) at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)

Hello,

After building successfully when I tried to run it, it says minimum memory is 8.5G. So I edited docker file and made it to 512 MB (For testing purpose)

If you pass "--build-arg javaopts to docker build you can change the minimum and maximum memory dynamically, there is not need to edit the Dockerfile. So you can pass --build-arg javaopts="-Xmx17g -Xms512m" to reduce minimum memory.

Now when I try to run following command as per document I has following errors. I am sharing my command. I think I am missing something, please guide me if possible :)
docker run --name mapmatcher -v /home/graphhoppermapmatch/map-matching/mdata:/map-matching/map-data -v /home/graphhoppermapmatch/map-matching/cdata:/map-matching/graph-cache -p 8989:8989 -e IMPORT=berlin-latest.osm.pbf -e VEHICLES="car,foot,bike" mapmatcher:master
`Nothing to import, skipping... Starting map-matcher web UI...

The command seems fine, Nothing to import, skipping... means that -e IMPORT=berlin-latest.osm.pbf above was not used. The default value False for IMPORT is not being overwritten. Did you add that flag to the command? If you did not, then that is expected. The last output log you sent seems to have picked up the -e IMPORT argument just fine.

java.lang.IllegalArgumentException: Unable to override server.application_connectors[0].bind_host; node with index not found. at io.dropwizard.configuration.BaseConfigurationFactory.addOverride(BaseConfigurationFactory.java:189)

Means you already have something running on port 8989, maybe graphhopper? If you want to change this port you must do it inside config.yml and also in lines 8 and 27 of the Dockerfile.

If I use this with run command IMPORT=berlin-latest.osm.pbf then I got one more error:
Importing file: berlin-latest.osm.pbf... rm: cannot remove '/map-matcher/graph-cache/': Device or resource busy java.lang.IllegalStateException: Your specified OSM file does not exist:/map-matcher/map-data/berlin-latest.osm.pbf at com.graphhopper.reader.osm.OSMReader.readGraph(OSMReader.java:139) at com.graphhopper.GraphHopper.importData(GraphHopper.java:668) at com.graphhopper.GraphHopper.process(GraphHopper.java:639) at com.graphhopper.GraphHopper.importOrLoad(GraphHopper.java:617) at com.graphhopper.matching.cli.ImportCommand.run(ImportCommand.java:37) at io.dropwizard.cli.Cli.run(Cli.java:78) at io.dropwizard.Application.run(Application.java:93) at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)

From this log:
rm: cannot remove '/map-matcher/graph-cache/': Device or resource is expected and ignored, when the graph-cache folder does not exist.
java.lang.IllegalStateException: Your specified OSM file does not exist:/map-matcher/map-data/berlin-latest.osm.pbf means that you don't have that file inside /home/graphhoppermapmatch/map-matching/mdata which is the folder you are mounting to /map-matching/map-data (inside of the container). So make sure you copy all necessary maps and the config.yml to /home/graphhoppermapmatch/map-matching/mdata on your host machine.
Hope this helps!

@rcasaleiro I've got a similar error
Importing file: koeln.pbf...
rm: cannot remove '/map-matcher/graph-cache/': Device or resource busy
Starting map-matcher web UI...
Killed
java.lang.IllegalArgumentException: Unable to override server.application_connectors[0].bind_host; node with index not found.
	at io.dropwizard.configuration.BaseConfigurationFactory.addOverride(BaseConfigurationFactory.java:189)
	at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:122)
	at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:89)
	at io.dropwizard.cli.ConfiguredCommand.parseConfiguration(ConfiguredCommand.java:126)
	at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:74)
	at io.dropwizard.cli.Cli.run(Cli.java:78)
	at io.dropwizard.Application.run(Application.java:93)
	at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)

So the file exists, but the proccess got killed i guess? I've 32GB of RAM, that should not be the problem

Finally had some time to look at this. My bad... did not notice my configuration was different from the one in the commit... and my own lack of knowledge of Dropwizard didn't point me in the right direction. I was trying to override a configuration from the config.yml that did not exist. Everything should work fine now!

Hello,
I wanted improve this pull request, but I did not know how I could do. So I was inspired by your work to create a new pull request.
Here are the improvements:

Use maven-job to dockerise the application (better perf, better use docker layer etc.)
No need of script for the entrypoint. All arguments programs are usable
add docker push in the travis.yml

Note. In fact, maybe I should have fork your repository and pull request on it. No ?

From my last test if I am not wrong I could not run this as docker container. @jbordeau did you mange to run it successfully ?

Yes I had the same problem. But I created a new pull request that works. You can test the image from my docker hub.
Example with a docker-compose:
version: '3' services:       graphhopper-map-matching-demo:     image: jbordeau/graphhopper-map-matching-web     ports:       - "<IP_ADDRESS>:8989:8989"     expose:        - "8989"     volumes:       - /data/graphhopper/graph-cache:/graph-cache       - /data/graphhopper/map-data:/data     environment:       - JAVA_TOOL_OPTIONS="-Xmx16g"
The documentation and the source: https://github.com/Enovea/map-matching
In summary, you have to put a config.yml and the osm protobuf file in /data/graphhopper/map-data (if like the docker-compose above).
Or with the docker run command:
docker run -v /data/graphhopper/graph-cache:/graph-cache -v /data/graphhopper/map-data:/data -e "JAVA_TOOL_OPTIONS=-Xms2g -Xmx4g" -p 8989:8989 jbordeau/graphhopper-map-matching-web

From my last test if I am not wrong I could not run this as docker container. @jbordeau did you mange to run it successfully ?

Did you try it with the new configuration file? Check my latest commit, as I had uploaded the wrong config file and didn't notice.
I haven't deployed everything from scratch in a while, but last time I tested it after that fix, it worked.

Hi, I have tried your solution that you told last time. It didn't work.
Meanwhile I didn't give you any feedback.
If you tell that everything is ok now, I will give another short.
Abrar
On Tue, Sep 15, 2020, 9:09 PM Rui Casaleiro<EMAIL_ADDRESS>wrote:

From my last test if I am not wrong I could not run this as docker
container. @jbordeau https://github.com/jbordeau did you mange to run
it successfully ?
Did you try it with the new configuration file? Check my latest commit, as
I had uploaded the wrong config file and didn't notice.
I haven't deployed everything from scratch in a while, but last time I
tested it after that fix, it worked.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/graphhopper/map-matching/pull/173#issuecomment-692779555,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABJAWEUJPHRGGBDYJYCH6ALSF57SLANCNFSM4MJ63UJQ
.

Hello,
I wanted improve this pull request, but I did not know how I could do. So I was inspired by your work to create a new pull request.
Here are the improvements:

Use maven-job to dockerise the application (better perf, better use docker layer etc.)
No need of script for the entrypoint. All arguments programs are usable
add docker push in the travis.yml

Note. In fact, maybe I should have fork your repository and pull request on it. No ?

@jbordeau thanks for the contribution! It does look neater!

@bluetoothfx sorry for the delay, I hope @jbordeau fixed your problem. Regardless, if you could try the latest commit I just pushed,  I just tried deploying everything from scratch and it worked fine.

I was deploying through docker compose and overriding the JAVA_OPTS defined in the Dockerfile, as such I wasn't having the problem before. These were the settings I just tried, with a freshly built image tagged as "mapmatcher-test:master":
map-matcher-test:     image: mapmatcher-test:master     container_name: map-matcher-test     hostname: map-matcher-test     restart: always     ports:        - 8999:8989     volumes:        - ~/docker_mounts/map-matcher-test/map-data:/map-matcher/map-data       - ~/docker_mounts/map-matcher-test/graph-cache:/map-matcher/graph-cache     environment:         - IMPORT=leipzig_germany.osm.pbf         - VEHICLES=car         - JAVA_OPTS=-server -Xconcurrentio -XX:+UseG1GC -Ddw.server.applicationConnectors[0].bindHost=<IP_ADDRESS> -Ddw.server.applicationConnectors[0].port=8989 -Xmx20g -Xms8g

@rcasaleiro I haven't test @jbordeau solution till now. I will test and let you guys know. Also I will check your updated solution.

@bluetoothfx you had just to use this image: https://hub.docker.com/repository/docker/jbordeau/graphhopper-map-matching-web with one command:
docker run -v /data/graphhopper/graph-cache:/graph-cache -v /data/graphhopper/map-data:/data -e "JAVA_TOOL_OPTIONS=-Xms2g -Xmx4g" -p 8989:8989 jbordeau/graphhopper-map-matching-web
And that works. The import is done automatically the first time while the graph-cache exists

@bluetoothfx you had just to use this image: https://hub.docker.com/repository/docker/jbordeau/graphhopper-map-matching-web with one command:
docker run -v /data/graphhopper/graph-cache:/graph-cache -v /data/graphhopper/map-data:/data -e "JAVA_TOOL_OPTIONS=-Xms2g -Xmx4g" -p 8989:8989 jbordeau/graphhopper-map-matching-web
And that works. The import is done automatically the first time while the graph-cache exists

I have edited the command a bit for permission related error. The command is following:
docker run -v ${PWD}/data/graphhopper/graph-cache:/graph-cache -v ${PWD}/data/graphhopper/map-data:/data -e "JAVA_TOOL_OPTIONS=-Xms2g -Xmx4g" -p 8989:8989 jbordeau/graphhopper-map-matching-web
And getting error:
java.io.FileNotFoundException: File /data/config.yml not found
        at io.dropwizard.configuration.FileConfigurationSourceProvider.open(FileConfigurationSourceProvider.java:18)
        at io.dropwizard.configuration.BaseConfigurationFactory.build(BaseConfigurationFactory.java:79)
        at io.dropwizard.cli.ConfiguredCommand.parseConfiguration(ConfiguredCommand.java:126)
        at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:74)
        at io.dropwizard.cli.Cli.run(Cli.java:78)
        at io.dropwizard.Application.run(Application.java:94)
        at com.graphhopper.matching.http.MapMatchingApplication.main(MapMatchingApplication.java:16)

Am I missing something ?

indeed I forgot to specify in my last post that you must put the config.yml (graphhopper config) and the osm protobuf file in ${PWD}/data/graphhopper/map-data. These files are mandatory.
Then the command docker runwas an example, you can change the directory volume mount up to you

indeed I forgot to specify in my last post that you must put the config.yml (graphhopper config) and the osm protobuf file in ${PWD}/data/graphhopper/map-data. These files are mandatory.
Then the command docker runwas an example, you can change the directory volume mount up to you

After putting those files in place it works like rocket. Though I have many questions. 1st how should I reference multiple proto buf files ? Multiple profile car, truck etc. And is there any docker compose for this. Please if you have time include docker-compose. In past thread I think you have made one docker-compose file click here but I think file need to have correct format. Please made an up and running file. Thanks. BTW in config file there is another thing called   admin_connectors do you have any idea about this?
Great work @jbordeau !!


Imperative present tense, not present tense

Simple present tense would be: "Marks huge records as obsolete when clearing hinting faults". The correct tense would be imperative present tense, which is "Mark huge records as obsolete when clearing hinting faults".

Thanks!


Recognize more environments as interactive

... and log to stdout in those cases, and show INFO messages by default.
Fixes #6438.

Jenkins, test this please.


Verdaccio Not able to login

I have installed verdaccio 4.3.3  and NPM 6.10.3.

Can you please help me to resolve above issue ?
2019-10-14T14_23_42_908Z-debug.log

Please, we need more context. Can you fill the template provided for Bug report? Here I give you:
<!--
Hi folk, please read carefully the following points, all this information is what you need to share and make the process efficient
so everybody can understand your issue, please notice if you don't fill any of this points our friendly boot will remind you to do it or
close automatically the issue. Removing the sections you consider are irrelevant for your issue is totally ok.

If you have questions, you might rather join use over Discord https://chat.verdaccio.org

As reminder, we have code of conduct all of us we must follow https://github.com/verdaccio/verdaccio/blob/master/CODE_OF_CONDUCT.md
-->

**Describe the bug**
<!-- A clear and concise description of what the bug is. -->

**To Reproduce**
<!-- How to reproduce the issue -->

Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

**Expected behavior**
<!-- A clear and concise description of what you expected to happen. -->

**Screenshots**
If applicable, add screenshots to help explain your problem.

**Docker || Kubernetes (please complete the following information):**
 - Docker verdaccio tag: [e.g. verdaccio:4.x]
 - Docker commands [e.g. docker pull ...]
 - Docker Version [e.g. v18.05.0-ce-rc1]

**Configuration File (cat ~/.config/verdaccio/config.yaml)**

<!-- Please be careful do not leak any sensitive information, remove tokens -->

**Environment information**

<!--
  Please paste the results of `verdaccio --info` here (only if you are using >4.0.0).
  Share, Node.js, node package manager used (npm, yarn or pnpm) and the version.
  The verdaccio version is really important, run `verdaccio --version` if you don't know it.
-->

**Debugging output**
<!-- If you are contributing and need to share internal stuff, here some useful commands to get more verbose output -->

 - `$ NODE_DEBUG=request verdaccio` display request calls (verdaccio <--> uplinks)
 - `$ DEBUG=express:* verdaccio` enable extreme verdaccio debug mode (verdaccio api)
 - `$ npm -ddd` prints:
 - `$ npm config get registry` prints:

**Additional context**

<!--

If there is something else to share, screenshots, log files, or link references to other tickets.
IMPORTANT: please do not attach log files, rather copy the content so is indexable for future search.
-->

I'll close it, I see only client side info. Feel free to provide more info and I will reponen if is valid.


Current Tasks

I will work on Formatting and finishing toc. Finished Friday night

I'll work on formatting the home page (like adding a section for the short description and the button to the storyboard). Goal is to finish by Friday night.

I'll work on formatting the home page (like adding a section for the short description and the button to the storyboard). Goal is to finish by Friday night.

Done more or less.

I'ma work on formatting the audio page. I'll put in fodder for the images and the audio for now, which can be replaced later on. Goal is to finish by wednesday night.


Remove spinning variants from async_end2end_test

Spinning is something we should test (based on a comment revived in #14388) but there is no need to test it on the full spectrum of async_end2end_tests. This should cut testing time.

****************************************************************

libgrpc.so

     VM SIZE        FILE SIZE
 ++++++++++++++  ++++++++++++++

  [ = ]       0        0  [ = ]

****************************************************************

libgrpc++.so

     VM SIZE        FILE SIZE
 ++++++++++++++  ++++++++++++++

  [ = ]       0        0  [ = ]

[trickle] No significant performance differences

[microbenchmarks] No significant performance differences


Pandas .astype('category') dramatically decreases performance

I have a DataFrame with 2 000 000 rows. It has columns client, driver, pickup_latitude, pickup_longitude. I do
table['client'] = table.client.astype('category')
table['driver'] = table.driver.astype('category')

to save some memory space. Aggregation
aggregate = canvas.points(table, 'pickup_longitude', 'pickup_latitude', ds.count())

runs for 4 seconds.
If I do not cast client and driver to category, aggregation runs in 20ms.
It is not obvious for me why .astype('category') decreases performance so much. It was hard to debug. Maybe add some notice or warning?

Is this a Pandas or a Dask dataframe?  Normally using categorical datatypes does not reduce performance, so this is definitely surprising, all the more so because the aggregation here is not using either of those columns. I'd need a reproducible example to try to figure it out.

data.csv.zip
table = pd.read_csv('data.csv.zip')
canvas = ds.Canvas(plot_width=700, plot_height=662, x_range=(4146921.8723705406, 4224887.706012843), y_range=(7470522.750106069, 7544365.4667577855))

%%timeit
aggregate = canvas.points(table, 'longitude', 'latitude', ds.count())
3.25 ms ± 350 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)

table = pd.read_csv('data.csv.zip')
table['client'] = table.client.astype('category')
table['driver'] = table.driver.astype('category')

canvas = ds.Canvas(plot_width=700, plot_height=662, x_range=(4146921.8723705406, 4224887.706012843), y_range=(7470522.750106069, 7544365.4667577855))

%%timeit
aggregate = canvas.points(table, 'longitude', 'latitude', ds.count())
572 ms ± 24.7 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

Thanks!  I've asked Greg to look into that when he gets the time.

I've taken a quick look at this, and it appears that in the categoricals case most of the time is spent doing schema validation with odo. Without categoricals, most of the time is spent in Canvas.points() (as expected). I suspect that there is a performance issue with the odo library in handling categorical dtypes.

Seems very suspicious!

I think we should just remove odo entirely. We initially used it to provide potential support for alternate data sources. Since we seem to have settled on pandas/dask.dataframe only, it doesn't make sense to have a generic dtype system as a dependency. I'd remove odo support and just use pandas dtypes directly.

@jcrist, just opened the PR to do this. The PR also address this performance issue, and brings categorical performance to be on-par with the case where they aren't used.

CC @teoliphant , as this partially relates to datashape performance, although most of the bottleneck appears to have gone away with the refactor in #561.

From discussions between me and Greg, it sounds like the underlying problems remaining after removing the odo code are that:

datashape is encoding the type of every column in a dataframe, not just the ones datashader is using.
datashape's encoding for a categorical column includes a step where the full set of possible categorical values is turned into a tuple, which is expensive if there are a lot of categories

In our previous datashader work, the only categoricals we used were meant for datashader's count_cat aggregation, which is only meaningful for small numbers of category values (up to a few dozen), because (a) it results in one layer in the final aggregate array per category value (which would quickly blow up in memory if there are many possible values), and (b) these extra layers are used solely to construct a colorized final image, and there are only a few dozen colors that can be reliably distinguished categorically.  Thus we've never previously tested with categoricals larger than 100 categories, and had no problems with performance.
Here the problem is the very presence of categorical columns with large numbers of categories, even if we aren't actually using them in datashader -- datashape tries to encode those values as tuples, despite us never needing to use that information, and everything gets slow.  So, we could somehow maybe:

Specify which columns we want datashape to encode, i.e. only the three or so that datashader actually uses
Tell datashape to treat categoricals as integers, i.e. not worrying about the actual category values, just the presence of a categorical column
Optimize datashape to have a more efficient encoding for categorical values, e.g. using a numpy array rather than a tuple
Make a copy of the original dataframe, sharing the same underlying data, consisting of only the columns we need, and only call datashape on that

@gbrener, does that capture our full discussion?  Any idea which of these options we should move forward with?

Thanks for the summary @jbednar. I agree that it captures our discussion.

Revisiting this issue today, here are the timings for running canvas.points() 1000x, revealing the "new" bottleneck (pointing to the datashape.Categoricals constructor):

First I implemented option 4 from the list above, since it was relatively low-effort (I selected only the columns from the dataframe that were being used). Here were the results:

Notice that there's ~40% performance improvement for the dataframe with categoricals, but a ~25% performance decrease in the common case of a dataframe without categoricals. The time seemed to be spent in pandas dataframe selection internals. So I added a branch that says "if there is a categorical dtype in this dataframe, subset the columns. Otherwise use the whole dataframe". The relevant code is located here:

This resulted in a ~38% improvement for the categoricals dataframe case, and ~10% perf decrease for the common case (overhead of checking for categoricals).

Sped things up a bit more in PR #431. There is now a ~50% increase in the categoricals case performance, with the non-categoricals performance staying roughly the same:

Now that the PR is an overall clear improvement in performance, I've merged it.  @alexanderkuk, please try out the latest datashader master branch on your original problem, and if it doesn't address the performance issue, please open a new issue with your observations about the new levels of performance. Thanks for reporting this!

Thank you! Before posting this issue I just removed .astype('category') from my code, so this is not a problem for me any more. Datashader was very useful in my work. By the way you can check out our project that uses Datashader http://lab.alexkuk.ru/taxi/

Very cool, thanks!