No kernel for language shell script found

I've installed bash kernel for Jupyter, tested it in jupyter notebook and it works like a charm.
Next I've tried making .sh script in atom and using hydrogen to evaluate line by line, however I get the title error with following message:
Check that the language for this file is set in Atom and that you have a Jupyter kernel installed for it.

There's probably some wiring issue somewhere since atom calls language shell script and it's called bash in jupyter
(at least I think so from inspecting ~/.local/share/jupyter/kernels/bash/kernel.json :
{"argv": ["/home/nmiculinic/anaconda3/bin/python", "-m", "bash_kernel", "-f", "{connection_file}"], "codemirror_mode": "shell", "display_name": "Bash", "env": {"PS1": "$"}, "language": "bash"}

)
I'm not exactly sure where in atom/hydrogen should I fix this wiring to properly use bash kernel?

You can add mappings like this to the package settings for Hydrogen. It takes a JSON mapping from the nonstandard name (the grammar Atom is using) to the kernel language.

Thank you!
On 4 January 2016 at 03:49, Will Whitney<EMAIL_ADDRESS>wrote:

You can add mappings like this to the package settings for Hydrogen. It
takes a JSON mapping from the nonstandard name (the grammar Atom is using)
to the kernel language.
—
Reply to this email directly or view it on GitHub
https://github.com/willwhitney/hydrogen/issues/151#issuecomment-168568885
.


Ensure SDL2.dll is copied for paths with spaces

Just a small fix for when the solution/bin path contains spaces. This was the only thing
preventing me from running it directly after premake generation.

Cool, thanks!  Will this cause issues with paths without spaces?  I don't know much cmd.exe...

Cool, just tested it and it's working fine.  LGTM


Tool to check pump

I think it like a tool to check if my own pump is working ok with the others or not.
Like does pingdom.com to the sites but it can check with the others to shutdown the connection and don't wait for it if the "pong" was not received.

I'm not sure I understand what's desired here. @eoyarzabal, can you spell out in detail what you want?

Sorry, was an old thinking. I'm not a pump user anymore.


ec2-user ssh failure and lack of active nodes

Environment:

AWS ParallelCluster  version aws-parallelcluster-2.2.1
OS: Ubuntu 16.0.04
Scheduler:  SGE
Master instance type: C4.large
Compute instance type: c4.large

Bug description and how to reproduce:
I have performed minor customisation of the aws-parallelcluster Ubuntu 16.04 following AWS documentation. Cluster creation goes well. However I am not able to pcluster ssh mycluster as I receive Permission denied (publickey,gssapi-keyex,gssapi-with-mic). error. I can replicate the same issue if I ssh with the SGE user (ec2-user), but I can use the other user (ubuntu) to ssh to my instance.
I have tried to change the SSH aliases to ssh = ssh ubuntu@{MASTER_IP} {ARGS}. With this approach the same error happens with the ubuntu user. I have also tried changing the alias to ssh = ssh ubuntu@{MASTER_IP} -i /path/to/key.pem which works, but the qhost still does not show the active nodes.
Additional context:
Cluster creation goes well, master node and compute nodes are created. I do not receive any errors or warnings during the "cluster creation" process .  Can you try running with the -d flag and confirm the username is ubuntu?

$ pcluster ssh -d mycluster
ssh<EMAIL_ADDRESS>

Can you post contents of /var/log/sqswatcher from the master? This is the only thing that concerns me.
Errors in jobwatcher aren't an issue, occasionally it takes a few minutes to find the asg. Is this at the end of the jobwatcher log?

Hi @sean-smith

Thank you. We can consider number 1 issue resolved. I just dumped the output FYI for posterity.

$ pcluster ssh -d testcluster
ssh<EMAIL_ADDRESS>-i ~/mykey.pem

contents of /var/log/sqswatcher

2019-04-01 21:54:19,479 INFO [sqswatcher:main] sqswatcher startup
2019-04-01 21:54:50,989 INFO [sqswatcher:_poll_queue] event_type=autoscaling:TEST_NOTIFICATION
2019-04-01 21:57:51,529 INFO [sqswatcher:_poll_queue] event_type=parallelcluster:COMPUTE_READY
2019-04-01 21:57:51,529 INFO [sqswatcher:_poll_queue] instance_id=i-05e5bf9fb387da500
2019-04-01 21:57:51,746 INFO [sqswatcher:_add_host] Adding hostname: ip-172-31-1-197
2019-04-01 21:57:51,746 INFO [sge:addHost] Adding ip-172-31-1-197 with 2 slots
ip-172-31-1-197.eu-west-2.compute.internal added to administrative host list
ip-172-31-1-197.eu-west-2.compute.internal added to submit host list
<EMAIL_ADDRESS>added "ip-172-31-1-197.eu-west-2.compute.internal" to exechost list
2019-04-01 21:57:51,770 INFO [sge:addHost] Connecting to host: ip-172-31-1-197 iter: 0
2019-04-01 21:57:51,781 INFO [transport:_log] Connected (version 2.0, client OpenSSH_7.2p2)
/usr/local/lib/python2.7/dist-packages/paramiko/kex_ecdh_nist.py:39: CryptographyDeprecationWarning: encode_point has been deprecated on EllipticCurvePublicNumbers and will be removed in a future version. Please use EllipticCurvePublicKey.public_bytes to obtain both compressed and uncompressed point encoding.
  m.add_string(self.Q_C.public_numbers().encode_point())
/usr/local/lib/python2.7/dist-packages/paramiko/kex_ecdh_nist.py:96: CryptographyDeprecationWarning: Support for unsafe construction of public numbers from encoded data will be removed in a future version. Please use EllipticCurvePublicKey.from_encoded_point
  self.curve, Q_S_bytes
/usr/local/lib/python2.7/dist-packages/paramiko/kex_ecdh_nist.py:111: CryptographyDeprecationWarning: encode_point has been deprecated on EllipticCurvePublicNumbers and will be removed in a future version. Please use EllipticCurvePublicKey.public_bytes to obtain both compressed and uncompressed point encoding.
  hm.add_string(self.Q_C.public_numbers().encode_point())
2019-04-01 21:57:52,431 INFO [transport:_log] Authentication (publickey) successful!
/usr/local/lib/python2.7/dist-packages/paramiko/ecdsakey.py:164: CryptographyDeprecationWarning: Support for unsafe construction of public numbers from encoded data will be removed in a future version. Please use EllipticCurvePublicKey.from_encoded_point
  self.ecdsa_curve.curve_class(), pointinfo
<EMAIL_ADDRESS>modified "@allhosts" in host group list
<EMAIL_ADDRESS>modified "all.q" in cluster queue list
2019-04-01 21:57:53,782 INFO [sqswatcher:_add_host] Host ip-172-31-1-197 successfully added to the cluster
2019-04-01 21:57:53,811 INFO [sqswatcher:_add_host] Instance i-05e5bf9fb387da500 successfully added to the database
2019-04-01 21:57:53,827 INFO [sqswatcher:_poll_queue] event_type=parallelcluster:COMPUTE_READY
2019-04-01 21:57:53,827 INFO [sqswatcher:_poll_queue] instance_id=i-04e95b307c8f7602c
2019-04-01 21:57:53,924 INFO [sqswatcher:_add_host] Adding hostname: ip-172-31-1-248
2019-04-01 21:57:53,924 INFO [sge:addHost] Adding ip-172-31-1-248 with 2 slots
ip-172-31-1-248.eu-west-2.compute.internal added to administrative host list
ip-172-31-1-248.eu-west-2.compute.internal added to submit host list
<EMAIL_ADDRESS>added "ip-172-31-1-248.eu-west-2.compute.internal" to exechost list
2019-04-01 21:57:53,946 INFO [sge:addHost] Connecting to host: ip-172-31-1-248 iter: 0
2019-04-01 21:57:53,954 INFO [transport:_log] Connected (version 2.0, client OpenSSH_7.2p2)
2019-04-01 21:57:54,076 INFO [transport:_log] Authentication (publickey) successful!
<EMAIL_ADDRESS>modified "@allhosts" in host group list
<EMAIL_ADDRESS>modified "all.q" in cluster queue list
2019-04-01 21:57:55,477 INFO [sqswatcher:_add_host] Host ip-172-31-1-248 successfully added to the cluster
2019-04-01 21:57:55,483 INFO [sqswatcher:_add_host] Instance i-04e95b307c8f7602c successfully added to the database

full jobwatcher log

2019-04-01 21:54:19,474 INFO [jobwatcher:main] Reading configuration file /etc/jobwatcher.cfg
2019-04-01 21:54:19,744 ERROR [jobwatcher:_get_asg_name] No asg found for cluster parallelcluster-testcluster
2019-04-01 21:54:49,809 INFO [jobwatcher:main] Saving asg_name parallelcluster-testcluster-ComputeFleet-1CFFI4AT1PJLC in the config file /etc/jobwatcher.cfg
2019-04-01 21:54:50,193 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:54:50,193 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 21:55:50,596 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:55:50,597 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 21:56:50,639 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:56:50,639 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 21:57:50,704 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:57:50,704 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 21:58:50,753 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:58:50,753 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 21:59:50,763 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 21:59:50,764 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:00:50,776 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:00:50,776 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:01:50,787 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:01:50,788 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:02:50,799 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:02:50,799 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:03:50,811 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:03:50,812 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:04:50,828 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:04:50,828 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:05:50,887 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:05:50,887 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
2019-04-01 22:06:50,910 INFO [jobwatcher:_get_vcpus_from_pricing_file] Instance c4.large has 2 vcpus.
2019-04-01 22:06:50,910 INFO [jobwatcher:_get_instance_properties] Instance c4.large will use number of vcpus as slots based on configuration.
~

$  qhost
HOSTNAME                ARCH         NCPU NSOC NCOR NTHR  LOAD  MEMTOT  MEMUSE  SWAPTO  SWAPUS
----------------------------------------------------------------------------------------------
global                  -               -    -    -    -     -       -       -       -       -
ip-172-31-1-197         -               -    -    -    -     -       -       -       -       -
ip-172-31-1-248         -               -    -    -    -     -       -       -       -       -

Thanks @armaneshaghi! can you also post your config file with any sensitive values removed.

Here is my ~/.parallelcluster/config:
[global]

cluster_template = default

sanity_check = true
[aws]
aws_region_name = eu-west-2
aws_access_key_id = ***removed
aws_secret_access_key = ****removed

[cluster default]
vpc_settings = public
key_name = test
master_instance_type = c4.large
compute_instance_type = c4.large
cluster_type = spot
spot_price = 0.2
custom_ami = ami-012e14b41b1b0ce77
master_root_volume_size = 17

 [vpc public]
 master_subnet_id = ***removed
 vpc_id = ***removed
 ssh_from = ***removed

 [aliases]
 ssh = ssh ubuntu@{MASTER_IP} -i ~/mykey.pem

 vpc_settings = public

 [ebs custom1]
 shared_dir = software
 ebs_volume_id = vol-06***

 [scaling custom]
 scaledown_idletime = 10

@sean-smith  new comment: I can reproduce the above issue by using one of the default AMIs for example, ami-0a436502cadd6550d that is Ubuntu 16.04 at EU-West-2. Certainly the issue has nothing to do with the AMI customisation.

great, thanks for the feedback

Hi @armaneshaghi,
I wasn't able to reproduce the error using the latest ami's in the eu-west-2 region. Is this still an issue for you?


Add support for contracttype on type aliases

I'm changing contracttype so that it has an export attribute, which will be true by default, except for contracttypes that are imported. Contract types that are imported will not be exported by default because it is the least surprise behavior and ensures that importing a contract with types that have the same name as types already in the contract do not collide in the contract spec (which is an issue we have now).

This is great. I was just thinking about the fact that the token example exports AllowanceDataKey and DataKey into the contract spec even though those are part of the private interface. They really shouldn't appear in the contract spec and (assuming I understand correctly what you are going to do) it should now be possible to remove them from it.

@jonjove I've change the contractimport! macro as a part of the work for https://github.com/stellar/rs-soroban-sdk/issues/622 so that it no longer automatically exports types from an imported contract.
The intent with this issue was to provide a mechanism through which someone could choose to reexport a type from another contract. I had two ideas in mind:

(This issue.) Use type aliases as a convenient syntax for reexporting. Because the spec XDR is a const function on each type, it is relatively easy to generate a const function for the alias that just calls the same function on the original type. The hope was to add a prefix spec entry on to the front of the original spec entry, where the prefix spec entry provided an alias for the latter.

Add to the contractimport! macro an attribute where you can list off the names of types you'd like reexported.

I started work on (1) and it was looking good, but in the process it occurred to me that this might not be a good practice for us to encourage. Reexporting another contracts types is essentially defining the form of user input without having that form well specified clearly in your code. Given that user input is not trusted, a contract should maybe not trust user input it can't see clearly, which is the case with generated code.
It also occurred to me that this isn't a critical issue. Even though it is inconvenient, someone can use the soroban-cli gen --output rust --wasm <file> command to generate code for another contract's type, and then copy and paste it into their code, and after copy pasting it they can remove the export = false attribute that is on the type.
There's enough ambiguity as to whether this is a good practice I'm going to close this issue and we can reopen it if someone expresses that it is a real and dire need.


Error: ProtocolError on MariaDB 10.10.3

Hi, I use arch linux and had monday an update up to mariadb  Ver 15.1 Distrib 10.10.3-MariaDB, for Linux (x86_64) using readline 5.1.
Since then its impossible to do anything on the db. I could connect, but as soon as something get executed I hit
Error
    at PoolConnection.execute (https://deno.land/x/mysql@v2.10.3/src/connection.ts:293:17)
    at async PoolConnection.query (https://deno.land/x/mysql@v2.10.3/src/connection.ts:239:20)
    at async https://deno.land/x/mysql@v2.10.3/src/client.ts:86:14
    at async Client.useConnection (https://deno.land/x/mysql@v2.10.3/src/client.ts:107:14)
    at async Client.query (https://deno.land/x/mysql@v2.10.3/src/client.ts:85:12)
    at async file:///home/tharo/dev/pudding-backend/test.ts:10:1

According to the source-code it looks like an issue by design. But my understanding of mariadb interna is not enought to understand why this if clause is there. The java drivers (used in DBeaver) and the php ones (PHP 8.2.2 (cli) (built: Feb  1 2023 08:33:04) (NTS)) had no issue with the new mariadb version.
Anyway. I think that soon many people might run into this issue. So I hope it get fixed soon.
Thanks for your great work.

Hi, did you try the latest version (v2.11.0)? We have fixed the handling of EOF_Packet.

Thats true. Thank you.


Port Assignment for each service

About the context
Hi, I am creating this issue to fix which port number we will use for each service. Here is the list of all the services that we might have in the future, and my suggestion of the port number to use:

Service
Port Number
Notes

Frontend Service
3000
-

User Service
5005
Changed to 5005 from 5000, as 5000 is reserved for Mac

Auth Service
5050
If we want to separate this from user service

Question Service
5100
-

Matching Service
5200
-

Collaboration Service
5300
-

Communication Service
5350
If we want to separate this from collaboration service

History Service
5400
-

Compiler Service
5500
If we want to support code execution

The port numbers are just randomly picked, and feel free to give suggestions if you have a better understanding of how to assign these port numbers.

Closed this as we don't have plans to include new services from now onwards


No template for Invoice/*******.pdf False

Hi, I created a template for my pdf, and when I try to run that it is again showing this no template found,
Only QualityHosting invoice is working other invoices are having the same issue though I am creating templates

Same Issue hare also

@Animesh-CSE
I found the solution add this code in your py file
import logging.config
import logging
logging.basicConfig(level=logging.DEBUG) logging.basicConfig()
And then it will display all the pdf data
After that just compare that issuer name you wrote is same as that in terminal

@NayanMogra  Thank You
Now come another issues.Hare it is-
**Traceback (most recent call last):
File "G:\project\project.py", line 6, in
result = extract_data('invoice/MyFlipkart.pdf',templates=templates)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\main.py", line 93, in extract_data
return t.extract(optimized_str)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\invoice_template.py", line 178, in extract
output[k] = self.parse_date(res_find[0])
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\invoice_template.py", line 113, in parse_date
value, date_formats=self.options['date_formats'], languages=self.options['languages']
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\dateparser\conf.py", line 89, in wrapper
return f(*args, kwargs)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\dateparser_init_.py", line 54, in parse
data = parser.get_date_data(date_string, date_formats)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\dateparser\date.py", line 412, in get_date_data
raise TypeError('Input type must be str')
TypeError: Input type must be str

Can you share your template here, please?

@Animesh-CSE  yes please share your template

@RossK1
@NayanMogra
-- coding: utf-8 --
issuer: Flipkart
keywords:

Flipkart
Shreyash Retail
OD
fields:
date: Invoice Date:\s+(\d{1,2})-(\d{1,2})-(\d{2,4})
amount: Grand Total\s+\₹\s(\d+.\d{2})
invoice_number: Invoice Number\s+#\s(\w{4,7}\d{8,12})
options:
remove_whitespace: false
currency: INR
date_formats:

'%d/%m/%Y'
languages:
en

yml file not supported hare ,thats why i send the code only. This template for recent Flipkart invoices.

What I can understand through your template there is some indentation error
You had fields inside keywords
You can upload template on GitHub and share link here
will check and help you then properly

YML is indentation sensitive. I can't tell from that code what your indentation is like. Can you please correct it to be representative?

@NayanMogra
@RossK1
MyFlipkart.txt

Try remove the date formats option and see if it works and what the dates come out as.

You have indentation issue in keyword as well as fields too
Use tab instead of single space,
Keywords
- Flipkart
Do like this

@NayanMogra  as i paste copying code hare thats why its repesentation are mismached.But in actual code its not.

@NayanMogra  as i paste copying code hare thats why its repesentation are mismached.But in actual code its not.

Also other issue what I can find out is there is no ':' in number and total

@RossK1  i tried by removing the date but then its showing regex for amount field not matching . But i already check  from regex on regex101 site, its matching.

@NayanMogra but without ':' ,regex not matching

Cant able to open your screenshot
But two things you can see if,

Check indentation of the plugin Keywords
though it is not mentioned anywhere try this out:- Move Field plugin above Keyword and check this out

After using tab this showing-
Traceback (most recent call last):
File "G:\project\project.py", line 4, in
templates = read_templates('template/')
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\loader.py", line 88, in read_templates
tpl = ordered_load(template_file.read())
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\loader.py", line 36, in ordered_load
return yaml.load(stream, OrderedLoader)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml_init_.py", line 114, in load
return loader.get_single_data()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\constructor.py", line 49, in get_single_data
node = self.get_single_node()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 36, in get_single_node
document = self.compose_document()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 55, in compose_document
node = self.compose_node(None, None)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 84, in compose_node
node = self.compose_mapping_node(anchor)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 133, in compose_mapping_node
item_value = self.compose_node(node, item_key)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 64, in compose_node
if self.check_event(AliasEvent):
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\parser.py", line 98, in check_event
self.current_event = self.state()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\parser.py", line 449, in parse_block_mapping_value
if not self.check_token(KeyToken, ValueToken, BlockEndToken):
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\scanner.py", line 116, in check_token
self.fetch_more_tokens()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\scanner.py", line 260, in fetch_more_tokens
self.get_mark())
yaml.scanner.ScannerError: while scanning for the next token
found character '\t' that cannot start any token
in "", line 4, column 1:
- Flipkart
^

Cant able to open your screenshot
But two things you can see if,

Check indentation of the plugin Keywords
though it is not mentioned anywhere try this out:- Move Field plugin above Keyword and check this out
Ok @NayanMogra

@NayanMogra
After moving field plag in above keyword-
Traceback (most recent call last):
File "G:\project\project.py", line 4, in
templates = read_templates('template/')
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\loader.py", line 88, in read_templates
tpl = ordered_load(template_file.read())
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\invoice2data\extract\loader.py", line 36, in ordered_load
return yaml.load(stream, OrderedLoader)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml_init_.py", line 114, in load
return loader.get_single_data()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\constructor.py", line 49, in get_single_data
node = self.get_single_node()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 36, in get_single_node
document = self.compose_document()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 55, in compose_document
node = self.compose_node(None, None)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 84, in compose_node
node = self.compose_mapping_node(anchor)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 133, in compose_mapping_node
item_value = self.compose_node(node, item_key)
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\composer.py", line 64, in compose_node
if self.check_event(AliasEvent):
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\parser.py", line 98, in check_event
self.current_event = self.state()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\parser.py", line 449, in parse_block_mapping_value
if not self.check_token(KeyToken, ValueToken, BlockEndToken):
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\scanner.py", line 116, in check_token
self.fetch_more_tokens()
File "C:\Users\Hp\AppData\Local\Programs\Python\Python37-32\lib\site-packages\yaml\scanner.py", line 260, in fetch_more_tokens
self.get_mark())
yaml.scanner.ScannerError: while scanning for the next token
found character '\t' that cannot start any token
in "", line 4, column 1:
date: Invoice Date:\s+(\d{1,2}) ...
^

@NayanMogra

in regex whenever you get a special character try using \w or \w+
According to my understandings
date: Invoice Date:\s+(\d{1,2})
there are two colons and that might be giving you token issue

in regex whenever you get a special character try using \w or \w+
According to my understandings
date: Invoice Date:\s+(\d{1,2})
there are two colons and that might be giving you token issue

i tried to use \w for special character but its not matching.

capital W not small

ok i replaced special character with '\W' but nothing happen, same error

Share SS again

I didn't see any changes in your file it is, the same as before
Date : Invoice\s+Date\s+\W\s+..... do it like this and also instead of using - use \W in date that will also be good

help me for regex of
Invoice Date: 18-02-2021

Invoice\s+Date\W\s+\d{1,2}\W\d{1,2}\W\d{2,4}
check this out

Invoice Date:\s+(\d{1,2})\-(\d{1,2})\-(\d{2,4})

This is the problem. That regex has three matching groups. It means re.findall returns an array with tuple of three strings.
Invoice\s+Date\W\s+\d{1,2}\W\d{1,2}\W\d{2,4}

This regex doesn't have any matching group, so the whole match will be treated as a date. Depending on how smart data parser is, it may success or not.
Just use a single matching group like:
Invoice Date:\s+(\d{1,2}-\d{1,2}-\d{2,4})


Document future GraphQL query limits

Direct link to preview: https://medplum-www-git-graphql-limit-docs-medplum.vercel.app/docs/graphql/basic-queries#query-limits

Hm, re-reading the Shopify doc, it's probably "yes and"
The Shopify doc doesn't have any mention of "nested" or "depth".  So perhaps we could start with their doc, and include your proposed language on how depth causes exponential growth in cost.
https://shopify.engineering/rate-limiting-graphql-apis-calculating-query-complexity


Unable to install on GitHub's macOS runners with Python 3.10

Minimal, reproducible code sample, a copy-pastable example if possible
A minimal GitHub actions workflow that reproduces the problem:
name: Foo

on:
  - push
  - pull_request

defaults:
  run:
    shell: bash

jobs:
  misc:
    runs-on: macos-latest
    steps:
      - uses: actions/setup-python@v4
        with:
          python-version: '3.10'

      - run: |
          pip install --upgrade pip wheel
          pip install numcodecs

Problem description
Currently, installing the latest version of numcodecs (0.9.1) in one of GitHub Actions' macOS runners when using Python 3.10 fails with numerous compilation errors of the form invalid conversion between vector type '__m64' (vector of 1 'long long' value) and integer type 'int' of different size (full output can be found here).  Of note is that installation was working as recently as 10:55 EDT today (June 16) but stopped working by 12:29 EDT.  In that time period, it appears that the software used by the macOS runners was updated; the old list of software can be found here, and new list of software is here.  From a cursory glance, the only possibly relevant difference I see is that Python 3.10 was updated from 3.10.4 to 3.10.5.
Version and installation information
Please provide the following:

Value of numcodecs.__version__: 0.9.1
Version of Python interpreter: 3.10.5
Operating system (Linux/Windows/Mac): macOS
How NumCodecs was installed (e.g., "using pip into virtual environment", or "using conda") — using pip

Can second this my "test-upstreams" action just found this as well: https://github.com/AllenCellModeling/aicsimageio/runs/6924636832?check_suite_focus=true
Seems like 3.10.4 was fine yesterday: https://github.com/AllenCellModeling/aicsimageio/runs/6906461555?check_suite_focus=true

Python 3.10 support is in main, but not in a release yet ( https://github.com/zarr-developers/numcodecs/issues/324 )

Shall we get it out? 🙂 (Very sorry for disappearing there for a bit. Bed rest can do wonders.)

SGTM

The 0.10.0 tag has been pushed.


Multi-Select data type queries

According to: https://developer.salesforce.com/docs/atlas.en-us.soql_sosl.meta/soql_sosl/sforce_api_calls_soql_querying_multiselect_picklists.htm
one must use the keywords INCLUDES and EXCLUDES to query certain combinations of values when the data type is a multi-select box.

Created pull request:
https://github.com/jsforce/jsforce/pull/530


Move object management to Tasks

This is a Feature Request

What would you like to be added

Why is this needed
Comments

Duplicate of  #14272

@steveperry-53 i'll close this in favour of #14272 where more info was provided
/close


Add integration test suite

Summary

Add integration tests interacting with the notification server from JS
Adds the missing request handler to the server

Generated summary (powered by Graphite)

TL;DR
This pull request includes changes to multiple files related to integration testing, environment variables, Docker configuration, and code modifications. It adds new services, updates job names, and includes new configuration settings for an integration service.
What changed

Updated .dockerignore to ignore specific directories and files
Added environment variables to .env.docker for configuration
Modified test.yml in .github/workflows to update job and step names
Renamed a job from "Test" to "Unit"
Added a new job for integration tests
Modified .gitignore to include "node_modules"
Added a condition for enabling HTTP delivery in main.go
Added a new HTTP delivery service in main.go
Created new integration scripts in the dev folder
Modified up script in the dev folder for specific service setup
Added new Dockerfile to the integration directory
Added a README.md file in the integration directory
Updated package.json with dependencies and devDependencies
Added new TypeScript files for configuration and message handling

How to test

Check the updated .dockerignore, .env.docker, and test.yml files
Review the changes in the main.go file for HTTP delivery and service setup
Run the integration scripts in the dev folder
Check the new Dockerfile and README.md in the integration directory
Test the TypeScript files for message handling and configuration

Why make this change

Improve Docker configuration and environment variable management
Enhance integration testing setup and job organization
Add new services and scripts for better testing and development
Update code for enabling HTTP delivery and service setup
Include new TypeScript files for message handling and configuration settings

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#32  👈
#31
#30
#29
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @neekolas and the rest of your teammates on  Graphite

Merge activity

Mar 11, 8:15 PM EDT: @neekolas started a stack merge that includes this pull request via Graphite.


Remove unused variable

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

I'm not sure whether this enables an unwanted compiler optimization. Are the benchmark results different after you've removed the variable?

Before the change, I have this :
go test -bench=BenchmarkProxyLogger github.com/fabiolb/fabio/proxy
2017/11/07 13:00:19 [INFO] cert: Store has certificates for ["example.com"]
goos: darwin
goarch: amd64
pkg: github.com/fabiolb/fabio/proxy
BenchmarkProxyLogger-4            100000             11171 ns/op
PASS
ok      github.com/fabiolb/fabio/proxy  1.781s

and after the change that :
2017/11/07 13:01:32 [INFO] cert: Store has certificates for ["example.com"]
goos: darwin
goarch: amd64
pkg: github.com/fabiolb/fabio/proxy
BenchmarkProxyLogger-4            100000             11111 ns/op
PASS
ok      github.com/fabiolb/fabio/proxy  1.670s

It's the same here with http_headers_test you have from tests :
proxy/http_headers_test.go:390:6: s declared but not used

it's for the same reason you told before this statement exists ?

The intention was to not let the compiler optimize a function away where the return value is never used. I may have gotten this wrong but that was the idea.
See last paragraphs in https://dave.cheney.net/2013/06/30/how-to-write-benchmarks-in-go

I think these two are unrelated. The var in the BenchmarkProxyLogger can go.

Thanks!

After reading this article, it's written you need to store the result in a package variable :
always store the result to a package level variable
so the compiler cannot eliminate the Benchmark itself.

And the var in http_headers_test is necessary ? If it's the case, if think a little comment could avoid another discussion.

I need to check again but I agree that there should be a comment if it is necessary indeed.


Make the recent activity feed link to a longer page with extended history

Describe the feature you'd like
To make it possible to see all activities, not merely the ones visible by the height of your browser viewport, link the activity feed sidebar to a page with a longer archive of activity, ideally making all past activities accessible in this way.
Describe the benefits this feature would bring to BookStack users
The ability to review all recent activity to identify problems and spam or other unwanted edits and behaviour, to protect the books.

Thanks for the request here @samtuke.
The core benefit requested can now be achieved via the system audit log that we introduced earlier this year. Due to that, and since there has been no other desire for this exact implementation to be added, I'm going to close this one off.


[IOTDB-6227] Remove unused retry policy in IStateMachine

The retry policy is never used in IStateMachine, yet it brings complexity in Ratis write while may incur poerformance penalties. We should remove it.

What a great contribution! Thx!


Benchmark

Tested with native python3.11 version of scheduler and go version scheduler and here is the results:

there are 10k noop functions
the result is impressive, go is 3 times faster than python version

Test Environment:

OS: Windows 11
CPU: Ryzen 5900x
RAM: DDR4 32gb

running all below in Ubuntu WSL2
python version:
(venv3.11) 20:14:59 Wed Feb 22 : zyin@Windows (tmux):~/dev/scaled
$ python -m unittest tests.test_client.TestClient.test_client
[INFO]2023-02-22 20:15:06-0500: logging to ('/dev/stdout',)
[INFO]2023-02-22 20:15:06-0500: ScaledClient: connect to tcp://<IP_ADDRESS>:2345
[INFO]2023-02-22 20:15:06-0500: beginning submit 100000 tasks
[INFO]2023-02-22 20:15:07-0500: completed submit 100000 tasks in 0:00:01.029573
[INFO]2023-02-22 20:15:07-0500: beginning gather 100000 results
[INFO]2023-02-22 20:15:37-0500: completed gather 100000 results in 0:00:29.883602
.
----------------------------------------------------------------------
Ran 1 test in 30.975s

OK
[INFO]2023-02-22 20:15:37-0500: ScaledClient: disconnect from tcp://<IP_ADDRESS>:2345

go version scheduler:
(venv3.11) 20:15:37 Wed Feb 22 : zyin@Windows (tmux):~/dev/scaled
$ python -m unittest tests.test_client.TestClient.test_client
[INFO]2023-02-22 20:16:11-0500: logging to ('/dev/stdout',)
[INFO]2023-02-22 20:16:11-0500: ScaledClient: connect to tcp://<IP_ADDRESS>:2345
[INFO]2023-02-22 20:16:11-0500: beginning submit 100000 tasks
[INFO]2023-02-22 20:16:12-0500: completed submit 100000 tasks in 0:00:01.042871
[INFO]2023-02-22 20:16:12-0500: beginning gather 100000 results
[INFO]2023-02-22 20:16:20-0500: completed gather 100000 results in 0:00:08.436920
.
----------------------------------------------------------------------
Ran 1 test in 9.543s

OK
[INFO]2023-02-22 20:16:20-0500: ScaledClient: disconnect from tcp://<IP_ADDRESS>:2345

@darenliang, please label it as discussion

I changed scaled monitor to spit out json encoded by ascii into bytes for monitor response


Codify the release checklist

This pull request only contains documentation, so we don't need to wait for CI to merge it.


python312Packages.sfrbox-api: 0.0.10 -> 0.0.11

Diff: https://github.com/hacf-fr/sfrbox-api/compare/refs/tags/v0.0.10...v0.0.11
Changelog: https://github.com/hacf-fr/sfrbox-api/releases/tag/v0.0.11
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 341313 run on x86_64-linux 1

1 package failed to build:

home-assistant-component-tests.sfr_box

4 packages built:

python311Packages.sfrbox-api
python311Packages.sfrbox-api.dist
python312Packages.sfrbox-api
python312Packages.sfrbox-api.dist

Was ignored during the last Home Assistant update.


DOnt mint

I love this  Ui but i cant mint!!.. I can't find the error, pressing the button does the mint but only charges the fees and when I update the page the supply is restored

The error is known. I'll fix it as soon as possible. Stay tuned for new release


RipMe 1.7.33 doesnt download full albums.

Ripme version: 1.7.33
Java version: java version "1.8.0_161"
Java(TM) SE Runtime Environment (build 1.8.0_161-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.161-b12, mixed mode)
Operating system: Microsoft Windows [Version 10.0.16299.371]
Exact URL you were trying to rip when the problem occurred: https://www.instagram.com/m0llys/
Please include any additional information about how to reproduce the problem:

Expected Behavior
User has 173 posts. RipMe should download all.
Actual Behavior
Detail the actual (incorrect) behavior here. You can post log snippets or attach log files to your issue report.
Ripme only retrieves 16, recieves "Non-retriable status code 403 while" on 1 of them.

I can't reproduce this. Ripping https://www.instagram.com/m0llys/ with ripme 1.7.33 3 images do error out on but besides that it rips the entire album fine. You might've been rate limited by IG if you were ripping many albums

How much is "too much" then?
I retried today with another album (1200+), they all "failed to download" sadly :(

How much is "too much" then?

No idea.

I retried today with another album (1200+), they all "failed to download" sadly :(

Yea, it looks like IG is cracking down a bit

It looks like iG changed yet again

dang that's too bad! I can also confirm it fails even on smaller IG accounts...

Agreed on the slow fetch option. With one download thread but Remember URL history unchecked (at large amounts of URLs (50k+), this becomes an unintended drain on performance speed), an album of 3103 posts completed with only 2113 files downloaded due to being rate-limited by insta whilst downloading. It was the first album I had tried that day: https://www.instagram.com/jessgearyx/

Looks like it stopped working again.  Won't download more than 12 files

Same here. 12 pics and it stops. Maybe I'm being rate limited too.
Btw, right after trying ripme which stops after 12 pics, I tried the Chrome Extension - DownAlbum. It managed to download but it stops working if > 1000 images. It will timeout and you just have to wait another 30-60mins or so to continue and it will download the rest of the images.
Could someone see how is that extension implemented? Perhaps it is using a different way.

Is it this one? https://github.com/inDream/DownAlbum

Sadly still a problem in 1.7.35 :(

Can confirm still only fetching first page on some IG accounts

https://www.instagram.com/kathyzworld/
Still broken. Curiously enough, not even JDownloader is getting past the 12 images. I guess IG is cracking down on downloaders.

They seem to be rate-limiting by IP if I grab around 1000 images in a given period (an hour?). After RipMe stops, if I visit Instagram in my browser, I'll get "failed to load" when trying to scroll past the first page of an album, so it's not just a RipMe thing.
For albums <1000 images, I can just wait in between rips. Problem is with really large albums, which it seems might be impossible to finish. After grabbing the first ~1000 images, if I change IP and run RipMe again, it runs through all the previous pages first (by necessity?) which seems to be counted by the rate limiter - I'll get maybe 50 additional images before the new IP gets rate-limited as well.

Does Instagram have a restful api? Or is it just streamed always from the latest Instagram post?

If I have time, I’ll look into it; but I’m superbusy writing code at work.

AFAIK Instagram really doesn't like you using its api of you're not a legitimate app. If I remember correctly, ripme just streams the images to download.

This was fixed quite a few releases ago


Adds icon and color to action.yml

Description

Refs: #98

Before you get started

[x] I read and I followed contributing guidelines
[x] ☝ Create an issue to discuss what you are going to do

Checklist
This section should be filled in by the creator of this pull request to make sure the pull request is ready to review.

[x] This pull request has a descriptive title
[x] Code is written according to the code quality guidelines
[x] Documentation if applicable is available
[x] Tests run successfully
[ ] All checks below this pull request were successful

Instructions to review the pull request

Strange name for icon and strange color name. Are the field names correct?

Doh, swapped them


Added a new git tutorial

Added a Git and BASH tutorials for beginners.

Thanks for your suggestion! Included the link in the latest edition: https://github.com/vicoyeh/pointers-for-software-engineers/pull/61


fix: worker security group handling when worker_create_security_group=false

PR o'clock
Description
Currently when you enable create_launch_template=true on the nodegroup, it switches from using primary cluster security group to worker security group which can cause various problems.
The first work around attempted was to use cluster_primary_security_group_id as worker_security_group_id, but that caused variable cycle error.
Error: Cycle: module.eks.local.cluster_primary_security_group_id (expand), module.eks.output.cluster_primary_security_group_id (expand), module.eks.var.worker_security_group_id (expand), module.eks.local.worker_security_group_id (expand), module.eks.aws_security_group_rule.cluster_https_worker_ingress, module.eks.aws_eks_cluster.this

The second workaround was to add the primary security group as worker_additional_security_group_ids, however that causes the ALB ingress controller to fail in AWS because the ingress controller cannot work when there are multiple SG attached to the network interface.
The solution was to delete the unused worker security group, however that causes the failure on launch template creation due to the empty security group id.
This PR cleans up the security groups for launch template if theres an empty string in the list.
There was also a cluster_private_access_sg_source rule which was trying to add the worker security group when the worker security group didn't exist, which is fixed in this PR.
Checklist

[X] README.md has been updated after any changes to variables and outputs. See https://github.com/terraform-aws-modules/terraform-aws-eks/#doc-generation

Hello @barryib @max-rocket-internet , I'm hoping to get some reviews on this PR. Please let me know if I should be pinging different person or channel. Thank you for maintaining this project.

Just hit this as well as https://github.com/terraform-aws-modules/terraform-aws-eks/pull/1447. Had to fork the base repo, and everything now works beautifully. Hope this gets merged soon.

I am having the same issue and this appears to be a direct fix for the problem, would appreciate a speedy merge on this small PR.

This is the only PR preventing us to go back from fork to official module. I can confirm that the fix is actually working and battle-tested. Please, review this 😢

Hi @yafanasiev ! I will review it during this week and merge it. Sorry that it takes so long time.

I couldn't make it to work on an existing cluster created with examples/launch_templates.
Error messages are like this:
╷
│ Error: Error updating Auto Scaling Group: ValidationError: You must use a valid fully-formed launch template. Value () for parameter groupId is invalid. The value cannot be empty
│       status code: 400, request id: 00236532-0ebb-412d-9f64-289d0ff947c2
│
│   with module.eks.aws_autoscaling_group.workers_launch_template[2],
│   on ../../workers_launch_template.tf line 3, in resource "aws_autoscaling_group" "workers_launch_template":
│    3: resource "aws_autoscaling_group" "workers_launch_template" {
│
╵

Could you please try to create a cluster using examples, then apply this PR (add worker_create_security_group = false and other required inputs), and run terraform plan/apply to confirm that it works as expected.
Please update the example, if necessary.

Thanks for the review @antonbabenko .
I could confirm that just adding worker_create_security_group = false alone did not work with example/launch_templates
The required blob was
  worker_create_security_group = false
  worker_create_cluster_primary_security_group_rules = true
  worker_additional_security_group_ids = [module.eks.cluster_primary_security_group_id]

I think it makes sense because there gotta be a security group in place before the cluster to work.
I also tested with example/managed_node_groups. For this one I could just add worker_create_security_group = false and the apply ran successfully.

Thanks, @sunghospark-calm !
v17.13.0 has been just released.


Invalid yaml on PYSEC-0000-000

The yaml file added on this PR is invalid. I suspect that is causing the following erro on skjold:
Traceback (most recent call last):
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/bin/skjold", line 8, in <module>
    sys.exit(cli())
             ^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/decorators.py", line 92, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/skjold/cli.py", line 186, in audit_
    findings = audit(config, packages, ignore=ignore)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/skjold/tasks.py", line 221, in audit
    if source.has_security_advisory_for(dependency):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/skjold/sources/pypa.py", line 65, in has_security_advisory_for
    return dependency.canonical_name in self.advisories.keys()
                                        ^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/skjold/core.py", line 123, in advisories
    self.populate_from_cache()
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/skjold/sources/pypa.py", line 43, in populate_from_cache
    doc = yaml.load(obj_fh, Loader=yaml.SafeLoader)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/__init__.py", line 81, in load
    return loader.get_single_data()
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/constructor.py", line 49, in get_single_data
    node = self.get_single_node()
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/composer.py", line 36, in get_single_node
    document = self.compose_document()
               ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/composer.py", line 55, in compose_document
    node = self.compose_node(None, None)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/composer.py", line 84, in compose_node
    node = self.compose_mapping_node(anchor)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/composer.py", line 127, in compose_mapping_node
    while not self.check_event(MappingEndEvent):
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/parser.py", line 98, in check_event
    self.current_event = self.state()
                         ^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/parser.py", line 428, in parse_block_mapping_key
    if self.check_token(KeyToken):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/scanner.py", line 116, in check_token
    self.fetch_more_tokens()
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/scanner.py", line 255, in fetch_more_tokens
    return self.fetch_plain()
           ^^^^^^^^^^^^^^^^^^
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/scanner.py", line 673, in fetch_plain
    self.save_possible_simple_key()
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/scanner.py", line 307, in save_possible_simple_key
    self.remove_possible_simple_key()
  File "/home/josue.avila/.cache/pre-commit/repohxzx_my8/py_env-python3/lib/python3.11/site-packages/yaml/scanner.py", line 320, in remove_possible_simple_key
    raise ScannerError("while scanning a simple key", key.mark,
yaml.scanner.ScannerError: while scanning a simple key
  in "/home/josue.avila/.skjold/cache/pypa.cache", line 2, column 1
could not find expected ':'
  in "/home/josue.avila/.skjold/cache/pypa.cache", line 3, column 1

I'm affected by this as well, and it seems that your CI has been broken since the PR above has been merged - starting with https://github.com/pypa/advisory-database/actions/runs/6907296438/job/18794186888 AFAIS.

https://github.com/pypa/advisory-database/actions and the advisory database itself seem to be broken for a few days now, which is rather unfortunate.
Bringing this to attention of @sethmlarson, who has approved the PR above, and @pitrou, who created said PR. Do you need some help in resolving this?

Is there some utility that helps validate the pysec yaml files? When I submitted the PR I expected to see a pre-merge PR step to validate the submitted file.

@oliverchang It's nice of you to fix this (in f932749b68343a4436ef4d9a6723a8af39a5244e) but would be even better if you had referenced this issue in your commit so we can be made aware of it :)
Anyhoo, can we close this issue now?

Closed in https://github.com/pypa/advisory-database/commit/f932749b68343a4436ef4d9a6723a8af39a5244e

@oliverchang It's nice of you to fix this (in f932749) but would be even better if you had referenced this issue in your commit so we can be made aware of it :)
Anyhoo, can we close this issue now?

Yep sorry about that :) I was doing this in a rush.

Is there some utility that helps validate the pysec yaml files? When I submitted the PR I expected to see a pre-merge PR step to validate the submitted file.

We absolutely need something like this. Contributions would be very welcome.


[WIP] Git StatusBar Item

This doesn't work, probably for several reasons. The component itself shows up fine, but a call to
Oni.git.getBranch() doesn't work.

I suspect that I've done something incorrect with the promise in the getBranch() function

This looks like a great start, @bert88sta ! Nice job implementing the API. I just checked out your branch and I can see the Oni.git object that is exposed to the plugin now.
One convenient thing about the plugin API is you can actually test it in the console. Here's a gif of how I tested your API:
I figured I'd detail it out just in case it helps you - these are the steps I took:

Opened the developer console (Control+Shift+P -> Open DevTools)
The Oni plugin object is available in the console, which is really convenient - so I started by running Oni.git just to make sure that object was set up correctly.
I then made sure getBranch() was actuallyi returning a promise
I then ran Oni.git.getBranch().then((branchName) => console.log(branchName)), which logs out the result of the promise. As you can see, the branch name isn't quite what I expected (my branch is pull-507).

I don't have a lot of "debugging guides" right now but there are lots of tips and tricks that can make life easier, I need to collect them somewhere!
Looking at the code of getBranch() though, there is one problem with it - we're making a synchronous call, which will block the UI and any keyboard interactions. This kills interactive performance, and it can be nefarious if you have a bunch of these synchronous actions happening sort of intermittently (like we might need to detect if a branch changes).
I was researching this a bit, and another way we could get the branch name - that might be easier to make async - is to read from the ./git/HEAD file in the repo (using the fs.readFile API - https://nodejs.org/api/fs.html) . This is actually what vim-fugitive does to get the branch (well, read the file at least). The other nice thing about this, is that we can watch the file for changes using fs.watch: https://nodejs.org/docs/latest/api/fs.html , and figure out when the branch has changed.
Just some thoughts. I hope that helps. Great work so far! Can't wait to have my branch show up in the statusbar.

Whoa thanks for the help!
The abbrev-ref is weird, the same command run in the terminal gives me the branch name. We'll probably move over to the first line of HEAD

AH! Notice I spelled "abbrev" with one "b". It works now!
My only concern with filesystem watching is if people migrate to a different project we're going to have to use a similar git command anyway to get the root git folder. There is an async version of exec from child_process, but I keep getting errors when I try to use it... Not completely sure about that.
I'm also wondering (weloming suggestions) for what colors we should use, and how we should do status. I personally love the agnoster zsh theme for git things, but we can work on this. Hopefully I'll have some work done later today

AH! Notice I spelled "abbrev" with one "b". It works now!

Nice find! 👍

My only concern with filesystem watching is if people migrate to a different project we're going to have to use a similar git command anyway to get the root git folder. There is an async version of exec from child_process, but I keep getting errors when I try to use it... Not completely sure about that.

I think we could also look upward, recursively, to see if there is a .git folder - we wouldn't actually need to run a command. All git repos have a .git folder - so if we don't eventually find one, we're not in a git repo. In any case - whether use the file system or spawn a process - we'd want to use the async version of the APIs, so that they don't block the UI.

I'm also wondering (weloming suggestions) for what colors we should use, and how we should do status. I personally love the agnoster zsh theme for git things, but we can work on this. Hopefully I'll have some work done later today

Ya, this is a tough one - here's a quick mock-up I did:

(with the git branch slightly darker) - that's using the fa-code-fork icon, a background-color of rgb(20, 20, 20), and a foreground color of white. I think as long as it looks reasonable with the default theme it'll be cool.  When #33 comes in we can do some more interesting things 😄
Hope that helps!

I meant colors (or potentially an asterisk) for dirty and staged changes,
or anything else git related that we want oni to track. Also, the upward
search is alright, we just have to know when we're in root.
On Jul 3, 2017 5:04 PM, "extr0py"<EMAIL_ADDRESS>wrote:

AH! Notice I spelled "abbrev" with one "b". It works now!
Nice find! 👍
My only concern with filesystem watching is if people migrate to a
different project we're going to have to use a similar git command anyway
to get the root git folder. There is an async version of exec from
child_process, but I keep getting errors when I try to use it... Not
completely sure about that.
I think we could also look upward, recursively, to see if there is a .git
folder - we wouldn't actually need to run a command. All git repos have a
.git folder - so if we don't eventually find one, we're not in a git
repo. In any case - whether use the file system or spawn a process - we'd
want to use the async version of the APIs, so that they don't block the UI.
I'm also wondering (weloming suggestions) for what colors we should use,
and how we should do status. I personally love the agnoster zsh theme for
git things, but we can work on this. Hopefully I'll have some work done
later today
Ya, this is a tough one - here's a quick mock-up I did:
[image: image]
https://user-images.githubusercontent.com/13532591/27807839-525c27ac-5ff8-11e7-84d9-76ca09ac85b5.png
(with the git branch slightly darker) - that's using the fa-code-fork
http://fontawesome.io/icon/code-fork/ icon, a background-color of rgb(20,
20, 20), and a foreground color of white. I think as long as it looks
reasonable with the default theme it'll be cool. When #33
https://github.com/extr0py/oni/issues/33 comes in we can do some more
interesting things 😄
Hope that helps!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/extr0py/oni/pull/507#issuecomment-312733490, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AICBCQSozPiyJr-7mfgyIwUUdTmCJYyVks5sKVdlgaJpZM4OK7lU
.

Oh I see - sure, modelling that after the shell integration seems reasonable. We could start with just the branch and then add some things like files added/modified, files changed, etc. Modelling the coloring after some existing shell integration sounds good.

@extr0py : I can't get the exec() to work async because I'm not familiar with how callbacks (?) should work. Can you point me in what might be the right direction so I can learn?
I'm probably going to check out the file I/O option next.

For sure - just as an FYI, there is wrapper I've been using in src\Plugins\Api\Oni.ts for plugins called execNodeScript (this is specific to running node modules / javascript files though, but it uses ChildProcess.exec as well).
The tslint plugin, in vim\core\oni-plugin-tslint\lib\index.js, actually wraps the call in a promise:
        return Q.nfcall(Oni.execNodeScript, tslintPath, processArgs, { cwd: workingDirectory })
            .then((stdout, stderr) => {

                const errorOutput = stdout.join(os.EOL).trim()

                const lintErrors = JSON.parse(errorOutput)

The Q.nfcall is from the Q promise library, and converts a function that uses a callback to one that uses a promise. The (stdout, stderr) => { ... } is called when the promise is completed. This is convenient for other parts of the code because the promise gets chained.
You could also use a callback directly, like:
Oni.execNodeScript(tslintPath, processArgs, { cwd: working Directory }, (stdout, stderr) => {
// stuff that happens eventually, once the process completes - stdout would contain the output of the process
})

(Oh, and Oni.execNodeScript is just a small wrapper around exec).
Hope that helps some. The async stuff can get complicated fast, let me know if you have any more questions.

That should help a ton, the issue I was having was that I couldn't return a promise as per the interface definition

Hi! a week ago or so I started working on this as a way to get to know the code base. This is what I got:
const childProcess = require("child_process");

const activate = (Oni) => {

    const gitBranchIndicator = Oni.statusBar.createItem(1, -3);

    const getBaseDir = (filePath) => {
        return filePath.substr(0, filePath.lastIndexOf('/') + 1)
    }

    const displayBranch = (error, stdout, stderr) => {
        if (error && error.code) {
            // Branch not available
            gitBranchIndicator.hide();
        }
        else {
            const React = Oni.dependencies.React;
            const gitBranch  = React.createElement("div", null, stdout);
            gitBranchIndicator.setContents(gitBranch);
            gitBranchIndicator.show();
        }
    };

    const updateGitBranch = (filePath) => {
        childProcess.exec("cd " + getBaseDir(filePath) + " && git rev-parse --abbrev-ref HEAD", displayBranch);
    }

    Oni.on("buffer-enter", (evt) => {
        updateGitBranch(evt.bufferFullPath)
    })

};

module.exports = {
    activate,
};

It does branch per buffer, instead of per folder where oni was executed and it allows the branch to change on the fly.
The issue I found is that gitBranchIndicator.hide() does not hide the item.
PS: Note that getBaseDir() approach is naive and probably is not cross-platform.

Thanks for sharing, @Galbar ! That looks really solid and clean, I like the approach you took.

The issue I found is that gitBranchIndicator.hide() does not hide the item.

I just noticed this too while implementing #485, sorry about that. I have a fix in progress with PR #524

PS: Note that cd and getBaseDir() are probably not cross-platform.

Which platform did you test on? I can check see if it works on others. I'm glad to see you are using the async version of exec 👍

Glad you liked my approach, @extr0py!
I tested it on Linux.

Looking at this PR I see that the integration of git inside the Oni object is done in the new file  browser/src/Plugins/Api/Git.ts. Looking throughout the project I found the file  browser/src/Plugins/Api/Git.ts which also contains git functionality. To avoid duplication I think they should be bundled together for both internal and external Oni usage. What do you think, @bert88sta and @extr0py ?

I tested it on Linux.

Cool, you're right, I think this may not work in Windows - but there should be an equivalent way. Instead of using cd <dir> &&  in the exec command, you can actually pass the cwd parameter to exec to specify the current working directory - which should accomplish the same thing: https://nodejs.org/api/child_process.html#child_process_child_process_exec_command_options_callback

Looking at this PR I see that the integration of git inside the Oni object is done in the new file browser/src/Plugins/Api/Git.ts. Looking throughout the project I found the file browser/src/Plugins/Api/Git.ts which also contains git functionality. To avoid duplication I think they should be bundled together for both internal and external Oni usage.

Definitely, it would be great to move this in a common place. Long-term, I want to take a more modular approach with Oni - splitting it up into smaller, reusable chunks. Moving Git to a common place that is usable both internally and externally is in line with that.  Thanks for thinking about this!
One possibility for this reuse is putting the git functionality on the Oni plugin interface, and making the Oni instance available internally too - it's basically 90% there anyway. There's a 'global' instance of Oni defined in browser\src\Plugins\AnonymousPlugin - we could just have a cleaner way of accessing it and reuse it globally. That way, anything defined on that API is reusable both internally and externally for plugins.

I'm going to close this out and let @Galbar submit his.

I opened a merge request with the git status bar indicator #540


Add data/ assets to release packages

When performing an automatic release package upon Git tag, we should also checkout and package the data/ assets.
Reference: #600
Previous release packaging PRs:
#379
#523

I was thinking, if too much package code ends up in the AppVeyor config file, then it becomes more difficult to package a release locally. I think I like the approach taken in NAS2D, where a Package.bat file prepares the release, and the AppVeyor config calls the batch file.
One thing I didn't like about the NAS2D solution, was the batch file had a few required parameters to identify which configuration to package. I think we should have a default of "64-bit Release", in case no parameters are specified. That way a reasonable release package can be prepared by double clicking on the batch file in explorer, rather than running it from a terminal, or some other method that lets parameters be set.
There should perhaps be some distinction in how release packages are prepared. A normal build will package the executable files, and possibly prepare a separate archive for the PDB files. A release package will also include data assets. We should probably avoid packaging data assets in normal builds for size and speed reasons. This means we'll need a way of packaging that may or may not include the data assets. One possibility is to package the data assets if they are present, but otherwise skip them. I think that would work well both locally, and on the CI servers. For a release build, we can checkout the assets submodule before packaging, otherwise we package as is currently done.

Was thinking, most of the release package data will be assets. Perhaps it would make sense to have a single package with executables for all platforms, and a single copy of the data.
Of course it might get messy to intermingle a bunch of executables for different platforms into the root folder. Maybe there could be subfolders for each platform, and a combined batch file / shell script at the root which can detect the platform and run the correct executable.
It seems it is possible to use a single file that is interpreted as either a batch file or a shell script, depending on the platform. The syntax is a bit odd, but perhaps still workable.
https://stackoverflow.com/questions/17510688/single-script-to-run-in-both-windows-batch-and-linux-bash
Example:

:; echo "Hi, I’m ${SHELL}."; exit $?
@ECHO OFF
ECHO I'm %COMSPEC%

I'm hoping it would be a fairly small script to detect the platform and run the correct executable.


[Video conference] Show image preview in settings

📝 Provide a description of the new feature
It would be nice to see a preview of the image you select.
Current UX:

Something like background personalization in W10 Settings comes to mind:

If you'd like to see this feature implemented, add a 👍 reaction to this post.

We should also provide a default one, something that contains just a symbol of the camera off (so it doesn't need to be localized).

We should also provide a default one, something that contains just a symbol of the camera off (so it doesn't need to be localized).

Ah yes, easy fix. What's the resolution you need for that and where should I put it? Black background makes most sense I guess, right?

@niels9001
let's try the two most common resolutions:
1280x720 and 1920x1080
I don't know if the black background is the best, I would like to see how it looks with a dark gray.

@enricogior

Tracked in https://github.com/microsoft/PowerToys/issues/6374


Search on select box when typing on focus

I managed to fix the accessibility problem of using the keyboard arrows to move through the different options when the element is on focus by following this suggested fix.
Now, I was wondering if there's any way to directly open the select dialog box to start searching if the user has the select box on focus and they start typing.
Otherwise the process becomes a bit slower and the user has to click on the select box to open it for a search or rather click the enter button.
I managed to fix it with a bad hack so whenever the user types on a focused select box, it starts filtering through the possible options.
Reproduction online
But it would be nice to have an option for it in the plugin.
$(".select2").select2();

//on key down
$(document).keypress(keydownHandler);

function keydownHandler(e) {
    var activeSelectBox = $('.select2-container.select2-container--focus').prev('.select2');
    activeSelectBox.select2('open');

    activeChar =String.fromCharCode(e.which);
    setTimeout(function(){
    	$('.select2-container--open').find('.select2-search__field').val(activeChar);
    }, 30);
}

Now, I was wondering if there's any way to directly open the select dialog box to start searching if the user has the select box on focus and they start typing.

Sounds like a duplicate of https://github.com/select2/select2/issues/3279.


Mccalluc/install eslint

eslint was missing dependencies, but this works now for me. I'm guessing you guys had installed globally and so you were getting all the dependencies from there? To make sure I've got all the dependencies, I wanted to run it against something, but picking karma.conf.js is arbitrary.
(If eslint should have worked out of the box, then ignore this, and I can try something different to get it working locally.)

Could you merge this with the latest develop branch to make sure the tests pass?

passed locally.

Thanks! Yeah, I have eslint installed globally so that it works with SublimeText.
I like how you have it run on karma.conf.js. We can start adding other files as they get cleaned up.


Does not generate sprout addresses on macOS, Linux

Originally it was extensively tested on windows but unix system needs to have sprout specified there instead of just nothing "" eventhough its default.
Changing "" to "sprout" fixes sprout address generation but obviously break transparent address generation.
So the change might be as following

String strResponse = this.executeCommandAndGetSingleStringResponse((isZAddress ? "z_" : "") + "getnewaddress", (isZAddress ? (isSapling ? "sapling" : "sprout") : ""));

Commit that introduced the bug is attached.
https://github.com/ZECmate/ZECmate-swing-wallet/commit/674763287bb32f3b6a12fc75b0810a9c33cee633#diff-0c5fb71d087c4909b8360e0354bc00a0R527
This will be very soon reflected in upcoming version 1.0.1

Version 1.0.1 containing fix described is released.


Definition of a holding and its properties

Defining the attributes of a holding, starting fields. What else would we like to add to represent a holding?

Field
Type
Description

id
string
Unique identifier in the source system

identifiers
array of strings
Array of unique URN identifiers

name
string
Display name of the holding

dateValidFrom
ISO 8601 DateTime
The timestamp the holding details were recorded

dateValidTo
ISO 8601 DateTime
The timestamp the holding details were replaced with new details

Attributes of a block - how is it defined? what is it used for?  Activities and events are time dependent and take place on a block.

Attribute
Description

Size/area
Area of the block

Primary activity(s)
pasture, crop, orchard, forestry, wetland, riparian, vineyard, structures, pond?, native bush.

Secondary activity
grazing, supplements, runoff

Parent holding Id
The holding(s) this block belongs to

Geometry (of course)
Link or embedded information about relevant contacts - eg. owner, manager, ... What about a "primary contact"?
Area (also can be calculated) - Aggregate sum of the polygons that make up the holding. In SI units (metres).
Descriptor for the area - or a prefix; for example land area, cadastral area, etc - to add context Would Productive area be one of these?
Is this a logical or physical feature? E.g. it is an aggregation of multiple polygons.
Linkages between features - for instance, the sites related to a holding, other land management units (wetlands).

Parents and children?

Links or relationships between features of different types

Labels or types of relationships - potentially also security

Address? Or coordinates of address points for different purposes. What about a "primary address" like an address for service?
Be aware there can be multiple addresses over times, and also aliases. We might not want to have to handle all of that. Also "local addresses - navigation on site". Also "What three words".

In reference to handling different forms of addresses. Could we use a reference?
primaryContactPlace
{
type of thing
relationship
identifier
URL (link)
}

Potential attributes for a Holding feature
All the attributes of the base class (#11) plus:

Attributes
Type
Comment

totalArea
number
Total area of all polygons that form the holding, in square metres (or should we allow for different units?)

catalogURL
string
URL to retrieve a feature catalogue of all the features held by the server that are relevant to this holding.

Places (address points) and other linked entities would be dealt with by the related array in the base class.
Other feature types (e.g. sites, cadastral boundaries, tracks) would be dealt with through the feature catalogue.
Thoughts? Other attributes?


Failing github action on my fork of CUPiD

I got an alert about a failed github action and it looks like my fork is building the documentation but failing on the deploy step. Is there a way to configure the action to only deploy on NCAR/CUPiD?

Oh, yup! Can do.


Set ES document's ID to a field in the JSON property bag.

Allows for stable identification of documents.

Hi @jjonte-angieslist,
Thanks for your contribution. Please take a look at the discussion here - https://github.com/mariamhakobyan/elasticsearch-river-kafka/issues/15. I have removed the generation of id, so if you put id in your json, it should automatically be set with the current version in master.
Please test it, and if that's sufficient we can close this pull request, otherwise let me know.
Cheers,
Mariam

Fixed.


[PROCS-3757][process] Fix flaking Windows E2E test

What does this PR do?
Updates the TestManualProcessCheckWithIO Windows E2E test  to check process stats for the Datadog agent process instead of MsMpEng.exe, and re-enables the E2E test.
Motivation
Windows E2E tests for the process agent are flaking with the following occasional test failure:
        	Test:       	TestWindowsTestSuite/TestManualProcessCheckWithIO
        	Messages:   	no MsMpEng.exe process had all data populated

Consequently, this E2E test was disabled in https://github.com/DataDog/datadog-agent/pull/22743
While the flake cannot be reliably reproduced when kicking off E2E test suite runs locally, we can review the failed test suite runs. This was done for ten commits to main where the new-e2e-process test suite was failing:

https://github.com/DataDog/datadog-agent/commit/1739a048156d968bbe5fd8a1ace8e07c997d16d9
https://github.com/DataDog/datadog-agent/commit/bb938051627cb9c7d454bb380a19911f8dc8dd42
https://github.com/DataDog/datadog-agent/commit/dd5a969bb81d13fced977c35ef5e684b9a5a0338
https://github.com/DataDog/datadog-agent/commit/2adc77c907c33e4df09587713d1c5391e2266536
https://github.com/DataDog/datadog-agent/commit/62390bf7baa17c00414776a94fbe51588e461325
https://github.com/DataDog/datadog-agent/commit/7f2ff2e12c0e46dbb24ab74d02405c5e07e55334
https://github.com/DataDog/datadog-agent/commit/7d66986b2092a2bbd09bb1ceca75a1782d93a7d5
https://github.com/DataDog/datadog-agent/commit/a728fe3940e100be78464640cc392aa7f1367ad5
https://github.com/DataDog/datadog-agent/commit/dd23965c00f656739a9d33946e0c909d21ca3eb7
https://github.com/DataDog/datadog-agent/commit/5582baaf0960e16aaadfe1d774e770946cbeda6e

In every one of these reviewed test suite runs that failed, the MsMpEng.exe process did not have IO stats populated, but the Datadog agent process did. This motivates the switch to retrieving stats for the Datadog agent process, instead of MsMpEng.exe

Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes
Ran tests locally with go test ./test/new-e2e/tests/process/... -timeout 900s -run TestWindowsTestSuite -v -count=1 and validated they are passing:
    suite_utils.go:19: Resources:
            - 23 deleted

        Duration: 2m18s

    suite_utils.go:19: The resources in the stack have been deleted, but the history and configuration associated with the stack are still maintained.

--- PASS: TestWindowsTestSuite (655.13s)
    --- PASS: TestWindowsTestSuite/TestManualProcessCheck (2.12s)
    --- PASS: TestWindowsTestSuite/TestManualProcessCheckWithIO (19.77s)
    --- PASS: TestWindowsTestSuite/TestManualProcessDiscoveryCheck (12.99s)
    --- PASS: TestWindowsTestSuite/TestProcessCheck (16.91s)
    --- PASS: TestWindowsTestSuite/TestProcessCheckIO (30.02s)
    --- PASS: TestWindowsTestSuite/TestProcessDiscoveryCheck (37.90s)
PASS
ok  	github.com/DataDog/datadog-agent/test/new-e2e/tests/process	657.680s

Reviewer's Checklist

[x] If known, an appropriate milestone has been selected; otherwise the Triage milestone is set.
[ ] Use the major_change label if your change either has a major impact on the code base, is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.
[x] A release note has been added or the changelog/no-changelog label has been applied.
[x] Changed code has automated tests for its functionality.
[x] Adequate QA/testing plan information is provided. Except if the qa/skip-qa label, with required either qa/done or qa/no-code-change labels, are applied.
[x] At least one team/.. label has been applied, indicating the team(s) that should QA this change.
[ ] If applicable, docs team has been notified or an issue has been opened on the documentation repo.
[ ] If applicable, the need-change/operator and need-change/helm labels have been applied.
[ ] If applicable, the k8s/<min-version> label, indicating the lowest Kubernetes version compatible with this feature.
[ ] If applicable, the config template has been updated.

/merge

/merge

/merge


Multigrid master

Changes to support connector talking to multiple gemfire clusters.
Refactoring the code , moving the function from GemFireStore to GemFireSparkConnectorCacheImpl.
Fix for putAll failure from the connector. Looks like for client server putAll implementation used by the store module of SnappyData is equivalent to GFE8.0 & not GFE7.1. The putAllOp in store has 5 parts ( apart from key & value), while PutAll7.0 in GemFire expects only 4 parts.
The other fix was more in terms of logging, the ClientProxyMembershipID was using GfxdVersion instead of GFE version as result in GemFire cluster , the logging identified client as having unknown ordinal of 32 ( thought it was not impacting the code execution).
(Fill in the changes here)
Patch testing
(Fill in the details about how this patch was tested)
ReleaseNotes changes
(Does this change require an entry in ReleaseNotes? If yes, has it been added to it?)
Other PRs
(Does this change require changes in other projects- snappydata, spark, spark-jobserver, aqp? Add the links of PR of the other subprojects that are related to this change)

Please note that GFE ordinal 30 also matches to GFXD Ordinal, I am assuning this would not create any issue.

ok
On Fri, Jun 2, 2017 at 12:14 PM, Sumedh Wale<EMAIL_ADDRESS>wrote:

@sumwale commented on this pull request.
In gemfire-core/src/main/java/com/gemstone/gemfire/cache/
GemFireSparkConnectorCacheFactory.java
https://github.com/SnappyDataInc/snappy-store/pull/204#discussion_r119932399
:

   }

 } catch (Exception e) {

   System.out.println("Unable to get remote gfe servers from locator = " + locator);

 }

}

List prefServers = null;
if (servers.size() > 0) {

 String sparkIp = System.getenv("SPARK_LOCAL_IP");

 String hostName = null;

 try {

   hostName = sparkIp != null ? InetAddress.getByName(sparkIp).getCanonicalHostName() :

       InetAddress.getLocalHost().getCanonicalHostName();

 } catch (Exception e) {

   hostName = "";

 }

I meant in SnappyData we should override SPARK_LOCAL_IP to use Gem/GemXD
convention so that Gem P2P connections and Spark ones bind to same address
(not for this PR).
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/SnappyDataInc/snappy-store/pull/204#discussion_r119932399,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AL1zaCfbxAynR56oGHHmj9WOsYrMAv0Xks5sAF7-gaJpZM4NsTV3
.


fix: update signup.go with provider params

What kind of change does this PR introduce?
Possible typo

Might be intended


Missing dSYM files on crashes even after adding the upload script build phase in the Xcode project

Describe the bug
We have added to our projects the upload script following the steps described here: https://docs.bugsnag.com/platforms/watchos/showing-full-stacktraces/#adding-a-build-phase-manually
Despite the upload seems to work fine, it frequently happens that after receiving a crash, it's not symbolicated and in the dashboard appears the message asking us to upload the missing dSYM manually.
Following the steps in the message then the crash is correctly symbolicated.
Is there something wrong in the upload script offered in the documentation?
Environment

Xcode version: 15.4 and 16.0

Hi @luky88
For further investigation, Could you please confirm whether there are any errors or warnings while building or share the log file of your application build?
As this is a public thread, if you do not feel entirely comfortable sharing your log files here you can always reach out to us at<EMAIL_ADDRESS>and share these logs there, referencing this github issue.

Hi @clr182 thanks for the reply!
Actually looking at the build logs in Xcode the Bugsnag script seems to run properly, attached the log we got.
Let me know if you need more specific info or details.
Thanks

Hi @luky88
Thanks for following up.
Just to confirm, you are saying that you upload your dSYMs as part of your build process, using the following script, which seems to be successful: https://docs.bugsnag.com/platforms/watchos/showing-full-stacktraces/#adding-a-build-phase-manually
But you are frequently seeing events that are not being symbolicated, and you also see a message asking you to manually upload the matching dSYMs. After uploading the dSYMs manually, you then see the events are successfully symbolicated?
If this is the case, we'd like to see an example of an event that isn't being symbolicated for our further investigation. Would you please be able to share a dashboard link for one of the unsymbolicated events? If possible, please refrain from manually uploading the matching dSYM for the event until we've taken a look.
Additionally, could you let us know if you notice any trends in the events that fail to symbolicate? Is it quite random, or is it a particular set of events that fail to symbolicate?
As this is a public thread, please feel free to open a ticket with us directly by contacting<EMAIL_ADDRESS>and provide the requested information so we can look into this further.


[GLUTEN-2629][VL] Use Project + Unnest to implement Expand operator

What changes were proposed in this pull request?
As discussed in https://github.com/facebookincubator/velox/discussions/5958, we can implement the Expand operator by Project + Unnest. And no need adding new Expand operator in Velox.
How was this patch tested?
Existing unit tests

@zhli1142015  Can you help to review? Thanks.


Move licenses API docs to opendefinition.org

One of the objectives of this visual refresh is to bring the look-and-feel of https://licenses.opendefinition.org/ into line with the current OKFN branding.
There are two long-standing issues at

https://github.com/okfn/licenses/issues/45
https://github.com/okfn/opendefinition/issues/7

where moving the API documentation out of the seperate site/repo and into the main Open Definition site/repo is discussed. These issues broadly seemed to gain some approval from the community but were never really actively worked on. Now seems like a good time to revive this plan though as by far the easiest approach to updating the styling there is to move that one page of content into this repo.
As such, I've grabbed the documentation from https://github.com/okfn/licenses/blob/master/index.html and moved it over to this site (updating where appropriate) and left all the JSON/data where it is. I've also submitted a companion PR over at https://github.com/okfn/licenses/pull/93 replacing the index page on licenses.opendefinition.org with a client-side redirect to https://opendefinition.org/licenses/api/ (which doesn't exist yet, but will once this is merged).
This doesn't fully close either of the referenced issues as there was also some additional discussion there around changes to the API/data. I have not addressed these here.

LGTM. Great to see this moving forward 👏  /cc @mlinksva


Auto create tile for multiple atlases

Based on issues: #69273 #79473
And PRs: #70790 #79558

Support for auto create tiles when adding multiple atlases
Button to add Atlas can be used for multiple files
Unify functions TileSetEditor::_texture_file_selected() and TileSetEditor::_drop_data_fw() into TileSetEditor::_load_data()

Thanks for the contribution!
Why do you create 3 functions to do handle that, and store atlases as a property of the editor ? I would suggest to instead use a single function that takes an array instead, it would be simpler.

And commits needs to be squashed in order for PR to be accepted (see https://docs.godotengine.org/en/latest/contributing/workflow/pr_workflow.html).

@groud I really didn't want to store atlases as a property but I don't know how to get the array after the user accept/decline a popup.
void TileSetAtlasSourceEditor::init_source(Vector<Ref<TileSetAtlasSource>> atlases) {
	tool_setup_atlas_source_button->set_pressed(true);
	atlases_to_auto_create_tiles = atlases;
	confirm_auto_create_tiles->popup_centered();
}

_clear_auto_create_tiles() created for when the user cancel the popup.
_auto_create_tiles_in_atlas() i think that i'm going to move the logic back to _auto_create_tiles()
Can you tell me the third function? init_source() existed before to deal with the popup.
@Chaosus Thank you, I will read and do right after any adjustment from feedbacks

@groud I really didn't want to store atlases as a property but I don't know how to get the array after the user accept/decline a popup.

Ah I see what you mean. I think it's fine to do it that way then, using a property. However I would probably move the definition closer to the popup's one in the .h file, so that's it's a bit more obvious this variable is only needed for the popup.

@groud Like this?
void _auto_create_tiles();
void _auto_remove_tiles();
void _cancel_auto_create_tiles();
AcceptDialog *confirm_auto_create_tiles = nullptr;

Also I renamed _clear_auto_create_tiles() to _cancel_auto_create_tiles().

I meant something like this:
void _auto_create_tiles();
void _auto_remove_tiles();
void _cancel_auto_create_tiles();
AcceptDialog *confirm_auto_create_tiles = nullptr;
Vector<Ref<TileSetAtlasSource>> atlases_to_auto_create_tiles;

Related variables and methods close together.

@groud Sorry, fixed.
@Chaosus Squashed.

Moved the comment // Handle dropping a texture in the list of atlas resources. back to _drop_data_fw()

@groud Can you confirm if i did rebase correctly?

@AThousandShips thank you for reviewing.
Changed as requested.


Error in importing theme css

Hi,
I have used medium editor with default theme. It works well in my machine locally. But when I push my changes to staging environment (Heroku). The theme is not getting applied. and in developer console it shows 404 error when trying to download default.css file.
Then I removed .css from import statement. It is working in both local & staging environment.
I have also noticed that the last change to readme is reverse of this change.
which one is correct?
@import 'activeadmin/medium_editor/themes/default.css';
or
@import 'activeadmin/medium_editor/themes/default'; (Working for me)

@rrameshbtech the problem seems related to a bug in libsass:
https://stackoverflow.com/questions/7111610/import-regular-css-file-in-scss-file/30279590
So it should depend on the version of the sass compiler.
Are you using sassc or libsass? What version?

No more updates on this. I'm closing it


Uncaught ImportError in types.py line 37

Aider version: 0.58.1
Python version: 3.11.8
Platform: Linux-6.1.100+-x86_64-with-glibc2.38
Python implementation: CPython
Virtual environment: Yes
OS: Linux 6.1.100+ (64bit)
Git version: git version 2.42.2
An uncaught exception occurred:
Traceback (most recent call last):
  File "base_coder.py", line 1129, in send_message
    yield from self.send(messages, functions=self.functions)
  File "base_coder.py", line 1410, in send
    hash_object, completion = send_completion(
                              ^^^^^^^^^^^^^^^^
  File "sendchat.py", line 83, in send_completion
    res = litellm.completion(**kwargs)
          ^^^^^^^^^^^^^^^^^^
  File "llm.py", line 23, in __getattr__
    self._load_litellm()
  File "llm.py", line 30, in _load_litellm
    self._lazy_module = importlib.import_module("litellm")
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "__init__.py", line 9, in <module>
    from litellm.caching import Cache
  File "caching.py", line 22, in <module>
    from openai._models import BaseModel as OpenAIObject
  File "__init__.py", line 8, in <module>
    from . import types
  File "__init__.py", line 5, in <module>
    from .batch import Batch as Batch
  File "batch.py", line 7, in <module>
    from .._models import BaseModel
  File "_models.py", line 23, in <module>
    from pydantic.fields import FieldInfo
  File "fields.py", line 20, in <module>
    from . import types
  File "types.py", line 37, in <module>
    from typing_extensions import Annotated, Literal, Protocol, TypeAlias, TypeAliasType, deprecated
ImportError: cannot import name 'TypeAliasType' from 'typing_extensions' (/home/user/deep_exploit/venv/lib/python3.11/site-packages/typing_extensions.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "aider", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "main.py", line 727, in main
    coder.run()
  File "base_coder.py", line 730, in run
    self.run_one(user_message, preproc)
  File "base_coder.py", line 767, in run_one
    message = self.preproc_user_input(user_message)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "base_coder.py", line 756, in preproc_user_input
    return self.commands.run(inp)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "commands.py", line 231, in run
    return self.do_run(matching_commands[0][1:], rest_inp)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "commands.py", line 206, in do_run
    return cmd_method(args)
           ^^^^^^^^^^^^^^^^
  File "commands.py", line 983, in cmd_ask
    return self._generic_chat_command(args, "ask")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "commands.py", line 1008, in _generic_chat_command
    coder.run(user_msg)
  File "base_coder.py", line 724, in run
    self.run_one(with_message, preproc)
  File "base_coder.py", line 773, in run_one
    list(self.send_message(message))
  File "base_coder.py", line 1131, in send_message
    except retry_exceptions() as err:
           ^^^^^^^^^^^^^^^^^^
  File "sendchat.py", line 24, in retry_exceptions
    litellm.exceptions.APIConnectionError,
    ^^^^^^^^^^^^^^^^^^
  File "llm.py", line 23, in __getattr__
    self._load_litellm()
  File "llm.py", line 30, in _load_litellm
    self._lazy_module = importlib.import_module("litellm")
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "__init__.py", line 9, in <module>
    from litellm.caching import Cache
  File "caching.py", line 22, in <module>
    from openai._models import BaseModel as OpenAIObject
  File "__init__.py", line 8, in <module>
    from . import types
  File "__init__.py", line 5, in <module>
    from .batch import Batch as Batch
  File "batch.py", line 7, in <module>
    from .._models import BaseModel
  File "_models.py", line 23, in <module>
    from pydantic.fields import FieldInfo
  File "fields.py", line 20, in <module>
    from . import types
  File "types.py", line 37, in <module>
    from typing_extensions import Annotated, Literal, Protocol, TypeAlias, TypeAliasType, deprecated
ImportError: cannot import name 'TypeAliasType' from 'typing_extensions' (/home/user/deep_exploit/venv/lib/python3.11/site-packages/typing_extensions.py)

Thank you for filing this issue.
Can you please try to install or reinstall aider in a separate Python environment? Either with venv or pipx?
Please remove the existing environment/aider installation first, e.g. with pipx:
$ pipx uninstall aider-chat
uninstalled aider-chat! ✨ 🌟 ✨

$ pipx install aider-chat
  installed package aider-chat 0.58.1, installed using Python 3.12.7
  These apps are now globally available
    - aider
done! ✨ 🌟 ✨

This document may be helpful -> https://aider.chat/docs/troubleshooting/imports.html

I'm closing this issue for now.
If any new related concerns arise, please feel free to comment, and I'll reopen the issue.

Thank you for addressing this issue. its working perfectly now.