[iOS] sample-Groceries angular-start

Running on Version 9.3 (SimulatorApp-645.9) ...
> tns run ios --emulator
[...]

** BUILD SUCCEEDED **

Project successfully built.
Using  /Users/psawicki/NativeScriptProjects/sample-Groceries/platforms/ios/build/emulator/sampleGroceries.app
Starting iOS Simulator
Jun 16 14:25:33 PAV-NB-C02QT3NUG8WN sampleGroceries[6015]: 1   0x11325c -[TNSRuntime executeModule:]
Jun 16 14:25:33 PAV-NB-C02QT3NUG8WN sampleGroceries[6015]: 2   0xc503b main
Jun 16 14:25:33 PAV-NB-C02QT3NUG8WN sampleGroceries[6015]: 3   0x3d6aa25 start
Jun 16 14:25:33 PAV-NB-C02QT3NUG8WN sampleGroceries[6015]: undefined: JS ERROR Error: Could not find module './'. Computed path '/Users/psawicki/Library/Developer/CoreSimulator/Devices/EE251090-E2DD-41FD-96B4-F80F3893A530/data/Containers/Bundle/Application/C096A28A-E848-4974-BA46-5FB36327AD71/sampleGroceries.app/app'.
Jun 16 14:25:33 PAV-NB-C02QT3NUG8WN com.apple.CoreSimulator.SimDevice.EE251090-E2DD-41FD-96B4-F80F3893A530.launchd_sim[4986] (UIKitApplication:org.nativescript.groceries[0xd9e1][6015]): Service exited due to signal: Segmentation fault: 11

Hey @psawicki-project-a,
I think this might be related to the same problems you were having with Android in https://github.com/NativeScript/sample-Groceries/issues/101. Could you try this again with Node 4.x or 5.x and see if things work?

Hi @tjvantoll,
Thank you. I tried both (node 4.x and 5.x, both managed with nvm). The error remains:
Service exited due to signal: Segmentation fault: 11

I am on the angular-start branch.

@psawicki-project-a is it still a valid issue? I can not reproduce with latest angular-start and latest {N} 2.2.1.
If you still encounter it, please first try to reset your simulators ("iOS Simulator" -> "Reset Content and Settings...")


@HariKrishna598

Size/Performance Tier not showing for the Storage Account Types - Standard HDD or SSD using Azure PowerShell
Checking the Performance Tier of Azure Disks using Azure PowerShell:
Command:
$disk = Get-AzDisk -ResourceGroupName $resourceGroupName -DiskName $diskName
$disk.Tier
I have tested for the below:
Premium SSD LRS
Standard HDD LRS
Standard SSD LRS
image
Get-AzDisk cmdlet showing the Performance Tier only for Premium Disks either attached or unattached disk state but not showing for the Standard Disks.
Originally posted by @AjayBathini-MSFT in https://github.com/MicrosoftDocs/azure-docs/issues/106167#issuecomment-1455570995
Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.
ID: 5846046f-fa6a-5440-76dd-73108299a0f6
Version Independent ID: 974145a5-3d9b-76cf-2f7f-3bd3e42cfdfa
Content: Change the performance of Azure managed disks - CLI/PowerShell - Azure Virtual Machines
Content Source: articles/virtual-machines/disks-performance-tiers.md
Service: storage
Sub-service: disks
GitHub Login: @roygara Roy Garana FTE
Microsoft Alias: rogarana

@HariKrishna598
Thanks for your feedback! We will investigate and update as appropriate.

@HariKrishna598
Thank you for your feedback!
Since this issue isn't directly related to improving our docs, and to gain a better understanding of your issue, I'd recommend working closer with our support team via an [Azure support request] (https://docs.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request). Or you can leverage our Q&A forum by posting your issue there so our community, and MVPs can further assist you in troubleshooting this issue or finding potential workarounds.
[Teams Q&A forum] (https://docs.microsoft.com/en-us/answers/topics/46488/office-teams-windows-itpro.html) for technical questions about the configuration and administration of Microsoft Teams on Windows.
[Microsoft Teams Community forum] (https://answers.microsoft.com/en-us/msteams/forum?sort=LastReplyDate&dir=Desc&tab=All&status=all&mod=&modAge=&advFil=&postedAfter=&postedBefore=&threadType=All&isFilterExpanded=false&page=1)
Thank you for your time and patience throughout this issue.


AWS Organization support

Hi,
we are hitting CF limits when deploying the solution centrally and inputting the ARNs of roles for cross account access. We have 200+ accounts and expecting to have many more in some years.
It would be nice, if you could introduce AWS Organization support, e.g. like other (official) services on the list. https://docs.aws.amazon.com/organizations/latest/userguide/orgs_integrate_services_list.html
If that's not possible (b/c it's a solution, not a services), then some kind of workaround to achieve the same effect would be nice.

This is a great idea. My current workaround is a small python script in our account provisioning pipeline that grabs a list of account IDs and replaces the cross_account_roles attribute in the config item in DynamoDB.
But having done this dynamically in code during invocation would be a good idea.

Also the ability to target an OU might be useful.

I had to update the Instance Scheduler code to support pulling the account list from the organization list.
It would be great if it were part of the original code. We manage around 700 accounts now.

I had to update the Instance Scheduler code to support pulling the account list from the organization list. It would be great if it were part of the original code. We manage around 700 accounts now.

Glad to hear you were able to get something that works for you!
Support for OUs is currently on our backlog and has been made a prioritized item for our next release

@CrypticCabub  that's great to know. What is the ETA for the next release? If we can remove our custom code that would be great to simply use the Instance Scheduler solution that would be ideal 👍

We don't have any ETAs that I can share for our next release at this time. However, our on-going development is now taking place in real-time on this repo, so you can follow along with current changes/progress and are welcome to contribute via PRs as well.

Organizational support has now released with v1.5.0


update-users-groups: update hashedPassword in /etc/shadow

Description of changes
As it is right now if a user has a password hash in /etc/shadow and then a changes it via configuration. However the hash does not get updated in /etc/shadow.
This PR makes possible to update the password hash in /etc/shadow declaratively using the options hashedPassword, password and passwordFile. So whenever one of the value of these options gets updated /etc/shadow will be updated accordingly.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Isn't this going to break the mutable users option?

hmm. yes this contradicts with the mutabe users statement The initial password for a user will be set according to users.users, but existing passwords will not be changed.
But wait a minute do you think I would achieve the same by using users.mutableUsers = false;?

You should, yes, as that just replaces the shadow file each time. Not sure of the specifics of the (intended) mutable users logic off the top is my head (specifically with regards to how state tracking and the existing shadow file interact), but making your users immutable would definitely fix this.

okay thanks for input. do we know why users.mutableUsers = true; is the default? Is it just to allow user manipulation via useradd and groupadd ?

okay thanks for input. do we know why users.mutableUsers = true; is the default? Is it just to allow user manipulation via useradd and groupadd ?

My understanding is that declarative users are nice but should be a conscious decision because of how they can break a lot of stuff and nixos-rebuild switch is not necessarily going to work under broken users / groups.

Feel free to reopen if you think this should be a change, but I think users.mutableUsers = false; achieves what is desired here.


no keras history of tensor, and impossible to make it a Input

Hi all,
I am applying the paper of Semi-supervised Learning with Deep Generative models.
Here is the problem, i have a classifier, who produce a softmax probability (10 dimension vector for 10 classes), so for every class, i need to embed to onehot version vector into the decoder model. The model is a little complicated, so here i put the simply version of it.
x = Input((batch,784)) # this the mnist data input
z = encoder(x) # encoder model to produce latent variable z
c = classifier(x) # classifier to produce softmax probability for digit 0-9
onehot # this is onthot tensor with dimension of 10 by 10
for i in range(10):
f_x(i) = decoder(z, onehot(i)) # here we put different onehot into the network
then we calculate the loss for 10 different classes and total loss will be:
K.sum(c * losses)
So, we problem is for the decoder part, my input of onehot always cause problem of no keras history.
and i also try decoder(z, Input(tensor=onehot(i)) but it says graph disconnected, so can anyone help me with this problem?
Best wishes,
Chen

can anyone provide some possible way to achieve this?


"Pass-through authentication current limitations" link leads to this same article

The title says it all: "Pass-through authentication current limitations" link leads to this same article

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: eafd62b3-145a-7c93-e88d-a7fb29814a0d
Version Independent ID: 999181be-96fa-1be6-36f3-b604f43613ed
Content: Azure Active Directory Pass-through Authentication security deep dive
Content Source: articles/active-directory/hybrid/how-to-connect-pta-security-deep-dive.md
Service: active-directory
GitHub Login: @billmath
Microsoft Alias: billmath

@ermacia91 Thanks for your feedback! We will investigate and update soon on it.

@ermacia91 I have assigned this issue to the content author, @billmath , for follow-up. Thanks!

@ermacia91 We will now proceed to close this thread. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


Support for outbound PUBLISH requests (RFC3903)

This commit adds the support for SIP PUBLISH (SIP Extension for Event State Publication, as described in RFC3903). Currently, only outgoing publish requests are supported.
SIP.PublishContext
Construction
Publishers are obtained via the SIP.UA publish method.
var publisher = ua.publish(target, event, body[, options]);

Instance Attributes
event
string, event to publish
target
string|SIP.URI, request target
body
string, request body to send with publish
options
object, optional. Object with extra parameters, see below
options.extraHeaders
array, optional. Array of strings with extra SIP headers to add with publish/unpublish requests
options.contentType
string, optional. Content-Type header representing body content type. Default is 'text/plain'
options.expires
int, optional. Default expire value for the published event. If not set, default value 3600 is used
options.removeOnClose
boolean, optional. If set true, UA will gracefully unpublish for the event on UA close. Default value is true.
Instance Methods
publish([body])
publish the event state. Used for updating the current state for the event or to restore the publish after the unpublish was called. When no body provided, existing state is refreshed ( no need to do this manually, as state will be refreshed periodically on 0.9 * Expire intervals)
unpublish()
removes published event
close()
removes published event and UA internal pointer to the object
Events
published Fired for a publish request success (2xx response received on PUBLISH request)
.on('published', function (response, cause) {});

unpublished Fired for a unpublish request success or for a periodic publish refresh failure
.on('unpublished', function (response, cause) {});

progress Fired for a publish/unpublish request progress. This event indicate session progress state (1xx response received) or recovering after the 412 or 423 responses
.on('progress', function (response, cause) {});

failed Fired for a publish request failure or on a periodic publish refresh failure
.on('failed', function (response, cause) {});

Hi Jim, thank you for the feedback.
Yes,  agree with all the points,  will rewrite the module.
As the PUBLISHes are out of dialog and do not create new dialog,  I'd propose to do a PublishContext extending ClientContext ( similar to RegisterContext ) exposing publish, unpublish and close methods.
As for new exception, can add the MethodParameterError(method, parameter, value) to SIP.Exceptions module.
And,  have noticed few other things that can be done better )

Have refactored the code:

removeOnClose is now part of the options
statuses were removed as unneeded
added MethodParameterError to Exceprions.js
SIP.publish returns now instance of PublishContext
unit tests added
some internal improvements and fixes
description on the initial post updated to reflect the changes

Hey Andrew, awesome work! I was curious as to why you implemented PublishContext the way you did, having it 'wrap' ClientContext instead of extending it, which seems simpler. Functionally, it's all there though.
The other small thing is that you have a typo in the filename test/spec/SpecPublihsContext.js
Other than that, really good stuff though- thanks for taking the time to work on my feedback.

Hi Jim,
Yes, my initial intention was to extend the ClientContext.  But after reading the code got understanding that while ClientContext  is perfect to extend for constructing single SIP transaction or for constructing dialogs,  is not so convenient to use for a sequence of independent transactions. ClientContext constructor create  the initial request, passing there headers,  etc. so for the subsequent requests (they can have different body and headers) it will be needed either to redefine the request calling new SIP.OutgoingRequest, or to do low some level processing of SIP request properties  like changing Cseq, changing headers,  etc (this is how it is done in RegisterContext).
So have taken least resistance path and just added  the ClientContext as an property redefining it for for each new request. This is not ideologically correct,  I know ( and,  there are still missed onRequestTimeout onTransportError events handlers,  they need to be added there. Will add on next update)
I see the following possible options here:

make the PublishContext extending the ClientContext and managing low level SIP request details, or redefining request object itself for each new transaction
instead of wrapping or extending  ClientContext,  add the request object as a property directly to PublishContext ( as it is done in ClientContext)

Think will not be a problem to do #1 or #2.  Please share your thoughts on this.

Latest commit with the PublishContext extending ClientContext.

Hey Andrew,
looks pretty good to me- I'll let this simmer and see if anyone else in the community wants to weigh in (just in case they haven't seen in already). We're probably going to get a release together in the next few days so i'll pull it in then. Thanks again

Hi, guys.
How it use now (in version 0.20.0)?
I tried:
import { SIP } from 'sip.js'
import { PublishContext } from 'sip.js'
import { PublishClientContext } from 'sip.js' // https://sipjs.com/api/0.15.0/subscription/publishClientContext/

Always obtained error:
Module '"../../node_modules/sip.js/lib"' has no exported member 'SIP'.  TS2305
Module '"../../node_modules/sip.js/lib"' has no exported member 'PublishContext'.  TS2305
Module '"../../node_modules/sip.js/lib"' has no exported member 'PublishClientContext'.  TS2305


logFilter isn't applied to firezone-client-ipc

I was trying to debug #6290 on Linux in a VM and I couldn't seem to find where the log level is being set for the IPC service.
It might good to improve UX a little bit here:

[ ] Add "Viewing logs" section to docs -- "Logs are in /var/log/dev.firezone.client" etc
[ ] Restart client IPC when log filter changes? Related: #5634

I use the headless-client where i can for this kind of debugging. You can set the log filter via an env variable when it starts up.

It's set by the GUI, same as on Windows.
We should definitely use that tracing reloader in the IPC service though. This might be easier now that the IPC code is cleaned up and the logging code is in firezone-logging


[frontend] Add Base Images

Based on #240
Adds forms and logic to create, update and delete Base Images.
Create Base Image:
https://user-images.githubusercontent.com/26611935/218417772-beb2610b-234e-45b0-b899-b3b08c5bd88c.mp4
Update and delete Base Image:
https://user-images.githubusercontent.com/26611935/218417983-fd11b138-925c-4b96-b2c6-7d49da364354.mp4

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-80.3%) to 0.0%

Totals

Change from base Build 72a69ac6dc2a9b1897ecba915757169dad1f898b:
-80.3%

Covered Lines:
0

Relevant Lines:
0

💛  - Coveralls


Added LG Q Stylo + Mobile Phone Sensor

This phone offers fuzzy photos, so results may be poor but it does work.

yeet

@pmoulon This is ready for review

Thank you @eanbowman


Add filtering capabilities to the DAG debug endpoint

Describe the solution you'd like
As a cluster operator using Contour, I would like to be able to filter the DAG debugging output that can be obtained via the debug endpoint. In a cluster with hundreds or thousands of IngressRoutes, the DAG is impossible to understand as it currently stands.
It would be great if I could produce a DAG for a specific IngressRoute by passing filtering parameters to the /debug/dag endpoint. E.g. /debug/dag?namespace=foo,ingressroute=bar

@alexbrand if you'd like to drive this work i'd be happy to pair with you on it.

Yeah, I'd love to! I think the biggest open question here is the UX.
Another use case came up this week around capturing all the secrets that Contour is holding in its DAG. We got around it by using grep, cut, etc to filter the DAG down.
Maybe a good starting point is adding the ability to get the DAG for a specific namespace? Delegation might throw a wrench into this though.


Optimize getBlockNumber && modify default cert file name

Codecov Report

Merging #8 into release-rc2 will increase coverage by 1.00%.
The diff coverage is 94.44%.

@@                Coverage Diff                @@
##             release-rc2       #8      +/-   ##
=================================================
+ Coverage          67.98%   68.99%   +1.00%
- Complexity           141      142       +1
=================================================
  Files                 20       20
  Lines               1134     1132       -2
  Branches              79       79
=================================================
+ Hits                 771      781      +10
+ Misses               300      287      -13
- Partials              63       64       +1

Impacted Files
Coverage Δ
Complexity Δ

...a/com/webank/wecross/stub/fabric/FabricDriver.java
67.13% <80.00%> (+4.11%)
16.00 <0.00> (ø)

...m/webank/wecross/stub/fabric/FabricConnection.java
66.66% <100.00%> (+8.92%)
17.00 <4.00> (+2.00)

...k/wecross/stub/fabric/FabricConnectionFactory.java
92.95% <100.00%> (ø)
10.00 <0.00> (ø)

...ain/java/com/webank/wecross/utils/FabricUtils.java
55.17% <100.00%> (ø)
6.00 <2.00> (ø)

...va/com/webank/wecross/stub/fabric/FabricBlock.java
77.90% <0.00%> (-1.17%)
9.00% <0.00%> (-1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c2895ad...d21ce3b. Read the comment docs.


feat(linter) eslint-plugin-next google-font-preconnect

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

Current dependencies on/for this PR:

main

PR #1931

PR #1932   👈

PR #1933

PR #1934

This stack of pull requests is managed by Graphite.

Merge activity

Jan 7, 10:49 PM: @Boshen started a stack merge that includes this pull request via Graphite.


feat(docs): replace zh-TW chars with zh-CN chars

The default language is Chinese Traditional, please submit changes at https://crowdin.com/project/chinese-copywriting-guidelines


Does it support custom metrics collection?

Question:
Does it support custom metrics collection. I mean metrics beside this three sources

The kubelet summary API
The kubelet stats API
The cAdvisor metrics API

Is it possible to configure it for custom metrics or is there maybe another plugin that makes this possible?

Is there an answer to this?

Hi, unfortunately we don't support custom metrics collection.

We do not support custom metric collection


Renaming files from their tab

When a user has a file open, I would like VSC to be able to rename the file by right clicking its tab:

Pictured above: the list of features we can already do by right clicking the tab. A simple, 'Rename file' would be appreciated!

Previously requested on #90104 but failed to get enough upvotes to progress.

The file utils extension has added a rename option to the tab's context menu.

We try to keep VS Code lean and we think the functionality you're asking for is great for a VS Code extension. Maybe you can already find one that suits you in the VS Code Marketplace. Just in case, in a few simple steps you can get started writing your own extension. See also our issue reporting guidelines.
Happy Coding!


Require CMake 3.5+

According to CMake 3.27 release notes:

Compatibility with versions of CMake older than 3.5 is now deprecated and will be removed from a future version.

Thank you for the information & update!


ReferenceError: weakly-referenced object no longer exists

Hi all,
when I use pykafka producer to send some messages to kafka in idle,it always success. But when i put the code in a py file,and execute it,it failed.
Here are detailed information:
Idle:
[root@dap194 home]# python
Python 2.7.10 (default, Jan 20 2016, 14:08:19)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-4)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
 from pykafka import KafkaClient
client = KafkaClient(hosts="<IP_ADDRESS>:9092")
 topic = client.topics['mytopic']
 print topic
pykafka.topic.Topic at 0x7ff0b8532d50 (name=mytopic)
 producer = topic.get_producer()
 producer.produce('test message ')

This one is ok,the kafka had received te message.
py file:
[root@dap194 home]# python test.py
DEBUG:pykafka.connection:Connecting to <IP_ADDRESS>:9092
DEBUG:pykafka.connection:Successfully connected to <IP_ADDRESS>:9092
INFO:pykafka.handlers:RequestHandler.stop: about to flush requests queue
INFO:pykafka.cluster:Discovered 1 brokers
DEBUG:pykafka.cluster:Discovered broker id 159115: centos115:9092
DEBUG:pykafka.connection:Connecting to centos115:9092
DEBUG:pykafka.connection:Successfully connected to centos115:9092
INFO:pykafka.cluster:Discovered 3 topics
DEBUG:pykafka.cluster:Discovered topic 'mytopic'
DEBUG:pykafka.cluster:Discovered topic 'mytest'
DEBUG:pykafka.cluster:Discovered topic 'true_cloud_datapoint_topic'
DEBUG:pykafka.connection:Connecting to <IP_ADDRESS>:9092
DEBUG:pykafka.connection:Successfully connected to <IP_ADDRESS>:9092
INFO:pykafka.handlers:RequestHandler.stop: about to flush requests queue
INFO:pykafka.topic:Adding 1 partitions
DEBUG:pykafka.topic:Adding partition mytopic/0
<pykafka.topic.Topic at 0x7fbeeeceaed0 (name=mytopic)>
INFO:pykafka.producer:Starting new produce worker for broker 159115
DEBUG:pykafka.producer:Finalising <pykafka.producer.Producer at 0x7fbeeecfe610>
INFO:pykafka.producer:Blocking until all messages are sent
INFO:pykafka.handlers:RequestHandler worker: exiting cleanly
INFO:pykafka.handlers:RequestHandler worker: exiting cleanly
Exception in thread Thread-4:
Traceback (most recent call last):
  File "/usr/local/python27/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/usr/local/python27/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/usr/local/python27/lib/python2.7/site-packages/pykafka-2.1.2-py2.7.egg/pykafka/producer.py", line 441, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

It's weird that the same code,it could be executed successfully in idle,but failed when i execute it by python xxx.py.
Btw,the code in test.py is:
#!/usr/bin/python
from pykafka import KafkaClient
import logging as log
log.basicConfig(level=log.DEBUG)
client = KafkaClient(hosts="<IP_ADDRESS>:9092")
topic = client.topics['mytopic']
print topic
producer = topic.get_producer()
producer.produce('test message ')

Pykafka Version is 2.1.2
Thank you!

Thanks very much for reporting this. Your finding confirms #352 - which said I had a hunch that this kind of error would be possible. The reason it works fine in the interpreter is that there you keep the producer instance alive, whereas in the scripted run the producer may have been finalised before the worker thread gets to empty the queue.
I'll rename #352 and it will jump up the priority list now. Do feel free to add suggestions and any further information that may come to mind to #352.

@Emor93 for the very short term, if you need a work-around, the atexit-based technique mentioned here should effectively deal with the problem.

Traceback (most recent call last):
  File "/app/venv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 327, in run
    result = self._run(*self.args, **self.kwargs)
  File "/app/venv/local/lib/python2.7/site-packages/pykafka/producer.py", line 534, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists
<Greenlet at 0x7eff384d62d0: queue_reader> failed with ReferenceError

pykafka==2.4.0
gevent==1.0.1

I am getting this exception while producing data to kafka.

@BlackRider97 Thanks for the traceback. Please post the code you're using to produce with PyKafka - this is often caused by not retaining a reference to the Producer object.

I have the same problem in production.
2016-06-19 15:01:56,521 INFO MainThread pykafka.producer._wait_all:479   Blocking until all messages are sent
Exception in thread 6: pykafka.OwnedBroker.queue_reader for broker 3:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/brm_index/venv/local/lib/python2.7/site-packages/pykafka/producer.py", line 534, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

Exception in thread 7: pykafka.OwnedBroker.queue_reader for broker 2:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/brm_index/venv/local/lib/python2.7/site-packages/pykafka/producer.py", line 534, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

Exception in thread 5: pykafka.OwnedBroker.queue_reader for broker 1:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/brm_index/venv/local/lib/python2.7/site-packages/pykafka/producer.py", line 534, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

My code is something like:
from pykafka import KafkaClient

class Scheduler(object):

    def __init__(self):
        self.kafka = KafkaClient('kafka hosts', 'zookeeper hosts')
        topic = self.kafka.topics['test']
        self.producer = topic.get_producer(max_retries=5)

    def run(self):
        # messages from some database
        messages = []
        for msg in messages:
            self.producer.produce(msg.encode('utf-8'))

if __name__ == '__main__':
    scheduler = Scheduler()
    scheduler.run()

hi,can you solve this problem @emmett9001

This is a blocker for us.
I also have a very similar problem to @messense.  My code is more or less identical to his.  I wrap pykafka with my own class and hold on to references to the producer and topic.  The first time I send a piece of data, the producer/topic appears to be fine.  The second time, I have a ReferenceError: weakly-referenced object no longer exists.
What's more concerning is that I do not seem to see this problem if I step through the code -- only if I run.  That tells me there's likely a problem with the threading conditions.

These tracebacks actually look like they might be a red herring. Notice the pykafka.producer._wait_all:479   Blocking until all messages are sent preceding all weakref errors here. _wait_all is called when stop() is hit, which is called in response to another error. Can anyone on this thread give any additional information about that the error might be that's causing stop() to be called?

Here's another traceback, for what it's worth:
Exception in thread 9: pykafka.OwnedBroker.queue_reader for broker 0:
Traceback (most recent call last):
  File "/usr/local/Cellar/python/2.7.12/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/local/Cellar/python/2.7.12/Frameworks/Python.framework/Versions/2.7/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/usr/local/lib/python2.7/site-packages/pykafka/producer.py", line 534, in queue_reader
    self.producer._worker_exception = sys.exc_info()
ReferenceError: weakly-referenced object no longer exists

@brianbruggeman i have the same error

@messense At what point in your program is the exception raised? Does it happen after the program has exited, or during execution?

@emmett9001 During execution.

my pykafka version is 2.4.0 ,and what about yours?

As in #352, we've seen this issue in the past when the Producer instance gets finalized before the worker thread has had a chance to flush its queue. Is there any situation in any of the code samples given here in which the Producer instance could be finalized before all messages have been sent?

@emmett9001 Use the atexit technique works for me. Some logs:
2016-07-08 09:33:17,355 INFO MainThread pykafka.topic.<module>:40    Successfully loaded pykafka.rdkafka extension.
2016-07-08 09:33:17,536 INFO MainThread raven.base.Client.__init__:188   Raven is not configured (logging is disabled). Please see the documentation for more information.
2016-07-08 09:33:17,711 INFO Thread-3 kazoo.client._connect:575   Connecting to localhost:2181
2016-07-08 09:33:17,720 INFO Thread-3 kazoo.client._session_callback:444   Zookeeper connection established, state: CONNECTED
2016-07-08 09:33:17,735 INFO Thread-3 kazoo.client._connect_attempt:542   Closing connection to localhost:2181
2016-07-08 09:33:17,735 INFO Thread-3 kazoo.client._session_callback:448   Zookeeper session lost, state: CLOSED
2016-07-08 09:33:17,743 INFO MainThread pykafka.handlers.stop:176   RequestHandler.stop: about to flush requests queue
2016-07-08 09:33:17,743 INFO MainThread pykafka.cluster._update_brokers:338   Discovered 1 brokers
2016-07-08 09:33:17,745 INFO MainThread pykafka.cluster._update_topics:128   Discovered 25 topics
2016-07-08 09:33:17,746 INFO Thread-6 kazoo.client._connect:575   Connecting to localhost:2181
2016-07-08 09:33:17,748 INFO Thread-6 kazoo.client._session_callback:444   Zookeeper connection established, state: CONNECTED
2016-07-08 09:33:17,751 INFO Thread-6 kazoo.client._connect_attempt:542   Closing connection to localhost:2181
2016-07-08 09:33:17,751 INFO Thread-6 kazoo.client._session_callback:448   Zookeeper session lost, state: CLOSED
2016-07-08 09:33:17,755 INFO MainThread pykafka.handlers.stop:176   RequestHandler.stop: about to flush requests queue
2016-07-08 09:33:17,755 INFO MainThread pykafka.topic.update:160   Adding 5 partitions
2016-07-08 09:33:17,756 INFO MainThread pykafka.producer.start:538   Starting new produce worker for broker 0
2016-07-08 09:33:17,756 INFO MainThread urllib3.connectionpool._new_conn:214   Starting new HTTP connection (1): ovh-0300.bosondata.net
2016-07-08 09:33:18,662 INFO MainThread elasticsearch.log_request_success:63    GET http://localhost:9000/abnormal/abnormal/_search?search_type=scan&scroll=10m [status:200 request:0.906s]
No handlers could be found for logger "elasticsearch.trace"
2016-07-08 09:33:18,743 INFO 0: pykafka.RequestHandler.worker for <IP_ADDRESS>:9092 pykafka.handlers.worker:206   RequestHandler worker: exiting cleanly
2016-07-08 09:33:18,757 INFO 2: pykafka.RequestHandler.worker for <IP_ADDRESS>:9092 pykafka.handlers.worker:206   RequestHandler worker: exiting cleanly
2016-07-08 09:33:18,998 INFO MainThread elasticsearch.log_request_success:63    GET http://localhost:9000/_search/scroll?scroll=10m [status:200 request:0.334s]
2016-07-08 09:33:19,345 INFO MainThread elasticsearch.log_request_success:63    GET http://localhost:9000/_search/scroll?scroll=10m [status:200 request:0.339s]
2016-07-08 09:33:21,406 INFO Dummy-7 pykafka.producer._wait_all:479   Blocking until all messages are sent
2016-07-08 09:33:27,794 INFO 3: pykafka.OwnedBroker.queue_reader for broker 0 pykafka.producer.queue_reader:537   Worker exited for broker <IP_ADDRESS>:9092
2016-07-08 09:33:27,795 INFO Dummy-7 pykafka.producer._wait_all:479   Blocking until all messages are sent
2016-07-08 09:33:27,795 INFO Dummy-7 pykafka.handlers.stop:176   RequestHandler.stop: about to flush requests queue
2016-07-08 09:33:27,806 INFO 1: pykafka.RequestHandler.worker for <IP_ADDRESS>:9092 pykafka.handlers.worker:206   RequestHandler worker: exiting cleanly

In general if the atexit fix works, I'd still prefer to wontfix this.

@emmett9001 I added the atexit and I can confirm that this prevented my errors from popping up.  However, I now have processes hanging on exit.  Note that this is workable only because I intend the processes to run 'forever'.  But, I think there's still a bug.

@brianbruggeman If you can reliably replicate the case where the producer hands on exit, please open a fresh issue. Thanks for your contributions!

hi,could one tell me how to reslove this problem

@itgeniusshuai This is the pattern we've been directing people to


Clan/Family data not transfered to client

See Title.
-> Causes crash when client tries to assess the clan menu.

This does not cause a crash anymore, there are however two parties appearing in the "Parties" tab in the Clan Menu.

I've confirmed that it is the Clan having multiple lordPartyComponents in WarPartyComponents being the issue (fixable using RemoveWarPartyInternal)
`[CommandLineFunctionality.CommandLineArgumentFunction("remove_wpc", sTestGroupName)]
public static string RemovePartyComps(List parameters)
{
typeof(Clan).GetMethod("RemoveWarPartyInternal", BindingFlags.Instance | BindingFlags.NonPublic)
.Invoke(MobileParty.MainParty.ActualClan, new object[] { MobileParty.MainParty.ActualClan.WarPartyComponents.FirstOrDefault() });
        return "end";
    }`

I can't tell where it is being duplicated. Could it be that the WarPartyComponent from the game it loads initially following over?
There also appears to be an issue with the Clients Clan having 0 WarPartyComponents on the Server

Issue now contained in #248


Remove -q args

We don't generally use the quiet arg with pip, and pytest. This PR removes those args.

Very nice.   Without -q, reading the output of the CI can be hard to read due to the progress bars while pip is downloading packages.  A modification we made in the featuretools repo was to configure pip to not use the progress bar by running
pip config --site set global.progress_bar off

After activating the environment and before installing packages
Could you make that change as well?

Very nice. Without -q, reading the output of the CI can be hard to read due to the progress bars while pip is downloading packages. A modification we made in the featuretools repo was to configure pip to not use the progress bar by running
pip config --site set global.progress_bar off

After activating the environment and before installing packages
Could you make that change as well?

Thanks, added:
https://github.com/FeatureLabs/categorical_encoding/pull/8/files#diff-1d37e48f9ceff6d8030570cd36286a61R12


SharpZipLib "Cannot be less than zero"

Steps to reproduce
Trying to extract tar.gz file with 15 files in it and total size of tar file is 413MB
I'm trying to use the below sample code I found
public void ExtractTarGZipSample(string gzipFileName, string targetDir)
{
        Stream inStream = File.OpenRead(gzipFileName);
        Stream gzipStream = new GZipInputStream(inStream);
        TarArchive tarArchive = TarArchive.CreateInputTarArchive(gzipStream);
        tarArchive.ExtractContents(targetDir);
        tarArchive.Close();
        gzipStream.Close();
    }

Expected behavior
It should actually extract files to a destination directory from tar archive
Actual behavior
It is throwing exception
An unhandled exception of type 'System.ArgumentOutOfRangeException' occurred in Console-SampleApps.exe
Additional information: Cannot be less than zero
###Stack trace
at ICSharpCode.SharpZipLib.Tar.TarHeader.set_Size(Int64 value)
at ICSharpCode.SharpZipLib.Tar.TarHeader.ParseBuffer(Byte[] header)
at ICSharpCode.SharpZipLib.Tar.TarInputStream.GetNextEntry()
at ICSharpCode.SharpZipLib.Tar.TarArchive.ExtractContents(String destinationDirectory)
at Console_SampleApps.Program.ExtractTarGZipSample(String gzipFileName, String targetDir) in C:\Users\Projects\Console-SampleApps\Console-SampleApps\Program.cs:line 94
at Console_SampleApps.Program.Main() in C:\Users\Projects\Console-SampleApps\Console-SampleApps\Program.cs:line 58
at System.AppDomain._nExecuteAssembly(RuntimeAssembly assembly, String[] args)
at System.AppDomain.ExecuteAssembly(String assemblyFile, Evidence assemblySecurity, String[] args)
at Microsoft.VisualStudio.HostingProcess.HostProc.RunUsersAssembly()
at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
at System.Threading.ThreadHelper.ThreadStart()
Version of SharpZipLib
Obtained from (place an x between the brackets for all that apply)

I'm using v0.86.0
Package installed using:
[ ] NuGet

Could not reproduce using a sample .tar.gz and the latest version.
Either there is something in your input file or it has been fixed in the later versions (>=1.0).
I'm closing this, but if you still have the problem, try with the latest version and a simple archive that you can upload here for testing.


[Bug] chatgpt.com ignores styling on load

Describe the bug
When visiting https://chatgpt.com the defined styles are ignored until styling is toggled in extension.
The problem occurred relatively recently and probably introduced on ChatGTP side. But since the website is quite popular maybe there are some workarounds possible.
Browser
macOS, Chrome Version 128.0.6613.139 (Official Build) (x86_64)
To Reproduce

Go to https://chatgpt.com/
Customize some styling
Refresh the page

Expected behavior
Styles are applied
Screenshots

the same, Windows 11 Home, last Firefox


NIFI-13634: Accounting for conditionally populated attributes based o…

…n missing 'view the data' permissions.

Will review...


Verify cases where no leaf exists in the original in structure view

Find examples where there is no leaf (not just a missing leaf image) and verify that this renders correctly.

MS Codex 107 is missing anything in L1:
https://vceditor.library.upenn.edu/project/62825f35d3ef8000013c4b62/viewOnly
Represented by the folio number being blank:
    "Leafs": {
        "1": {
            "params": {
                "folio_number": "",
                "material": "None",
                "type": "Original",
                "attached_above": "None",
                "attached_below": "None",
                "stub": "Yes",
                "nestLevel": 1
            },
            "conjoined_leaf_order": 8,
            "parentOrder": 1,
            "rectoOrder": 1,
            "versoOrder": 1
        },

Will just show placeholder image in leaf now.


Request: GitHub Action artifact support

Since shareable URLs only last two weeks, I am now persisting my promptfoo outputs via https://github.com/actions/upload-artifact.
It would be nice to either:

Support artifacts directly in this action
Support output arg in this action
Allow promptfoo eval --output to pull from an environment variable PROMPTFOO_OUTPUT

Actually, it looks like by default this action creates an output.json: https://github.com/promptfoo/promptfoo-action/blob/v1/src/main.ts#L124
I think this issue can alternately be closed by just documenting that in the README.md (and optionally making that path configurable)


icc parameter to docker_service logic is off

https://github.com/bflad/chef-docker/blob/4e843c10f12e57e7369b26fa770cc86f166cd7ee/libraries/helpers_service.rb#L154
The default value of icc is true according to this documentation
https://docs.docker.com/reference/commandline/daemon/
I want to be able to set icc to false but doing so results in it not be adding to the parameters of the daemon.  It looks like it will only add the parameter if its true but that doesn't really matter as the default is true.
docker_service 'default' do
action [:create, :start]
log_level :info
icc false
end
Results in:
ExecStart=/usr/bin/docker daemon --log-level=info
I want:
ExecStart=/usr/bin/docker daemon --log-level=info --icc=false

thanks for reporting this

thank you so much for the quick response and release!!!  Amazing work.

https://github.com/bflad/chef-docker/pull/464/files#diff-51c36c8f820c0f1bf918f59163c3d498L154
Sorry, but this doesn't work correctly.  "if new_resource.icc" is false (in my case) and will still result in not having icc in the parameters of the command.

fixed up, conditional was incorrect because of false :cry:


ASK AI should work with open source self hosted/cloud hosted LLMs in open source pygwalker

Is your feature request related to a problem? Please describe.
I am unable to integrate or use Amazon Bedrock, Azure GPT, Gemini or my own llama 2 LLM for the ASK AI feature.
Describe the solution you'd like
Either I should have the option to remove the real state used by the ASK AI bar in the open source PyGwalker or I should be able to integrate custom LLM endpoints.

Thank you for your feedback. Currently, we do not support different llm endpoints or the option to remove the real state used by the ASK AI bar in PyGwalker. We only provide our own API for PyGwalker. While we appreciate your suggestion, we don't have plans to implement these features at the moment.

since this is open source, we can fork and edit right? could you or someone please provide guidance on which components support this feature?

@ObservedObserver Can you keep the issue open for others to submit PR on it.

Hi @rosmur @rishabh-dream11.
I will keep the issue open and welcome to make PRs. If your are interested implement it, here is how you can develop:
What ask viz does it use LLM to generate a DSL of graphic walker, the DSL's JSON schema can be found at https://graphic-walker.kanaries.net/chartinfo.json
If you connect pygwalker with custom LLM, you build a function (metas, query) => DSL, and pass it to pygwalker. We will add a func parameter for pygwalker in next release which allows you to put your customized function there.

pip install --pre --upgrade pygwalker
pygwalker already support custom ask callback function.
from typing import List, Dict, Any

# metas: [{"dragId":"gw_8ffA","fid":"work yes or not","name":"work yes or not","basename":"work yes or not","semanticType":"nominal","analyticType":"dimension"}]
# query: register count per season
# return: refer https://graphic-walker.kanaries.net/chartinfo.json
def ask_callback(metas: List[Dict[str, Any]], query: str) -> Dict[str, Any]:
    return {}

pyg.walk(df, custom_ask_callback=ask_callback)

related pr: #477


[MINOR FIX] Fix markdown header

This time using cargo-readme :)

You need make doc  (There are two README to update).

That's odd; I did run make doc. I now tried running it again but that does not seem to change anything.

Doesn't it modify the root level README?

Silly me. It did initially but somehow I did not include it in the commit. Apologies!


Variables in Kotlin: Android Basics with Compose

URL of codelab
In which task and step of the codelab can this issue be found?
Describe the problem
Eu terminei ,mas nao aparece como concluído
Steps to reproduce?

Go to...
Click on...
See error...

Versions
Android Studio version:
API version of the emulator:
Additional information
Include screenshots if they would be useful in clarifying the problem.

@SamiraCavalcanti
Obrigado por nos contactar. Verifique se você está conectado.


Replace CONSTRUCT .. WHEN with CONSTRUCT … WHERE

in parser (very simple renaming)

Branch issue2 commit: 800b43e487b0225ff4b5b4c8ecb54bbd304c9283

fixed by https://github.com/ldbc/gcore-spark/commit/3ff80fed77026da917fd9736c2c54f0effb6ca1c


Support non-rectangular images

Use a special color to detect "no color" and crop the image to the shape wanted.

Hello, Has this been resolved? I have a circular decal (sticker) I would like to show in some instructions and I cannot seem to avoid the box color.

Hi there. Unfortunately there have been no pull requests submitted for this issue yet. If someone has made a solution for it, then I will make the time to review the PR.

Fixed in latest push to master.


Hi

Is it possible for us to repair its IMEI?
If so this would be a bit more interesting.

Or if you can point me to some documentation on this part of the API, I could take a stab at implementing it.


PartialView is cahced somehow

I deployed an ASP.NET Core MVC application to my server, and hosted it in IIS. Configured binding and everything is working. Here's the problem:

I change a cshtml file
I only upload that cshtml file onto the server, inside the relevant folder
I call the public action, that returns the PartialView of that cshtml file
It's not the updated version
I delete cshtml file from server, and call that action again
It serves the file, while file is not there anymore physically
I restart IIS, again file is served
I kill dotnet.exe, again file is served
I completely remove Views folder, still file is served

It seems that ASP.NET Core MVC caches the PartialView response somehow. This is good of course for performance, but not when I want to get a fresh version. The response from IIS is 200, and there is no caching response in IIS.
What can be wrong here?

Sounds like you're shipping precompiled views. See https://docs.microsoft.com/en-us/aspnet/core/mvc/views/view-compilation?tabs=aspnetcore2x. The default behavior varies a bit depending on the version of ASP.NET Core you're running.
Do you have a *.PrecompiledViews.dll file in your apps bin folder?

No I haven't use precompiled views, and I HAVE NOT configured my project file this way:
  <ItemGroup>
    <EmbeddedResource Include="Views\**\*.cshtml" />
  </ItemGroup>

Yet for some weird reason I see a *.PrecompiledViews.dll in my obj folder, not in my bin folder.

Yeah, you're right, thought *.PrecompiledViews.dll is not in my bin folder, it's present in my published folder on my server. This is strange, because I can see that we have not configured csproj file to do the view precompilation.

What version of ASP.NET Core are you running? If you're running 2.0, precompiled views are turned on by default:

The ASP.NET Core 2.x project templates implicitly set MvcRazorCompileOnPublish to true by default, which means this node can be safely removed from the .csproj file.

If you're targeting 2.0 and have <Project Sdk="Microsoft.NET.Sdk.Web"> in the top of your project file, you're probably publishing precompiled views without knowing it.

Yet for some weird reason I see a *.PrecompiledViews.dll in my obj folder, not in my bin folder.

Yeah, you're right, thought *.PrecompiledViews.dll is not in my bin folder, it's present in my published folder on my server.

Yeah, by bin folder, I was really referring to your published application folder 😄

I'm using <PackageReference Include="Microsoft.AspNetCore.All" Version="2.0.5" /> and I do have <Project Sdk="Microsoft.NET.Sdk.Web"> at the top of my project.

@pranavkm, any suggestions here? Thanks!


Remove DCO workflow as the app is taking care of the task

Signed-off-by: Peter Zhu<EMAIL_ADDRESS>Description
Remove DCO workflow as the app is taking care of the task
Issues Resolved
List any issues this PR will resolve, e.g. Closes [...].
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #2105 (9958afc) into main (dd06256) will increase coverage by 5.76%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##               main     #2105      +/-   ##
=============================================
+ Coverage     94.23%   100.00%   +5.76%
=============================================
  Files           198         6     -192
  Lines          3902       105    -3797
  Branches         29        19      -10
=============================================
- Hits           3677       105    -3572
+ Misses          219         0     -219
+ Partials          6         0       -6

Impacted Files
Coverage Δ

src/assemble_workflow/bundle_file_location.py

src/sign_workflow/sign_artifacts.py

src/ci_workflow/ci_check_list_dist.py

...orkflow/integ_test/integ_test_runner_opensearch.py

...orkflow/ci_check_gradle_dependencies_opensearch.py

src/run_manifests.py

...rc/test_workflow/test_result/test_suite_results.py

...est_workflow/bwc_test/bwc_test_suite_opensearch.py

src/test_workflow/integ_test/integ_test_runner.py

tests/jenkins/jobs/BuildFailureMessage_Jenkinsfile

... and 182 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dd06256...9958afc. Read the comment docs.

Shall other repos follow the same? E.g https://github.com/opensearch-project/opensearch-dashboards-functional-test

Shall other repos follow the same? E.g https://github.com/opensearch-project/opensearch-dashboards-functional-test

Yes please.

Hey @reta please check this comment added on opensearch-plugin-template-java PR.
Thank you


Save process environment variables in capture file

Add some kind of a block to capture that contains the process environment variables.  E.g. "MESA_SHADER_CACHE_DIR" is an important variable for allowing Mesa to use the same cache for created graphics pipeline (compiled shaders) from run to run.  If the environment was stored in the capture file, someone could take the output of gfxrecon-info or gfxrecon-convert and pull out environment variables of interest.  This could be automated by a replayer script, maybe repurpose gfxrecon-replay-renamed.py to apply some heuristics and goop to set helpful environment variables, etc.

Is there an analog for Android?  Android has environment variables and properties - is there a subset of that data that alters driver behavior that we would like to have restored in replay in #1575?


travis-ci build status badge

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My change requires a change to the documentation.
[ ] My change relies on a pending issue/pull request
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.

Thanks @rootulp


ARTEMIS-2018 - Add bridge events to plugin API

Add callbacks to handle bridge events including beforeDeliverBridge,
afterDeliverBridge and afterAcknowledgeBridge

I like the idea of using separate interfaces and having ActiveMQServerPlugin extend them.  This way if someone doesn't care they can make it easy and just extend ActiveMQServerPlugin (as well as keep backwards compatibility) or the user can choose to pick specific interfaces for performance.

Ill merge this a bit later today if no other commenta


message options: Not visible just after sending message.

Just after sending message, its options buttons/icons are not visible. Only edit icon is visible.

After re-narrowing to same topic/stream makes options/icons visible.

ok! got it
it is due to local outbox 👍
Closing


inject struct field

Close #2

Codecov Report

Merging #5 into master will increase coverage by 0.25%.
The diff coverage is 86.36%.

@@            Coverage Diff             @@
##           master       #5      +/-   ##
==========================================
+ Coverage   88.60%   88.85%   +0.25%
==========================================
  Files          25       26       +1
  Lines         851      906      +55
==========================================
+ Hits          754      805      +51
- Misses         59       61       +2
- Partials       38       40       +2

Impacted Files
Coverage Δ

provider.go
50.00% <ø> (ø)

utils.go
54.54% <54.54%> (ø)

parameter.go
89.09% <82.60%> (-4.66%)
:arrow_down:

container.go
93.49% <100.00%> (+0.16%)
:arrow_up:

provider_ctor.go
94.36% <100.00%> (+2.05%)
:arrow_up:

provider_embed.go
93.87% <100.00%> (+8.16%)
:arrow_up:

provider_group.go
100.00% <100.00%> (ø)

provider_iface.go
100.00% <100.00%> (ø)

provider_stub.go
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9f0b148...c5f745e. Read the comment docs.

@zeromake Hi!
ResultList() is too similar to the already existing ParameterList() function. Conceptually, it should all be in one place. Since the constructor provider has information about what parameters the structure needs, it can process them correctly in the Provide() method.
ParameterList() must parse fields with the tag in the result type and return it.
Provide() must distinguish the constructor parameters from the structure parameters, and inject them accordingly.
You don't need to change the compilation process to change the behavior of the constructor provider.

@defval
It makes sense, then I expand the parameter to join returns, and then manually handle in Provide
type parameter struct {
	name     string       // string identifier
	typ      reflect.Type // resultant type
	optional bool         // optional flag
	embed    bool         // embed flag
	returns  int 	       // is return struct index + 1
}

func (c *providerConstructor) Provide(values ...reflect.Value) (reflect.Value, func(), error) {
	// handle returns
}


Partially fix Dropbox backup

This PR restore the working development environment which was broken due to changes in Parse API, Dropbox API and Google's maven repository since 2016.
Changes :

Make project compile.
Remove Parse API because they are not hosting it anymore.
Upgrade Dropbox to latest API.

What still not working :

Google sync.
Photos sync. (Format changes might need to be discuss. It's quite hard to implement)
Entries deletion. (Probably introduced in this PR.)
And maybe Analytic too.

Related :

#13
#1

Hello - I'm wondering if you can help me.  When upgrading my phone, the files in narrate did not transfer.  Some were backed up in dropbox.  However, the Narrate app does not recognize the files.  Do you have any solution?  I have a lot of info stuck in those files that I would like to be able to access.
Many thanks

@maryhbrock . Apology, I didn't see your comments. I'm afraid that there's no way I can help you recover those files in the privacy preserving way.
Closing this issue due to inactivity, and I also can't recall the content of this PR anymore.


[REGEN] breaking resource names

This PR was generated using Autosynth. :rainbow:
Synth log will be available here:
https://source.cloud.google.com/results/invocations/24e59984-764e-4ede-9be1-f042de4e3caa/targets

For new APIs we can generate parseList and toStringList. In fact we have to generate them for back-compat when a single-pattern resource becomes a multi-pattern resource.
For API migrated from gapic v1 we can't generate them, because in gapic v1 multi-pattern resources are parent classes and each resource name pattern is a subclass. Parent class and subclass cannot have methods with the same signature after type eraser, otherwise it won't compile.
List<DataSourceName> parseList(List<String> values);  // parent class
List<LocationDataSourceName> parseList(List<String> values); // child class

List<String> toStringList(List<DataSourceName> resources); // parent class
List<String> toStringList(List<LocationDataSourceName> resources); // parent class

Users can continue to use toStringList and parseList in subclasses. And the fact that generated unit tests pass can show that this API doesn't expose a repeated resource name field on the surface. (i.e. these two methods aren't really used).
Implementation: https://github.com/googleapis/protoc-java-resource-names-plugin/pull/79

@hzyi-google looks like we have clirr errors - you need to add clirr-ignore file to bypass it so that we can clear binary compatibility check.

closing due to #103 is raised. this is a dupliate PR.


on update of the Data binding in Configuration of the App page let user set the commit message

When saving the Data binding related changes, only confirmation is requested, so the change is not reflected in the history of the application updates.

App -> Configration


Broken link on page

At the bottom of the page section "Next Steps", there's a broken link on the second bullet point.
https://github.com/Azure/azure-sdk-for-net/tree/Fluent

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e990bfc8-9afd-407f-d5e1-238287bbb163
Version Independent ID: b91acd54-51f1-7cac-0f35-de0771fd06fc
Content: Azure Service Fabric Programmatic Scaling - Azure Service Fabric
Content Source: articles/service-fabric/service-fabric-cluster-programmatic-scaling.md
Service: service-fabric
GitHub Login: @mjrousos
Microsoft Alias: mikerou

Thanks for the issue, I've assigned this to the doc author to take a look.

Thanks for reporting this. The Azure SDKs have gone through a lot of changes lately. The right link for that repo now is https://github.com/Azure/azure-libraries-for-net. I'll update the docs.


Address SAM issue 551

After initial review, the implementation will be completed for all other PPA models before merging.
Goes with SAM pull request
test file
SAM_551.zip

To changes messages displayed, please edit text in common_financial.cpp line 3299 through 3321


scATAC version 2.1.2 SIGNALS error description

In the current version 2.1.2 of the scATAC analysis pipeline, some samples encounter SIGNALS errors during merging due to high memory usage.
This issue will be optimized in the next version.
The cause is that some fragments are present in a very large number of cell barcodes, leading to excessive memory consumption during computation.
The optimization direction is to filter out these positions when calculating the Jaccard index, as these positions are not genuine.

Hi Shuangshuang, thank you for the development of this tool. I see the same error while analysing scRNA-seq data using version 2.1.2. Would you recommend me to downgrade to an older version for now? Cheers, Nora

The memory error logic of scRNA should be different.
I guess it may be the oligo filtering or saturation calculation.
Can you show the error  information?
@Wenjun-Liu

@lishuangshuang0616 Sure, please see the log file attached.
20240623.txt

This error is caused by insufficient memory provided during the STAR alignment. Your sample species is human, so 50G of memory should be enough for analysis.

When I ran this on a cluster with 128 GB of RAM, the job was killed just a few mins after with the OUT_OF_MEMORY error. And the above log file was from a machine with 256 GM of RAM... Have you guys seen this happen before?

I haven't encountered this problem. Have you successfully run other samples before? It seems that after loading the genome, the alignment runs for 10 minutes and then stops because of excessive memory. Can you take a screenshot of the 01.data page?
I will provide you with a new scStar scStar.zip and then you unzip and replace the original package /home/liuwj/ws/Polo_group/users/liuwj/miniconda3/envs/dnbc4tools/lib/python3.8/site-packages/dnbc4tools/software/scStar.
I'm not sure if this helps, because I don't know the cause of the problem yet.

Here's the 01.data output. I am trying to re-run the job with the new scStar now. Thanks a lot for looking into this.


API changes and schema updates

Change to Case API Party entity. Added mobile number, e-mail and address so these can be stored as entered by the complainant. When respondent joins the case, they may enter completely different details which will be stored in the Individual service. This is for reference.
Removed uuid from the case schema since persister does not support that. Went back to using varchar(36)

@subhashini-egov the CaseCriteria for case search, should use courtId instead of JudgeId


🗄🔧 Sanic

Current Status
Codebase in progress:  https://github.com/matheuscas/realworld-starter-kit
Todo:

[x] 🏁 Fork the starter repo & post the link in this issue
[ ] 🎨 Create logo for repo & update issue status (@EricSimons)
[ ] 🔨 Implement all of Conduit's functionality per the spec & API
[ ] 👀 Move repo to main org & Peer review final codebase by admins/community (RFC)
[ ] 🎉 Tag v1 release and officially list it on the README!

Hello we are currently moving all work in progress to Github Discussions.
I'll close this issue by now, you can find instruction to open a discussion there : https://github.com/gothinkster/realworld/discussions/633
Thanks for your contribution !


Dragonmaw icon broken on multiboard

The icon specified isn't in the map so that's not too surprising!


Reduce bound input function in Interactive calls to one

Fixes #763
Most extra function calls were done inside __init__. I have added the Watcher to the watchers list if it is not already there, and if it is on the list, I unwatch it. I have a suspicion this is not the best practice and could be done more elegantly.
The change in __new__ reduces the bound function call from two to one (after the change in __init__).

I get the following warning when running the script with python file.py. The warning is only there when .hvplot is added to interactive.
import panel as pn
import hvplot.pandas  # noqa
from bokeh.sampledata import penguins

pn.extension()

df = penguins.data
w_species = pn.widgets.Select(name='Species', options=list(df['species'].unique()))
w_sex = pn.widgets.MultiSelect(name='Sex', value=['MALE'], options=['MALE', 'FEMALE'])

def load_data(species):
    """Simluate loading data from e.g a database or from a web API."""
    print('species')
    data = df.loc[df['species'] == species]
    return data

df2 = hvplot.bind(load_data, w_species)
dfi = df2.interactive()

interactive = (
    dfi
    .loc[(dfi['sex'].isin(w_sex))]
    .hvplot(kind='scatter')  # No warning if this is commented out
)

Exception ignored in: functools.partial(<function cleanup_custom_options at 0x7fd3213205e0>, 2)
Traceback (most recent call last):
  File "/home/shh/Development/holoviz/holoviews/holoviews/core/options.py", line 81, in cleanup_custom_options
Exception: Cleanup of custom options tree with id '2' failed with the following exception: 'NoneType' object has no attribute '_options_context', an unreferenced orphan tree may persist in memory.
Exception ignored in: functools.partial(<function cleanup_custom_options at 0x7fd3213205e0>, 2)
Traceback (most recent call last):
  File "/home/shh/Development/holoviz/holoviews/holoviews/core/options.py", line 81, in cleanup_custom_options
Exception: Cleanup of custom options tree with id '2' failed with the following exception: 'NoneType' object has no attribute '_options_context', an unreferenced orphan tree may persist in memory.
Exception ignored in: functools.partial(<function cleanup_custom_options at 0x7fd3213205e0>, 2)
Traceback (most recent call last):
  File "/home/shh/Development/holoviz/holoviews/holoviews/core/options.py", line 81, in cleanup_custom_options
Exception: Cleanup of custom options tree with id '2' failed with the following exception: 'NoneType' object has no attribute '_options_context', an unreferenced orphan tree may persist in memory.
Exception ignored in: functools.partial(<function cleanup_custom_options at 0x7fd3213205e0>, 2)
Traceback (most recent call last):
  File "/home/shh/Development/holoviz/holoviews/holoviews/core/options.py", line 81, in cleanup_custom_options
Exception: Cleanup of custom options tree with id '2' failed with the following exception: 'NoneType' object has no attribute '_options_context', an unreferenced orphan tree may persist in memory.

@Hoxbro this is the code snippet I've been running in a notebook and you should see that the output, here the shape of the dataframe, doesn't update with the current changes of this PR while it should:
import panel as pn
import hvplot.pandas
from bokeh.sampledata import airports

df = airports.data

def foo(max_elev):
    df = airports.data
    return df.loc[df.elevation < max_elev]

w = pn.widgets.IntSlider(value=2000, start=1000, end=3000)
dfi = hvplot.bind(foo, w).interactive()
dfi.shape

@philippjfr could you have a look at this PR? What happens is that many watchers are registered to call the input function when the input widget(s) change. This happens at this location in the code, because Interactive is cloned quite a few times when the pipeline is built:
https://github.com/holoviz/hvplot/blob/ce0f4e135e0bb0c940a5092edb6d9436377b9c70/hvplot/interactive.py#L83-L85
In general it would be great if you could add a few comments in the Interactive code, for us to better understand its methods but also its overall logic.

Hmm, yeah this one is tricky. I wonder if an easier fix is simply not to inherit the _fn when chaining the pipeline. Without diving in I'm not sure how straightforward that is however.

Superseded by https://github.com/holoviz/hvplot/pull/818


Enum for string status codes

Create an enumeration that contains the envelope and recipient status codes instead of relying upon the string codes from the server. The API should decode these values and provide an enumerated set of values.
Such as : enum EnvelopeStatus { Completed }, etc.

yes, that would certainly be useful :)


memoy leak in quadpack.h when using ctype function in nquad

So using integrate.nquad with a ctype function the memory used by my code grows eventually killing the process. Minimal example is here (tested with python3.4.1,  scipy v0.15.1, 0.16.0b2 and bb3c6b16cfdf921f9ec4c524ef67a7641442aeb7)
https://stackoverflow.com/questions/31083267/memory-ever-increasing-with-pythonctypesscipy-nquad
Running valgrind shows memory loss here:
==16835== 476,280 bytes in 19,845 blocks are definitely lost in loss record 7,053 of 7,054
==16835==    at 0x4C29BCF: malloc (in /usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so)
==16835==    by 0x1630B7BF: c_array_from_tuple (quadpack.h:135)
==16835==    by 0x1630B7BF: init_c_multivariate (quadpack.h:170)
==16835==    by 0x1630FF5F: quadpack_qagse (__quadpack.h:301)
==16835==    by 0x4F4D84D: PyEval_EvalFrameEx (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4F4CF07: PyEval_EvalFrameEx (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4F4E93E: PyEval_EvalCodeEx (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4EC0385: ??? (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4E97EA0: PyObject_Call (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4F48932: PyEval_EvalFrameEx (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4F4E93E: PyEval_EvalCodeEx (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4EC0385: ??? (in /usr/lib64/libpython3.4m.so.1.0)
==16835==    by 0x4E97EA0: PyObject_Call (in /usr/lib64/libpython3.4m.so.1.0)
At which point i don't understand cython so cant help further

@woodscn @BrianNewsom any takers for having a look at this one?

I can try to look at it, but I don't really understand valgrind, so I'll need some help unpacking what it's telling us. The good news is there is no cython involved; it's just straight C.

On Jun 30, 2015, at 3:25 PM, Ralf Gommers<EMAIL_ADDRESS>wrote:
@woodscn @BrianNewsom any takers for having a look at this one?
—
Reply to this email directly or view it on GitHub.

I think it's the malloc command in c_array_from_tuple that's causing the problem; it's never freed. Unfortunately, it doesn't appear that it's possible to declare that array on the stack. As soon as I can figure out where the free command should go, it seems like it should be a quick fix.

Only problem is, it seems like the free() command is given in the restore_c_multivariate function. @BrianNewsom any ideas here?

This part of the code looks relevant here:
https://github.com/scipy/scipy/blob/master/scipy/integrate/quadpack.h#L196
.
See also gh-4831

Sorry I dropped out for a bit. I was thinking of tackling gh-4831, and seeing if that solved this. Thoughts?

Hi, is this bug what's causing the following:
from scipy.integrate import quad
for i in range(100000):
    quad(lambda x: x**2+x, 0 , 1)

to eat memory "permanently" (until Python is closed) or that's another bug?

Never mind, I've just found #7216

This was fixed.


prevent certain characters

I'm looking for a way to ignore certain characters in the search (mainly the spacebar). In other words, the requirement is that users cannot input spaces into the search. When they do I need to cancel the key event so nothing happens (and show a message stating the problem, which then quickly fades away).
How can I accomplish this being that the <input> is not exposed?

w.e I just ended up using jquery


I really struggle with p7zip to create data for the test suite

Describe what needs to be documented.
Can we add a section to the docs that shows how to both create and decompress 7z files for the test suite in the safest and more straight forward  way?
For example:
I was helping @JustinPrivitera extract some data. We used the p7zip man pages - however when we decompressed, the option we choose d actually removed the archive, which was a surprise (luckily we already checked it in so we could recover the file).
I think we have cmake help targets built in for this, but I couldn't figure out those names b/c we have so many cmake targets -- grep didn't help me :-(.

Yikes, here is the cause of some of my confusion.
Command line args for 7za and p7zip aren't compatible.
And they aren't compatible in scary ways.
In 7za d means delete a file in the archive.
In p7zip d means decompress (and delete the archive).
Usage: 7za <command> [<switches>...] <archive_name> [<file_names>...]
<EMAIL_ADDRESS>
<Commands>
  a : Add files to archive
  b : Benchmark
  d : Delete files from archive
  e : Extract files from archive (without using directory names)
  h : Calculate hash values for files
  i : Show information about supported formats
  l : List contents of archive
  rn : Rename files in archive
  t : Test integrity of archive
  u : Update files to archive
  x : eXtract files with full paths

Usage: /usr/bin/p7zip [options] [--] [ name ... ]

Options:
    -c --stdout --to-stdout      output data to stdout
    -d --decompress --uncompress decompress file
    -f --force                   do not ask questions
    -k --keep                    keep original file
    -h --help                    print this help
    --                           treat subsequent arguments as file
                                 names, even if they start with a dash

FWIW...
% pwd
/Users/miller86/visit/visit/data
[scratlantis:~/visit/visit/data] miller86% make help
The following are some of the valid targets for this Makefile:
... all (the default if no target is provided)
... clean
... depend
... edit_cache
... 7z-more-help
... 7z-help
... list
... testdata
... expand
... archive
... rebuild_cache
... data
[scratlantis:~/visit/visit/data] miller86% make 7z-help

               Conveninent make targets:

To create an archive...
  make ANAME=<arname> AFILES=... archive

  ANAME is the name of the archive withOUT the extension (e.g .7z)
  AFILES can be a directory name, a file name, or space separated
    list of files and/or directories bracketed in quotes.

To expand a single, specific archive...
  make ANAME=<arname> expand

  ANAME is the name of the archive WITH the extension (e.g .7z)

To list contents of a single, specific archive...
  make ANAME=<arname> list

  ANAME is the name of the archive WITH the extension (e.g .7z)

Examples...
  make ANAME=silo_hdf5_test_data.7z expand
  make ANAME=silo_hdf5_test_data.7z list
  make ANAME=new_archive AFILES="*.txt" archive
  make ANAME=foodir_archive AFILES=foodir archive

To get more help on using the 7z archiver
  make 7z-more-help

Built target 7z-help
[scratlantis:~/visit/visit/data] miller86% make 7z-more-help

             More help using 7z archiver/compresser

7z (or 7-Zip) is an archiving and compression tool that replaces
the combination of tools like tar and gzip (.tar.gz or .tgz) and
often does a better job at compression. 7z supports a variety of
archival and comression file formats including .tar.gz. Here are
examples of command-lines to use 7z. Sometimes the 7z executable
is named 7za, p7zip or 7-Zip. See www.7-zip.org for more info.

creating an archive for VisIt test data
  7z a -m0=lzma2 -mx=9 <archive-file-name>.7z <file1>|<dir1>|<file2>...

expand an archive
  7z x <archive-file-name>.7z

list contents of an archive
  7z l <archive-file-name>.7z

For VisIt test data archives, we want maximal compression and this
is usually best acchived using ultra compression (-mx=9) and lzma2
algorithm (-m0=lzma2). Also, we require compression be used on any
single file or collections of related files exceeding 1Mb in size.
It is a best practice to put all related files in a directory named
<format>_test_data (e.g. vtk_test_data) where <format> is a moniker
indicating the data format and then archive that single directory.

Built target 7z-more-help

Now, currently, I think the args to whatever archiver command (7za or p7zip) are staticly set in the CMakeLists.txt file there. Given your experience, they should probably be set based on whatever the executable name actually is (or maybe some tell-tale signs in whatever --help on the executable returns.)

And, 7z is 2-3x smaller than .tar.gz so I think its really worth continuing to use.

thanks @markcmiller86.
I think most of this was the surprise about the different args between the different utils - and my use of them outside of VisIt build system.
Not a surprise one you know better, but frustrating until that discovery.
I also should have tried make help in the data dir (instead of at the root, where there are a bazillion targets)

One thing I just noticed, 7za's initial option is a <command> (e.g. list, add, delete, etc.) and those are named WITHOUT a leading dash or dash-dash. Shouldn't that mean a d as command to 7za is not the same as -d to p7zip.
Also, where does p7zip executable actually come from? I only ever see 7za when I build the p7zip tarball.

Add this to the developers manual under testing. Just list the incantations for each tool.

       -j, --bzip2
              Filter the archive through bzip2(1).

       -J, --xz
              Filter the archive through xz(1).

       --lzip Filter the archive through lzip(1).

       --lzma Filter the archive through lzma(1).

Is this what you are looking for?

Is this what you are looking for? @markcmiller86

yes. thank you. I may have found a way to pitch 7z tooling for vanilla tar.

@biagas do you wind up having to do anything strange in the way of 7z tooling on Windows to handle these archives right now? I mean, does the vanilla toolchain you have there already handle it. Do you have a tar command there? If so, can you check if that tar command supports the -J switch or xz style compressed archives or lzma2 compression algorithm?

Currently use 7-zip with VisIt just like the other platforms.  It can create tar files, but no special options available for tar that I can tell.
Are you asking about creating or reading?
WinZip can also read tar files, but afaict, won't create them.
Regular tar probably available from special command tools like GIT-bash but using that isn't part of my general work flow.

Are you asking about creating or reading?

Both. Is it fair if I find something in Windows powershell? If I drill down on this information from MicroSoft, it look like there should be a bsdtar command there that accepts the -J (--xz) option which is the main benefit that comes with using 7z.

So the creation part is for our data files, correct?  When we want to add to a current tarball or create a new one? That's a pretty rare thing, and isn't an automatic thing we do with Visit that is part of our build right?
What is wrong with using 7zip for this on Windows?  It's all by hand anyways.
As for extraction of data files, as long as the process is cmake-able and generally available, I don't have a preference.
Would the cmake command have to invoke powershell  in order to invoke the bsdtar command?
What is the ultimate goal here?

@cyrush after reading a lot more about 7z tooling, I learned that the key algorithm we use in it is lzma2 and most versions of tar now support that. Our mac system tar commands support it. LLNL CZ machines support it. @JustinPrivitera ubuntu system supports it. I am pretty sure Windows PowerShell supports it via bsdtar command. @brugger1 RHEL system supports it.
I compared all our test data files in our repo with tar -J to 7z and all of them compress about the same (a few precentage points gain or lost. There were a few cases where the size was 50% worse with tar -J. In total, for top level data dir, I got...
total uncompressed bytes =<PHONE_NUMBER>
total 7z compressed bytes =<PHONE_NUMBER>
total xz compressed bytes =<PHONE_NUMBER>

which shows tar -J is about 6% worse so hardly worth quibbling.
One key change...all our files would be .tar.xz (note the X in the extension).
Thoughts?

What is the ultimate goal here?

Eliminating 7z tooling requirements.

@markcmiller86 Here is the information from tar on Windows (available in Command and Powershell prompts):
C:\>tar /?
Usage:
  List:    tar -tf <archive-filename>
  Extract: tar -xf <archive-filename>
  Create:  tar -cf <archive-filename> [filenames...]
  Help:    tar --help

C:\>tar --help
tar(bsdtar): manipulate archive files
First option must be a mode specifier:
  -c Create  -r Add/Replace  -t List  -u Update  -x Extract
Common Options:
  -b #  Use # 512-byte records per I/O block
  -f <filename>  Location of archive (default \\.\tape0)
  -v    Verbose
  -w    Interactive
Create: tar -c [options] [<file> | <dir> | @<archive> | -C <dir> ]
  <file>, <dir>  add these items to archive
  -z, -j, -J, --lzma  Compress archive with gzip/bzip2/xz/lzma
  --format {ustar|pax|cpio|shar}  Select archive format
  --exclude <pattern>  Skip files that match pattern
  -C <dir>  Change to <dir> before processing remaining files
  @<archive>  Add entries from <archive> to output
List: tar -t [options] [<patterns>]
  <patterns>  If specified, list only entries that match
Extract: tar -x [options] [<patterns>]
  <patterns>  If specified, extract only entries that match
  -k    Keep (don't overwrite) existing files
  -m    Don't restore modification times
  -O    Write entries to stdout, don't restore to disk
  -p    Restore permissions (including ACLs, owner, file flags)
bsdtar 3.5.2 - libarchive 3.5.2 zlib/1.2.5.f-ipp

I'm definitely fine with going with the xz extension. I think the only change will be changing tar zxf to tar xf to extract the files from the tar file.

Thought I'd try to create a tarball with tar.exe on Windows, encountered problems using -J:
C:\testdata>tar -cJf silo_hdf5_test_data.xz silo_hdf5_test_data
tar: Unsupported compression option --xz

Using -j instead of -J:
tar: Can't launch external program: bzip2
Using --lzma:
tar: Unsupported compression option --lzma
Using -z works, but the generated file is much larger than the .7z version (68.4mb vs 8.25mb)
This is Windows 10 OS build 18363.2158.
I created a .tar.xz file using 7-zip, and 'tar' command couldn't extract it.

That is somewhat troubling but I don't think a showstopper. What it might mean is that we're in no better shape on Windows than before and still need 7zip there.
I spent some time trying with my Windows 10 machine. I have same issues you do there. This official post from Microsoft from two years ago says that the tar command there uses libarchive and then gives a link to a page about libarchive where xz compression is explicitly mentioned as being supported.
I have Windows 10 "Pro" and would have expected to find tar+xz there and do not. I have tar but not xz like you. We'll need to confirm compatability of tar-produced .tar.xz files with 7z tools on Windows. I will be sure to keep this on my radar as I work through this.

@biagas I am curious whether this python stuff works for you on your Windows system...
https://docs.python.org/3/library/tarfile.html

Note: Currently, GitHub doesn't support .tar.xz or .txz attachements.

Capture an xz compressed file here for testing purposes.
overlink_test_data.tar.copy.xz.gz
I am gonna see if I can decompress on windows.

Ok, I downloaded Python for Windows from Microsoft Store. That installed automagically and is visible from powershell and command prompt.
I then downloaded the above file overlink_test_data.tar.copy.xz.gz and renamed to overlink_test_data.tar.copy.xz (I added the .gz just so GitHub would allow me to attach it here. It is really an xz compressed archive.
I then ran this python script...
import tarfile
tf = tarfile.open('overlink_test_data.tar.copy.xz','r')
tf.extractall()

and it worked fine. I can't speak to performance of the decompress but it does work.

@visit-dav/visit-developers can each of you do two quick checks on your machines and report back here your findings...

run default python (3) interpreter and attempt import lzma
run python built with VisIt and import lzma

The test with import tarfile worked for me with python3 and VisIt (3.2.2) cli on kickit. For lzma test, all I did was import lzma. I assume that was all you wanted done.

I can only answer for Windows,  my linux system won't boot.
I don't have 'default' python' on Windows.
I marked my answer as per VisIt's Python on Windows.


Allow for individual checkbox to be disabled within group

Is your feature request related to a problem? Please describe.
Currently, only the disabled state can be applied via the group. That means that the whole group is either enabled or disabled.
Describe the solution you'd like
See this update to radio buttons where this allows for an individual radio-button option to be set as disabled from the group.

@jordanchang oops... my bad. I read this the wrong way. Checkboxes in a group are still individual elements and not related to each other like radio buttons are.
I can look at the element, but I am pretty sure that we support this out of the box.

Ah ha! Yup, this was supported then it was broken. Working on a fix.


Adds upgradable contracts to Aztec.

The Aztec L1 verifier is upgradable by the owner, with no apparent time delay.

The CI failure appears unrelated to this change.

Yes, it is unrelated. Coingecko API seems to be flaky. Will fix tests


Corrected example to update retention leases

Fixes #12858 with updated API method for changing the length of time a build is retained for.

@steved0x
Can you review the proposed changes? IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Sorry, just noticed another issue with this code, the Update method doesn't take an array, unlike the Add method above.

#sign-off


Steamworks Binding.

Would be awesome to have a proper binding to steamworks.

As luck would have it, this already exists, contributed by @code-disaster ! :)
Look at the https://www.lwjgl.org/download page, hit any of the three versions and observe that "steamworks4j" can be selected in the "Addons" section.

Note that though there is a "flat C API" for Steamworks, with header files which look like they are auto-generated, all Valve documentation and code samples targets the C++ API. I didn't work with the C API myself, but from what I gathered from the developer forums, it doesn't seem to be easy to handle.
Now the C++ API itself is heavy on asynchronous callbacks, which doesn't fit very well with the LWJGL model. I could see some benefits of utilising LWJGL library functions though, like MemoryStack and SharedLibraryLoader. That's something I want to look into soon'ish.


Logger changes

New Pull request for all the files created for mnist project

Please do not attempt to merge into main; create PRs to merge into your development branches


Packaging gimp

Hello,
I'm trying to package gimp. For the moment I have the problem with the intltool dependency. I don't know intltool, from what I can see it's use for the translation. If I understand right, if we get ride of intltool gimp will be only in english. Right ?
I only know some files in po directories or ending with po are used for translation. So do I have to get ride of:

all calls to intltool ?
delete po files or po directory ?

So I can know in which direction I have to investigate. I tried to package like sabotage, but it didn't work.

Does --disable-nls fix the issue? I'd need to see exact terminal output from the build to help any further.

  You need intltool 0.40.1 or later.

This looks to me like broken nls (gettext, intltool etc) detection.

I deleted a lot of lines in configure and I was able to get ride of this problem I think. Is it possible, that the problem is here ?
######################
# Internationalisation
######################

  { $as_echo "$as_me:${as_lineno-$LINENO}: checking whether NLS is requested" >&5
$as_echo_n "checking whether NLS is requested... " >&6; }
    # Check whether --enable-nls was given.
if test "${enable_nls+set}" = set; then :
  enableval=$enable_nls; USE_NLS=$enableval
else
  USE_NLS=yes
fi

  { $as_echo "$as_me:${as_lineno-$LINENO}: result: $USE_NLS" >&5
$as_echo "$USE_NLS" >&6; }

case "$am__api_version" in
    1.01234)
        as_fn_error $? "Automake 1.5 or newer is required to use intltool" "$LINENO" 5
    ;;
    *)
    ;;
esac

INTLTOOL_REQUIRED_VERSION_AS_INT=`echo 0.40.1 | awk -F. '{ print $ 1 * 1000 + $ 2 * 100 + $ 3; }'`
INTLTOOL_APPLIED_VERSION=`intltool-update --version | head -1 | cut -d" " -f3`
INTLTOOL_APPLIED_VERSION_AS_INT=`echo $INTLTOOL_APPLIED_VERSION | awk -F. '{ print $ 1 * 1000 + $ 2 * 100 + $ 3; }'`
if test -n "0.40.1"; then
    { $as_echo "$as_me:${as_lineno-$LINENO}: checking for intltool >= 0.40.1" >&5
$as_echo_n "checking for intltool >= 0.40.1... " >&6; }
    { $as_echo "$as_me:${as_lineno-$LINENO}: result: $INTLTOOL_APPLIED_VERSION found" >&5
$as_echo "$INTLTOOL_APPLIED_VERSION found" >&6; }
    test "$INTLTOOL_APPLIED_VERSION_AS_INT" -ge "$INTLTOOL_REQUIRED_VERSION_AS_INT" ||
        as_fn_error $? "Your intltool is too old.  You need intltool 0.40.1 or later." "$LINENO" 5
fi

I'm not sure, but it seems nls is not taken into account, the version of intltool is checked. I will try to patch it and then to build it.

Packaging for Gimp done! Now I have to check my builds before creatings some pull requests.

@Vouivre Did you ever upload the package files anywhere specifically the patch? I am having no luck getting gimp to compile.

Hello, now it's done: https://github.com/Vouivre/kiss-repository/tree/master/packages
Keep in mind the following:

I forgot perhaps to upload some dependencies which are not packaged for Kiss
I can't submit it on community. You will have to manually install some dependencies, because I didn't check the depends file
I don't have the latest version, it's 2.10.14
I removed glib-networking. Now it's packaged in KISS, but as I understood it, it's only for the documentation, so I don't need it.
at start, there will be an error. If I remember correctly, a plugin can't be load (pagecurl or something else). Just delete it.

Just tell me if you are interested to test my package when it will be done. But for the moment I don't have enough time.
I let you open an issue in my repository if it doesn't work for you.


[CARBONDATA-1597] Remove spark1 integration

As voted by community, spark version 1 integration can be removed.
This PR removes following profiles and module for spark version 1 integration

spark-1.5 profile
spark-1.6 profile
example/spark module
integration/spark module

Build Failed with Spark 1.6, Please check CI http://<IP_ADDRESS>:8080/job/ApacheCarbonPRBuilder/361/

SDV Build Success , Please check CI http://<IP_ADDRESS>:8080/job/ApacheSDVTests/1114/

LGTM

LGTM


Fix bot

This fixes our packet autoupdater

Deploy preview for landscape ready!
Built with commit fc5d3c82888638419cb074e58147c9cac71b3b39
https://deploy-preview-443--landscape.netlify.com


External images with imgix / s3

Hello - I'm setting up my site using Imager and imgix, and everything is working fine except for external images.
My section has an asset field that uploads to an S3 bucket, which is the source for imgix. The field accepts both images and Embedded Assets.  All of the images are rendering via imgix and working perfectly, but images from embedded assets (youtube videos in this case) fail to render.
My assumption was that the external images would be pushed to the S3 '/transforms/' directory and be displayed via imgix - but I'm not seeing anything show up there or in the local '@webroot/transforms/' directory.
I'm sure this is a config error or misunderstanding of how things should work on my part, but would appreciate any assistance.  Thank you!
Here's my config:
'transformer' => 'imgix',
'cacheEnabled' => false,
'cacheRemoteFiles' => false,
'imagerSystemPath' => '@webroot/transforms/',
'imagerUrl' => 'https://mybucket.s3.us-east-2.amazonaws.com/transforms',
'storages' => ['aws'],
'storageConfig' => [
'aws'  => [
'accessKey' => 'mykey',
'secretAccessKey' => 'mysecret',
'region' => 'us-east-2',
'bucket' => 'mybucket',
'folder' => 'transforms',
'requestHeaders' => array(),
'storageType' => 'standard',
'cloudfrontInvalidateEnabled' => false,
'cloudfrontDistributionId' => '',
]
],
'imgixApiKey' => 'myimgixkey',
'imgixConfig' => [
'default' => [
'domains' => ['myresource.imgix.net'],
'useHttps' => true,
'signKey' => '',
'sourceIsWebProxy' => false,
'useCloudSourcePath' => true,
'getExternalImageDimensions' => true,
'defaultParams' => ['auto'=>'compress,format', 'cs'=>'srgb', 'q'=>80],
]
]

As a follow up, when I switch to 'transformer' => 'craft' in the config file (keeping everything else the same) it works as expected - all srcset images for the embedded assets are created locally in /web/transforms, then uploaded and served from the S3 transforms directory.

Hi,
Just a heads up that Imager is no longer maintained and supported, if you want support you need to use Imager X, which is a commercial option. Generally, I'll not respond to issue in here anymore (I'll make an issues-template which states so), anyways, here's a quick take on your issue...
First of all, if you use Imgix, external storages (ie AWS) is not relevant. External storages is just a way to upload a transformed file to a cloud service, and serve it from there. With Imgix, there's no files being created, all Imager does is make an Imgix-URL based on their URL-API, and return that URL. Imgix will then handle the transform and serving of that file.
I've not used Embedded Assets, but know that what it stores for each asset, is a JSON-file containing the necessary information (a pretty elegant solution, imho). So, in your S3 bucket there will be JSON-files, and if Imgix tries to pull one from it, it will have no idea what to do with it. It's a JSON file, not an image.
I have no idea what happens if you do {{ myEmbeddedAsset.getUrl() }}, but from the sound of it, I'm guessing that it actually drills down into the JSON and returns an URL to an external image associated with the asset. What happens when you switch to 'transformer' => 'craft' is that Imager will automatically treat normal assets as normal assets, and embedded assets as external images. Imager can do this transparently, but Imgix can't. The only way you can transform external images with Imgix, is to use a web proxy source (that's a different kind of source that you can create in Imgix). Web proxy sources can transform images by URL from wherever.
So I think your options are:

Create a web proxy source in Imgix, instead of the one you've got. Configure it as such in Imager, and all assets will be passed to Imgix as URLs, and (hopefully) everything will just work.

Create a new web proxy source in Imgix in addition to the one you've got. Configure it as a separate profile in Imager, and then in your templates dynamically set imgixProfile depending on whether or not you're transforming an embedded asset or not (not sure how you detect that).

Both should work. I usually prefer the second option, because passing all assets by URL, creates very big srcsets, which blows up you markup and template cache db tables. But, option 1 is easier.
So yeah, without knowing anything about Embedded Assets, that's my guess.
Hope you'll migrate to Imager X. :)

Hello! Thank you very much for the detailed explanation, I took your advice and am now up and running with the second option you suggested.
Again, really appreciate you taking the time to respond so thoroughly - I will definitely be buying a license for ImagerX Pro!


[docker] resotoshell container should mount a local directory as download directory

Description
Using the docker setup it is not easy to get access to the download directory.
The default compose should mount a local directory for the shell server and use this as download directory for resh.
Version
2.5.0
Environment
No response
Steps to Reproduce

docker compose up
docker exec -it resotoshell resh
search all limit 1 | write foo
File foo is written to the resotoshell container.

Logs
No response
Additional Context
No response

Fixed via #1243


Broken semantic search scoring link

@pwoznic https://docs.vectara.com/docs/common-use-cases/semantic-search/semantic-search-scoring is a broken link. Unfortunately it's also a Google search result for "vectara docs tuning".
Can we do an RCA to figure out how this link broken and if any other links were broken by the same root cause?

I think Google has not yet indexed the new URLs from the IA revamp. I'm wondering if we can just update the redirects to include old links.

Was "https://docs.vectara.com/docs/common-use-cases/semantic-search/semantic-search-scoring" a working URL before the IA revamp?

I'm wondering if we can just update the redirects to include old links.

👍 I think we should use the redirects to ensure all links that Google is sending people to, resolve to useful pages.

@pwoznic Thanks for fixing this via https://github.com/vectara/vectara-docs/pull/135#event-10815883413! Do we know what caused the broken link? Was it due to a recent change or has this been a broken link for awhile?

@pwoznic Thanks for fixing this via #135 (comment)! Do we know what caused the broken link? Was it due to a recent change or has this been a broken link for a while?

It was due to the IA change and some topics were moved around and/or renamed. Google still referenced the old topic in its search results. I went through a G search testing out each topic and then updated several references with redirects once I got errors. Let me know if you find others. Also, I can update the comment on 135 if you want me to close this one (wanted to wait). :)

Awesome! Thanks for the resolution. I think we can close this.


switch is not switch

https://github.com/brennerm/PyTricks/blob/master/switch.py -
This is not fallthrough as you can expect from switch-case statement ^^"

Thanks :)
Added handling if key is not in dict.

Still not switch :)
https://en.wikipedia.org/wiki/Switch_statement#Fallthrough

Do you see any way to add this functionality in a pythonic way?

@yammesicka
From what I can find Python's switch case statement doesn't support fallthrough.

There are no switch case in Python as far as I know
On Mar 23, 2015 12:28 PM, "Max Brenner"<EMAIL_ADDRESS>wrote:

@yammesicka https://github.com/yammesicka
From what I can find Python's switch case statement doesn't support
fallthrough.
—
Reply to this email directly or view it on GitHub
https://github.com/brennerm/PyTricks/issues/20#issuecomment-84936075.

Damn you're right :D.
That's the problem switching between different languages frequently ;)

updated file