App downloads too many of my contributions, without reason

Summary
Even without scrolling down, the app seems to download the metadata of hundreds of my past contributions.
This wastes network data, storage space, and seems to be the root cause of a "Davey" latency problem.
Steps to reproduce

Install the app with an account that has hundreds of uploads (tip)
Start the app
Launch adb logcat
Log in inside the app, do nothing else in the app
Just watch downloads of metadata in logcat

Expected behaviour
Downloads of contributions should stop after a page or two
Actual behaviour
The app continues loading hundreds of contributions
Device name
No response
Android version
Any
Commons app version
Master
Device logs
No response
Screen-shots
No response
Would you like to work on the issue?
Prefer not

@nicolas-raoul  So we want something like lazy loading (pagination)? As we scroll down, more data should be loaded right?
I would like to work on this issue

Hmm, it looks like when we introduced lazy loading, we only introduced it for the images but not the metadata. So I think we would need to download the data at the appropriate time (when the image is downloaded), not all at the start.

@misaochan : I wrote metadata, but I am not too sure what transits. I just see a packet per picture, at a very fast pace (more than 1 request per second), and that seems to never stop.
@devarsh-mavani-19 : Thanks! Better use prod for this issue as it is not about writing. Do you have an account with hundreds of contributions? If not, see the tip above :-)

@nicolas-raoul no I don't have account with hundreds of contribution.

@devarsh-mavani-19 Please send me an email as tipped at https://github.com/commons-app/apps-android-commons/issues/4359#issuecomment-820904731 thanks!

@devarsh-mavani-19 Please send me an email as tipped at #4359 (comment) thanks!

sorry for the delay. sent you an email


[SUPPORT] MultiWriter w/ DynamoDB - Unable to acquire lock, lock object null

Hello,
I'm currently trying the multiwriter feature using the dynamoDB lock.
I followed all the steps documented on the https://hudi.apache.org/docs/concurrency_control/ and also the hoodie.write.lock.dynamodb.billing_mode=PAY_PER_REQUEST config, thanks to @bhasudha advice on slack.
After that i ended with the following error: org.apache.hudi.exception.HoodieLockException: Unable to acquire lock, lock object null
This error happens when trying to write in a existing Hudi table.
Since there is no details on how the DynamoDB table must me created on the documentation, i created one simple DynamoDB with a String field like partition.
On slack, there is also other users with the same problem, also AWS Glue users
Environment Description

Hudi version : 0.10
Spark version : AWS Glue 2.0
Storage (HDFS/S3/GCS..) : S3

Stacktrace
Caused by: org.apache.hudi.exception.HoodieException: Unable to acquire lock, lock object null
at org.apache.hudi.internal.DataSourceInternalWriterHelper.commit(DataSourceInternalWriterHelper.java:86)
at org.apache.hudi.spark3.internal.HoodieDataSourceInternalBatchWrite.commit(HoodieDataSourceInternalBatchWrite.java:93)
at org.apache.spark.sql.execution.datasources.v2.V2TableWriteExec.writeWithV2(WriteToDataSourceV2Exec.scala:371)
... 69 more
Caused by: org.apache.hudi.exception.HoodieLockException: Unable to acquire lock, lock object null
at org.apache.hudi.client.transaction.lock.LockManager.lock(LockManager.java:82)
at org.apache.hudi.client.transaction.TransactionManager.beginTransaction(TransactionManager.java:64)
at org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:186)
at org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:171)
at org.apache.hudi.internal.DataSourceInternalWriterHelper.commit(DataSourceInternalWriterHelper.java:83)
... 71 more

@zhedoubushishi : Can you take a look at this issue please?

Can you provide the code you used? And how you create the Dynamodb table?

@nochimow : a gentle reminder to respond to above question. above commentor is a Hoodie committer who added dynamoDB lock provider. So, he should be able to help in your case.

Hi there, my code basically reads some avro file into a dataframe then we write this dataframe into a hudi table.
I'm using the following hudi confs during the write. (It's a python on AWS Glue 3.0)
oodie.datasource.write.keygenerator.class": "org.apache.hudi.keygen.ComplexKeyGenerator",
oodie.datasource.write.payload.class": "org.apache.hudi.common.model.DefaultHoodieRecordPayload",
hoodie.datasource.hive_sync.partition_extractor_class": "org.apache.hudi.hive.MultiPartKeysValueExtractor",
hoodie.table.name": table_name,
hoodie.datasource.write.recordkey.field": IDX_COL,
hoodie.datasource.write.partitionpath.field": pks,
hoodie.datasource.write.hive_style_partitioning": "true",
hoodie.datasource.write.precombine.field": tiebreaker,
hoodie.datasource.write.operation": operation,
hoodie.write.lock.provider=org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider
hoodie.write.lock.dynamodb.table
hoodie.write.lock.dynamodb.partition_key
hoodie.write.lock.dynamodb.region
hoodie.write.lock.dynamodb.billing_mode=PAY_PER_REQUEST
My dynamodb is a simple table with just the partition_key field as a string. There is any recommendation on how the dynamodb structure have to be?

@zhedoubushishi : When you get a chance, can you please follow up.

Sorry for the late reply, if you set hoodie.write.lock.dynamodb.table as a table that not exist, it would just create one and set the structure automatically. Or do you have to create the dynamodb lock table by yourself?

I am facing same issue, created a dynamo DB table with a single column as per below config where dynamo DB table and partition key is being passed when writing the data.
So are you suggesting just passing the table name and it will be created and we don't have to specify partition key
#'hoodie.write.concurrency.mode' : 'optimistic_concurrency_control',
#'hoodie.cleaner.policy.failed.writes' : 'LAZY',
##'hoodie.write.lock.provider' : 'org.apache.hudi.hive.HiveMetastoreBasedLockProvider',
#'hoodie.write.lock.provider' : 'org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider',
    #'hoodie.write.lock.hivemetastore.database' : 'test_db',
    #'hoodie.write.lock.hivemetastore.table' : new_table_name,
    #'hoodie.write.lock.dynamodb.table' : 'dynamo_db_table',
    #'hoodie.write.lock.dynamodb.partition_key' : 'tablename',
    #'hoodie.write.lock.dynamodb.region' : 'eu-central-1',
    #'hoodie.write.lock.dynamodb.billing_mode' : 'PAY_PER_REQUEST',

@zhedoubushishi : Can you follow up here please and help unblock the user.

I couldn't reproduce this issue, this is the config I used:
.option("hoodie.write.concurrency.mode", "optimistic_concurrency_control")
 .option("hoodie.cleaner.policy.failed.writes", "LAZY")
 .option("hoodie.write.lock.provider", "org.apache.hudi.aws.transaction.lock.DynamoDBBasedLockProvider")
 .option("hoodie.write.lock.dynamodb.table", "hudi")
 .option("hoodie.write.lock.dynamodb.partition_key", tableName)
.option("hoodie.write.lock.dynamodb.endpoint_url", "dynamodb.us-west-2.amazonaws.com")
 .option("hoodie.write.lock.dynamodb.region", "us-west-2")

Since i had to rollback to Hudi 0.9 due the Redshift Spectrum incompatibility i cannot track this issue anymore. @mainamit can you follow up this issue since you also face the same issue?

@mainamit : let us know if you were able to get it working. Feel free to close out the github issue. If you are still facing the issue, do ping w/ more details. Wenning should be able to assist you.

@mainamit : do you have any updates for us.

@nsivabalan I am also using 0.9 now and done a workaround of loading this data in sequential. If you have a working example of this it would be great, but I cannot test with 0.10 due to constraints at my end.

@mainamit : do you see any discrepancy in your configs wrt what @zhedoubushishi  have provided above. Can you post your write configs you use for lock configurations.

thanks! closing this for now. please reach out if you are looking for any more assistance.

Hello @nsivabalan  @zhedoubushishi ,
I am facing same exception[Unable to acquire lock, lock object null]
We don't need to create a dynamodb table ahead ? will hudi create a DynamoDB automatically?
Pls confirm


Support uploading configsets through the operator

Is your feature request related to a problem? Please describe.
I'd like to be able to apply a configset to a solr cluster managed through the operator.
Describe the solution you'd like
I could write a yaml file to define a configset.
Describe alternatives you've considered
Currently the only alternatives are to either build the image with the configsets or to upload one through the API before creating the configsets.

Currently the only alternatives are to either build the image with the configsets or to upload one through the API before creating the configsets.

@whitleykeith Did you mean [...] or to upload one through the API before creating the collections?
Is so, I'm wondering how to upload the configset between the creation of the kind: SolrCloud object, and the kind: SolrCollection object. Could you please give me more details about this?

First question is - should it be a configSet bootstrapping feature that will only be run on first startup if a configset with that name does not already exist...
OR - should it be a mechanism to manage configset updates through the operator?
As a bootstrapping feature we just need an initContainer which looks for a CM and uploads it with a CLI command.
But as a management feature it would more look like a SolrConfigSet CRD, where you could create, update, delete. For this to make sense, Solr should supported making a configSet Read-Only, so it is "owned" by the operator, since changes from ConfigSet API would be overwritten on next CM change...


FTP sink does not create directories when writing

I'm actually using the kafka connector based on the ftp sink kamelet, but the error I'm receiving I believe is because the old camel.sink.endpoint.autoCreate property (which defaults to true) is not being used/set by the ftp-sink kamelet. The connector tries to cd to a directory in the path of my filename, and cannot. So it fails with a 550 error. Instead of attempting to mkdir the directory via ftp first.
Any advice on what to do, or any extra debug I can provide, I'm happy to do so/receive advice.

This was an issue on the ftp server end it turns out.


No dialog pops up when using an existing name to create one queue

Storage Explorer Version: 1.13.0
Build: 20200504.7
Branch: master
Platform/OS: Windows 10/ macOS Catalina / Linux Ubuntu 16.04
Architecture: ia32/x64
Regression From: Previous release(1.13.0)
Steps to reproduce:

Expand one storage account -> Queues.
Create one queue -> Using an existing name to create one new queue.
Check the result.

Expect Experience:
A dialog pops up.

Actual Experience:
No dialog pops up.

The queue service is returning a code 204, which apparently means success? That sounds like a potential bug in the service. I'll need to follow up with them.

The platform team has explained that, when a queue with matching name exists, the service compares the new queue request's metadata with the existing queue. A proper error is only returned if the metadata is different. Since Storage Explorer doesn't create queues with metadata, this outcome is very likely to happen.
@XiaoningLiu Is this response known to the client library? In other words, does the client library handle this case intentionally in some way? Do you have recommendations, or is this something we should fix?


fix e2e.sh

@kyessenov ,  why were these setup steps moved out of driver.go into a separate bash script?

bazel can't run bazel in bazel :)
So I had to move out bazel commands out. But I really want to keep this script as small as possible!

I would have to investigate. And its frankly a waste of time to work around like this. The simplest alternative is to have two scripts or keep this script for Jenkins while folks use something else simpler for local development. Duplication will always be a pain.


New warnings during compilation

[ 98%] Linking CXX executable walletd
WalletTransactionSender.cpp: In member function ‘selectDepositTransfers’:
WalletTransactionSender.cpp:732:34: warning: ‘deposit.interest’ may be used uninitialized in this function
     foundMoney += deposit.amount + deposit.interest;
                                  ^
WalletTransactionSender.cpp:728:13: note: ‘deposit.interest’ was declared here
     Deposit deposit;
             ^
WalletTransactionSender.cpp:732:34: warning: ‘deposit.amount’ may be used uninitialized in this function
     foundMoney += deposit.amount + deposit.interest;
                                  ^
WalletTransactionSender.cpp:728:13: note: ‘deposit.amount’ was declared here
     Deposit deposit;
             ^

[ 99%] Linking CXX executable conceald
WalletSerialization.cpp: In member function ‘loadWallets’:
WalletSerialization.cpp:668:74: warning: ‘isTrackingMode’ may be used uninitialized in this function
     } else if ((isTrackingMode && dto.spendSecretKey != NULL_SECRET_KEY) || (!isTrackingMode && dto.spendSecretKey == NULL_SECRET_KEY)) {
                                                                          ^
WalletSerialization.cpp:659:8: note: ‘isTrackingMode’ was declared here
   bool isTrackingMode;
        ^
Blockchain.cpp: In member function ‘findBlockchainSupplement’:
Blockchain.cpp:1360:10: warning: ‘blockIndex’ may be used uninitialized in this function
   return blockIndex;
          ^
Blockchain.cpp:1357:12: note: ‘blockIndex’ was declared here
   uint32_t blockIndex;
            ^
RpcServer.cpp: In member function ‘f_on_block_json’:
RpcServer.cpp:568:10: warning: ‘blockGrantedFullRewardZone’ may be used uninitialized in this function
   size_t blockGrantedFullRewardZone = penalizeFee ?
          ^
[100%] Linking CXX executable tools-connectivity
make[3]: Leaving directory '/home/john/Desktop/conceal-core/build/release'
[100%] Built target ConnectivityTool
Blockchain.cpp: In member function ‘findBlockchainSupplement’:
Blockchain.cpp:1360:10: warning: ‘blockIndex’ may be used uninitialized in this function
   return blockIndex;
          ^
/home/john/Desktop/conceal-core/src/CryptoNoteCore/Blockchain.cpp:1357:12: note: ‘blockIndex’ was declared here
   uint32_t blockIndex;
            ^
Blockchain.cpp: In member function ‘findBlockchainSupplement’:
Blockchain.cpp:1438:83: warning: ‘blockIndex’ may be used uninitialized in this function
   return m_blockIndex.getBlockIds(startBlockIndex, static_cast<uint32_t>(maxCount));
                                                                                ^
Blockchain.cpp:1357:12: note: ‘blockIndex’ was declared here
   uint32_t blockIndex;
            ^
RpcServer.cpp: In member function ‘f_on_block_json’:
RpcServer.cpp:568:10: warning: ‘blockGrantedFullRewardZone’ may be used uninitialized in this function
   size_t blockGrantedFullRewardZone = penalizeFee ?
          ^
Core.cpp: In member function ‘findBlockchainSupplement’:
Blockchain.cpp:1438:83: warning: ‘blockIndex’ may be used uninitialized in this function
   return m_blockIndex.getBlockIds(startBlockIndex, static_cast<uint32_t>(maxCount));
                                                                                ^
Blockchain.cpp:1357:12: note: ‘blockIndex’ was declared here
   uint32_t blockIndex;
            ^
Core.cpp: In member function ‘findStartAndFullOffsets’:
Core.cpp:781:26: warning: ‘blockIndex’ may be used uninitialized in this function
   if (!lbs->getLowerBound(timestamp, startOffset, startFullOffset)) {
                          ^
Blockchain.cpp:1357:12: note: ‘blockIndex’ was declared here
   uint32_t blockIndex;
            ^

It seems sorted out


Datetime component is not removed from

When we have one form with one or more datetime component each time that the form is rendered it adds one more
...
 to
After some time of use of the application we can have dozens (or even hundreds) of dummy divs.

This could be easily replicated in https://formio.github.io/angular-demo/manager
Is there anything we could on ngOnDestroy to release that when we navigate to out of the form?

Hello João,
Thanks for reaching out!
We have added this to our backlog. We also accept pull requests if you are interested in contributing this fix.
Thanks!

Any updates on this issue?

Any updates on this issue? Still experiencing this in react-formio as well

@Javo-blip
This issue has been resolved in the latest version of 4x.

I seem to be still experiencing this issue on formio-react, should I open a new issue in that repo?

@Javo-blip Yes, please reopen a new ticket in the React issue  board.
Thanks!


[Feature request] Installation script for Debian x64 platform

To push adoption and amount of Lightning full nodes running with RaspiBlitz we need beside the Raspberry Pi as hardware platform a more universal and tested, official installation script of RaspiBlitz for a recent Debian x64 platform. For example, Debian is widely adopted in virtual server hosting. personal computer x64 platforms and NAS with virtualization apps like QNAP and Synology.
I myself tried also several platforms and feel quite a bit frustrated. Whilst the Raspberry-Pi platform might be ideal for the RaspiBlitz installation, it seems that hardware isn't. Serious bottleneck is limited robustness of any MicroSD memorycard keeping OS and RaspiBlitz software. It's simply not designed for such usecase and therefore stability problems are daily routine. On the other hand, RaspiBlitz installation script always failed with Debian 11 x64 because of several reasons.
RaspiBlitz running with Raspberry-Pi is great for first steps but obviously not a robust enough 24/7/365 solution.
That's why a approved and official Debian x64 installation script for RaspiBlitz would be great.

See the work done towards running in an Ubuntu 20.04 VM: https://github.com/rootzoll/raspiblitz/issues/1500#issuecomment-917444439
Debian 11 is unfortunately not running on my TrueNAS based setup.

There is progress on the build script:
https://github.com/rootzoll/raspiblitz/issues/1500#issuecomment-982606560
The logic is that the scripts would use the second (nonOS) disk for the chain and other storage.
I am running VMs on Ubuntu, but testing on Debian is welcome.

Testing on Debian VM #2772

Successfully installed raspiblitz using the build_script from the dev branch.
1 disk for the OS and used a separate 1TB one for the blockchain.
# download the build script
wget https://raw.githubusercontent.com/rootzoll/raspiblitz/dev/build_sdcard.sh
# run
sudo bash build_sdcard.sh false false rootzoll dev hdmi false

with the new changes in the build options it should be:
# download the build script
wget -O build_sdcard.sh https://raw.githubusercontent.com/rootzoll/raspiblitz/dev/build_sdcard.sh
# run
sudo bash build_sdcard.sh --github-user rootzoll --branch dev --display hdmi --tweak-boot-drive 0  --wifi-region off

Hey @openoms , I tried running the above from a Debian 11 VM but I get a "403 Forbidden" when trying to access the nginx page. I have a 32GB OS drive on /dev/sda1 and my blockchain drive (/dev/sdb1) is mounted to /mnt/hdd. I run the script and nothing gets populated in the /mnt/hdd folder. Not sure what I'm missing... any help is greatly appreciated.

connect with ssh to your VM

connect with ssh to your VM

I was connected via SSH. I couldn't figure out how to get the scripts to generate data inside /mnt/hdd. I had mounted it manually and added an entry inside of /etc/fstab.

when you boot the OS image it simply wait for a second disk to be attached. Should work on the fly, but try restarting the VM if not picked up automatically.


Breaking on phoenix

When I try and add my gamertag to the Destiny section - this happens

Account renamed perhaps? Shitty implementation of the system. I should have used XUID, but when the Destiny portion was written the Xbox API wasn't in the codebase yet nor was it added until H5 support was added. It basically sees a different gamertag, adds it, but then the foreign key on destiny account id already exists thus dies out.
This entire project needs a wipe/rewrite/cleanse/something, but the short term I can just fallback to the account owning the duplicated destiny account id and use that account w/ a renamed gamertag.

I've never changed the name on this account, must be something else


(Master Branch) tsserver.js hangs in vs-code

Tested at commit c27b379b1798b79f3ebf46db0aef03222acfc65f and 01244d60dac82eec017e9150e663c5d144f989ff .
To reproduce:

Build typescript (jake local).

In powershell:
Copy-Item C:\<...>\typescript\public\built\local\tsserver.js C:\Users\<username>\AppData\Local\Code\app-0.5.0\resources\app\plugins\vs.language.typescript\lib\tsserver.js

Open up vs code. Hover over several items to get quickinfo. After a few requests, the language service writes Loading... on each hover.

On occasion, the language service was busted immediately (on the first hover), but I'm having trouble reproducing it consistently.
The source file I've been inspecting is src\services\services.ts.
This error doesn't appear to occur in Visual Studio. So it may or may not be a bug on our side.

This may or may not be related to #3887.

Can we close this then?


Cannot set reference field value

Godot version: v4.1.stable.official [970459615]
Describe the bug
When setting a reference property value, error is printed and the change doesn't happen.
To Reproduce
Steps to reproduce the behavior:

Go to Pandora panel with the example dataset (inventory)
Under Items/Ores select CopperOre
Change the CopperOre's rarity from currently Legendary to any other
Error gets printed and the change doesn't go through

Error: Pandora error: value <Resource#-9223369595769779648> is incompatible with type reference
This happens even if I create a brand new category with new reference fields and items.
Expected behavior
The rarity of CopperOre should change and no error should be printed.
Desktop

OS: MacOS 13.4.1

The issue is, that the PandoraReference class isn't considered of type "reference" and fails the is_valid_type check.
func(variant): return variant is PandoraEntity,

Adding PandoraReference to the type check should be fine, I think. I tried it, seemed to work just fine.
func(variant): return variant is PandoraEntity or variant is PandoraReference,

But I don't understand the codebase well enough (yet!) to be fully confident.

@VojtaStruhar the idea is that the reference gets created dynamically inside Pandora. From an API perspective, it should always be PandoraEntity.
Let me see today what the issue is here!

I dug a little more and found, that after selecting entity from a dropdown, you wrap it in PandoraReference and then call set_default_value with it:
# reference_property.gd, _ready
entity_picker.entity_selected.connect(
  func(entity:PandoraEntity):
    var reference = PandoraReference.new(entity.get_entity_id(), 1 if entity is PandoraCategory else 0)
    _property.set_default_value(reference)
    property_value_changed.emit())

But in set_default_value you have a very similar piece of code that does the same thing conditionally:
value = PandoraReference.new(value.get_entity_id(), PandoraReference.Type.CATEGORY if value is PandoraCategory else PandoraReference.Type.ENTITY)

I think that in the entity_picker, we are wrapping the entity in a PandoraReference too early! I tried to pass in just the entity, seems to work just fine. I had a look in the stored data too - it seems to add the override correctly:

If this sounds good to you, I'll make a pull request, it's a one-liner :)


Develop in docker containers with vscode

now we can develop in docker containers with vscode.
the config file is in the branch named devcontainer-support.

@huan Does the branch need to be merged into main branch?

If we do not merge it, it is inconvenient for the developer to start the dev environment, because he should start from the branch containing the .devcontainer directory. But this directory is not necessary for other developers.

One way to solve this contradiction is to clone the devcontainer-support branch and reset the branch and add a .gitignore file under the .devcontainer directory.


hash_builder has unexpected test case fail

https://github.com/soonl2/hash_builder/commit/10e8cd27facbd8220b10afa5cd0e100ebf870bae

@chengzhinei

https://github.com/soonl2/hash_builder/pull/2

#3


Error on install - A device attached to the system is not functioning

Hello,
First, Calcpad is now my favourite engineering calculator. An excellent tool indeed!
I am getting a weird error trying to install on my work machine. (Win 11 - i5)

I have checked all hardware in device manager but there doesn't seem to be any issues.
I have installed dotnet sdk 8.

Am doing something wrong?
Is there a portable/ non-install version?
Big Thanks!

Hi! It looks like some antivirus software is making problems.
Check the antivirus for recent detection or putting the file into quarantine.

Hi!
Yes, it is a virus scan issue.
My IT team will no longer help me with the install as a threat has been detected. (sad)
Interestingly the MS Store version installs and runs fine...
Will there be an update to the MS Store version?

Hi,
The MS Store version is actually the same, it is just a bit older. This is certainly a false alarm.
After compiling, we sign the program files with our official Digicert EV code signing certificate.
After that, the code cannot be modified, without breaking the corresponding hash.
I think you can safely take it out of quarantine and report a false alarm.
In all cases, it is an open source software. You can clone the source code and compile it by yourself on your own computer with VS 2019. Nothing can be safer than that. :)


Not an issue with the apk but with the download site

I have just downloaded and installed the (Android version of the) DDG browser from its "official" website. Initially, I was disappointed that the only two OBVIOUS download options were via the Apple and the Google stores. It took me scrolling down screen after screen to the very end of the download page to find that there are indeed two other options (though presented only in "small print", almost like a dark pattern): directly from the DDG website and via f-droid (which I prefer).
Why not show these two options (for Android users) at the top and more prominently to boot? I do realise there are reasons why some people prefer the stores but many do not and those people (me included) should have a choice without scrolling down screen after screen. IMO of course.
Given DDG's vigorous attempts to make web privacy available to all (which I applaud), I find this sad and actually somewhat disconcerting. Either you take this privacy thing seriously or you don't. Again, strictly IMO.

Sorry about that, I can take your feedback and share it internally. However, we only expect to receive bug reports of our app as issues, as per our contribution guidelines. Hope that's ok. Thanks.


support giorgio

A variety of requests documented in email; we will make a roadmap for how to foster this collaboration and answer their questions/requests.

DoD is (first) jupyter-notebook (eventually) web service:

how to ingest images
how to ingest swc

:-)
On Thu, Dec 22, 2016 at 2:18 PM, Greg Kiar<EMAIL_ADDRESS>wrote:

DoD is (first) jupyter-notebook (eventually) web service:

how to ingest images
how to ingest swc

—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/neurostorm/meta/issues/7#issuecomment-268870468, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AACjcpE2Y-i3G-7dSYxbLzAsIWjsgvpbks5rKsz1gaJpZM4LNbPc
.

--
the glass is all full:  half water, half air.
neurodata.io, jovo calendar
https://calendar.google.com/calendar/embed?src=joshuav%40gmail.com&ctz=America/New_York
starting in 2017, i will be responding to emails approximately weekly,
so that i can focus more on the people around me.
thank you for your understanding.


Fix case on internal type names

Should allow microbenchmarks to get running again

[trickle] No significant performance differences

[microbenchmarks] No significant performance differences


[FIX] Can't build when name of primary key isn't "Id".

Example:
File main.go
package main

//+AR
type User struct {
	ID   int `db:"pk"`
	Name string
}

func main() {
}

File Makefile
all:
	argen main.go
	go build

Before patch
$ make
argen main.go
go build
# _/tmp/ar
./main_gen.go:199: m.Id undefined (type *User has no field or method Id)
Makefile:2: recipe for target 'all' failed
make: *** [all] Error 2

Patched
$ make
argen main.go
go build

LGTM :+1:
Thanks !!


Shelly RGBW2 White

Hey,
This is not an issue exactly but I am not sure where else to ask this question.
I installed the drivers and it has connected to my shelly no problem. Within the device page I see the 4 channels and there levels. This all works and the light turns on and off no problem.
What I want to know is how do I add this to the dashboard, one on/off and dimmer per channel.
thanks

Add the device to the dashboard.... you can ask for more help on on the Hubitat forum.

unrelated to driver code


fixing wrong o2 url

fixed the URL_INVOICE_OVERVIEW, contained /api/ twice

gonna do a new one, too much went wrong here


Requirements File

The actual command syntax for the requirements.txt file is:
pip install -r requirements.txt
the install was missing in the README text. More of a whoops than and issue. Also be sure to update/upgrade to 9.0.3 documentation/2.7/user guide 9.0.3

Thanks, addressed on 284f78c64c216331506ef99b180c537246a5f684.


Use updated rancher image of external-dns with version 0.5.11

Fix for https://github.com/rancher/rancher/issues/18454
There is a introduced in the kubernetes-incubator/external-dns v0.5.10 version that we use to launch external-dns. Refer the issue here:
kubernetes-incubator/external-dns#883
As mentioned in this issue, trying out with version v0.5.11 resolves this problem.
This PR updates the chart version to use the update image.

@thxCode @loganhz @alena1108 please review/merge

LGTM


Can't use feedkernel; doesn't allow running as root

Hi,
I'm trying out the tentative solo-python package for Debian, version 0.0.26, and I can't use feedkernel.
$ solo key rng feedkernel
Entropy before: 0x3866
Traceback (most recent call last):
File "/usr/bin/solo", line 4, in <module>
solo_cli()
File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python3/dist-packages/solo/cli/key.py", line 117, in feedkernel
fcntl.ioctl(fh, RNDADDENTROPY, t)
PermissionError: [Errno 1] Operation not permitted

It refuses to let me use it as root:
$ sudo solo key rng feedkernel
THIS COMMAND SHOULD NOT BE RUN AS ROOT!

Please install udev rules and run `solo` as regular user (without sudo).
For more information, see: https://docs.solokeys.io/solo/udev
Entropy before: 0x3911
Entropy after:  0x3915

I do have the udev rules though. The merge request #18 that introduced the feedkernel option says that it should just warn in recent versions, but 0.0.26 is the latest.

You can set the environment variable ALLOW_ROOT to suppress the warning if you know what you're doing.
$ sudo ALLOW_ROOT=1 solo key rng feedkernel

Here is what I get after trying to run solo key rng feedkernel:
Traceback (most recent call last):
File "/usr/bin/solo", line 8, in
sys.exit(solo_cli())
File "/usr/lib/python3.10/site-packages/click/core.py", line 1128, in call
return self.main(*args, **kwargs)
File "/usr/lib/python3.10/site-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/usr/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3.10/site-packages/click/core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "/usr/lib/python3.10/site-packages/solo/cli/key.py", line 83, in feedkernel
p = solo.client.find(serial)
File "/usr/lib/python3.10/site-packages/solo/client.py", line 33, in find
p.find_device(dev=raw_device, solo_serial=solo_serial)
File "/usr/lib/python3.10/site-packages/solo/devices/solo_v1.py", line 63, in find_device
raise solo.exceptions.NonUniqueDeviceError
solo.exceptions.NonUniqueDeviceError


Migrate beacon from ouroboros-consensus.

Closes https://github.com/input-output-hk/ouroboros-consensus/issues/290

Thanks for checking!

Do you already have local changes for a CI setup? If not, we could copy and slightly edit some stuff from ouroboros-consensus (happy to do that in a separate PR).

Not yet. I could migrate the GHA part, but I might need your help for the nix stuff :)


UX improvement during execution

Provides hints as to navigation, avoids spurious character entry to start script display and ensures step count doesn't go negative.

@halseth rebased and ready for review

@halseth after rebase I see a need to refactor this line.  This statement needs to either be appended to the table output in all cases after the initial print (otherwise it gets overwritten and not displayed; which could be the intent (?) but I don't think it is) or this should be extracted out of the table itself and printed a single time (like these statements, which seems more natural).  Let me know if you have a preferred approach.  I'll update this PR with what I think reasonable.


chore: improve app typography

This PR changes:

Changes the order of default theme in theme list
sets the default font from nunito to System default

Fixes #21426
Type of change

Bug fix

How Has This Been Tested?

Manual
Cypress

Test Plan

Add Testsmith test cases links that relate to this PR

Issues raised during DP testing

Link issues raised during DP testing for better visiblity and tracking (copy link from comments dropped on this PR)

Checklist:
Dev activity

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] PR is being merged under a feature flag

QA activity:

[ ] Test plan has been approved by relevant developers
[ ] Test plan has been peer reviewed by QA
[ ] Cypress test cases have been added and approved by either SDET or manual QA
[ ] Organized project review call with relevant stakeholders after Round 1/2 of QA
[ ] Added Test Plan Approved label after reveiwing all Cypress test

/ok-to-test sha=b7e0e86

/build-deploy-preview sha=b7e0e86

/ok-to-test sha=12307e7

/ok-to-test sha=2df3619

/ok-to-test sha=2698c52

/ok-to-test sha=078ba44

Observations:
On importing an application which had Nunito as font , the font is getting set as System Default @jsartisan

@dilippitchika need your help on this. Will need someone from backend team to unblock us. It needs a backend migration.

/build-deploy-preview skip-tests=true

@jsartisan @KelvinOm closing this PR for now


Add BR 1-24 template to buildspec

Issue #, if available:
#3491
Description of changes:
Add BR 1-24 template to buildspec
Testing (if applicable):
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve

/cherrypick release-0.12


udp: allows to create ClientConn at server

Fixes #315

Codecov Report

Merging #316 (4e9474f) into master (96978f2) will decrease coverage by 0.13%.
The diff coverage is 78.94%.

@@            Coverage Diff             @@
##           master     #316      +/-   ##
==========================================
- Coverage   69.28%   69.15%   -0.14%
==========================================
  Files          67       67
  Lines        5571     5583      +12
==========================================
+ Hits         3860     3861       +1
- Misses       1312     1320       +8
- Partials      399      402       +3

Impacted Files
Coverage Δ

udp/server.go
83.09% <78.94%> (-0.99%)
:arrow_down:

net/conn.go
82.81% <0.00%> (-3.13%)
:arrow_down:

udp/client/clientconn.go
70.81% <0.00%> (-0.96%)
:arrow_down:

tcp/clientobserve.go
66.38% <0.00%> (-0.85%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 96978f2...4e9474f. Read the comment docs.


Create CODE_OF_CONDUCT.md

Pull Request Test Coverage Report for Build 22

0 of 0 (NaN%) changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 82.584%

Totals

Change from base Build 20:
0.0%

Covered Lines:
147

Relevant Lines:
178

💛  - Coveralls


setHudPosition fix ASAP

I just realised that I did not push my last commit. Please apply it ASAP.

do not forget to update bower


Fox Page - Main Opportunity

Overview
We should create a component to display the main opportunity for FOX/FOXy/oneFOX, with all its info and a CTA to get started with this opportunity.
References and additional details
FoxyOpportunity can be used as a base type for this, using a subset of its fields.
Given we represent opportunities in a standardized way across the codebase, it is safe to assume such subset without API changes needed later on. From this type, pick these to be passed as props:

apy
tvl
balance (the balance in tokens)
type and provider will more than likely be needed (waiting on architecture planning)
tokenCaip19 - the caip19 of the staked token (can be different from the reward token), where the tokenname and description can be gotten from

Note: To be fully functional and be able to develop this in isolation, not using tokenCaip19 and instead passing the name and description as separate props is probably a better way to go with this

https://github.com/shapeshift/web/blob/fd67442e47da2136ddf7148fa3549c330a1b89e5/src/pages/Defi/hooks/useFoxyBalances.tsx#L19-L36
Acceptance Criteria

A <asset symbol> Asset header is displayed (hardcoded FOX asset for now)
The description of that asset is displayed (hardcoded FOX asset for now)
The APY is displayed as a percentage
The TVL is displayed in Fiat with US$ prefix similar to the  DeFi section
The token balance is shown if there is a balance, -- otherwise
"Get Started" button is displayed but not yet clickable - it will open different steps depending on the staking type

Design note:  As we've discussed during the design requirements, all internal CTAs like this "Get Started" should be displayed with the full style:

While all external links are displayed as ghost buttons:

For this issue, assume FOX staking opening the FOXy modal, which is an internal CTA.
Need By Date
No response
Screenshots/Mockups
Mockups: https://www.figma.com/proto/WgALgik9YuWzq7VIM0JRdb/FOX-Page-Bounty?node-id=71%3A533&scaling=min-zoom&page-id=71%3A532

Estimated effort
3 hours

Removed the needs-engineering tag on this one after architecture review/opportunities spike in https://github.com/shapeshift/web/issues/1810


Add ServerBuilderListener

Until now, ServerListener instance should be written by the user one by one. This approach is enough when there are only a few ServerListeners, but if lots of ServerListeners are required, this approach becomes not only cumbersome but also time-consuming and error-prone. Writing Armeria application that interacts with Zookeeper using Curator is a good example of this (#882) - you have to start and stop some Curator instances when the Server is started or stopping. Even worse, most of those routines are repetitive.
If Armeria supports an easy way to build ServerListener instance by composing Runnable instances, there are following advantages:

Easy to write: the listener can be written with only a few lambda syntax.
Better Readability: it focuses what it does.
Reusable: we can define reusable capsulations of the repetitive routines.

You can check my implementation in this commit in this branch. How are they? 😄

Sounds good to me. Could you send a PR so we can review?


Fix code-server login

This resolves the issue in code-server where a Couldn't recognize command error occurs during authentication against the Platform, because it expects the windowId URI parameter, which is missing.
The fix has been successfully tested in both code-server and standard VSCode environments.

I'm wondering if windowId is something one can only expect from desktop (electron app) distributions of VS Code?

I'm wondering if windowId is something one can only expect from desktop (electron app) distributions of VS Code?

@sourishkrout It is definitely related to letting VSCode handle links in different or existing windows, as mentioned here: https://code.visualstudio.com/updates/v1_67#_handle-uri-in-new-window. However, I didn’t find any explicit information stating that this behavior is limited to desktop distributions only.
That said, windowId is not related to the authentication process, so I think it's safe to remove it.

That said, windowId is not related to the authentication process, so I think it's safe to remove it.

I'd like to hear @pastuxso's opinion. Also, why not check if it's defined and set it accordingly but not require it in the condition? Again, I haven't checked, but it seems important when multiple Windows (desktop apps) are running.

That said, windowId is not related to the authentication process, so I think it's safe to remove it.

I'd like to hear @pastuxso's opinion. Also, why not check if it's defined and set it accordingly but not require it in the condition? Again, I haven't checked, but it seems important when multiple Windows (desktop apps) are running.

Totally! :100:
Regarding the condition and how the parameter is handled, it's only used as a validation to define if the URI is valid or not. The whole URI is then forwarded to the next handler, see https://github.com/stateful/vscode-runme/pull/1662/files#diff-35ad708e91026099e03a5b146676d059a44e4aab20fd04d76412c9c485ec73c4R73.

That sounds good, @peraltafederico. Since @pastuxso wrote this code initially, I assigned him as a reviewer. I'm using a build from this branch to unblock my development work. It'd be great to get his fixed soon but it's no emergency.

@sourishkrout The validation of the windowId parameter can be safely removed. Initially, it was used to differentiate between commands, but with the introduction of the argument command=auth, it has become redundant.


Add note about now deployments to README

Codecov Report

Merging #65 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #65   +/-   ##
=======================================
  Coverage   72.03%   72.03%
=======================================
  Files           6        6
  Lines         118      118
  Branches       25       25
=======================================
  Hits           85       85
  Misses         31       31
  Partials        2        2

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5d072ea...7d09cb8. Read the comment docs.


Fix problematic retransmission of authentication token (alternative solution)

Here is an alternative solution to #436. It delegates the redirect-handling to the got library, instead of fixing the manual handling. This should fix #343 and fix #363, just as the original solution.

'updatedOptions' is defined but never used

I just remove the second parameter, or is there another favored solution?

Thanks @JojOatXGME for making this bugfix!


only 2050 characters?

@xorbit I found a limitation, can only send up to 2050 characters, using the PoE-FeatherWing.
I made a workaround, so there is no failure/issue.
However, can you think of any reason the 2050 char limits is there?
Note: while the workaround is to the library I prefer to use, the limitation exists when using the native Arduino library too, and the example attached has workaround commented-out
Arduino-WebServer_bufferTest.ino.txt
index_complete_html.h.txt
index_html.h.txt
index_html2.h.txt
I do not observe the same limitation when using an ESP8266.

@xorbit see Khoi's comment. The 2K limitation is part of the base Ethernet library.
Closing issue as it is not a PoE-FeatherWing problem; it is a library problem.

Alright, thank you for letting me know.
I have noticed a lot of software limitations with the various "maker level" drivers for the W5500, I have been spending a lot of time myself on improving the CircuitPython driver which was very limited.


Reproduce a crash in TypeScript 2.9 JS support.

If JavaScript code has both a valueDeclaration that is a binary
expression (e.g. property assignment), and additional declarations that are not, TypeScript gets confused and crashes in an attempted cast:
var CtorFunction = function() {
  this.myField = 'a';
};
/** @type {string} */
CtorFunction.prototype.myField;

var x = new CtorFunction();
x.myField = 'b';

Leading to:
Error: Debug Failure. Invalid cast. The supplied value [object Object] did not pass the test 'isBinaryExpression'.
  at Object.cast (src/compiler/core.ts:1445:22)
  at _loop_4 (src/compiler/checker.ts:4644:80)
  at getWidenedTypeFromJSSpecialPropertyDeclarations (built/local/run.js:33366:31)
  at getJSSpecialType (src/compiler/checker.ts:4982:21)
  at getTypeOfVariableOrParameterOrProperty (src/compiler/checker.ts:4920:28)
  at getTypeOfSymbol (src/compiler/checker.ts:5219:24)
  at checkPropertyAccessExpressionOrQualifiedName (src/compiler/checker.ts:17285:53)
  at checkPropertyAccessExpression (src/compiler/checker.ts:17238:20)
  at checkExpressionWorker (src/compiler/checker.ts:20937:28)
  at checkExpression (src/compiler/checker.ts:20878:44)
  at checkBinaryLikeExpression (src/compiler/checker.ts:20350:28)
  at checkBinaryExpression (src/compiler/checker.ts:20342:20)
  at checkExpressionWorker (src/compiler/checker.ts:20976:28)

getWidenedTypeFromJSSpecialPropertyDeclarations iterates all declarations and then runs into the non-binary one.

Should be covered by the test in https://github.com/Microsoft/TypeScript/pull/25170


Return headers() as associative array

I followed your steps here:
https://github.com/sendgrid/sendgrid-php/blob/master/USE_CASES.md
var_dump($response->headers());
array:15 [
  0 => "HTTP/1.1 202 Accepted\r"
  1 => "Server: nginx\r"
  2 => "Date: Wed, 22 Feb 2017 14:14:30 GMT\r"
  3 => "Content-Type: text/plain; charset=utf-8\r"
  4 => "Content-Length: 0\r"
  5 => "Connection: keep-alive\r"
  6 => "X-Message-Id: rL5XOoCUSkm-0sH4CLipBx\r"
  7 => "X-Frame-Options: DENY\r"
  8 => "Access-Control-Allow-Origin: https://sendgrid.api-docs.io\r"
  9 => "Access-Control-Allow-Methods: POST\r"
  10 => "Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl\r"
  11 => "Access-Control-Max-Age: 600\r"
  12 => "X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html\r"
  13 => "\r"
  14 => ""
]

I think it could happen, that the needed "X-Message-Id" will not always be in [6], so please provide headers in a nicer way, e.g. associative array - carriage return character removed. Thanks!
"X-Message-Id" is the Sendgrid Message Id which I need for further processing of Webhooks.

e.g.
private function getHeadersNice($headers) {
        $return = [];
        foreach ($headers as $key => $header) {
            if ($key == 0) {
                $return['Status'] = $header;

            } else {
                $exploded = explode(":",$header);

                if (isset($exploded[1])) {
                    $return[trim($exploded[0])] = trim($exploded[1]);
                }
            }
        }

        return $return;
    }

or use composer and set guzzle as requirement and use this instead of curl ;-)

Hello @danielsippel,
I think this is a great idea and I've added it to our backlog for implementation.
With regards to Guzzle, we removed that dependency because we were getting too many compatibility issues reported from our customers.
With Best Regards,
Elmer

👍 I agree, headers should be an associative array.

Thanks @WadeShuler, I've added your vote to this issue in our backlog.

Solved by https://github.com/sendgrid/php-http-client/pull/19


[BugFix] Specify storage medium of materialized view

What type of PR is this：

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #17352
Problem Summary(Required) ：

Checklist:

[x] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto backported to target branch

[x] 3.0
[x] 2.5
[ ] 2.4
[ ] 2.3

[FE PR Coverage Check]
:heart_eyes: pass : 4 / 4 (100.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/scheduler/PartitionBasedMaterializedViewRefreshProcessor.java
4
4
100.00%
[]

run starrocks_admit_test

run starrocks_admit_test

@Mergifyio backport branch-3.0

@Mergifyio backport branch-2.5


[Bug]: Add correct file path

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
The file path used in Portfolio_Optimization_Using_Genetic_Algorithm.ipynb is incorrect

Add ScreenShots
No response
What browsers are you seeing the problem on?
No response
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC contributor
[X] I want to work on this issue
[X] I'm willing to provide further clarification or assistance if needed.

@shristirwt let me know any guidelines need on the mentorship

@shristirwt let me know any guidelines need on the mentorship

sure sir


Rundeck + Ansible always send --limit to playbooks

I have a playbook that looks like this:
- hosts: localhost
  vars:
    some_var: 'some value'
  tasks:
    - name: some local task
      set_fact:
        some_local_var: 'some local value'
- hosts: linux
  tasks:
    - name: some linux task
      shell: 'uname -a'
- hosts: windows
  tasks:
    - name: some windows task
      raw: 'ping <IP_ADDRESS>'

I run it from command line with:
# ansible-playbook some_playbook.yml
And works as expected.
But I cant find a way to run it from rundeck with ansible plugin. (rundeck shell command works)
What I see is that rundeck runs ansible-playbook with the --limit option always and this playbook needs to be run as shown.
My questions are:
Am I writing bad playbooks?
Is there a way to run ansible playbooks without sending a --limit option?
Thanks

1 I am using playbooks, and this limit for me sometimes are useless. because all node assignment is in yml file.

I think this is due to the way rundeck models running processes.
It has to always have a target.
Perhaps, the ansible plugin could interpret that running on local node means no target (or --limit)

Not just this. But specifying --limit localhost causes ansible to interpret 'localhost' differently inside playbooks. There is an 'implicit' localhost included in inventories that is removed when a limit expression is passed to ansible-playbook. My understanding is that this is done for compatibility with ansible-pull mode. For instance I have a playbook that connects to vmware and creates vm's, from 'localhost'. But it breaks in rundeck with -l localhost. So I have to do all sorts of things to make it work using delegations and connection_mode local. (I also have to override the python interpreter to use a virtualenv, which is done by default otherwise, since Ansbile will also change the python interpreter that is used.) Basically lots of stuff changes when --limit localhost is used.
Additionally I can't add this host to inventory inside the playbook and then go configure it, because the --limit localhost will override any limits in the playbook.
The 'easy' fix to all this would be to allow a field to be set in the plugin to NOT pass the --limit flag to ansible-playbook when 'Execute Locally' is selected for the Node specification.

This appears to be a simple change to the code. Would a Pull request be accepted for this change?

@brokenjacobs of course, as stated at the bottom of the README "Discussions and pull requests are welcome."!
Rundeck 2.9.0 will have exciting new features that we need to look into.
I'm currently trying to put some time into this project again (working on a Docker image).

I am running in to this problem, so I thought I would comment here for documentation.  Here is the offending lines:
    String limit = nodes.length() > 0 ? nodes.substring(0, nodes.length() - 1): "";
    if (limit != "") {
        configuration.put(AnsibleDescribable.ANSIBLE_LIMIT,limit);
    }

Also just ran into this problem with current version of RunDeck 2.9.2 (2017-08-07). When selecting 'Execute Locally' the Ansible playbook execution is always passed an empty limit parameter resulting in error.

@frozenice is there any harm in removing the --limit flag?

@DerekTBrown I don't think so, but am not sure. Needs some testing, I guess. :)

--limit is normally required when sending commands to Ansible as this specifies which nodes are going to be targeted by the commands. As @brokenjacobs says, the --limit and its parameter should be omitted when Nodes is Execute locally.

@larry-s I think that would create a change in the functionality (that isn't necessarily a problem, just something we need to agree upon).  Currently if I execute locally, it will only run against localhost, which might break other peoples' current jobs.
I think there are two possible solutions to this problem:

Remove the --limit option entirely

Pros:
Allows users to pass custom --limit using extra arguments.
Cons:
Changes existing functionality.

Override --inventory with an ad-hoc list of hosts containing only localhost (somehow parse out variables).

Pros
Allows users to run add_host without error
Cons
Doesn't use static inventory file.

I am going to add this as an option as @brokenjacobs suggested.

https://github.com/Batix/rundeck-ansible-plugin/pull/143

Just catching up here. Excellent news!

Thanks! Testing this out today in 2.1.2 release. Is it possible to set this option in the job/task or only in Project/Framework?


eplenmean and eprewmean always nan

For my own environment, when I run ppo2, I am always getting nan for eplenmean and eprewmean. I see from the code that it uses 'l' and 'r' keys from debug info returned from step calls. But what are those values? Where it is documented?

Related: https://github.com/hill-a/stable-baselines/issues/24

Oh, it seems I just have to wrap my env with Monitor wrapper. I can even make file None to not log it, just populate those fields. Cool.
Is this documented anywhere?

In general most of the gym or env stuff isn't documented beyond what you might see here:
https://gym.openai.com/docs/
It's a lot of trial and error but the code itself isn't too bad to read (it does take some time, though).

@mitar How 'Monitor' helps to fix this? I'm having the same problem with my custom environment. I only wrapped with TimeLimit so that the episode will end when it reaches the max_number_steps.

@tkelestemur Monitor wrapper reports lengths and rewards of each episode in the info dict (fourth return value from env.step); the reason why it helps to fix the nan problem with ppo2 is because ppo2 uses those values for reporting - if there are none, ppo2 will report NaN's.
In your case, however, the environment seemed to be created correctly... looking at your code here (https://github.com/tkelestemur/sawyer_gym/blob/master/train_baseline.py) (I suspect that's what you are referring to) - I think there is a wrong Monitor imported. I.e. if you replace from gym.wrappers import Monitor to from baselines.bench import Monitor ppo2 will report things correctly (or at least seemingly correclty, I did not look very deeply in the values).
Now, you may say "wtf this is so confusing", and I will agree with that :) Will look into why the one in gym does not work correctly with ppo2.

oh I see the one in gym does something completely different - it tries to record a video of agent interacting with the environment. Ugh. This is an unfortunate name collision. We'll fix it one way or another; in the mean time, I'll close this - don't see any actionable here (other than improving the docs - which there is already plenty of open issues about).

@pzhokhov Thanks a lot for going over my environment. I tried the Monitor from baselines.bench and it worked perfectly fine. In fact, the performance is really good. When I was looking at the https://github.com/openai/baselines/blob/master/baselines/run.py to see how I can use PPO without a registered Gym environment, I skipped the Monitor because I thought it was doing what Gym's Monitor does which is recording videos of the agent.
Thanks for the help!


Debug - A global flag required to disable it

api/check_license on the online-tools hosted at https://spdxtools.sourceauditor.com/
is how this issue was first found. The debug is turned-on in production and a global setting to disable/enable is required

@UShan89 @pombredanne
I might be wrong, but Django already has a debug flag that should be changed to False prior to deployment.
# SECURITY WARNING: don't run with debug turned on in production!
DEBUG = True

If that was done, then please I would like to have more details on this issue, to take this on.
Thanks

@freddy28  Yes, this flag is already provided in Django by default in settings.py

@rtgdk
Ok,
In that case, can I have more details on the issue. I don't quite understand what the issue is about.

@freddy28 having debug flag is an insecure operation for production. There are python packages and browser addons that could be leveraged for unexpected actions from an end user.
Here is one scenario that would definitely worry me. https://pypi.python.org/pypi/django-debug-toolbar.
If this package (say was available) then a client (Browser) can be used to make changes to almost everything.

The idea is to make everything run without debug (Unless specifically asked)

I updated the debug flag to False on the production environment.
Propose we update the settings.py in the repo to set debug to False.  When running it on local systems during development, you can override the settings to True.  This would make it less likely we accidentally leave debug on in the production environment.


Make the sidebar collapsible, particularly to support viewing on smaller screens.

Split off from #59
I'll start with detecting if width is too small and simply hide it. In future, we'll want to also have a button.

The material UI “drawer” component seems well suited to this https://mui.com/material-ui/react-drawer/

I've used this component before (e.g. https://github.com/jsoules/stellarator-navigator/blob/trunk/stellarator-navigator/src/components/selectionControl/SelectionControlDrawer.tsx) and found it very convenient.

I think those two solutions are probably best in terms of styling, but I wanted something where I'd have more control of the exact functionality and sizes... so I did this:
#88


[core][apps] Increase aliyun timeout

to: @airbnb/streamalert-maintainers
related to:
resolves:
Background
Increase default connection and read timeout to aliyun server to prevent aliyun_actiontrail app getting timed out. Aliyun SDK team separates timeout to connection and read timeout and also lower the default connection timeout time from 10 to 5 seconds (Aliyun Python SDK PR 216), so we can increase both connection and read timeout.
Changes

Increase both connection and read timeout to 15 seconds.
Raise exception instead of silent the timeout error and next app run should pick up the previous logs.

Testing

Updated unit test

The Action CI failure is related to this comment

Hello everyone, this issue is related to image, not the setup-python task. We are working on investigation and fix. Progress can be tracked in actions/virtual-environments#1202 (comment)

I checked, our PyYAML package is pinned to 5.1.2 which kinda conflict with Action CI image where expects to have 5.3.1. So we either wait for Action CI image to be fixed or upgrade our PyYAML to 5.3.1. 🤷♀


Experimental version of the copy tool

Commit the initial version of the copy tool. It may be the experimental.

ltfsoacp is little bit confused with ltfscp utility had been provided by IBM before.
The concept is quite different. So we need to have another name for this utility.


Added constructors for cluster config structures with const members (CON-389)

Solved the problem where end_product_type couldn't be customized at the start of the application (Fixes #280)
Because  end_product_type now is const in order to follow Matter specification and the value can not be changed after the cluster instance has been initialized, now there are two constructors that allows to create a window covering endpoint configuration with a cluster configuration that has a custom  end_product_type, so you can create it just like this:
window_covering_device::config_t config(static_cast<uint8_t>(chip::app::Clusters::WindowCovering::EndProductType::kTiltOnlyInteriorBlind));
This also has been done for pump and pump_configuration_and_control.
Also updated documentation to explain these special cases as suggested @shubhamdp.

@shubhamdp Thank you for your answer 😊. Requested changes done!

@Diegorro98 Thanks a lot for the PR. I have trigged the build pipeline on this PR, once that is green, this will be merged.

@Diegorro98 Thanks for your contribution. The PR has now been merged to Github


Add a wiki: RLCraft

Link to origin wiki: Fandom
Link to destination (independent) wiki: Wiki.gg

Thanks for submitting this wiki! Added in v3.9.0 (now available for Chrome, should be available in Firefox within a few days).

Glad I could help! Love your extension and I hope you continue to maintain it!


Report in the UI if the pinner is unhealthy

If the pinner is having trouble saving data to ipfs-cluster asynchronously, it would be good if it could report that it is in poor health, and display that in the PeerPad UI somehow.
There may be more than one pinner in a collaboration, so we'd need to figure out how to display that information.

we do currently have a bad status, right? should this be refined to "improve pinner error message in UI"?

There are sort of multiple levels of pinning - the first stage is for the web browser to pin the peer-base collaboration via a websocket to peer-base-pinner, which is basically just another peer in the collaboration. When that succeeds, the UI will say that the content was pinned.
There's a second level of pinning which is basically peer-base-pinner saving a backup to ipfs-cluster. Conceptually it's a bit like how virtual memory swaps out to disk. That happens asynchronously, and could happen a minute or so later than when peer-base-pinner first synced the data from the web client. If bad things are happening at this stage, currently, the web client will not know that the pinner is in trouble, and will assume that the data they have pinned has been durably persisted, when in fact it hasn't been.

I wonder if the "real" way to do this is for the app itself to check that findProvs of the latest state shows the expected results?


Cant run Data Centric Examples - "Too many values to unpack" when searching grid

Description
Hello all,
I have set up a network on my computers via Docker (Tag: production). I use PySyft 0.2.8 so it is compatible with PyGrid. One computer is the network and another is the node. I ran the Introduction example and the Data Owner part works fine. But in the Data Scientist part, the grid cannot be searched and I get following error:

I have checked if the dataset is in it as follows:
print("Node tags: ", requests.get(node_address + "/data-centric/dataset-tags").json())
I also checked if the Network has his node via http-Request: <IP_ADDRESS>:7000/connected-nodes
When I manually search in Postman, I get following message:

I also looked up to the definition of search in public_grid.py and added a print of the match_nodes, which results in {'message': 'Invalid JSON format.'}:

def search(self, *query: Union[str]) -> Dict[Any, Any]:
        """ Search a set of tags across the grid network.

        Args:
            query : A set of dataset tags.
        Returns:
            tensor_results : matrix of tensor pointers.
        """
        # Ask gateway about desired tags
        body = json.dumps({"query": list(query)})
        match_nodes = self._ask_gateway(requests.post, GATEWAY_ENDPOINTS.SEARCH_TAGS, body)
        print(match_nodes) #added this line
        # Connect with grid nodes that contains the dataset and get their pointers
        tensor_results = {}
        for node_id, node_url in match_nodes:
            worker = self.__connect_with_node(node_id, node_url)
            tensor_results[node_id] = worker.search(query)
        return tensor_results

Here is my code for the Data Scientist part:
from syft.grid.public_grid import PublicGridNetwork
import torch as th
import syft as sy
import requests

hook = sy.TorchHook(th)

grid_address = "http://<IP_ADDRESS>:7000"
node_address = "http://<IP_ADDRESS>:5000"
grid = PublicGridNetwork(hook, grid_address)

print("Node tags: ", requests.get(node_address + "/data-centric/dataset-tags").json())

results = grid.search("#February", "#birth-records")
results

I also tried the MNIST-Example but I get the same error message as above. The same error appeared in an older issue #747 but it wasn't solved yet.
How to Reproduce

Execute the introduction example of data centric (https://github.com/OpenMined/PyGrid/blob/dev/examples/data-centric/introduction/01-introduction-to-pygrid.ipynb)
Execute the mnist example (https://github.com/OpenMined/PyGrid/tree/dev/examples/data-centric/mnist)

Expected Behavior
Return the results of the grid search.
System Information

OS: Windows
OS Version: 10
Language Version: Python 3.7, PySyft 0.2.8

Thanks in advance!

Updagre to pysyft 0.2.x

I managed to get the examples to work. First I took the Docker with the tag development instead of production. Also, I tested a different state of PyGrid (https://github.com/OpenMined/PyGrid/commit/0a837a14d000f29e1cd732f2fcdd3e901639c06f), with this one it works fine.

0.2.x is no longer supported. Please refer to the new 0.5 release.


AES implementation in Python

🚀 Feature
This is going to be the implementation of the Advanced Encryption Standard (AES) algorithm in python
Have you read the Contributing Guidelines on Pull Requests?
Yes
Motivation
Popular and widely adopted symmetric encryption algorithm nowadays is the Advanced Encryption Standard (AES). It is found at least six times faster than triple DES. AES encrypts and decrypts data using 128/192/256-bit keys into 128-bit blocks.
Pitch
Popular and widely adopted symmetric encryption algorithm nowadays is the Advanced Encryption Standard (AES). It is found at least six times faster than triple DES.

I would like to work on this as a part of DWOC. Kindly Assign me this issue.
@HarshCasper @anushkrishnav

Done Good Luck !!

Hello @anushkrishnav,
I have added AES implementation in python first using pycrypto and later using pycryptodome since security checks were not successful. Library mentioned in your analysis check is pyca/cryptography for which I will have to implement in a new manner.
can you guide me here or using pycrypto or pycryptodome library is fine.


Enable specifying https github webhooks

Proposed Changes

Add spec property secure which when set to true causes the webhook to be configured using https rather than the default http.

Release Note

Configure https GitHub webhooks using the `secure` property.

nice.
/ok-to-test

/approve

/lgtm


Adding PSI for continious data

added Population Stability Index (PSI) for continuous data.
I used 0.25 as the alerting threshold citing this -> https://www.risk.net/journal-of-risk-model-validation/7725371/statistical-properties-of-the-population-stability-index#:~:text=In practice%2C the following “rule,or type II error rates.
Used to Freedman-Diaconis Rule determine bin size
also updated the comments in drift/methods to say drift metric, instead of performance metrics
I recommend looking at the calculations and math closely to see whether it makes sense.
I'll add it for categorical next

Small Comment:
You may want to consider numpy.histogram_bin_edges instead of manually implementing Freedman-Diaconis Rule.
We are also using it for JS here
https://github.com/NannyML/nannyml/blob/main/nannyml/drift/univariate/methods.py#L683

Maybe also add some numerical tests in tests/drift/test_univariate_drift_methods.py?
This helps us verify that the behavior is correct now and doesn't change over time!


Translating DFA (plex) to graphviz format (.dot)

I've finished the C version of the routine that, given a plex - created DFA, creates a file in graphviz format representing the state machine. Code can be found at the end of this comment.
I already posted the code in another issue but that issue got closed (apparently I closed the issue but I have no clue how I closed that issue). If you saw my previous post then you can forget about this post as it is a repeat of my previous post.
I finished the translation of the C code to FreeBASIC (UniCC). I should get the FreeBASIC template code working in the upcoming week.
#include "phorward.h"

#define SIZE (lex->trans[i][0])
#define FROM (lex->trans[i][j])
#define TO   (lex->trans[i][j+1])
#define DST  (lex->trans[i][j+2])
#define MATCH_FLAGS (lex->trans[i][2])
#define REF_FLAGS (lex->trans[i][3])
#define FINAL_STATE (lex->trans[i][1] > 0)
#define ID (lex->trans[i][1])
#define DEFAULT_TRANSITION (lex->trans[i][4] != lex->trans_cnt)

void write_edge(FILE* transitions, wchar_t from, wchar_t to);
int write_dfa(plex *lex, char* filename);

void write_edge(FILE* transitions, wchar_t from, wchar_t to)
{
  if (iswprint(from))
    fprintf(transitions,"&#x%x;",from);
  else
    fprintf(transitions,"0x%x",from);
  if (to != from)
  {
    if (iswprint(to))
      fprintf(transitions," - &#x%x;",to);
    else
      fprintf(transitions," - 0x%x",to);
  };
};

int write_dfa(plex *lex, char* filename)
{
  int i,j;
  FILE *transitions;
  int dst;

  if (strlen(filename) == 0)
    return -1;
  transitions = fopen(filename,"w+b");
  if (transitions == 0)
    return -1;

  /* write start of graph */
  fprintf(transitions,"digraph {\n");
  fprintf(transitions,"  rankdir=LR;\n");
  fprintf(transitions,"  node [shape = circle];\n");

  for (i = 0;i < lex->trans_cnt;i++)
  {
    /* size = lex->trans[i][0]; */
    fprintf(transitions,"  n%d [",i);
    /* change shape and label of node if state is a final state */
    if (FINAL_STATE)
      fprintf(transitions,"shape=doublecircle,");
    fprintf(transitions,"label = \" n%d\\nmatch_flags = %d\\nref_flags = %d\\n",i,MATCH_FLAGS,REF_FLAGS);
    if (FINAL_STATE)
      fprintf(transitions,"id = %d\\n", ID);
    fprintf(transitions,"\"];\n");
    /* default transition */
    if (DEFAULT_TRANSITION)
      fprintf(transitions,"  n%d -> n%d [style=bold];\n",i,lex->trans[i][4]);
    /* a state with size < 5 is a final state: it has no outgoing transitions */
    if (SIZE > 5)
    {
      j = 5;
      while (1)
      {
        fprintf(transitions,"  n%d -> n%d [label = <",i,DST);
        write_edge(transitions,FROM,TO);
        dst = lex->trans[i][j+2];
        j += 3;
        while (1)
        {
          /*  no more transitions to write */
          if (j >= SIZE)
          {
            fprintf(transitions,">];\n");
            break;
          };
          if (lex->trans[i][j+2] == dst)
          {
            fprintf(transitions,"<br/>");
            write_edge(transitions,FROM,TO);
            j += 3;
            continue;
          };
          /* no more transitions to write */
          fprintf(transitions,">];\n");
          break;
        };
        if (j >= SIZE)
          break;
      };
    };
  };
  fprintf(transitions,"}\n");
  fclose(transitions);
  return 0;
};

int main (int argc, char** argv)
{
  int i;
  plex *s;
  pregex_ptn *err_;
  int err;

  enum
  {
    ID1 = 1,
    ID2 = 2,
    ID3 = 3,
    ID4 = 4,
    ID5 = 5,
    ID6 = 6,
    ID7 = 7
  };

  struct
  {
    char* pat;
    int id;
    int flags;
  } patterns[] =
  {
    {"wstring",ID1,PREGEX_COMP_STATIC},
    {"zstring",ID2,PREGEX_COMP_STATIC},
    {"string",ID3,PREGEX_COMP_STATIC},
    {"wstr",ID4,PREGEX_COMP_STATIC},
    {"str",ID5,PREGEX_COMP_STATIC},
    {"bling",ID6,PREGEX_COMP_STATIC},
    {"wing",ID7,PREGEX_COMP_STATIC},
    {"keywords.dot",0,-1},
    {"_[a-zA-Z0-9_]+",ID1,0},
    {"[a-zA-Z][a-zA-Z0-9_]*",ID1,0},
    {"identifier.dot",0,-1},
    {"abc.*def.*ghi",ID1,0},
    {"large.dot",0,0},
    {"",-1,-1}
  };

  i = 0;
  while (1)
  {
    s =  plex_create(0);
    if (s == 0)
    {
      fprintf(stderr,"Could not create lexical analyzer, exiting");
      return -1;
    };
    while (patterns[i].id != 0)
    {
      err_ = plex_define(s,patterns[i].pat,patterns[i].id,patterns[i].flags);
      if (err_ == 0)
      {
        fprintf(stderr,"Problem while creating pattern, exiting");
        plex_free(s);
        return -1;
      };
      i++;
    };
    err = plex_prepare(s);
    if (err == 0)
    {
      fprintf(stderr,"Could not generate dfa");
      plex_free(s);
      return -1;
    };
    err = write_dfa(s,patterns[i].pat);
    if (err)
    {
      fprintf(stderr,"Could not create file %s",patterns[i].pat);
      plex_free(s);
      return -1;
    };
    plex_free(s);
    i++;
    if (patterns[i].id == -1 && patterns[i].flags == -1)
      return 0;
  };
};

(Copied from issue #4):
Thanks, looks very cool and interesting.
I would like to bring some dynamic inside this and would integrate it into the library as a demo program (what about plexdot, or plex with a dot output option?)

Hi @FreeBASIC-programmer, I've put your code in the current develop branch under DEMO (https://github.com/phorward/phorward/blob/develop/DEMO/plex-to-dot.c), for now without any modifications. Will do so, soon.

Feel free to use my code in any way you see fit. No need to mention my name (or pseudonym or ...).


webpack 4 doesn’t provide this.options

Fixes #189

Hey @mzgoddard, can you look into this pull?

Thanks!


add bower files cli

https://github.com/thompsonemerson/bower-files-cli

@thompsonemerson Thank you for contributing!
A couple of tips to make your package even more awesome:

Put an asciicast in the readme, demonstrating installing a bower package, then running bower-files-cli, and finally using cat to print the generated file. https://asciinema.org/
Link to https://github.com/ksmithut/bower-files from the readme so users don't have to search for the underlying library.
Consider using mkdirp or fs-extra to avoid ENOENT errors when the output directory doesn't exist.

Thanks @RyanZim
I will see when possible. 🚀


fix: possible installation of older versions of cordis-axios

Codecov Report

Merging #86 (3b38c14) into master (5d300a2) will not change coverage.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@           Coverage Diff           @@
##           master      #86   +/-   ##
=======================================
  Coverage   82.10%   82.10%
=======================================
  Files           1        1
  Lines         419      419
  Branches       86       86
=======================================
  Hits          344      344
  Misses         75       75

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

依赖更新会在每个版本发布前完成，无需 PR。


Update ci.{c,g}pu.yml and devcontainers to clang18, CUDA 12.4, and nvhpc24.3

update ci.cpu.yml to cuda12.4
update ci.gpu.yml to clang18-cuda12.0, clang18-cuda12.4, and nvhpc24.3
devcontainers to clang18-cuda12.0, clang18-cuda12.4, and nvhpc24.3

Thank you! Do you know if this will fix the gcc-11 Release ASAN build? It's been suffering from a weird linker error for weeks.

Do you know if this will fix the gcc-11 Release ASAN build?

I don't know, but we'll see here shortly. We can also try other versions of GCC if we need.

/ok to test

@ericniebler I think it's just complaining because I put [skip ci] in the last commit. This PR should be good to merge.