hugo server should check for /foo.html when requesting /foo

I'm using https://surge.sh/ to deploy my hugo site. It has a great clean url feature, so if you have /foo.html, /foo will get it, /foo/ will redirect to /foo.
So now I'm creating content/foo.md, and enabling uglyurls so hugo generates /foo.html.
In some pages, such as listing page, I'm now using {{ trim .RelPermalink ".html" }} to use clean url in href. However, this causes problem with hugo server. A request of /foo doesn't check the existence of /foo.html, but directs to /foo/ to try /foo/index.html immediately.

@anthonyfok Hey I'm interested in doing this myself, but I don't have much experience with golang. or hugo. Would you mind giving me a pointer as to where to start?

@octref this issue is in the category of "we should most likely not do this", and only if it is really simple and someone is providing a finished solution for it. Teaching you Golang doesn't fit that bill.

@bep I understand that. Just want to know where to start. Guess I'll look into https://github.com/spf13/hugo/blob/master/commands/server.go and how net/http fileserver handles request.
Just wondering, is it that you are against this feature?
If not, are you OK if I do it this way?
/foo serves /foo.html if it's available. If not, directs to /foo/ and behave like it is before.

Knowing "we should most likely not do this" is useful as I can possibly avoid the awkward situation where I take time to do a PR and you don't want this feature at all.
Also saw your comment at #874:

@rustyoz I agree, but I still feels that the FileServer devs should have made this extensible in the first place. When they sober up from GopherCon I will post an issue; but that will be Go 1.6 at best.

I guess this discussion can hold until we decide what to do about a REST api.

So as for approach to this problem:

Is FileServer made extensible now go is 1.7?
Does hugo need to take dep on https://github.com/julienschmidt/httprouter to implement this feature?
Or is it you are doing the REST api(didn't see it in code, and didn't find it on roadmap)?

Guess I'll should switch back to jekyll.

I'm not sure I understand this feature request.
Is it that you want the page URL to be /a/ but you want the filename to be /a.html instead of /a/index.html so your provider will do redirects? If so, there's no need to adjust Hugo. Just write a script (could be in any language, doesn't have to be Go) to move /a/index.html to /a.html after you've done a build with Hugo, since it's really about the final file locations, not the URL as Hugo understands them.


Application Insights with Serilog

Ref
https://github.com/Microsoft/ApplicationInsights-aspnetcore/wiki/Getting-Started
Serilog sink for app ins
https://github.com/serilog/serilog-sinks-applicationinsights
Channel9 video on Serilog + AppIns
https://channel9.msdn.com/Series/aspnetmonsters/ASPNET-Monsters-102-Structured-Logging-with-Application-Insights
AppInsight in appsettings.json
https://github.com/serilog/serilog-sinks-applicationinsights/issues/32
Trace, Event etc.
https://docs.microsoft.com/en-us/azure/application-insights/app-insights-api-custom-events-metrics
Local monitoring
https://docs.microsoft.com/en-us/azure/application-insights/app-insights-visual-studio
Logging templates
https://messagetemplates.org/
Azure
I created a new AppIns on US West 2, noticed the following,

by hooking up App Service with App Ins, request etc are captured, but no logging which needs key
dev locally pointing to App Ins and can be seen inside VS
App Ins delays to show logging data
local can still use app ins without a key, it'll show you last debug session
GitHub can be hooked up as the issue tracker
Setting up App Ins inside VS will alter .csproj with ApplicationInsightsResourceId and ApplicationInsightsAnnotationResourceId, which are just for easy configuration when you inside VS right click on Connected Services/Application Insights to update your App Ins.

Testing the following scenarios

[ ] Running in Development with an App Insights key, will be able to log to Azure

[ ] Running in Development without an App Insights key, will be able to log to local AppIns but not Azure

[ ] Running in Production from local with an App Insights key, will be able to log to Azure

[ ] Running in Production from local without an App Insights key, will be able to log to local AppIns but not Azure

[ ] Running on Azure, will be able to use the Key stored in App Service > Application Settings and log


Polling < 5 seconds?

Hi
Could you change the minimum polling time < 5 seconds?
I would love to have it each second...
Thanks

I would not recommend this. I have set it to about 10.000 (10s) and even that led to blacklisting after some time. So I changed to 15s now.


[Enhancement] Make it optional to have starrocks_be.debuginfo in allin1 image

Why I'm doing:
We need debuginfo in the allin1 container to catch/reproduce issues.
What I'm doing:
Make it optional to keep starrocks_be.debuginfo in allin1 image.
Fixes #issue
What type of PR is this:

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

[ ] This is a backport pr

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.3
[x] 3.2
[x] 3.1
[ ] 3.0
[ ] 2.5

can you merge this to 3.2?
Thank you!


Refactor scraping news flash

The modules handling the scraping of news flash scraping require extensive refactoring.
Here's a non-exhaustive list of quality issues I see:

[x]  Multiple occurrences of swallowed exceptions - I mean Exceptions (catching Exception, even when logged, seems to be overkill).

[x] Module-level side effects: init_flask()

[x] Naming: Unclear separation of news_flash_* files and a news_flash folder. Noninformative long names; "scrap" instead of "scrape" (the correct verb);  beautiful_soup as part of a file name. The database adapter is named news_flash_parser. Regular links are named rss_link.

[x] get_* functions receive site as argument to dispatch completely different handling for each site; I believe this should be "transposed" to separate modules/classes/config for each site (group by site, not by task, since they are not similar). Moreover, it seems easy to create a single function that would return a dict[str, str] which will hide the difference in source from other parts of the parsing.

[x] u'' strings

[x] Different classifier functions for ynet and twitter, using separate lists, hard coded inside the conditionals. The classifier for both walla and ynet is called classify_ynet.

[x] Commented-out imports and other minor style issues such as non-PEP8 compliant spaces

[x] Using deprecated pd.np instead of numpy directly.

[x] Unnecessarily repeated fetching and parsing of news flashes, just to check if there are new ones.

Of course, to in order to make large changes, we need tests. I guess another issue is in order for that.

More:

[ ] Duplicated logic for location extraction on update_news_flash
[ ] Use SQLAlchemy objects (NewsFlash) instead of hand crafted SQL.

@elazarg I see we're left with one sub-issue here of Duplicated logic for location extraction on update_news_flash.
Can you take this one and finalize this issue?


Deviantart image download error

Steps to reproduce
Would like to say that when I download deviantart images either per page or complete, there is a change in both the size and definition of the images, I would like to know if you could fix this error
I would like to notify you that this error is occurring from the Grabber 7.6.1 version

Hello
Do you have an example of an image that does not get downloaded properly?

This was the download I made on deviantart

the site is like this after


KAFKA-4719: Consumption timeout should take into account producer request timeout

cc @ewencp
Single run here: https://jenkins.confluent.io/view/All/job/system-test-kafka-branch-builder-2/190/console. If successful, I'll repeat the test run a few more times.

@ewencp I ran the offset validation tests 5 times here: https://jenkins.confluent.io/view/All/job/system-test-kafka-branch-builder-2/191/console. There was no recurrence of the specific failure that this patch is targeting. The two other failures are difficult to understand and do not seem to fit with the event output. If the changes here seem reasonable, I suggest we merge this patch for the increased logging visibility, and I can continue investigating the other failures.

Oh, I almost forgot. One of the test failures seems to have been caused by this:
[INFO  - 2017-02-01 19:02:37,216 - background_thread - _protected_worker - lineno:39]: Traceback (most recent call last):
  File "/var/lib/jenkins/workspace/system-test-kafka-branch-builder-2/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/services/
background_thread.py", line 35, in _protected_worker
    self._worker(idx, node)
  File "/var/lib/jenkins/workspace/system-test-kafka-branch-builder-2/kafka/tests/kafkatest/services/verifiable_consumer.py", line 169, in _worker
    log_config = self.render('tools_log4j.properties', log_file=VerifiableConsumer.LOG_FILE)
  File "/var/lib/jenkins/workspace/system-test-kafka-branch-builder-2/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/template.py", line 90, in render
    template = self.template_env.get_template(path)
AttributeError: 'VerifiableConsumer' object has no attribute 'template_env'

5 more runs, this time all passing: https://jenkins.confluent.io/view/All/job/system-test-kafka-branch-builder-2/192/console.


refactor: normalize file path

What ❔

normalize file path

Why ❔

Standardize the paths in the file for more accurate use, reducing exceptions

Checklist

[ ✅ ] PR title corresponds to the body of PR (we generate changelog entries from PRs).
[ ✅ ] Tests for the changes have been added / updated.
[ ✅ ] Documentation comments have been added / updated.
[ ✅ ] Code has been formatted via zk fmt and zk lint.

Please review the merge.

Is anyone maintaining this project?


Fix #224 Added New Submodule Paste and Indent

One issue to fix, plus pass travis.

Looks good, depending on Travis.


BitmapData.loadFromFile freezes the app on Linux when loading a corrupted PNG file

It works absolutely fine with any other files except for this one. This file is corrupted. I'm not sure how exactly. Some tools open this file just fine, others report corruption.
The problem is that BitmapData.loadFromFile just hangs while trying to load this file. onError callback never being called and try/catch doesn't work either. The only way to stop the programm is to kill it with SIGKILL. It happenes on both Neko and Linux targets.
It doesn't happen on MacOS. I didn't try it on Windows just yet.
Synchronous BitmapData.fromFile works just fine (it doesn't load the file but try/catch catches an error).
OpenFL version: 8.4.1-LlyE3A
Lime version: 7.0.0
hxcpp version: 4.0.4
OS: Arch Linux amd64
MCVE

Thank you so much for the example file!
We were not handling errors in libpng the same way when loading from bytes (which occurs in the async version) as we were when loading from disk.
In the process, I improved how the fromBytes and fromFile work so that they return null and an error on async, then OpenFL's side so it also does not return a BitmapData if the load failed.
Now BitmapData.fromFile should return null when it fails and BitmapData.loadFromFile should error


Asset Baseline - Heritage Assets

Task:

Use the alphav2 data model to create a zarr representations of the assets in the title of this issue.
Identify the relevant datasets currently available in the CDAP datalake, and optionally suggest other required datasets by raising an issue on the CDAP issue tracker.
As a first pass, store the asset creation pipeline in a Databricks notebook
Then create a recipe which can represent the relevant data sources and required transformations. A notebook showing some initial work on recipes is here. (Note: recipe structure and style is likely to change - see discussion here).
Store the recipe in the recipe repo
Use this issue to discuss any issues with these assets.

Overview of all levels:

Focus on lower levels:

After discussion with @jpd-defra i'm transferring this issue to sds-asset-recipes


Suggested Development Environment

Set up a wiki and make a page explaining how to use Eclipse to work on the project.

Wiki updated with full details on how to use and develop (should cover eventual networking too). Might add a screenshot of the Mysteries app when its done.


Fix use of free() when deleting YGNode

Nodes are allocated using operator new, but released using free() instead of operator delete.

Thank you for your PR @code-disaster. This change has already been introduced via 66045bd.


Rename ratelimiting configs to reflect requests and not connections

email to dev/users@
On Tuesday, May 12, 2020, 05:17:36 PM PDT, Sudheer Vinukonda<EMAIL_ADDRESS>wrote:

9.x (re)introduces a feature (it was accidentally "lost" during some unrelated refactoring) that will allow to configure limits on max "active" connections that can be allowed at any given time (https://github.com/apache/trafficserver/pull/6754)

Given that this feature is based on tracking "active connections", it should work very well with HTTP/1.1 traffic (where, 1 active connection = 1 request). However, with HTTP/2 and stream multiplexing, this is no longer true and it isn't nearly as effective. One can still use an average number of concurrent streams/connection to configure the limits, but, ideally, what would work for both HTTP/1.1 and HTTP/2 (and going forward with QUIC/HTTP/3) would be to track and (rate) limit request level concurrency. There is some ongoing work on this and to align better with that work, we are proposing to make the below changes to existing configs with 9.x

1) Rename "proxy.config.net.max_connections_in" to "proxy.config.net.max_requests_in"

2) Rename "proxy.config.net.max_active_connections_in" to "proxy.config.net.max_active_requests_in"

3) proxy.config.net.connections_throttle - This config will stay put to limit the max number of open connections (FD, rlimits etc)

More context on the new changes -

The idea is to tune active connections that can be handled (based on the available resources/capacity (CPU, Memory, Network bandwidth) and minimize/remove dependency on having to tune connection timeouts (active/inactive/keep-alive etc) which are very hard to tune.

The primary goal is to limit the max active connections allowed at any given instant. The resource requirement for an idle/inactive vs active connections are completely different - For e.g an idle connection really only consumes memory resource, while an active connection consumes CPU, network besides memory. And allowing to tune/cap the max active connections based on the deployed capacity for the resources available, would make timeout tuning almost redundant and no op. Otherwise, we'd have to tune the timeouts to estimate throughput which is very hard as it's hard to justify how large or small we want the active timeout to be or keep alive timeout to be. For e.g in a non-peak hour, we could let the active timeout be much higher than the default, while during peak hour, we'd want to limit it to ensure we are not starving resources on one connection.

Note: there's one little TODO item here. PluginVC's connections are not tracked in the NetVC's active queue because these are bogus internal connections. However, for some users, internal traffic is significant (e.g sideways calls, or background fetches etc) and does consume plenty of resources. Since these internal requests don't impact ingress network, and have a slightly different resource requirements than client originated requests, it might be better to track these using a separate config for internal requests. Will follow that part up with a separate PR.

@bryancall has a better naming suggestion for the configs. Converting this to Draft until we post (and get feedback on) the new proposal to the mailing lists.

This change will now be tracked using #6968


DK sim freezes when using Imp UH Pres & setting Unholy for the fight presence

Describe the bug
Death Knight DPS sim iteration freezes when using Improved Unholy Presence talent and "Fight Presence = Unholy" setting.
To Reproduce
Steps to reproduce the behavior:

Use any Unholy build that includes Improved Unholy Presence
Go to Settings and change "Fight Presence" from Blood to Unholy
Start sim
See iteration counter stop incrementing.

Expected behavior
Expected the simulation to complete as normal
Desktop:

OS: Windows 10
Browser: Chrome
Version 107.0.5304.107

Additional context
Does not occur for Unholy fight presence without Improved Unholy Presence talented. Also does not occur for Blood fight presence with Improved Unholy Presence talented

Could you link a sim where this is happening? I have been running MANY sims using IUP and unholy for fight presence without any issues so far

Just ran this and it froze on 495/3000
https://wowsims.github.io/wotlk/deathknight/#eJzjUuJgEmAyYMpgLGBsYGRcwci4gZHxACPjBUbGF4yMPxiZLjAxOQkoMBkwOjBGANV0gNUIMUh9Y2liZAvISaxMLeJgFOCS2szIxS+w6jCTxEtZJbZth5nOnWXiYhGYuoSJi0fg7R4miQeySsw3DjNxsQv0L2OSuM4OVH1wK5PEFkklNqAwSIZLYMd+Jon5kkqMDFy8Ai+AetawKrEAZRiARuxaxARXyC/wBij5HmjPvJNQgUm3mCQ+ycJVsAg8/A8im0+CyDd7QeS78yDLNwJ1rpDiYgAKrN7PpMTPwWTAa8EYwBLBUgHym9YEJoZRgAKqWDgYJZh+Mepw8XEwSQCTQQAoBewAJwIJQYiaD/YKjFrcHP9hgLGLUVfX2MjAwBQIgcBI18gYSBoYGwO5xkaGYEEgCRQxNDY2NDV8xCjBMfcKk8Cbp0wSs64wKcy4wqQx4yqTwcyrTC8YWT4wss9iZLjFyDCLiUHpLhMn2M6GNAeo7SIOkrNmgsBJe0uIyAV7xTQwuGZvtJZJIViCg+YR2+JADVMaTh6hijnEAEhY+dx1cITwf9h7MCYwAgDi2oXv

fixed https://github.com/wowsims/wotlk/pull/1991


🚀 Feature: Trigger an bitbucket pipeline with an action similar to github:dispatch

🔖 Feature description
i would greatly appreciate if i could trigger an bitbucket cloud pipeline on my backstage template
this triggers an pipeline on github that creates an S3 Bucket on AWS
We have this on github
- id: github-action
name: Trigger GitHub Action
action: github:actions:dispatch
input:
workflowId: s3-aws.yml
repoUrl: 'github.com?repo=S3-AWS&owner=owner'
branchOrTagName: 'main'
workflowInputs:
bucket_name: ${{ parameters.bucket_name }}
region: ${{ parameters.region }}
action: ${{ parameters.action }}
i would like to do the same with bitbucket, but i cant seem to find anything on how to do it
🎤 Context
My company only uses bitbucket cloud
Im creating a pipeline that have numerous terraform modules
my goal with backstage is to create an infra-as-a-code platform with the terraform modules templates, in a way that my devs can create any infra with my terraform code (they don't know terraform)
i want to publish the content of the template, and then trigger the terraform pipeline with the specific parameters set by the template
In my career i only dived into DevOps, so i'm not familiar with node to create an custom action (maybe its time to study)
✌ Possible Implementation
I would like to pass the repoUrl, or the branch, or make an commit that triggers the pipeline
maybe something like bitbucketCloud:actions:triggerpipeline
👀 Have you spent some time to check if this feature request has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Are you willing to submit PR?
None

This sounds sensible, do you want to contribute these actions? :pray:

@benjdlambert im happy to pick this up.

Nice @NeuralEvolution!
I'm just in the process of implementing https://github.com/backstage/backstage/issues/21442, so there might be some rebase work need after it lands, but go ahead!


Proper constructor and getters added to Book and User classes

Hi,
when I was trying to run the project here, I noticed some compilation errors that prevented me from running the project:
The Book and User was using a constructor with 3 arguments in the respective DAO classes, but this constructor was not implemented in Book and User classes neither, so I did it. The same applies to Book and User getters that were being used, but was not implemented.
Best wishes.

Hi @tomurlh. These classes are generated by lombok. They should be there if you use the lombok plugin, or when you build with maven.

Oh Lombok, now it makes sense, closing it.


Vote#anonymous was returning the opposite!  Fixed.

Coverage increased (+0.004%) to 93.024% when pulling 1dd2136d83b36bd4458143559aa7556ac0251b8e on fix-anonymous-votes-in-api into 76781a894442b9b86195fcd59e68d356c17c94ca on master.


TelnetLib: switch to GLOBAL library scope

Hey all,
this commit changes the LIBRARY_SCOPE of the Telnet Library to GLOBAL
allowing the user to keep a persistent Telnet connection.
Beside of that, the behavior is exactly the same.
Targeting my issue #3232.
This is useful if multiple test suites are based on the same connection and
the connection handling is not part of the test specification.
Please feel free to inform me if additional tasks are required.
Tested on Debian Buster w/ Python 3.7.3.
Cheers,
BB

Upvote for GLOBAL scope in Telnet Lib.

I agree the global scope would make more sense. Unfortunately the approach used in this PR masks keyword documentation from Robot Framework and from Libdoc making it impossible to create library documentation.
The library uses the hybrid library API and earlier actual keywords seen by Robot came from the TelnetConnection class and thus their docstrings were used. The problem could be easily fixed by copying/moving docstrings to the Telnet class, but it would probably be a good idea to change the library to use the normal static library API at that point too. I believe it would ease maintaining the library in general as well. Unfortunately doing big changes like this isn't possible anymore before RF 3.2.
I have also decided it's better to make the Telnet library an external library and submitted #3537 about that. As the result I'm closing all Telnet related issues and PRs (including this one) and linking them from #3537 as a reference. If you are interested in becoming maintainers of the new library and adding this functionality there, please comment #3537 or contact me otherwise.


As a new user, I can my relatives into JENGA...

Adding of base skeleton code for ease of development for all feature implementations.

... so that I can begin tracking my family history.


Domain activation is Failed - [BRIEF DESCRIPTION]

App Id: d2hzj6jgxc2xul
Region: ap-south-1
Step: Domain activation
Status: Failed

Note: Do not include information that is sensitive in nature such as your domain name, company etc.

Issue/question
Not able to verify with my google domain
Error message
Note: Be sure to check the message for sensitive information.
Error message: Hard limit reached; unable to record function association
Additional information
Please add any other relevant information. Please feel free to include screenshots.

Have you found any solution for that ?

It looks like your domain has since successfully verified and been created, please reopen this issue if you're still experiencing problems.


[API7]could not login!

while I join to the server and type /login command(after regist registration), I was noticed that 'You entered too many times a wrong password'.
Test with FlexableLogin version 0.17
minecraft: 1.12.2
Sponge api : 7.1.0-6aa4e43
Spongeforge: 1.12.2-2611-7.1.0-Beta-2931
minecraftForge: <IP_ADDRESS>11

The player register out perfectly. But after exit not can to join.
forge-1.12.2-<IP_ADDRESS>11-universal.jar
spongeforge-1.12.2-2611-7.1.0-BETA-2931.jar
flexiblelogin-0.17.jar
For the test. I deleted the database and configuration files. It doesn't help.

Thx for update~!


Please enable connecting to etcd with tls based authentication

This branch extracts work done by https://github.com/gandalfmagic/vip-manager to allow vip-manager to connect to etcd via tls based authentication.
It should fix #13

@tpo  @gandalfmagic Could you please rebase your PR on the latest version, please?

Merged in 86db6ec88a31f0732bd7e77b1c155f94be6e4fde .
Thanks everyone!


Download slack files using API

Adding download functionality to the client with a new method GetFile
which will write the contents to a provided io.Writer
Resolves: #141

Open to feedback - just started messing around with go the other day so if its horrible, will gladly make changes.

simple test and fixing the seg fault and this can be merged if anyone is interested in taking up the work.

picked up this task in a new PR
https://github.com/nlopes/slack/pull/472

think we can probably close this since #472 resolved the issue?

or at least maybe take off the help wanted labels to prevent confusion

closing due to age.


Serializer Refactor

Closes #51
Closes #50
Serialize now returns an optional and eliminates the need for special handling of Property Policy and Optional.
Serialized Optional won't be included by default when nil (previously was NSNull)
PropertyPolicy is now much simpler, just an enum that should cover all use cases and doesn't need special handling because it leverages the power of CustomSerializable

@joanromano please give me feedback before I proceed fixing the unit test with the new behaviors

Ready to be reviewed

👍

[Current coverage][cc-pull] is 98.73%

Merging [#52][cc-pull] into [master][cc-base-branch] will increase coverage by +49.40%

2 files (not in diff) in .../Sources/Quick/Hooks were deleted. more
4 files (not in diff) in ...ck/Sources/Quick/DSL were deleted. more
2 files (not in diff) in .../Quick/Configuration were deleted. more
14 files (not in diff) in .../Quick/Sources/Quick were deleted. more
5 files (not in diff) in ...Sources/Nimble/Utils were deleted. more
27 files (not in diff) in ...rces/Nimble/Matchers were deleted. more
6 files (not in diff) in .../Adapters/ObjectiveC were deleted. more
4 files (not in diff) in ...rces/Nimble/Adapters were deleted. more
5 files (not in diff) in ...imble/Sources/Nimble were deleted. more
1 files (not in diff) in KakapoExample/Pods were deleted. more

@@             master        #52   diff @@
==========================================
  Files            85          5     -80
  Lines          4762        314   -4448
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits           2349        310   -2039
+ Misses         2413          4   -2409
  Partials          0          0

Powered by Codecov. Last updated by [a7385e3...ca3577c][cc-compare]
[cc-base-branch]: https://codecov.io/gh/devlucky/Kakapo/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/devlucky/Kakapo/compare/a7385e3a617ceb2f656257c414bc67d806ad37a5...ca3577c02fdbdce3a2596e753291b229c97e8f0b
[cc-pull]: https://codecov.io/gh/devlucky/Kakapo/pull/52?src=pr


_utils: Make sure boto3's default session is used

Description of changes:

Currently awswrangler ensures that at least some boto3 Session is
used when it calls AWS resources. However, since it creates a
boto3.Session() when non-null boto3 Session is passed as a
parameter, it completely sidesteps the ability of the user to set
parameters to the boto3 session that gets used by default (via the
boto3.setup_default_session function).

This commit ensures that the ensure_session function uses boto3's
default session (reachable via boto3._get_default_session()) which
then also allows awswrangler users to set default parameters of the
boto3 Session it uses by default via boto3.setup_default_session().

Signed-off-by: mr.Shu<EMAIL_ADDRESS>By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Relevant link: https://boto3.amazonaws.com/v1/documentation/api/latest/_modules/boto3.html#setup_default_session

@igorborgest I am not sure how would one test something like this but I'd be happy to incorporate some tests, if that was advisable.
Furthermore, if this ever makes it to master it may make sense to update the second part of the tutorial, so that users are aware that the parameters of the default session can also be set globally -- much like in the pre-1.0.0 versions of awswrangler.
Please do let me know if there is anything you'd like me to update here.
Thanks!

Hi @mrshu, thanks for the contribution.
It makes a lot of sense.
I would like to avoid access to external private methods as much as possible, but I can't see an alternative by now.
I will merge it on the dev branch and then write some tests to cover it.


[TST] Refactoring CircleCI setup

Moves --use-aroma to ds054 with two ideas:

Shorten ds005 which was growing too large (CIFTI, partial exec, etc.)
Remove SyN from ds054 because it has fieldmaps, and make time for AROMA.

Overall, this PR should shorten the runtime of tests.
Also, figures/ folder has been pruned out of the outputs check (reports can be visualized and this check is a source of many errors).
When finished, this should fix #1090.

Something weird is happening. Moving AROMA to ds054 now gives:
Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/plugins/multiproc.py", line 68, in run_node
    result['result'] = node.run(updatehash=updatehash)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/nodes.py", line 480, in run
    result = self._run_interface(execute=True)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/nodes.py", line 564, in _run_interface
    return self._run_command(execute)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/pipeline/engine/nodes.py", line 644, in _run_command
    result = self._interface.run(cwd=outdir)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 520, in run
    runtime = self._run_interface(runtime)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/interfaces/report_base.py", line 51, in _run_interface
    ReportCapableInterface, self)._run_interface(runtime)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 1020, in _run_interface
    self.raise_exception(runtime)
  File "/usr/local/miniconda/lib/python3.6/site-packages/niworkflows/nipype/interfaces/base/core.py", line 957, in raise_exception
    ).format(**runtime.dictcopy()))
RuntimeError: Command:
ICA_AROMA.py -den nonaggr -i /scratch/fmriprep_wf/single_subject_100185_wf/func_preproc_task_machinegame_run_01_wf/ica_aroma_wf/smooth/vol0000_xform-00000_merged_smooth.nii.gz -meldir /scratch/fmriprep_wf/single_subject_100185_wf/func_preproc_task_machinegame_run_01_wf/ica_aroma_wf/melodic -mc /scratch/fmriprep_wf/single_subject_100185_wf/func_preproc_task_machinegame_run_01_wf/bold_hmc_wf/normalize_motion/motion_params.txt -o out
Standard output:

------------------------------- RUNNING ICA-AROMA -------------------------------
--------------- 'ICA-based Automatic Removal Of Motion Artifacts' ---------------

Warning! Please check whether the determined TR (of 1.0s) is correct!

Step 1) MELODIC
  - The specified MELODIC directory does not contain the required files to run ICA-AROMA. MELODIC will be run seperately.
Standard error:

An exception has been thrown
Logic error:- detected by Newmat: index error: requested index = 2

MatrixType = Rect   # Rows = 1; # Cols = 1

Traceback (most recent call last):
  File "/opt/ICA-AROMA/ICA_AROMA.py", line 193, in <module>
    aromafunc.runICA(fslDir, inFile, outDir, melDir, mask, dim, TR)
  File "/opt/ICA-AROMA/ICA_AROMA_functions.py", line 94, in runICA
    nrICs = int(float(subprocess.getoutput(cmd)))
ValueError: could not convert string to float: 'ERROR: Could not open file'
Return code: 1

And the weird issue of work/ subfolders not being stored as artifacts is replicated.

This looks reasonable, but I guess we'll see when tests finish.

Continued in #1098. Fix for #1090 will be addressed in a new PR.


Add Kumina's company logo to the list of users.

Kumina a company based in the Netherlands doing managed operations for
Linux-based systems. Kumina has switched over to Prometheus over the
last year and is now using it as its exclusive monitoring system for
some of its customers.
In the process, Kumina has developed (and is still developing) metrics
exporters for many pieces of commonly used Open Source software. Most of
these can be found on our company's GitHub page:
https://github.com/kumina

Kumina is promoting the use of Prometheus and affiliated projects, like
Kubernetes, by giving talks about them at Open Source conferences in the
Netherlands.

Thanks!


1.5 linters build error

Looks like some linters are unable to build with go 1.5, probably because the types package was moved (see https://golang.org/doc/go1.5).
Errors output: https://gist.github.com/sp-gonzalo-serrano/782a93cb7a7e656bcbe1
Is there any way to just install certain linters?
Thanks

If you have upgrade Go recently you should clean the packages cache, rm -rf $GOPATH/pkg.

This is currently happening from running
go get -u github.com/opennota/check/cmd/structcheck
go get -u github.com/opennota/check/cmd/aligncheck

There is currently no way to install linters separately.
All linters are installed with one command to avoid repeatedly updating/installing the same packages that the linters depend on. For example, the two commands mentioned by @njohns-grovo will download all the dependencies twice. Multiply that by 17 linters and installs/updates take a very long time if done individually. By combining them into one command, common dependencies are only downloaded once. This was introduced in 8d1fc9355fa30b100f360af158acfd8a32433943.
There are several solutions:

Do nothing. People can manually install linters if temporary breakage occurs.
Attempt one-shot install but fall back on installing linters individually on failure.

I implemented the second option.

Looks like this specific build failure was fixed by a roll-back commit in golang/tools: https://github.com/golang/tools/commit/da91609d887c6b1e28ad4548c47f3ff39a471989


Remove indexes from dataframes returned by format_as_dataframe

So far from my and @kmike experience we always call .reset_index() on results of  format_as_dataframe/explain_*_df, because usually some data transformation is needed (that's why dataframe format is convenient) and it's usually easier to do that on plain columns.
So the idea is to change the API and always return dataframes without custom indexes.

/cc @ClimbsRocks - does it affect you?

@kmike what do you think about transition features? Right now they are returned as a pivot table to maximally resemble the look of formatted explanation, but I feel that since we are removing indexes everywhere, it makes sense to return them as a plain dataframe too?


Notepadqq regular expression subgroup can't be reused in search and replace

Prerequisites

[ y] Can you reproduce the problem with Debug -> Reload Without Extensions?
[ y] Did you perform a cursory search to see if your bug or enhancement is already reported?
[ ] Did you read the Troubleshooting guide?

For more information on how to write a good bug report read here
For more information on how to contribute read here
Description
If you want to search and replace using regular expression in notepadqq you will not able to replace a group more than once in replace.
Steps to Reproduce

Search a replace a string in notepadqq
In replace use any group more than once e.g. \1 more than one
only once it will be replaced

Expected behavior: [Needs debugging]
Actual behavior: [Should be able to reuse as much as we needed]
Versions
I am using ubuntu 16.10
Please include the version of Brackets. You can find it under Help -> About Brackets (Windows and Linux) or Brackets -> About Brackets (macOS)

AFAICT Brackets does support group reusage.
Maybe you need to open the issue to Notepadqq?


Can add context support?

add 3 functions
func (r *Runtime) RunProgramWithContext(ctx context.Context, p *Program) (result Value, err error)
func (r *Runtime) RunScriptWithContext(ctx context.Context, name, src string) (Value, error)
func (r *Runtime) RunStringWithContext(ctx context.Context, str string) (Value, error)
add Context field into FunctionCall  and ConstructorCall.
usage:
vm := New()
vm.Set("test", func(call goja.FunctionCall) goja.Value {
  ctx := call.Context
  ........
})
......

vm. RunStringWithContext(ctx, `test('aa')`)

See https://github.com/dop251/goja/issues/198

See https://github.com/dop251/goja/issues/198

My Needs is Pass a Argument from RunXXXWithContext to my go function.
vm := New()
vm.Set("test", func(call goja.FunctionCall) goja.Value {
  ctx := call.Context
  x := ctx.Value("xxxx").(MyObject)
  ........
})
......

vm. RunStringWithContext(context.WithValue(ctx, "xxxx", myObject), `test('aa')`)

yes, context is error, but it is already exists in the golang, and gls isnot exists in the golang.
There is now a way to work around, but it is not convenient, and inefficient:
vm := New()
vm.Set("test", func(call goja.FunctionCall) goja.Value {
   myObject := convertToMyObject(call.Argument(0))
  ........
})
......
vm.Set("xxx", myObject)
vm. RunString(`test(xxx, 'aa')`)
vm.Set("xxx", goja.Undefined())

My Needs is Pass a Argument from RunXXXWithContext to my go function.
vm := New()
vm.Set("test", func(call goja.FunctionCall) goja.Value {
  ctx := call.Context
  x := ctx.Value("xxxx").(MyObject)
  ........
})
......

vm. RunStringWithContext(context.WithValue(ctx, "xxxx", myObject), `test('aa')`)

yes, context is error, but it is already exists in the golang, and gls isnot exists in the golang.
There is now a way to work around, but it is not convenient, and inefficient:
vm := New()
vm.Set("test", func(call goja.FunctionCall) goja.Value {
   myObject := convertToMyObject(call.Argument(0))
  ........
})
......
vm.Set("xxx", myObject)
vm. RunString(`test(xxx, 'aa')`)
vm.Set("xxx", goja.Undefined())

HI @runner-mei,
At k6 we use this function to basically do a struct->map[string]interface{} transformation such that for each method of the struct that has context.Context as the first argument it will be given the context provided in the Bind call, but all other arguments remain the same.
(It also does other things that are less relevant to the discussion here).
I agree that having this build inside goja would've saved us doing that (although it is from before my time, and we are kind of afraid to touch it ... as it's a lot of black magic). On the other hand, this hack isn't as ugly as it looks, and apart from having to know to call it when this is required and the fact that you can't use the resulting value as the type it originated as (probably butchering the explanation somewhat) it is ... perfectly serviceable and is used throughout k6. I would expect that other people have also done similar hacks or that this is a very rare use case?
Now that I am looking at the code I am more and more inclined to believe that if we don't export map[string]interface{} but a Proxy (like) object this will probably work better and there will be a way for the common.Bind to even get the correct object out of the proxy and put it back as the argument for the call. So the issue from our community forum is solvable even now :).
Will it be easier for me in this case if goja, just supported it - definitely, although I don't know if it won't have other problems.
If I was writing a JS VM in golang, today I am definitely adding context support, but retroactively adding it, might be much harder and likely will break existing code so :shrug:
~Another alternative that I am probably going to explore in k6 is to drop the whole binding of stuff and just getting goja.FunctionCall in all cases where we care about the context.Context and having the context.Context as a global in the goja.Runtime that we get from the goja.FunctionaCall~ Unfortunately as I wrote this I went and checked and it seems like there is no way to get the goja.Runtime :(

HI @runner-mei,
At k6 we use this function to basically do a struct->map[string]interface{} transformation such that for each method of the struct that has context.Context as the first argument it will be given the context provided in the Bind call, but all other arguments remain the same.
(It also does other things that are less relevant to the discussion here).
I agree that having this build inside goja would've saved us doing that (although it is from before my time, and we are kind of afraid to touch it ... as it's a lot of black magic). On the other hand, this hack isn't as ugly as it looks, and apart from having to know to call it when this is required and the fact that you can't use the resulting value as the type it originated as (probably butchering the explanation somewhat) it is ... perfectly serviceable and is used throughout k6. I would expect that other people have also done similar hacks or that this is a very rare use case?
Now that I am looking at the code I am more and more inclined to believe that if we don't export map[string]interface{} but a Proxy (like) object this will probably work better and there will be a way for the common.Bind to even get the correct object out of the proxy and put it back as the argument for the call. So the issue from our community forum is solvable even now :).
Will it be easier for me in this case if goja, just supported it - definitely, although I don't know if it won't have other problems.
If I was writing a JS VM in golang, today I am definitely adding context support, but retroactively adding it, might be much harder and likely will break existing code so :shrug:
~Another alternative that I am probably going to explore in k6 is to drop the whole binding of stuff and just getting goja.FunctionCall in all cases where we care about the context.Context and having the context.Context as a global in the goja.Runtime that we get from the goja.FunctionaCall~ Unfortunately as I wrote this I went and checked and it seems like there is no way to get the goja.Runtime :(

I wouldn't want to add Runtime to FunctionCall simply because in most cases it's not needed, however, it should be possible to have a special treatment for func(FunctionCall, *Runtime) Value in Runtime.ToValue() which would make a simple wrapper around it. If it helps.

I wouldn't want to add Runtime to FunctionCall simply because in most cases it's not needed, however, it should be possible to have a special treatment for func(FunctionCall, *Runtime) Value in Runtime.ToValue() which would make a simple wrapper around it. If it helps.

I wouldn't want to add Runtime to FunctionCall simply because in most cases it's not needed, however, it should be possible to have a special treatment for func(FunctionCall, *Runtime) Value in Runtime.ToValue() which would make a simple wrapper around it. If it helps.

If this is so my last alternative will work ... I don't think it is required for the k6 team, at least not currently.
I don't find either of the two shortcomings big enough to touch the code I linked ... as it is a lot of black magic. So removing or completely rewriting it .. is an unlikely occurrence. I do intend on dropping support for a pointer to a context ... which I don't know why exists and maybe at that time I will try to figure out if there are other things I would be willing to try changing. The problem is that at least for our project - having another "easier" way of doing stuff isn't really interesting as we already have it working :D
This doesn't mean that I don't think that something like
func(f FunctionCall, r *Runtime)

or even better
func(parameter1 int, r *Runtime)

won't be useful. I just prefer if you work on adding support for more ES6 features such as generators/Promises/let/const then adding random wrapping logic that at least for k6 we have already figured out, and rewriting to an alternative variant will likely ... not improve things for us.
Others obviously might be in a different boat, and I can definitely say that some of the cases where context is being used in k6 are just so we get the Runtime and do something with it, not to get any of the other things the context has or check if it's "Done".

I wouldn't want to add Runtime to FunctionCall simply because in most cases it's not needed, however, it should be possible to have a special treatment for func(FunctionCall, *Runtime) Value in Runtime.ToValue() which would make a simple wrapper around it. If it helps.

If this is so my last alternative will work ... I don't think it is required for the k6 team, at least not currently.
I don't find either of the two shortcomings big enough to touch the code I linked ... as it is a lot of black magic. So removing or completely rewriting it .. is an unlikely occurrence. I do intend on dropping support for a pointer to a context ... which I don't know why exists and maybe at that time I will try to figure out if there are other things I would be willing to try changing. The problem is that at least for our project - having another "easier" way of doing stuff isn't really interesting as we already have it working :D
This doesn't mean that I don't think that something like
func(f FunctionCall, r *Runtime)

or even better
func(parameter1 int, r *Runtime)

won't be useful. I just prefer if you work on adding support for more ES6 features such as generators/Promises/let/const then adding random wrapping logic that at least for k6 we have already figured out, and rewriting to an alternative variant will likely ... not improve things for us.
Others obviously might be in a different boat, and I can definitely say that some of the cases where context is being used in k6 are just so we get the Runtime and do something with it, not to get any of the other things the context has or check if it's "Done".

I don't like "func(f FunctionCall, r *Runtime)", I can achieve this by myself。https://github.com/runner-mei/gojs

I don't like "func(f FunctionCall, r *Runtime)", I can achieve this by myself。https://github.com/runner-mei/gojs


Add JSON.stringify to enable error on  browser.service.ts

Add JSON.stringify to enable try/catch error handling

errors are currently coming back with [Object object] in the message string

This will log '{}'. See:

https://stackoverflow.com/questions/18391212/is-it-not-possible-to-stringify-an-error-using-json-stringify
https://jsfiddle.net/wstueve/872q15aj/3/

I am seeing  [Object object] in the string currently.
This code is implemented on an error below on line 120, same file, why is this acceptable in this use case?

Not sure.  I couldn't get it to print out the correct thing when I tried it in a Fiddle a couple ways.


can you support IE11

Yes, but you can compensate by loading src/polyfills.ts scripts, that demo site is not enabled by default.

but I got below problem:
Promise rejection: Object doesn't support property or method 'includes'

see https://github.com/angular/angular-cli/issues/4128

Thank you cipchk,
I add the import to polyfills.ts follow the link, and it work well.
import 'core-js/es7/array';
I suggest add the line code and comment it into source code.


Bug: Week number is off by one

The week number does not display correctly. Currently on January 22nd it is showing as week 4 instead of 3.
Edit: Turns out it is set correctly, but Moment.js bases the week number off of locale (as in language set). To resolve this, should add an option to base Week number off the ISO Week Number.

Ya, I noticed this too. I think some calendar software offer options of what constitutes the first week of the year (i.e. how many days of the new year need to be in the first week to count as week number 1 rather than the last week of the last year.) - this could be an alternative, or maybe just look into what ISO says about it, like OP proposed.
(FWIW I had to disable week numbers because it's clashing with what Outlook and my paper calendar are telling me.)

Ya, I noticed this too. I think some calendar software offer options of what constitutes the first week of the year (i.e. how many days of the new year need to be in the first week to count as week number 1 rather than the last week of the last year.) - this could be an alternative, or maybe just look into what ISO says about it, like OP proposed.
(FWIW I had to disable week numbers because it's clashing with what Outlook and my paper calendar are telling me.)

An ISO option has been added in version 3.2.0, you should hopefully see this update on your machine within a week, as soon as Chrome and Edge approve it. Thank you.


Build of zswag on msys2 fails.

I tried to build zswag on msys2 but an error occurred.
The details of the error are not output and I am not sure how to deal with it.
Do you have any advice on how to resolve this error?
Also, what development environment (OS, etc.) does the zswag team use?
Development Environment
$ python3 --version
Python 3.9.13

$ pip --version
pip 22.0.4 from C:/msys64/mingw64/lib/python3.9/site-packages/pip (python 3.9)

$ cmake --version
cmake version 3.23.2

$ gcc --version
gcc.exe (Rev2, Built by MSYS2 project) 12.1.0

$ java --version
openjdk <IP_ADDRESS> 2022-04-22
OpenJDK Runtime Environment (build <IP_ADDRESS>+2-6)
OpenJDK 64-Bit Server VM (build <IP_ADDRESS>+2-6, mixed mode, sharing)

$ ant -version
Apache Ant(TM) version 1.10.12 compiled on October 13 2021

Procedure
Install dependent packages related to keychain.
$ pacman -S mingw-w64-x86_64-libsecret
$ pacman -S glib2

$ git clone --recursive https://github.com/ndsev/zswag.git

$ mkdir build
$ cd build
$ cmake ..

Error message
-- Building for: Ninja
-- The C compiler identification is GNU 12.1.0
-- The CXX compiler identification is GNU 12.1.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/msys64/mingw64/bin/cc.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/msys64/mingw64/bin/c++.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found OpenSSL: C:/msys64/mingw64/lib/libcrypto.dll.a (found version "1.1.1o")
-- Found Python3: C:/msys64/mingw64/bin/python3.9.exe (found version "3.9.13") found components: Interpreter Development Development.Module Development.Embed
-- Build spdlog: 1.10.0
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Build type: Release
-- pybind11 v2.6.3 dev1
CMake Warning (dev) at C:/msys64/mingw64/share/cmake/Modules/CMakeDependentOption.cmake:89 (message):
  Policy CMP0127 is not set: cmake_dependent_option() supports full Condition
  Syntax.  Run "cmake --help-policy CMP0127" for policy details.  Use the
  cmake_policy command to set the policy and suppress this warning.
Call Stack (most recent call first):
  deps/pybind11/CMakeLists.txt:98 (cmake_dependent_option)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Performing Test HAS_FLTO
-- Performing Test HAS_FLTO - Success
=> Running main zserio ant install ...
=> Running zserio cpp extension ant install ...
=> Running zserio doc extension ant install ...
=> Running zserio bundle install ...
CMake Error at deps/zserio-cmake-helper/CMakeLists.txt:62 (message):
  Failed to build zserio.jar in
  C:/msys64/home/70206703/work/zswag/deps/zserio.

Hi! You can see the set of platforms we test on from the Github CI file under .github/cmake.yaml:

OSs: Ubuntu >= 20.04, macOS 10.15, macOS latest, Windows latest
Python Versions: 3.8, 3.9

On Windows, we are building through Ninja and MSVC (MS Build Tools >= 2017). Unfortunately I can't provide any experience with MINGW. The expected output during configuration can be seen for example in this Github Action Output: https://github.com/ndsev/zswag/runs/7498009417. Check the Build (Windows) step...


Support Solr Config API

As discussed today in Relevance Slack: I've found that attempting to add the Querqy query parser using the Solr Config API (in Solr 8.2) fails with the exception java.lang.ClassCastException: class java.util.LinkedHashMap cannot be cast to class org.apache.solr.common.util.NamedList. The command below is accepted (but is ineffective) only if the rewriter property is renamed:
{
  "create-queryparser": {
    "class": "querqy.solr.DefaultQuerqyDismaxQParserPlugin",
    "name": "querqy",
    "parser": {
      "class": "querqy.parser.WhiteSpaceQuerqyParser",
      "factory": "querqy.solr.SimpleQuerqyQParserFactory"
    },
    "rewriteChain": {
      "rewriter": {
        "class": "querqy.solr.SimpleCommonRulesRewriterFactory",
        "ignoreCase": true,
        "querqyParser": "querqy.rewrite.commonrules.WhiteSpaceQuerqyParserFactory",
        "rules": "rules.txt"
      }
    }
  }
}

I think we should re-consider the approach to configuring Querqy in general and move towards its own API (request handler) to manage the configuration. This would allow us to validate the configuration before it is saved and also avoid the need for core/collection reloads on update.

I agree, with @renekrie  as this will also standardize with how querqy will be configured.

Created #76 for a new general approach to rewriter definition

Thanks Rene - shall I close this issue?

Thanks Rene - shall I close this issue?

I think we should leave it  open and x-ref the two issues until #76 has a clear outcome.

This will be covered by #76. Closing this issue now.


[FeatureRequest] make used color palette customizable

Since not everybody has good eyes or even have a specific colorblindness it would be cool to make the used palette customizable via configfile/parameter

That's a great idea. This is already supported; for example, you can use --color-scheme solarized. The full list of color schemes can be found here.
Unfortunately there's no configuration file support yet, so for now, I would add an alias such as alias ktail=/usr/local/bin/ktail --color-scheme <scheme>.

I added support for using a configuration file. If you build from source (clone this repo and run go install .), you can try it out. See the readme for instructions.

This is now released in 1.4.0.


POPGym performance issue.

Hi, @artemZholus I'm now reproducing your projec(popgym) in my PC.
The rep and dyn loss seems to be stable While the score is very different from your figure, Especially the steps after 40M

After searching, I've find that the act_opt_loss is very bad ,You can see it as here.

I'm just using the code and config as your repo, using the command you provided.
Notice: The running was once interupt at 20M and i rerun it ,It resume to run from 20M to 120 M
Could you help me ?

rep loss.

dyn loss

Hi , @Lr-2002 , let me take a look.

ok, do you need wandb access? or something else ?

Hi @Lr-2002 . After a quick investigation I found there was some mismatch is the configuration for popgym. The mismatch is only in the network sizes (to the best of my knowledge). Note that memory-maze configs are unaffected and they successfully reproduce the results from the paper (I reproduced them with this code just before the release).  I put the fixed config into PR #4 , please check it. I will run some additional reproduction experiments on my side to make sure things are fine.

Well, have you tried to run with the config file ? It remains other bugs.
TypeError: add got incompatible shapes for broadcasting: (8, 1024), (8, 512).

Yes. You need to delete your previous contents of your logs directory as it contains a saved model with different tensor shapes.

ohhh，thanks.Let me check it

Closing this issue due to the lack of activity. Please reopen if you have any other issues.


Support for QFUS - yi 1080p PTZ outdoor Camera

Hello Roleoroleo,
is it possible to customize the firmware to support the yi 1080p PTZ outdoor Camera or is it all ready compatible? This model is quite new I guess. and I bought it via Ali Express. it is fully integrated with the Yi Home  App, but I was not able to find a custom firmware to use the rtsp streams. Regarding some Discord channels some of the developer mentioned that your firmware is the closest one that is compatible with the camera. Is the true or does it require some development time to get it working? Firmware Version is <IP_ADDRESS>_202101251914 and the ID Beginns with "QFUSXXXXXXX"

Same camera here, seems to do something r30gb (does boot into yi hack and can get on the yi hack webinterface)
can take a snapshot, but the image seems encrypted, after taking a snapshot the cam reboots.
Would be nice to have support for it, if testing is needed i'll be happy to do some

Are you able to dump a backup?
Check the wiki.

Are you able to dump a backup?
Check the wiki.
About reboot, enable swap file.

Yes, backup seems to have worked
QFUS_PTZ_backup.zip

Your cam is a r40ga.
I will try to add it.

Here it is a first alpha version:
r40ga_0.1.7.tar.gz
Probably rtsp and snapshot don't work.
Install it and check if ssh and web work.

Man your fast :-) thanks for all the work your putting into this.
Below my test findings on the alpha version:
Configuration:
Hostname - works
date time server and timezone - works
ftp - works
ssh - works
telnet - works
Mqtt seems to work, but when enabled and rebooting the cam using the webinterface it will never let you get back into the webinterface without powercycling the camera bij unplugging it from the mains.
Allso making changes to other settings and rebooting via maintanance locks you out of the webinterface untill you power cycle.
Disabeling yi cloud does work, but no files are stored local
Motion events does seem to create a folder, but does not record
On ssh I get "mount: mounting none on /sys/kernel/debug failed: Resource busy"
Not sure if this is related to the not recording and the freezing after sooft reboot, but it might be that it can not mount the sd correctly?!?
snapshot - not working
rtsp - not working
onviv -  seems to find the camera but shows a connection refused
ptz - not working (stating it is not availale on this cam)

Ok, send me 3 copies of your /dev/shm/fshare_frame_buf
It's the video buffer.
Make a copy, wait 5 seconds, make another copy, wait 5 seconds and make the last copy.
Compress it and send it to me.
I will try to fix rtsp and snapshot.

Not sure how exact the 5 seconds in between have to be......but i tried to stay close to 5 seconds :)
dev_shm_fshare.zip

The video is very different.
I need a lot of time to make this cam compatible.

The video is very different.
I need a lot of time to make this cam compatible.

No problem, the cam is not going anywhere so take all the time you need.
I wish I could help, but my linux and camera knowledge is not so good.
If I can do anything, help testing or sending files/logs let me know, i'll do what i can.

i will donate you some beers to keep the stress level down during the process! cheers :)

Thank you, I'll let you know as soon as possible.

Overwrite the file in /tmp/sd/yi-hack/bin with the content of this archive:
r40ga.tar.gz

Overwrite the files in /tmp/sd/yi-hack/bin with the content of this archive:
r40ga.tar.gz

Test with the new files.
no luck

snapshot paes stays empty
no video is saved in the motion tab (only empty date time folders are created
VLC won't connect to the stream (vlc log below)
onvif does find cam but gives connection error as well

-- logger module started --
main: Running vlc with the default interface. Use 'cvlc' to use vlc without interface.
main: playlist is empty
live555 error: Failed to connect with rtsp://<IP_ADDRESS>:554
main error: connection failed: Connection refused by peer
satip error: Failed to connect to RTSP server <IP_ADDRESS>:554
main error: connection failed: Connection refused by peer
access_realrtsp error: cannot connect to <IP_ADDRESS>:554
live555 error: Failed to connect with rtsp://<IP_ADDRESS>:554/ch0_0.h264
main error: connection failed: Connection refused by peer
satip error: Failed to connect to RTSP server <IP_ADDRESS>:554
main error: connection failed: Connection refused by peer
access_realrtsp error: cannot connect to <IP_ADDRESS>:554
-- logger module stopped --

* snapshot page stays empty

Try to run the webservices:
http://<IP_ADDRESS>:8080/cgi-bin/snapshot.sh
http://<IP_ADDRESS>:8080/cgi-bin/snapshot.sh?res=low

* VLC won't connect to the stream (vlc log below)

Did you try both high and low res?
Log in with ssh and check if programs are running (command ps).

* onvif does find cam but gives connection error as well

This is normal because rtsp doesn't work.

Both web requests return a blank page (empty even in the dev tools there are no tags or anything) only a 200 OK
Request URL: http://<IP_ADDRESS>:8080/cgi-bin/snapshot.sh?res=low
Request Method: GET
Status Code: 200 OK
Below the list of running programs:
PID USER       VSZ STAT COMMAND
1 root       980 S    /sbin/init
2 root         0 SW   [kthreadd]
3 root         0 SW   [ksoftirqd/0]
5 root         0 SW<  [kworker/0:0H]
7 root         0 SW   [rcu_preempt]
8 root         0 SW   [rcu_sched]
9 root         0 SW   [rcu_bh]
10 root         0 SW<  [lru-add-drain]
11 root         0 SW   [kdevtmpfs]
207 root         0 SW   [oom_reaper]
208 root         0 SW<  [writeback]
210 root         0 SW   [kcompactd0]
211 root         0 SW<  [crypto]
212 root         0 SW<  [bioset]
214 root         0 SW<  [kblockd]
255 root         0 SW   [sys_user]
263 root         0 SW<  [cfg80211]
269 root         0 SW<  [watchdogd]
289 root         0 SW<  [spi0]
299 root         0 SW   [kswapd0]
383 root         0 SW<  [bioset]
388 root         0 SW<  [bioset]
393 root         0 SW<  [bioset]
398 root         0 SW<  [bioset]
403 root         0 SW<  [bioset]
408 root         0 SW<  [bioset]
413 root         0 SW<  [bioset]
418 root         0 SW<  [bioset]
423 root         0 SW<  [bioset]
451 root         0 SW   [irq/302-sunxi-m]
453 root         0 SW   [irq/166-sdc0 cd]
509 root         0 SW<  [bioset]
510 root         0 SW   [mmcqd/0]
535 root         0 SW<  [kworker/0:1H]
551 root         0 SWN  [jffs2_gcd_mtd4]
557 root       980 S    -/bin/sh
588 root       980 S    /usr/sbin/telnetd
615 root      1172 S    ./dispatch
1114 root     52624 S    ./rmm
1176 root         0 SW   [RTW_CMD_THREAD]
1195 root      1424 S    /backup/tools/wpa_supplicant -c/tmp/wpa_supplicant.c
1433 root       980 S    udhcpc -i wlan0 -b -s /backup/tools/default.script -
1586 root      2896 S    ./mp4record
1601 root       860 S    httpd -p 8080 -h /tmp/sd/yi-hack/www/ -c /tmp/httpd.
1619 root       844 S    pure-ftpd (SERVER)
1634 root       876 S    dropbear -R -B
1636 root       668 S    ipc_multiplexer
1835 root       860 S    ntpd -p pool.ntp.org
1911 root       996 S    {wd_rtsp.sh} /bin/sh /tmp/sd/yi-hack/script/wd_rtsp.
1967 root      2072 S    wsdd --pid_file /var/run/wsdd.pid --if_name wlan0 --
1968 root      2420 S    framefinder r40ga
1993 root       860 S    /tmp/sd/yi-hack/usr/sbin/crond -c /var/spool/cron/cr
13609 root         0 SW   [kworker/u2:1]
22850 root         0 SW   [kworker/u2:2]
23347 root         0 SW   [kworker/0:1]
26439 root         0 SW   [kworker/0:0]
26777 root         0 SW   [kworker/u2:0]
28729 root       900 R    dropbear -R -B
28784 root       980 S    -ash
28868 root       980 S    sleep 10
28890 root       980 R    ps

rtsp is not running, I don't know why.
Try to run it manually and check the log:
killall wd_rtsp.sh
. /tmp/sd/yi-hack/script/env.sh
RRTSP_MODEL=r40gb RRTSP_RES=both RRTSP_AUDIO=no RRTSP_DEBUG=1 rRTSPServer

Do the
. /tmp/sd/yi-hack/script/env.sh
and
RRTSP_MODEL=r40gb RRTSP_RES=both RRTSP_AUDIO=no RRTSP_DEBUG=1 rRTSPServer
need to be on 1 line?
if i do it on 2 lines i get the error below
on the same line i get no error, but it results in the server still not running i think
root@TestYi:~# killall wd_rtsp.sh
root@TestYi:~# . /tmp/sd/yi-hack/script/env.sh
root@TestYi:~# RRTSP_MODEL=r40gb RRTSP_RES=both RRTSP_AUDIO=no RRTSP_DEBUG=1 rRT
SPServer
Segmentation fault
root@TestYi:~# killall wd_rtsp.sh
killall: wd_rtsp.sh: no process killed
root@TestYi:~# . /tmp/sd/yi-hack/script/env.sh RRTSP_MODEL=r40gb RRTSP_RES=both
RRTSP_AUDIO=no RRTSP_DEBUG=1 rRTSPServer
root@TestYi:~# ps
PID USER       VSZ STAT COMMAND
1 root       980 S    /sbin/init
2 root         0 SW   [kthreadd]
3 root         0 SW   [ksoftirqd/0]
5 root         0 SW<  [kworker/0:0H]
7 root         0 SW   [rcu_preempt]
8 root         0 SW   [rcu_sched]
9 root         0 SW   [rcu_bh]
10 root         0 SW<  [lru-add-drain]
11 root         0 SW   [kdevtmpfs]
207 root         0 SW   [oom_reaper]
208 root         0 SW<  [writeback]
210 root         0 SW   [kcompactd0]
211 root         0 SW<  [crypto]
212 root         0 SW<  [bioset]
214 root         0 SW<  [kblockd]
255 root         0 SW   [sys_user]
263 root         0 SW<  [cfg80211]
269 root         0 SW<  [watchdogd]
289 root         0 SW<  [spi0]
299 root         0 SW   [kswapd0]
383 root         0 SW<  [bioset]
388 root         0 SW<  [bioset]
393 root         0 SW<  [bioset]
398 root         0 SW<  [bioset]
403 root         0 SW<  [bioset]
408 root         0 SW<  [bioset]
413 root         0 SW<  [bioset]
418 root         0 SW<  [bioset]
423 root         0 SW<  [bioset]
451 root         0 SW   [irq/302-sunxi-m]
453 root         0 SW   [irq/166-sdc0 cd]
509 root         0 SW<  [bioset]
510 root         0 SW   [mmcqd/0]
535 root         0 SW<  [kworker/0:1H]
551 root         0 SWN  [jffs2_gcd_mtd4]
556 root       980 S    -/bin/sh
588 root       980 S    /usr/sbin/telnetd
615 root      1172 S    ./dispatch
1114 root     52692 S    ./rmm
1143 root         0 SW   [kworker/u2:2]
1177 root         0 SW   [RTW_CMD_THREAD]
1195 root      1424 S    /backup/tools/wpa_supplicant -c/tmp/wpa_supplicant.c
1252 root       980 S    udhcpc -i wlan0 -b -s /backup/tools/default.script -
1469 root      2932 S    ./mp4record
1485 root       860 S    httpd -p 8080 -h /tmp/sd/yi-hack/www/ -c /tmp/httpd.
1496 root       844 S    pure-ftpd (SERVER)
1510 root       876 S    dropbear -R -B
1513 root       668 S    ipc_multiplexer
1633 root       860 S    ntpd -p pool.ntp.org
1734 root      2072 S    wsdd --pid_file /var/run/wsdd.pid --if_name wlan0 --
1735 root      2420 S    framefinder r40ga
1752 root       860 S    /tmp/sd/yi-hack/usr/sbin/crond -c /var/spool/cron/cr
8436 root         0 SW   [kworker/0:0]
11064 root         0 SW   [kworker/0:2]
11748 root         0 SW   [kworker/u2:1]
15051 root         0 SW   [kworker/0:1]
16334 root       900 S    dropbear -R -B
16347 root       984 S    -ash
17053 root       980 R    ps

Some more testing makes me think "RRTSP_MODEL=r40gb" is generating the Segmentation fault error, if i change it to any other model it does not give a fault but starts spitting out:
1623176041877: warning - unexpected NALU header
1623176041902: warning - unexpected NALU header
1623176041927: warning - unexpected NALU header
1623176041953: warning - unexpected NALU header
1623176041978: warning - unexpected NALU header
1623176042003: warning - unexpected NALU header
1623176042028: warning - unexpected NALU header
1623176042053: warning - unexpected NALU header
1623176042079: warning - unexpected NALU header

Thanks, I will check the code again.

If  the help doesn't show r40ga model, you aren't running the new binary.
Please check it.

Snapshot + higres +lowres rtsp is working ! thanks man!

If the help doesn't show r40ga model, you aren't running the new binary.
Please check it.

You are right, it was still running the old files when i checked on the SD card.

Overwrite the files in /tmp/sd/yi-hack/bin with the content of this archive:
r40ga.tar.gz

It looks like the overwriting of the files did not work.
I removed the SD card and changed the files directly on it now with more succes.

Good news!
Now, please check other services: onvif, ptz, etc...

Please try this new archive.
I made some code improvement.
https://github.com/roleoroleo/yi-hack-Allwinner-v2/issues/179#issuecomment-857515796

Please try this new archive.
I made some code improvement.
#179 (comment)

Tests done with new archive:

RTSP High/low - OK
Snapshot - OK
SSH - OK
Telnet - OK
FTP - OK
Legacy FTP - NOT TESTED
Swap File - NOT TESTED
MQTT - OK
NTPD - OK
PTZ - Pan/Tilt working, no Zoom option on the webinterface
Onvif - detected on network but can't connect
Motion Events - motion is detected but files are not saved (date/time folder is created but no recordings in it)

Motion Events - motion is detected but files are not saved (date/time folder is created but no recordings in it)

Some extra info on this.......

recordings are made and stored in /tmp/sd/record/ (can find them using ftp)
recordings do not show on web interface or on sd card

the above and the fact tat the files where not updated when doing the " Overwrite the files in /tmp/sd/yi-hack/bin with the content of this archive:" makes me think that the cam does store things in it's memory but is not retaining it on the SD
But i might be completly off...........

PTZ - Pan/Tilt working, no Zoom option on the webinterface (not even sure if the cam has it, it's not showing in the yi app, so guess not)

Some more info on this.....

It was not working untill i changed the all.js file to include the r40ga

Please update with this file:
https://github.com/roleoroleo/yi-hack-Allwinner-v2/issues/179#issuecomment-857771325
About recording, I will check later.
Questions:

What network interface are you using?
Does your cam have zoom?

What network interface are you using?
WLAN0
if needed for testing I can switch to eth0 and use a cable

2. Does your cam have zoom?
I can't find any zoom option in the yi original app, so i think not.........
(the name most have tricked me... who calls a camera PTZ outdoor if it only has PT, must be marketing trick)

On the webinterface not showing files....
Could it have to do with the filename format it is storing it in??
The naming convention seems different if i compare y21ga with r40ga files, so there is a good chance the js or cgi can't convert it to date time and keeps data == 0, showing the blank page "No events in this folder"
**y21ga - filename **
21M51S09.mp4
r40ga - filename
E222M12S48.mp4
y21ga

I will check.it.

The "problem" is in this file : https://github.com/roleoroleo/yi-hack-Allwinner-v2/blob/master/src/www/httpd/cgi-bin/eventsfile.sh
line 21 for loop:
for f in ls -r /tmp/sd/record/$DIR | grep mp4; do
if [ ${#f} == 14 ]; then
it counts the characters and expects 12 but the new names are 14
changing it to 14 works for showing the file, but it makes the date time wrong du to where the code is expecting minutes and seconds
needs some thinkering to make it work on both old and new filenames (12 and 14)

Your changes are ok, I moved to my source.
Thanks.

Onvif is not starting on this cam, starting it manual like advised here https://github.com/roleoroleo/yi-hack-Allwinner-v2/issues/179#issuecomment-858400828 does work

I think there is a small typo in the new system.sh
line 265
if [[ $MODEL_SUFFIX == "r30gb" ]] || [[ $MODEL_SUFFIX == "r40gb" ]] || [[ $MODEL_SUFFIX == "h5.................................................
Think this shoul be r40ga not r40gb

With the updated system.sh from https://github.com/roleoroleo/yi-hack-Allwinner-v2/issues/179#issuecomment-859405630
this camera seems to have everything working now i think

You are right.

Thank you for the effort! @bfboarder can you please give me a short description how to get the camera on the same state like yours for some testing? @roleoroleo i also noticed that the "Release Page" Link was removed from the read.me. (I just found it by looking at yi-hack-Allwinner (non-V2) and just change the url. if its to complicated i will just wait for the next release.

The release page is linked in the right side of the main page.
But a release for this model is not yet available.
Maybe in a few days.

Hi @roleoroleo sorry to post in old thread, but any news on this release?
I bought this camera and old firmware files in this thread do not seem to work for me.
Thanks for your time and energy.

If your cam is the same model, it's released: r40ga_0.2.0.tgz is your file.

Hi @roleoroleo thanks, I am a moron :D I didn't expand release page so I only saw 4 release versions 🤦
Thanks for you help.

Hi i need your help, i have the same camera but QFCN (chinese version) imposible use this out of China, web ip:port don't work. Thank for your work and your help

You need to configure proxychains-ng.

Could give more details ou link to do this with the camera please ?

This wiki is for a different model but it should work.
https://github.com/roleoroleo/yi-hack-MStar/wiki/Use-proxychains-ng-to-connect-your-app-(thanks-to-@x571)


STY: rename QueryCompiler.view to something more consistent

QueryCompiler.view seems to behave more like PandasDataframe.mask (which in turn is completely different from pandas.DataFrame.mask).
I propose that both QueryCompiler.view and PandasDataframe.mask (and whatever other relevant methods are out there) be renamed to something like take_2d or possibly take_or_slice_2d

@jbrockmendel your proposal sounds great to me. Maybe for further clarity we could use take_2d_labels or take_2d_positions for take-2d-like methods that only take labels or positions, respectively.

Cool.  Are there any other methods that we should get while we're at it?
Are there any scenarios in which these don't make copies?  If so then "take" might not be appropriate. (but it'd be nice to have no-copy variants)

@jbrockmendel

Are there any other methods that we should get while we're at it?

I can't think of anything else. Just view in the query compilers and mask at lower levels.

Are there any scenarios in which these don't make copies?

loc and iloc on a dataframe make copies of the modin.pandas dataframe, query compiler, and PandasDataframe, but they actually use the same partitions pointing to the same data, e.g.
import modin.pandas as pd
import numpy as np

df = pd.DataFrame(np.random.randint(0, 100, (2**10, 2**10)))
loc_2d_taken = df.loc[:,:]
iloc_2d_taken = df.iloc[:,:]

assert  loc_2d_taken._query_compiler._modin_frame._partitions[0,0] is df._query_compiler._modin_frame._partitions[0,0]
assert  iloc_2d_taken._query_compiler._modin_frame._partitions[0,0] is df._query_compiler._modin_frame._partitions[0,0]

assert  loc_2d_taken._query_compiler._modin_frame._partitions[0,0]._data is df._query_compiler._modin_frame._partitions[0,0]._data
assert  iloc_2d_taken._query_compiler._modin_frame._partitions[0,0]._data is df._query_compiler._modin_frame._partitions[0,0]._data

So I guess I would count the results as not copies.

So I guess I would count the results as not copies.

I think in the example above, the full slice short circuits the usual PandasDataframe.mask code. But more generally the iloc makes a new set of partitions with an iloc added to the call queue: https://github.com/modin-project/modin/blob/05bf659b67d2b7153d8aaa004dd95252377eed51/modin/core/dataframe/pandas/partitioning/partition.py#L188
Ray objects are immutable, and adding anything to the call queue means the new data is the result of a new Ray function call, so in that case the result data is a copy. I think add_to_apply_calls works the same way in Dask, and we make a copy.

So I guess I would count the results as not copies.

I think I worded the question poorly.  I meant "copy" as in "copying the underlying data, which can be expensive, and putting it in a new object", as opposed to "making a new object backed by the same data, which is cheap".  in pandas we would call this .copy(deep=True) vs .copy(deep=False).
It sounds like modin is doing a third thing, making a copy of the data but not a new object?

It sounds like modin is doing a third thing, making a copy of the data but not a new object?

No, Modin will normally do "copying the underlying data, which can be expensive, and putting it in a new object". A typical loc or iloc will create a new pandas API object (series or dataframe), query compiler, modin frame, and partitions, which will ultimately get new references to new remote data, e.g.:
import modin.pandas as pd

df = pd.DataFrame([[1, 2], [3, 4]])
view = df.loc[[1], [0]]
assert view._query_compiler._modin_frame._partitions[0,0] is not  df._query_compiler._modin_frame._partitions[0,0]
# new partition still has old _data, but it has a loc[] on the call_queue
print(view._query_compiler._modin_frame._partitions[0,0].call_queue)
assert view._query_compiler._modin_frame._partitions[0,0]._data ==  df._query_compiler._modin_frame._partitions[0,0]._data
# convert view to pandas to flush ilocs from call queues so partitions have updated data
view._to_pandas()
# now the `view` partitions point to distinct `_data` references
assert view._query_compiler._modin_frame._partitions[0,0]._data != df._query_compiler._modin_frame._partitions[0,0]._data

but note that the lazy add_to_apply_calls I linked here means that we defer creating the copy of the underlying data until it's needed for another operation. Above, the _to_pandas drains the call queue. I agree that we don't want to copy a large piece of data for operations like this, but on the other hand, we don't want to keep copying the entire original data from the object store when we have to do some operation on just a view of it. The current implementation of view means that the first time we have to do something with the subset of the data (say, with view above), we save just that subset in the object store (this is the new partition's new _data), and on subsequent accesses to view, we'll only have to access that small piece.

in pandas we would call this .copy(deep=True) vs .copy(deep=False).

modin series and dataframe do support shallow copies for the entire object. These copies are backed by the same data: https://github.com/modin-project/modin/blob/05bf659b67d2b7153d8aaa004dd95252377eed51/modin/pandas/base.py#L1035-L1040

A typical loc or iloc will create a new pandas API object (series or dataframe), query compiler, modin frame, and partitions, which will ultimately get new references to new remote data, e.g.:

Doesn't this conflict with

but they actually use the same partitions pointing to the same data, e.g.

?

Doesn't this conflict with

It does. I think my second statement is correct. I should correct my first statement about "actually use the same partitions pointing to the same data" to say that it only seems to apply to copies (either deep or not) and full slices like loc[:].


[Installer] Add PowerRename Runtime dependency

Summary of the Pull Request
What is this about:
Including Runtime libs in PowerRename install folder.
What is include in the PR:
How does someone test / validate:
Quality Checklist

[x] Linked issue: #14076
[ ] Communication: I've discussed this with core contributors in the issue.
[ ] Tests: Added/updated and all pass
[ ] Installer: Added/updated and all pass
[ ] Localization: All end user facing strings can be localized
[ ] Docs: Added/ updated
[ ] Binaries: Any new files are added to WXS / YML

[ ] No new binaries
[ ] YML for signing for new binaries
[ ] WXS for installer for new binaries

Contributor License Agreement (CLA)
A CLA must be signed. If not, go over here and sign the CLA.

Hit fix PR?

Hit fix PR?

IMO, this won't be the main reason for a hotfix. But there is a hotfix (maybe 0.49.2?). We should introduce this one.

/azp run

Have you tested the resulting installer on a clean VM?

Have you tested the resulting installer on a clean VM?

Yes


final tx in my series of tx for a rain game doth not want to go thru

I believe @pit-trash-king has helped me with this ages ago when I was beginning to understand rain,
@long-banana I summon you in case you have a minute to teach me what I am not getting here.
This is my backend leaving a match, that the player has lost:
https://explorer.solana.com/tx/WGAJ1ZYKoW61hNCiwfnPnDZdKb8yd1rHks1siTZDHN3yahXkMwM4SZZVu5EfMwrrhyZ7FTvmVEvMWZnVhvdnUu8?cluster=devnet
It works! Rejoice!
This is my frontend failing to leave:
https://explorer.solana.com/tx/41WHkJZWnLtzEyquD4NkJsjgChafeGyUzvdo8XS1VLL3s5wLCyuGNj96Ar4spM137hWZcnJcyDyxJC6eheKzS3Ws?cluster=devnet
I think I have somehow messed up where pit told me how to do this properly, am I required to sned the whole amounts out of the match? If so, why does it let my backend leave and not the player?
Any and all help is appreciated here fellas
here is the match:
{
"winOracle": null,
"matchState": {
"initialized": true
},
"winOracleCooldown": 0,
"space": 500,
"minimumAllowedEntryTime": null,
"tokenEntryValidation": null,
"authority": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"leaveAllowed": true,
"joinAllowedDuringStart": false,
"oracleState": {
"seed": "Ahpx7NtTgRPpPcf15HEABH8HKFNxzotH2q6s3bJsDPJM",
"authority": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"finalized": false,
"tokenTransferRoot": null,
"tokenTransfers": []
},
"tokensToJoin": [
{
"mint": "openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79",
"amount": 1000000,
"sourceType": 1,
"index": 1,
"validationProgram": "nameAxQRRBnd4kLfsVoZBBXfrByZdZTkh8mULLxLyqV"
}
]
}
matches-cli show_match -k ~/.config/solana/id.json -e devnet -l debug -cp abla.json
wallet public key: JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm
Match  iNPbTEDySwfHn8CT7k4r5eh7YH1qNLmzfrMn26HoXAP
Namespaces: Not Set
State: finalized
Win Oracle: PublicKey {
_bn: <BN: aa588369a10d9b04a64efd8e208e35554043d510ebb9470738d6a8ac8c309d4c>
}
Oracle Cooldown: 0
Last Oracle Check: 2022-07-08T20:18:32.000Z
Oracle Finalized: true
Oracle Token Transfer Root: Unset
Oracle Token Transfers:
--> From: Ff7EmnYRhGMBjvQ91mkKWQzfzWTWZVdfECMZdFZQv5Xw
--> To: JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm
--> Transfer Type: undefined
--> Mint: openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79
--> Amount: 1000000
--> From: JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm
--> To: Ff7EmnYRhGMBjvQ91mkKWQzfzWTWZVdfECMZdFZQv5Xw
--> Transfer Type: undefined
--> Mint: openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79
--> Amount: 0
Authority: JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm
Leaving Match Allowed?: Yes
Joining Match Allowed?: No
Minimum Allowed Entry Time: Unset
Current token transfer index: 1
Token Types Added: 2
Token Types Removed: 1
Token Entry Validations:
Token Entry Validation Root: Unset
jarettdunn@jaretts-MacBook-Air ~ %
I redact my previous statement; with leave_allowed it should let us leave even if not paid out :/
pending this works I'll put the game live on autist.design remove some links and gib the pandas the ability to use this token: https://app.strataprotocol.com/swap/2PAGcvionSsRsYv8vbbxbSfiNa8THnGT81q11vHU3faP

update: this is probably armani's fault, sec I am syncing the stuff w<EMAIL_ADDRESS>(as u guys had it ha before I butchered it)

so what is this, ha
https://explorer.solana.com/tx/43kHuEfcbm2eZtsQLS9C8Ynf7ifBaR99ka3SgNZTR1wyG3RdSsvUMuPYfp7jZVv3UDTmUT2iHuJVHAoRXUhif9tU?cluster=devnet
{
"winOracle": null,
"matchState": {
"initialized": true
},
"winOracleCooldown": 0,
"space": 500,
"minimumAllowedEntryTime": null,
"tokenEntryValidation": null,
"authority": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"leaveAllowed": false,
"joinAllowedDuringStart": false,
"oracleState": {
"seed": "EPKhqRPcgEchakSAc9h5EHbgrGnLFwLhAi2GoDTZFhET",
"authority": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"finalized": false,
"tokenTransferRoot": null,
"tokenTransfers": []
},
"tokensToJoin": [
{
"mint": "openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79",
"amount": 1000000,
"sourceType": 1,
"index": 1,
"validationProgram": "nameAxQRRBnd4kLfsVoZBBXfrByZdZTkh8mULLxLyqV"
}
]
}
{
"finalized": true,
"tokenTransferRoot": null,
"tokenTransfers": [
{
"from": "Ff7EmnYRhGMBjvQ91mkKWQzfzWTWZVdfECMZdFZQv5Xw",
"to": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"tokenTransferType": {
"normal": {}
},
"mint": "openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79",
"amount": 1000000
},
{
"from": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"to": "JARehRjGUkkEShpjzfuV4ERJS25j8XhamL776FAktNGm",
"tokenTransferType": {
"normal": {}
},
"mint": "openDKyuDPS6Ak1BuD3JtvkQGV3tzCxjpHUfe1mdC79",
"amount": "0f4240"
}
]
}

Alright so the official word is ignore this in the case that it is PaidOut, however this leaves house at a sig disadvantage as there are any number PaidOut matches that cannot be drained :)
suggestion 1: allow draining these
suggestion 2: figure out why these matches can sometimes? not be left by some? parties


allow sharing violation error to not fail completely

It allows the ls to continue but not have much information for the files in error.

closing in favor of #681


Add C# Sample

Adding C# sample in response to MSDN forum question:
https://social.msdn.microsoft.com/Forums/en-US/25ecf271-ccd7-4a6c-99d6-fbfe351f223c/impossible-to-read-mp3-stream-on-raspberry-pi-2?forum=WindowsIoT
It seems users are having trouble getting remote mp3 playback on RPi 2 using familiar MediaElement.
Since UniversalMediaEngine solves this, I have extended the samples to support C# in addition to existing C++ sample.

Allow to choose the culture of the voice used in the System for use with "SpeechSynthesizer". Today you can only use the three available for "en-US"

Hello, I was perusing my open PRs and notice this one is still open.  I believe this would be a useful commit as it gives a usable example in C#.  Please let me know if this requires any further changes for acceptance.

Sorry for the delay on this. The original engineer moved on. Looks good and thanks for the submit!


.Net 4.8 BCL: Switch UseLegacyFipsThrow for VSTO add-ins is set to true (old behavior) by default

Hello team,
Why is the switch UseLegacyFipsThrow for VSTO add-ins set to true (old behavior) by default?
Was it intentional?
All other project types I tested use the new policy as default.
Regards,
Alain.

@bartonjs

If the switch is true, either the main executable targets something older than 4.8, or the switch is actively set to true by config.
I don't know what is hosting the VSTO add-in, but whatever it is is what would be used for the "older than 4.8" check.

Thanks Jeremy,
The add-ins are hosted in PowerPoint and Excel from Office 365 (latest semi-annual stable build). I guess the latest semi-annual release has not target .net 4.8 yet. I tried updating the switch inside the add-in start up function and It seems to work.
I'll do some testing with the latest monthly release to see if the .net target version was increased to 4.8.
Alain.


[Removal]:  miners are bought and placed in the real places

Hotspot Name
Howling Pink Shell, Funny Banana Raven, Skinny Metal Monkey, Hidden Pineapple Newt, Gentle Magenta Dragon
Hotspot b58 Address
112RUygsxzjddAbUScTX5P7E67uf5NMwLeXeE2RiopnF1xiTVNP9 112MLmyguU95n1f3VLfY3SESodMfiVci2Tvkbu7BocDD8RQYjzPN  1191i1eoQpG9iTKstbTALoe75hCvrrEE3bb9izGAsVYMnX41Eri  112KZMzvkGnLFMstDNbEKmZ2XEk6AQVqmnzdVQuiWWLC4frtzRw7  11mqmBUEsMQCBfxH8WSNqZz6eRbAF4N1QqpTdf7BpnB9h5625dV
Discord Handle
No response
Hotspot Manufacturer
PantherX
Removal Reason
I just bought this miner, previous owner might be doing some illegal thing, but I'm going to use it in a normal way way
Modifications
No
Extra forwarders
No
Extra antennas
No
Additional Information
Hello, I'm developer from Ukraine.
Me and few my friends bought 5 PantherX miner  to put it in our flats and have some profit of its work.
there are miners adresses:
112RUygsxzjddAbUScTX5P7E67uf5NMwLeXeE2RiopnF1xiTVNP9
112MLmyguU95n1f3VLfY3SESodMfiVci2Tvkbu7BocDD8RQYjzPN
1191i1eoQpG9iTKstbTALoe75hCvrrEE3bb9izGAsVYMnX41Eri
112KZMzvkGnLFMstDNbEKmZ2XEk6AQVqmnzdVQuiWWLC4frtzRw7
11mqmBUEsMQCBfxH8WSNqZz6eRbAF4N1QqpTdf7BpnB9h5625dV
We knew about Helium from relatives, who live in another city and using such miners too.
We bought it from private seller online few weeks ago and he showed that it is working great in his location. Now we received miners and can't get it to our wallets and set location while seller unable to send it to us via helium network.
I found out the miners got in the DenyList. Maybe seller was doing something illegal before.
I want to ask you to get it out of denylist so we can receive it in our wallets and set the real location for it. We will use it in a real way.
This is our beautiful city:

Here are some photos about the miners:

There is approximately places, where the miners currently placing:

Note: while in our city it is quite expensive to get static ip, so we are using connection to the external IP adress via VPN remote connection channel. So because of this it will be not an Ukrainian IP adress.
if there are any questions, I can be reached via:
email<EMAIL_ADDRESS>discord: alex10023#5932

Dude! Are you Ukrainian ? Be serious about cheating!

Dude! Are you Ukrainian ? Be serious about cheating!
Yes, I am Ukrainian


add working implementation of 1D and nD potential landscape computation

Closes #27

Make sure everything is formatted in Black. For the notebook, the figures look amazing but please add some descriptions/inferences to all sections. What is the purpose, what is the take home etc.


Logbook 2

Logbook : 2
Meeting No: 2 Date: 22/11/2024
Start Time: 11 AM End Time: 11:30 AM
Items Discussed:
1. Setup Node.js Backend Environment for the Project
o Discussed the environment setup for the Node.js backend, including the
installation of required dependencies and folder structure organization.
o Talked about setting up nodemon for efficient development and testing.
2. Implement User Registration API for the Gymify Application
o Reviewed the design and functionality of the user registration API.
o Discussed data validation and error handling mechanisms for user inputs.
3. Database Integration with Node.js
o Researched how to integrate PostgreSQL with the Node.js backend using Prisma
ORM.
o Addressed best practices for managing database connections and configurations.
4. Language Server Extension (VS Code)
o Discussed installing and configuring Language Server Extensions to enhance
productivity during development.
o Focused on enabling IntelliSense, linting, and debugging features in VS Code.
5. Development of User Registration API Endpoints
o Planned about defining API routes and controllers for user registration.
o Response formats and how to handle different status codes.
6. Debugging Environment Setup
o Reviewed the process of setting up debugging tools in VS Code.
o Discussed about using breakpoints to step through backend code for
troubleshooting with supervisor.
7. Loosely Typed vs. Strongly Typed Languages
o Discussed the differences between loosely typed (e.g., JavaScript) and strongly
typed (e.g., TypeScript) languages.
8. Imperative vs. Declarative Programming
o Examined the differences between imperative programming (step-by-step
instructions) and declarative programming (describing what to do, not how to do
it).
o Related examples to the Gymify application, such as using SQL (declarative) for
querying the database versus using loops (imperative) for data processing in
JavaScript.
Achievements:
1. Backend Environment Setup
o Successfully set up the Node.js backend environment with initial configurations
and dependencies.
2. Initial API Development
o Defined the structure for user registration API endpoints.
o Basic API functionality was tested with mock data using Jest.
3. VS Code Enhancements
o Installed and configured Language Server Extensions for improved coding
experience.
4. Debugging Setup
o Configured debugging tools in VS Code, allowing the team to set breakpoints and
debug backend processes efficiently.
5. Conceptual Understanding
o Enhanced understanding of loosely typed vs. strongly typed languages and
imperative vs. declarative programming paradigms.
Problems:
Lack of Input Validation in APIs
• Identified missing input validation in the user registration API, leading to potential
issues with incorrect or malicious data being processed.
Prisma Integration Issues
• Encountered difficulties integrating Prisma ORM with the Node.js backend. Problems
included configuration errors and schema issues that affected database connections.
Incorrect Language Server Extension (LSP) Installation
• LSP failed to work due to installing the incorrect extension in VS Code. This caused
IntelliSense and linting features to be unavailable.
CORS Errors during API Testing
• Experienced Cross-Origin Resource Sharing (CORS) errors when testing API calls with
dummy React code. This was resolved by configuring CORS middleware in the
Express app.
Missing Authentication Token during Login
• The authentication token was not included in the login request, causing issues with
subsequent API calls that required user authentication.
Token Access Issues in Protected Routes
• The token was not being accessed properly in protected API routes (e.g., profile view
and update), which was fixed by adding the authentication middleware for token
validation.
File Upload Issues with Multer and Cloudinary.
• Encountered challenges while implementing file upload with Multer and Cloudinary.
The issue was resolved by reviewing tutorials and fixing the implementation in
commit 0f72014.
Tasks for the Next Meeting:
API Testing in Postman and React
• Thoroughly test the newly developed APIs using Postman and React dummy code to ensure
they work correctly and handle edge cases.
Add Missing Validations to Previous APIs
• Review and improve the input validation for the user registration API and other previously
developed endpoints to prevent potential security or data integrity issues.
Create Forget Password API
• Develop an API to handle password recovery, including features such as token generation,
email validation, and secure password reset functionality
Aashish Prasad Gupta Prasant Adhikari
(1st Supervisor)


single-day workshop

If a workshop lasts one day, the build gives the following on the front page:

Is there a way to remedy this behaviour in conference_details.yml?

Working on a fix!


Reorder block traversal order for correct hoisting.

Resolves #9379

The prior code was actually okay but requires the blocks to be processed in the right order.  The critical thing is that if there is a getattr on an object and then a call of that getattr, the getattr has to precede the call for the code that detects multiple writes to an object to detect this scenario as a second write.  My attempt at copying the offending code into a Numba test didn't work because the block order there was one that didn't manifest the problem.  Any test you could write now that used normal code I suppose you'd have no guarantee that the block order would continue to manifest the problem with any change later.

@sklam Do you think these test failures are related to the PR?  Seems unrelated to me.

/azurepipelines run

@sklam , would you be able to review this PR? The issue is still there.

might be related to https://github.com/numba/numba/issues/9582 but I'm not sure to be honest.

Confirmed that this fixes #9379 but it has also been fixed by #9532.
This doesn't fix #9586.

Confirmed that this fixes #9379 but it has also been fixed by #9532. This doesn't fix #9586.

So, 9532 fixes 9379 and 9586?  9397 only fixes 9379?

Confirmed that this fixes #9379 but it has also been fixed by #9532. This doesn't fix #9586.

So, 9532 fixes 9379 and 9586? 9397 only fixes 9379?

#9532 fixes #9379
#9532 does NOT fix #9586.
#9586 as a PR is needed for https://github.com/numba/numba/issues/9581, https://github.com/numba/numba/issues/9490.
I am trying to understand what remaining cases are fixed by this PR uniquely. The original problem in https://github.com/numba/numba/issues/9379 seems to come from build_tuple hiding dependency of mutable object in code like:
func([<listcomp>], *args)

where the build_tuple comes from handling of *args, which is translated to func( ( [<listcomp>] ,) + args ). I tested this by changing the original reproducer from
        res = func([data[start_idx:end_idx, ...] for data in dataargs], *funcargs)

to
        res = func([data[start_idx:end_idx, ...] for data in dataargs])

and confirmed that the bug goes away.
I am unable to find a case that depends on the block traversal order. I believe such a case may appear from Numba internal changes; e.g. changes to inline-closure, changes to parfors details.
I think this patch will prevent non-deterministic bug that may be introduced from randomized block insertion from other passes or changes to internal details. Since it seems unlikely for users to create such a case, and I am slightly concerned that the reordering may expose some unforeseen bugs, I suggest we merge it for 0.61 milestone.

@DrTodd13, can you merge main to fix the merge conflict?

@DrTodd13, can you merge main to fix the merge conflict?

Done.  @sklam


Make separate package.json and gitignore files for themes

Now we have one big package.json file, we should split the dependencys to core and theme-specific.

[ ] Move default theme dependencys to themes/default/package.json
[ ] Move catalog theme dependencys to themes/catalog/package.json
[ ] Add .gitignore for both themes with node_modules

@filrak @pkarw I can do this task

Great!