Synchronous az blob storage copy fails for PageBlobs

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug
Using the requires-sync parameter causes copy operation to fail when blob type is a PageBlob. So, if you run a copy operation on a PageBlob (example: A VHD created by packer via it's azure-vhd builder) with requires-sync NOT set like this:
az storage blob copy start --destination-blob "$prod_vhd_filename" \
        --destination-container bnbnb --account-name yuny \
        --account-key "$prod_blob_storage_key" --source-uri "$dev_vhd_id"

The response is a JSON object with details like
{
  "completionTime": null,
  "id": "redacted",
  "progress": null,
  "source": null,
  "status": "pending",
  "statusDescription": null
}

But, if you include the requires-sync param in your copy start call like below:
az storage blob copy start --destination-blob "$prod_vhd_filename" \
        --destination-container bnbnb--account-name yuny \
        --requires-sync true \
        --account-key "$prod_blob_storage_key" --source-uri "$dev_vhd_id"

An error with the following issue is reported:
The copy source must be a block blob. ErrorCode: CannotVerifyCopySource
<?xml version="1.0" encoding="utf-8"?><Error>CannotVerifyCopySource<Message>The copy source must be a block blob.
RequestId:xxyyxx
Time:2020-05-13T12:11:20.8982539Z</Message></Error>

To Reproduce

Ensure you have a Storage Blob Container with a blob of type PageBlob
Copy this blob of type PageBlob to another Storage Blob Container on another account using the commands described above with the requires-sync param set to true
This fails and cancels the Copy operation

Expected behavior

When a copy operation for a page blob happens across storage accounts with the requires-sync param set to true, the copy operation shouldn't error and cancel itself

Environment summary

OS -> linux
Shell -> bash
Install method -> interactive script

az --version
azure-cli                          2.5.1

command-modules-nspkg              2.0.3
core                               2.5.1
nspkg                              3.0.4
telemetry                          1.0.4

Python location '/opt/az/bin/python3'
Extensions directory '/root/.azure/cliextensions'

Python (Linux) 3.6.5 (default, Apr 30 2020, 06:22:25)
[GCC 8.3.0]```

**Additional context**

add to S170

add to S172

Thanks for your feedback. It is by design from server side. --requires-sync only support blob blob and we will refine the help message. :)


Spelling: ID, IMDb, TheTVDB, URL, addition to translators, https

As per https://en.wikipedia.org/wiki/IMDb and https://en.wikipedia.org/wiki/TheTVDB

thanks for your contribution..
in fact you've only changed some internal log infos and one UI occurrence of the Id naming ;)
what about the UI panel for movies? there is also a call to imdb/tmdb and labels with the Ids - are they ok?

@mlaggner Link?
I fix things a bit sporadically as I see them, it helps me finish the translation to Norwegian Bokmål.

here would be another location: https://github.com/tinyMediaManager/tinyMediaManager/blob/master/src/main/java/org/tinymediamanager/ui/movies/MovieDetailsPanel.java
btw: if you mean the translation via weblate, you have to look at the v3 branch (weblate is for v3 whereas transifex is for v2)

thanks for your contribution


Slow Startup

Hi there,
i am working on a big node.js application, currently the debugger requires about one Minute to finish loading. To improve the startup time i sometimes clear local caches but this helps only a little.
Is there any way to improve speed ? Maybe exclude files or something ?
Thx

What needs to be implemented to resolve this issue:

Modify ScriptFileStorage to cache results of glob searches by reusing the glob cache object (see https://npmjs.org/package/glob for details).

Add a new config option to disable findAllApplicationScripts - see lib/ScriptFileStorage.js

Add a new config option to disable sourceMap detection - see lib/ScriptManager.js

Try reload http://<IP_ADDRESS>:8080/debug?port=5858
After.
node-debug <appname.js>
Then the debugger starts instantly, on my system.

@voidcode doesn't help much, I also use that trick, but is still not as fast as I like.

@3y3 and then what? where are the logs? no file is created nor the cli program outputs anything.

@bajtos
With<EMAIL_ADDRESS>/<EMAIL_ADDRESS>on Linux, it takes a long time to load initially, then takes forever to proceed (after resuming from being paused on the first line), while logging these entries:
backend: {"method":"Debugger.scriptParsed"

(To get that output I had to hack one of the files as described in https://github.com/node-inspector/node-inspector/issues/671#issuecomment-114200212.)
How do I:

[disable] dispatch of this event in the front-end

? And what consequences will that have?
Is that what this reference to front-end/InspectorBackend.js line 44 and 45 relates to? Please always make links like that to the permalink URL.

How do I [disable] dispatch of this event in the front-end

You need to modify the code in front-end directory, most likely front-end/sdk/InspectorBackend.js. I don't have enough time to try this myself now, sorry for that :(

what consequences will that have?

IIRC, when you disable Debugger.scriptParsed events, the front-end will not know about your source files. I am not sure about the exact behaviour, in the worst case you won't be able to debug at all, because there will be no source code in the UI to show.

@bajtos Thanks, sorry for the delay replying. I'll have to poke around sometime. So that's probably just going to identify a bottleneck, but not actually work around it I guess.

I am debugging a grunt task with node-inspector, and because my project contains a lot of dependencies, startup time is about 4-5 mins.
Adding --no-preload boosts the startup time to 2-3 s, but my breakpoint is not hit. I guess that script finishes before node-inspector gets a chance to break it.
Fortunately, I found a solution for this: add in your script debugger; and node-inspector will stop there.

@danielmanesku , how about --debug-brk option?

@3y3 If I run into one shell node-inspector and in another node --debug-brk /usr/local/bin/grunt myTask, startup time is long, about 4-5 min. Am I missing something?

Try preload:false instead of no-preload:true if using a rc file or similar:
{
  "preload": false
}

It's unusably slow for me in Node Inspector v0.12.8 using node-inspector --preload=false (or with no optional arguments).


 Here's example output:

$ docker -D push peetonn/docker-ndnrtc-ubuntu14.04:head44-built
DEBU[0000] Trusting certs with subjects: [010U
peetonn]
The push refers to a repository [docker.io/peetonn/docker-ndnrtc-ubuntu14.04] (len: 1)
50bed83bbf19: Pushing [==================================================>] 9.959 GB
Received unexpected HTTP status: 500 Internal Server Error

Describe the results you received:
Received unexpected HTTP status: 500 Internal Server Error
Describe the results you expected:
Image successfully pushed to the remote repo (hub.docker.com).
Additional information you deem important (e.g. issue happens only occasionally):

@peetonn given that the 500 Internal Server Error is returned by Docker Hub, I think this should be reported at the Docker Hub team. Can you report this at<EMAIL_ADDRESS>

@thaJeztah ok. reported two days ago. no response yet.

@peetonn ouch, let me try to ping them on our internal Slack channel; unfortunately I don't have access to the Docker Hub infrastructure, but keep me posted if they got back to you


error info has not been saved into LG (missed auto-completion part)

Complete the necessary portions of this template and delete the rest.
Describe the bug
If user input error info in LG with auto-completion, the auto suggested part will not be saved into LG file and only typed words have been saved . Redo this again, it just append the typed words but not update it with user inputs. (see attached )
Version
Master
Browser
What browser are you using?

[X ] Chrome
[ ] Safari
[ ] Firefox
[ ] Edge

OS
What operating system are you using?

[ ] macOS
[ X] Windows
[ ] Ubuntu

To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
error info should be saved
Screenshots
https://recordit.co/W5eT57kUS8
Additional context
Add any other context about the problem here.

addressed in https://github.com/microsoft/BotFramework-Composer/pull/1504


sandbox: TLS sandbox

Users are frequently confused on TLS configuration. We should have a sandbox that demonstrates both downstream and upstream TLS configuration. We could have the sandbox potentially generate self signed certs similar to what we do in the integration tests: https://github.com/envoyproxy/envoy/blob/master/test/config/integration/certs/certs.sh

cc @phlax this would be a good one to add to your list.

yep @mattklein123 im definitely happy to take this one

checking through for prior art, im seeing the front-proxy example has an existing tls example:
https://github.com/envoyproxy/envoy/blob/master/examples/front-proxy/front-envoy.yaml#L63
this should be quite useful for getting started

some possibly relevant refs:

#12965
#13221
#12586
#9577

@phlax good point regarding that example. I would say we should do 2 things:

Rename it "TLS front proxy" or something like that
Also demonstrate TLS upstream connections

WDYT?

yep, re upstream connections
i think lets knock out the tutorial first (#13386) which also has some tls examples, and then i can collate the info into a tls sandbox, and we can figure out what it needs to demonstrate

Rename it "TLS front proxy" or something like that

i need to check through a  bit more, but i think the front-proxy example is useful even without the  tls bits - i would be more tempted to just separate out the tls to its own example (or maybe even just leave it, and add a tls focused example)

i would be more tempted to just separate out the tls to its own example (or maybe even just leave it, and add a tls focused example)

Sure sgtm

@phlax , I noticed that you referred #13321.
I want to point out that in the referenced issue the envoy user within the container can read the TLS certificates but Envoy binary cannot read the certificates provided in envoy.yaml.
The envoy.yaml configuration attached in the referenced issue works fine with v1.14.4.

@chintan-mishra thanks for info.
I tagged it because i figured i might be able to look at that bug when following up on adding an example - might be beyond my immediate capabilities tho


Signal 11 (Segmentation fault), address is 94 from 8096232

=========================== FCNPC Exception Handler ============================
Signal 11 (Segmentation fault), address is 94 from 8096232
Backtrace:
#0 in plugins/FCNPC.so(_ZN17CExceptionHandler24ExceptionHandlerCallbackEiP9siginfo_tPv+0x126) [0xf26626e6]
#1 in linux-gate.so.1(__kernel_rt_sigreturn+0) [0xf7ed6570]
#2 in ./samp03svr() [0x8096232]
#3 in plugins/deadlinevoice.so(_ZN4Pawn32OnPlayerActivationKeyPressForAllEth+0x7a) [0xf64d8b3a]
#4 in [0x45d0db00]
Information:
System: GNU/Linux
SA-MP: 0.3.7 R2
FCNPC: 2.0.4
Functions:
FUNC_CPlayerPool__DeletePlayer: 0x80d0a90
FUNC_CPlayer__Kill: 0x80cb220
FUNC_CPlayer__EnterVehicle: 0x80cc1c0
FUNC_CPlayer__ExitVehicle: 0x80cc340
FUNC_CPlayer__SpawnForWorld: 0x80ccfc0
FUNC_GetVehicleModelInfo: 0x80d5d30
FUNC_CConsole__GetIntVariable: 0x80a0070
FUNC_ClientJoin_RPC: 0x80b0030
Pointers:
VAR_ServerAuthentication: 0x81aa8a8
VAR_NetVersion: 0xfd9
Offsets:
OFFSET_RemoteSystemManager: 0x334
OFFSET_RemoteSystemSize: 0xc69
OFFSET_RemoteSystem__ConnectMode: 0xc62
OFFSET_RemoteSystem__Unknown: 0xc67
=========================== FCNPC Exception Handler ============================

The problem is in deadlinevoice, read the logs.

The problem is in deadlinevoice, read the logs.

soo, how to fix?
in windows server is work but in linux server bug like this


added chromium support for devTools on linux

  Thanks for submitting a PR! Please read these instructions carefully:

[ ] Explain the motivation for making this change.
[ ] Provide a test plan demonstrating that the code is solid.
[ ] Match the code formatting of the rest of the codebase.
[ ] Target the master branch, NOT a "stable" branch.

Please read the Contribution Guidelines to learn more about contributing to React Native.

Motivation (required)
What existing problem does the pull request solve?
On Linux, the packager caught an "Google Chrome exited with error: { Error: spawn google-chrome ENOENT}" when trying to launch the devTools because google-chrome is not installed but chromium is.
Thus, this pull request maps the platform Linux with chromium for launching the debugger automatically in the packager
Test Plan (required)
A good test plan has the exact commands you ran and their output, provides screenshots or videos if the pull request changes UI or updates the website.

enter on terminal

react-native start

launch the app in dev mode with "Debug JS remotely" enabled
the packager prints "Launching Dev Tools..." and launch chromium with the debugger

The code currently tries to google-chrome, which your changed would override for linux users to chromium. Both of them are valid, can you instead change the open logic to try the two variants somehow?

I added an existence test for google-chrome on linux, and mapped the program to spawn with the test result. What do you think?

up


issue #15/Random Meme Generator

Description
This is a meme generator website . It generates random memes by using the technique of API Fetching.
Related Issue

Closes #15

Type of Change
Please check the type of change that applies to your PR:

[ ]  Bug Fix
[x] New Feature
[ ] Enhancement (improvements, refactoring, etc.)
[ ] Documentation Update
[ ] Other (please specify):

Checklist
Before submitting your pull request, please ensure you've completed the following:

[x] I have read the CONTRIBUTING.md document and followed the contribution guidelines.
[x] My code follows the project's coding standards.
[x] I have added or updated the necessary documentation (if applicable).
[x] My changes do not introduce any new linting or test errors.
[x] All new and existing tests have passed.
[x] I have reviewed my code to ensure its quality.

Screenshots (if applicable)

Additional Information
Feedback or any enhancing changes are always welcome . Please review the changes and merge the PR for Apertre'24.
Thank you.

Best of luck and Happy Coding.


chore: projen upgrade

Fixes #

AWS CodeBuild CI Report

CodeBuild project: DDKIntegrationTestsD8472609-5SCHWjldmWcf
Commit ID: 7c6d700c7f7c6221ed1f9a060c5bf61a770a00af
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


Enable third party developers

Congratulations on the great work done so far!
As an interested third party contributor I ran into difficulties getting the app to run out of the box. Two issues were the reason:

The required entitlements com.apple.developer.exposure-notification are not easily accessible for common developers without an official background, see https://developer.apple.com/documentation/exposurenotification
After the "onboarding" the activation check for the exposure manager is mandatory

I was able to workaround both:

I ran the app in the simulator, which does not require the entitlement
For the actual device I removed the entitlements
I commented out the check

In order to allow more participation it would be great to have some of these settings for DEBUG builds already in place.
I'll provide a PR for allowing to skip the exposure check when running in the simulator.
Good luck for your work! And stay healthy.

Your PR has already been approved by myself. I like the idea to make it easier for other developers to join the development efforts.

Awesome, thanks! I really appreciate that the work is going on weekends as well ;)
Regarding the entitlements I'd suggest to add another Configuration and leave out the entitlements for it. It should have a clear name like "DebugWithoutExposureAPI". Of course a preset Schema for this configuration would be nice as well. What do you think?

Awesome, thanks! I really appreciate that the work is going on weekends as well ;)
Regarding the entitlements I'd suggest to add another Configuration and leave out the entitlements for it. It should have a clear name like "DebugWithoutExposureAPI". Of course a preset Schema for this configuration would be nice as well. What do you think?

Thanks for this great idea. @inf2381 is already on it. 😋

Please have a look at #43 😁


Using the amazon-echo-ha-bridge with Alexa Voice Service (running on a PI)

I was wondering, would this awesome bridge be able to work with the Alexa Voice Service using a Java client (running on a Raspberry Pi)?
This would be cool. because your could use a relatively cheap PI to control your home automation.
I think not, because their seems to be no implementation for device discovery and thus this awesome bridge project would no work. Anyone care to elaborate?

No idea why it wouldn't work. I'm running a fork of this project https://github.com/bwssytems/ha-bridge on Debian Jessie which is basically the same OS as the Raspberry Pi. I even compile the .jar file on a totally different server running Ubuntu 14.04, then just copied the target .jar over and make sure I installed the same version of the Oracle Java SDK that I built on. Currently thats 1.8u101 and it's working great.
I was going to run everything on a raspberry pi as well, but I had the virtual server build to run an Apple HomeKit bridge to my iOS devices working the same way... so I might as well use it for multiple things.

@randomname872634 I would give it a look to this amazing project:
https://github.com/openhab
Even though release 2.0 is still a snapshot, it has full support for Docker and Alexa without using heavy handed spring-boot bridge (+ elastic search).
Besides that, this project seems to be completely dead and openhab community is really active.


[Snackbar] Position problem when using with rc-queue-anim

When using Snackbar with rc-queue-anim, Snackbar positions go wrong
Instead position relative to <body>, it positions relative to rc-queue-anim container
Online demo: https://codesandbox.io/s/5xql2nwzzx
(Demo code is based on v1.4.0 https://material-ui.com/demos/snackbars/, the only file changed is index.js )
Ant Design - Message does the same job like Snackbar, it works fine, its approach is to attach the message / snackbar to the <body>

[x] This is a v1.x issue.
[x] I have searched the issues of this repository and believe that this is not a duplicate.

Expected Behavior
Snackbar position should be position relative to <body>
Current Behavior
Snackbar positions relative to the rc-queue-anim container
Steps to Reproduce
Online demo: https://codesandbox.io/s/5xql2nwzzx
(Demo code is based on v1.4.0 https://material-ui.com/demos/snackbars/, the only file changed is index.js )
Context
Your Environment

Tech
Version

Material-UI
v1.4.0

React
v16.4.1

browser
Chrome

etc.

You can use the Portal component for this use case: https://codesandbox.io/s/04y3vykw0p.
We don't back the portal directly into the snackbar as it works pretty well without in 90% of the cases.

Hi @oliviertassinari, thanks for fast response!
I wonder why don't we position the snackbar relative to <body> like Ant Design - Message does?
Btw, really love material-ui!

@gudh we do, but the transform: translate(0px, 0px); style is creating a rendering layer that absolute positionnig can't escape.

People using the snackbar inside a modal & dialog with experience the same issue. https://github.com/mui-org/material-ui/issues/12201#issuecomment-406434406 covers this use case too.

Thank you! All works with


Add no-op WebMessageListener

Task/Issue URL: https://app.asana.com/0/1200204095367872/1207300292572452/f
Description
Steps to test this PR
Feature 1

[ ]
[ ]

UI changes

Before
After

!(Upload before screenshot)
(Upload after screenshot)

#4551  👈
develop

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @joshliebe and the rest of your teammates on  Graphite


Show tflite version when interpreter initialize

@haozha111 I have used TFLITE_VERSION_STRING directly because tensorflow/lite/experimental is not linked as of now. Could you please review?

@haozha111 Could you please kindly review this PR, I have resolved the conflict and uploaded

Please don't land this yet, we have some internal tests that it will break. I already have a CL to update the version, so I'm going to close this for now.


Can I insert an image into a cell？

Hi @uglymie
I'm sorry, but no. OpenXLSX is targeted at data extraction, not so much on formatting.


"System cannot find the path specified" error at Rye::Box.new() on Windows

When using Rye on Windows (which works great by the way!) there's always an error message System cannot find the path specified when initializing a Rye::Box.
I guess this is because of
@rye_stty_save = `stty -g 2>/dev/null`.chomp rescue nil

which could probably be changed to something like
@rye_stty_save = `stty -g 2>/dev/null`.chomp unless Rye.sysinfo.os == :windows rescue nil

in Rye::Box (and also in Rye::Hop I guess).
I didn't make a PR because it seems like there is already a pending PR #56 which also works on that code (on a slightly different matter) and recently there seems to be no more activity in the repo. I'd be happy to make one though if there's still interest...

Thanks for bringing this back on the radar.
Can you check if the change on that PR works for you? Usingif STDIN.tty? rescue nil instead of checking the OS.

Hey, thanks for the reply!

Can you check if the change on that PR works for you? Usingif STDIN.tty? rescue nil instead of checking the OS.

Oh, forgot to mention that I already did that - and well, no, it doesn't work because STDIN.tty? returns true on Windows as well.
So, when doing both checks this might be a little bit much/rather unreadable for a one liner... ;-)


Permissions for a new user -- IAM policies? How to constrain?

What's the workflow for spinning up a new user?
How does IAM integrate into this?

I think we have this figured out with role delegation via IAM and encrypted travis keys


Add support for non-ldap groups

Thank you for your contribution @neeravkumar, I'm not quite fond about untyping groups and exposing a raw interface{} to be honest so I would also consider an alternative solution.

Groups can be a list of strings when using a non-ldap idp

is this behavior described in cloudflare documentation? Can you point me to the docs page or to how you reproduced the issue?

I can't find the docs but how I reproduced it was with okta as idp I get:
time="2022-12-05T16:33:41Z" level=info msg="&{00uciixz75u9sm3HY4h6 Neerav Kumar<EMAIL_ADDRESS>b74eb480-6cd1-4e53-90f1-b35d2418293c 3a560c410cd99cb5f05d7aeb6000ed23 2605:xxxx:xxxx:xxxx::6a NONE   false false false 0 map[]<PHONE_NUMBER> 0xc00051ba40 0xc00129a620 [ACL-NERO-NERO-app-access]}"

I have redacted my email and ip address.
This is with:
--- a/vendor/github.com/fabiofenoglio/gin-cloudflare-access/cloudflare_client.go
+++ b/vendor/github.com/fabiofenoglio/gin-cloudflare-access/cloudflare_client.go
@@ -4,11 +4,11 @@ import (
        "context"
        "errors"
        "fmt"
-       "net/http"
-       "time"
-
        "github.com/coreos/go-oidc/v3/oidc"
        resty "github.com/go-resty/resty/v2"
+       log "github.com/sirupsen/logrus"
+       "net/http"
+       "time"
 )

 const (
@@ -188,6 +188,8 @@ func (s *cloudflareAccessClientImpl) fetchIdentity(ctx context.Context, raw stri
                return nil, fmt.Errorf("got HTTP server error reading user groups: %v %v", resp.StatusCode(), resp.Status())
        }

+       log.Info(resp.String())
+

You can also see: https://community.cloudflare.com/t/how-to-know-which-users-are-in-which-groups/146807/5
where they also see different formats based on different IDPs.

thank you for the additional information @neeravkumar, this is indeed a difficult situation.
Please check this proposed solution: https://github.com/fabiofenoglio/gin-cloudflare-access/pull/4

Thanks for such a fast response and your solution indeed looks better! I will close this.

tag v0.2.4 was deployed with a solution for the issue


MANGO-466. Run integration tests on docker container in Github Actions pipeline.

MANGO-466. Run integration tests on docker container in Github Actions pipeline.

Codecov Report

Merging #201 (d8d1b2b) into develop (7a83a5c) will increase coverage by 8.14%.
The diff coverage is 83.94%.

@@             Coverage Diff             @@
##           develop     #201      +/-   ##
===========================================
+ Coverage    59.83%   67.98%   +8.14%
===========================================
  Files          202      243      +41
  Lines         2963     8689    +5726
  Branches       110      115       +5
===========================================
+ Hits          1773     5907    +4134
- Misses        1169     2749    +1580
- Partials        21       33      +12

Flag
Coverage Δ

web
67.98% <83.94%> (+8.14%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...angoAPI.Application/Services/CorrelationContext.cs
0.00% <0.00%> (ø)

...yExchange/CngConfirmOrDeclineKeyExchangeCommand.cs
100.00% <ø> (ø)

...gKeyExchange/CngCreateKeyExchangeRequestCommand.cs
100.00% <ø> (ø)

...ic/ApiCommands/Communities/CreateChannelCommand.cs
100.00% <ø> (ø)

...Logic/ApiCommands/Communities/CreateChatCommand.cs
100.00% <ø> (ø)

...ApiCommands/Communities/CreateCommunityResponse.cs
100.00% <ø> (ø)

...ommands/Communities/UpdateChannelPictureCommand.cs
100.00% <ø> (ø)

...essLogic/ApiCommands/Contacts/AddContactCommand.cs
100.00% <ø> (ø)

...Logic/ApiCommands/Contacts/DeleteContactCommand.cs
100.00% <ø> (ø)

...gic/ApiCommands/Documents/UploadDocumentCommand.cs
100.00% <ø> (ø)

... and 245 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4c0b767...d8d1b2b. Read the comment docs.


How do I generate the labeled data?

I get this error when I run "train.py":
Traceback (most recent call last):   File "train.py", line 133, in <module>     train("model.0201")   File "train.py", line 55, in train     dr.load_data(FLAGS.train_data_file, max_doc_length, max_sen_length)   File "/scratch/user/phan3006/MATH689/SummaRuNNer/data_reader.py", line 83, in load_data     for line in f.readlines():   File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 696, in readlines     return self.reader.readlines(sizehint)   File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 605, in readlines     data = self.read()   File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 494, in read     newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 0: invalid start byte

i will upload the data and w2v model tonight，so please pay attention to my project发自我的华为手机-------- 原始邮件 --------主题：[pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)发件人：luhas123 收件人：pocheyeniu/SummaRuNNer 抄送：Subscribed I get this error when I run "train.py":
Traceback (most recent call last): File "train.py", line 133, in  train("model.0201") File "train.py", line 55, in train dr.load_data(FLAGS.train_data_file, max_doc_length, max_sen_length) File "/scratch/user/phan3006/MATH689/SummaRuNNer/data_reader.py", line 83, in load_data for line in f.readlines(): File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 696, in readlines return self.reader.readlines(sizehint) File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 605, in readlines data = self.read() File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 494, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 0: invalid start byte
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/pocheyeniu/SummaRuNNer","title":"pocheyeniu/SummaRuNNer","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/pocheyeniu/SummaRuNNer"}},"updates":{"snippets":[{"icon":"DESCRIPTION","message":"How do I generate the labeled data? (#1)"}],"action":{"name":"View Issue","url":"https://github.com/pocheyeniu/SummaRuNNer/issues/1"}}}
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/pocheyeniu/SummaRuNNer/issues/1",
"url": "https://github.com/pocheyeniu/SummaRuNNer/issues/1",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
},
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB",
"title": "How do I generate the labeled data? (#1)",
"sections": [
{
"text": "",
"activityTitle": "luhas123",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@luhas123",
"facts": [
{
"name": "Repository: ",
"value": "pocheyeniu/SummaRuNNer"
},
{
"name": "Issue #: ",
"value": 1
}
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueComment",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1,\n"IssueComment": "{{IssueComment.value}}"\n}"
}
]
},
{
"name": "Close issue",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueClose",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1\n}"
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/pocheyeniu/SummaRuNNer/issues/1"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "MuteNotification",\n"threadId": 393039758\n}"
}
],
"themeColor": "26292E"
}
]

now the data & word2vec model are provided， you can have a try again.发自我的华为手机-------- 原始邮件 --------主题：[pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)发件人：luhas123 收件人：pocheyeniu/SummaRuNNer 抄送：Subscribed I get this error when I run "train.py":
Traceback (most recent call last): File "train.py", line 133, in  train("model.0201") File "train.py", line 55, in train dr.load_data(FLAGS.train_data_file, max_doc_length, max_sen_length) File "/scratch/user/phan3006/MATH689/SummaRuNNer/data_reader.py", line 83, in load_data for line in f.readlines(): File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 696, in readlines return self.reader.readlines(sizehint) File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 605, in readlines data = self.read() File "/scratch/user/phan3006/MATH689/dl_proj_summarun_py2.7/lib/python2.7/codecs.py", line 494, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 0: invalid start byte
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/pocheyeniu/SummaRuNNer","title":"pocheyeniu/SummaRuNNer","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/pocheyeniu/SummaRuNNer"}},"updates":{"snippets":[{"icon":"DESCRIPTION","message":"How do I generate the labeled data? (#1)"}],"action":{"name":"View Issue","url":"https://github.com/pocheyeniu/SummaRuNNer/issues/1"}}}
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/pocheyeniu/SummaRuNNer/issues/1",
"url": "https://github.com/pocheyeniu/SummaRuNNer/issues/1",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
},
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB",
"title": "How do I generate the labeled data? (#1)",
"sections": [
{
"text": "",
"activityTitle": "luhas123",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@luhas123",
"facts": [
{
"name": "Repository: ",
"value": "pocheyeniu/SummaRuNNer"
},
{
"name": "Issue #: ",
"value": 1
}
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueComment",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1,\n"IssueComment": "{{IssueComment.value}}"\n}"
}
]
},
{
"name": "Close issue",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueClose",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1\n}"
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/pocheyeniu/SummaRuNNer/issues/1"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "MuteNotification",\n"threadId": 393039758\n}"
}
],
"themeColor": "26292E"
}
]

Is the data download link unavailable now? I can't access to the data.

i will try it. it seems unaccessable except in china. i will upload it to google disk tonight.发自我的华为手机-------- 原始邮件 --------主题：Re: [pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)发件人：Ci Jie 收件人：pocheyeniu/SummaRuNNer 抄送：zhaopeng ,State change Is the data download link unavailable now? I can't access to the data.
—You are receiving this because you modified the open/close state.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/pocheyeniu/SummaRuNNer","title":"pocheyeniu/SummaRuNNer","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/pocheyeniu/SummaRuNNer"}},"updates":{"snippets":[{"icon":"PERSON","message":"@odek53r in #1: Is the data download link unavailable now? I can't access to the data."}],"action":{"name":"View Issue","url":"https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434219712"}}}
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434219712",
"url": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434219712",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
},
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB",
"title": "Re: [pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)",
"sections": [
{
"text": "",
"activityTitle": "Ci   Jie",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@odek53r",
"facts": [
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueComment",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1,\n"IssueComment": "{{IssueComment.value}}"\n}"
}
]
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434219712"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "MuteNotification",\n"threadId": 393039758\n}"
}
],
"themeColor": "26292E"
}
]

Thanks.

ok now. if all thing is ok，give me a star: )发自我的华为手机-------- 原始邮件 --------主题：Re: [pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)发件人：Ci Jie 收件人：pocheyeniu/SummaRuNNer 抄送：zhaopeng ,State change Thanks.
—You are receiving this because you modified the open/close state.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/pocheyeniu/SummaRuNNer","title":"pocheyeniu/SummaRuNNer","subtitle":"GitHub repository","main_image_url":"https://assets-cdn.github.com/images/email/message_cards/header.png","avatar_image_url":"https://assets-cdn.github.com/images/email/message_cards/avatar.png","action":{"name":"Open in GitHub","url":"https://github.com/pocheyeniu/SummaRuNNer"}},"updates":{"snippets":[{"icon":"PERSON","message":"@odek53r in #1: Thanks."}],"action":{"name":"View Issue","url":"https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434571968"}}}
[
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"potentialAction": {
"@type": "ViewAction",
"target": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434571968",
"url": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434571968",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
"@type": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
},
{
"@type": "MessageCard",
"@context": "http://schema.org/extensions",
"hideOriginalBody": "false",
"originator": "AF6C5A86-E920-430C-9C59-A73278B5EFEB",
"title": "Re: [pocheyeniu/SummaRuNNer] How do I generate the labeled data? (#1)",
"sections": [
{
"text": "",
"activityTitle": "Ci   Jie",
"activityImage": "https://assets-cdn.github.com/images/email/message_cards/avatar.png",
"activitySubtitle": "@odek53r",
"facts": [
]
}
],
"potentialAction": [
{
"name": "Add a comment",
"@type": "ActionCard",
"inputs": [
{
"isMultiLine": true,
"@type": "TextInput",
"id": "IssueComment",
"isRequired": false
}
],
"actions": [
{
"name": "Comment",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "IssueComment",\n"repositoryFullName": "pocheyeniu/SummaRuNNer",\n"issueId": 1,\n"IssueComment": "{{IssueComment.value}}"\n}"
}
]
},
{
"targets": [
{
"os": "default",
"uri": "https://github.com/pocheyeniu/SummaRuNNer/issues/1#issuecomment-434571968"
}
],
"@type": "OpenUri",
"name": "View on GitHub"
},
{
"name": "Unsubscribe",
"@type": "HttpPOST",
"target": "https://api.github.com",
"body": "{\n"commandName": "MuteNotification",\n"threadId": 393039758\n}"
}
],
"themeColor": "26292E"
}
]


Copyedit READMEmd up to --chomp section

I got as far as the --chomp section and thought I would stop and get your feedback.  Is this good?
The changes are all small except for "bypass" which has a confusing meaning.  I chose "act on" and "actioning" instead of "bypass" and "bypassing".  What do you think?  There might be other choices.

I have read all the changes carefully and I believe it became streamlined and quite natural.
Thank you so much!
merged.


mrouted multicast routing cache in SELinux enforcing

Hello,
I am seeing issues with mrouted creating the multicast routing cache when SELinux is in enforcing mode. I am sending a multicast video stream from a machine using VLC and forwarding the stream to another system that is also running mrouted. A fourth machine requests the stream using VLC. This setup works with SELinux in permissive mode on both machines that are running mrouted. Both mrouted configs have all rules commented out.
Machine A (sending multicast stream) <---> Machine B (mrouted in enforcing) <---> Machine C (mrouted in permissive) <---> Machine D (requesting video stream)

I am running mrouted version 3.9.6 (I have also tried 3.9.8) on RHEL 6. I have verified the same behavior occurs in RHEL 5 and 7. I am also seeing this with pimd (master branch, commit dc27fea).
The system seeing issues (Machine B in the diagram above) is using SECMARK to label packets in the mangle table of IPTables. When packets come into the system running mrouted, the following flow is observed using TRACE debugging of IPTables:
Jul 26 21:29:59 localhost kernel: TRACE: mangle:PREROUTING:rule:1 IN=eth0 OUT= MAC=<redacted> SRC=<IP_ADDRESS> DST=<IP_ADDRESS> LEN=1356 TOS=0x00 PREC=0x00 TTL=20 ID=23017 DF PROTO=UDP SPT=39773 DPT=5191 LEN=1336
Jul 26 21:29:59 localhost kernel: TRACE: mangle:Label_Multicast:rule:1 IN=eth0 OUT= MAC=<redacted> SRC=<IP_ADDRESS> DST=<IP_ADDRESS> LEN=1356 TOS=0x00 PREC=0x00 TTL=20 ID=23017 DF PROTO=UDP SPT=39773 DPT=5191 LEN=1336
Jul 26 21:29:59 localhost kernel: TRACE: mangle:Label_Multicast:return:2 IN=eth0 OUT= MAC=<redacted> SRC=<IP_ADDRESS> DST=<IP_ADDRESS> LEN=1356 TOS=0x00 PREC=0x00 TTL=20 ID=23017 DF PROTO=UDP SPT=39773 DPT=5191 LEN=1336
Jul 26 21:29:59 localhost kernel: TRACE: nat:PREROUTING:rule:1 IN=eth0 OUT= MAC=<redacted> SRC=<IP_ADDRESS> DST=<IP_ADDRESS> LEN=1356 TOS=0x00 PREC=0x00 TTL=20 ID=23017 DF PROTO=UDP SPT=39773 DPT=5191 LEN=1336
Jul 26 21:29:59 localhost kernel: TRACE: nat:PREROUTING:policy:2 IN=eth0 OUT= MAC=<redacted> SRC=<IP_ADDRESS> DST=<IP_ADDRESS> LEN=1356 TOS=0x00 PREC=0x00 TTL=20 ID=23017 DF PROTO=UDP SPT=39773 DPT=5191 LEN=1336
Jul 26 21:29:59 localhost kernel: mroute: pending queue full, dropping entries.
Jul 26 21:29:59 localhost kernel: type=AVC msg=audit(1501104611.910:4867): avc:  denied  { recv } for  saddr=<IP_ADDRESS> daddr=<IP_ADDRESS> scontext=system_u:system_r:foo_t:s0 tcontext=system_u:object_r:unlabeled_t:s0 tclass=packet

To summarize:
raw (PREROUTING) -> mangle (PREROUTING) -> proper SELinux label applied -> nat (PREROUTING) (see https://www.frozentux.net/iptables-tutorial/chunkyhtml/images/tables_traverse.jpg)

After the nat table, the packets are dropped. The routing decision to go to the mangle (FORWARD) never occurs because the packet is given the SELinux domain of unlabeled_t.
This is the mangle table in IPTables that I am using:
:PREROUTING ACCEPT [0:0]
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
:POSTROUTING ACCEPT [0:0]
:Label_Multicast - [0:0]

-A Label_Multicast -j SECMARK --selctx system_u:object_r:foo_t:s0
-A Label_Multicast -j ACCEPT

-A INPUT -p udp --destination <IP_ADDRESS>/4 -j Label_Multicast
-A OUTPUT -p udp --destination <IP_ADDRESS>/4 -j Label_Multicast
-A INPUT -p igmp -j Label_Multicast
-A OUTPUT -p igmp -j Label_Multicast

COMMIT

When running the system in SELinux permissive mode, I see the same denials. Once I let the actual multicast stream to flow through my system, I see that ip mroute shows the multicast routing cache was established. I then do not see any unlabeled packets.
The possible relation to the multicast routing cache is also seen when I use smcroute and specify static routes in my config. I boot in enforcing with smcroute, send my multicast stream through the system, and I do not see any unlabeled packets and multicast routing cache for my data flow exists.
To me it seems that IPTables needs the multicast routing cache to exist before it knows how to make a routing decision, as the smcroute test shows. It's also weird that IPTables does allow the packet to be labeled with the context in the Label_Multicast chain, but then the packet still has the unlabeled_t label after the nat table and no routing decision can be made.
Do you have any ideas what could be behind this issue? Should I reach out to the netfilter list instead?
Thanks!

I just realized I posted this to the wrong project. Please feel free to close and I'll open on the mrouted github page if necessary.

Multicast routing and netfilter is a special kind of hell ... have you tried flushing connection tracking?

I did flush connection tracking with conntrack -F and it did not make a difference. I have been reading around more today and it appears there is no connection tracking for multicast in IPTables. There is also no IPTables helper for multicast connection tracking.
It very well might be related to connection tracking.

Unfortunately I have no other ideas, never used SELinux myself.  I know we had issues at work though when doing 1-to-1 NAT (netmap) of multicast, turned out to be due to conntrack locking on to the multicast before the NAT, so for each new multicast rule being set in the kernel we had to do a conntrack flush.  I later added a -e CMD to SMCRoute so it could call conntrack -F for each (*,G) route it added.
Well, let's leave this issue open, maybe someone else has a similar issue and can chime in.


chore: bdd-spring-1572518125 to 0.0.1

chore: Promote bdd-spring-1572518125 to version 0.0.1

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Update tags "Merger" and "Workshops" blogs

Happy Hacktoberfest!

for #73

Referencing the "Selecting Tags for your Carpentries Blog", noting the section "By Carpentry" and the "original source" tags. Please advise.

Sorry, confused about the By Carpentry section. Please review.

Thanks Eliot!


Direct draw into buffer using GPU for further usages

I was trying to draw Flutter widgets directly into the video, via a buffer object.
It shows that Flutter has an implementation: Scene , where lies a native method _toImage linked to Scene_toImage,
and it offers access to Image Bytes, which can be used to furnish the video.
However, it causes quite some pressure on CPU seemingly, and I was wondering how to use Skia ability to draw flutter things into some FrameBuffer or sth like that.
I am a quite newbee and non-english speaker here, so I would appreciate for excusing my poor understanding of the workflows.
Use case
Creating one video-stream composing APP, providing OBS-like functions.

Video composing with YUV(A)/ARGB inputs
Live video source filtering, e.g. Gauss blur etc. (SkSL might be needed)
Switching final composition from various sources.
...

Now I ran into the problem that I can't use flutter widgets as in-video visual components.
What I can do now is as following code:
try {
  var render = repaintKey.currentContext!.findRenderObject()
      as RenderRepaintBoundary;
  double dpr = window.devicePixelRatio;

  var byteData = await render
      .toImage(pixelRatio: dpr)
      .then((image) => image.toByteData(format: ImageByteFormat.png));

  var tempDir = await getTemporaryDirectory();
  var fileName = '${tempDir.path}/frame_${index++}';

  var bytes = byteData!.buffer.asUint8List();

  var file = File(fileName);
  if (!file.existsSync()) {
    file.createSync();
  }
  await file.writeAsBytes(bytes);

} catch (e) {
  ...
}

I can get single frame of this.
I have no idea of implementing continuous outputting and generating the ARGB or YUVA data as a stream source.

Proposal
Expose an API or access to Skia, which could be this way:
(naive design)
RenderRepaintBoundary render = ... ;

// redirect/multicast the output
var bufferObject = render.createBuffer();

var foo = StreamSource(...);
foo.bindBuffer(bufferObject);

Thank you for your time.

I've found some questions on StackOverflow maybe relevant to the issue:
Video Editor in Flutter using dart [closed]
Flutter how to save(re-encode) text overlay on video
and also mine:

, which turned out to be the issue here.
and thanks.

Hi, this feature request is mainly about flutter/engine.
I started to know about Flutter's low-level workflows, whose understanding is out of my capabilities now.
I found this picture:

might be some sort of starting point, and seemingly I need to write native code around compositing stage.
rasterizer.cc -> gpu_surface_gl.cc -> android_surface_gl.cc might be the steps I should intervene.
Could you please give some hints on this? The feature might not be added in the coming future, but if I the noob (😵💫 ) make it to mess up with these codes... hmmm
Any thanks, Zhang

/cc @chinmaygarde

If you want to record a stream of Flutter frames directly to a video, I suggest authoring a custom Flutter Embedder where you have control of the notion of the "onscreen" framebuffer that Flutter renders to.
As you have already discovered, capturing a single image from within a Flutter application is possible but prohibitively slow. Also, there isn't anything Skia specific about the implementation of this feature.
The use-case is fairly niche and since there is already a way to do this using custom embedders, I am closing this as a wont-fix.

Thank you. I'll try.


relax codecov

This will only fail codecov if coverage drops by > 5%

Looks like a codecov file got added in another PR--gonna drop this


Pyarrow  filters are not being applied in read_parquet

Describe the issue:
Pyarrow filters (or at least the one in the below example) appear to be ignored by dask when passed into read parquet.
Minimal Complete Verifiable Example:
import dask.dataframe as dd
import pandas as pd

df = pd.DataFrame({"a": [1, 2, 3], "b": [None, "hat", "bat"]}).astype("a": "int64[pyarrow]", "b": "string[pyarrow]"})
df.to_parquet("example.parquet")
dd.read_parquet("example.parquet", filters=[("b", "!=", "<NA>")]).compute()
# <NA> value is still present in data
pd.read_parquet("example.parquet", filters=[("b", "!=", "<NA>")])
# When called with pandas <NA> value has been filtered out as expected

Anything else we need to know?:
Not sure if this is specific to null strings - seems that other filters such as ("a", "=", 2) or ("b", "=", "hat") work as expected.
Environment:

Dask version: 2024.7.0 (dask_expr 1.1.7)
Python version: 3.10
Operating System: ubuntu
Install method (conda, pip, source): pip

cc @rjzamora git blame points to #9885

Hi @benrutter !
Filtering on <NA> is not well documented because it's still a bit unclear how the this kind of filtering should be represented in "tuple" form (if at all). You can find some background discussion in https://github.com/dask/dask/issues/9845
At the moment, dask doesn't allow you to use != or == to compare with "null" values, because pyarrow doesn't really allow this either. Your specific example does work for pandas, but you'll notice that an equality check (like filters=[("b", "==", "<NA>")]) does not work.
If you want to filter out nulls with dask, you currently need to use "is" or "is not" (E.g. filters=[("b", "is not", None)]).
I'm not convinced Dask is using the "best" solution here, so it could make sense to revisit this topic.

Ah ok, that makes sense! I'd offer to add a helpful note in the docs since its not obvious, but I guess it's a weird one since it's a pyarrow rather than a dask thing.
I'll close this off, since it seems like it's not a bug, just a case where Dask's implementation differs from Pandas I guess?


Benchmark improvements and writeToMemory and save methods

Improves the current benchmark implementation according what was discussed in #1

Make the Sqflite and Moor implementations run the write operations inside a transaction

The current GetStorage implementation in the write benchmark calls write N times. Each of those calls serialize and writes to storage N times. If we were to await each of those calls the result time for GS it would be all over the roof. The current implementation wouldn't scale very well. What I did is instead of calling write during the loop, call writeToMemory instead and call a method save at the end that would persist to storage. Without awaiting the write operations in the GS benchmark, this calls are queued up in Dart and they would run while benchmarking the other packages, giving inaccurate results.

Currently, the randomly generated keys for the benchmarks are alphanumeric strings that range between 5 and 200 characters. I think this range produces too much variance to be useful in the benchmark. I believe that hardcoding it to 10 characters it would be better and would give more consistent results between runs.

With the above changes this is the result on my device.

Thank you for that PR.
You did exactly what I was thinking of doing, to make the recording on memory / disc clearer.
I even think about creating backup copies of the file in memory every x seconds, to avoid truncating the file in case of power failure, for example, and doing things that way makes this type of implementation easier.
Thanks.
I will clone the repository to run the tests, because github actions is failing with path_provider (pana problems), and then I merge if I pass the package tests.


Typescript type for MangoPay.kycDocument.SubmitKycDocument

Current definition of the MangoPay.kycDocument.SubmitKycDocument is :
interface SubmitKycDocument {
      /**
       * The status of this KYC/Dispute document
       */
      Status: "VALIDATION_ASKED";
      Tag?: string;
    }

https://github.com/Mangopay/mangopay2-nodejs-sdk/blob/c0cbc7f89474f8fc0c3f3bd7c564b93c2bdbc04b/typings/index.d.ts#L1534
However method to actually update the document, seems to require object with document Id (which would be consistent with api doc) :
updateKycDocument: function (userId, kycDocument, callback, options) {
        options = this._api._getOptions(callback, options, {
            path: {
                id: userId,
                documentId: kycDocument.Id
            },
            data: kycDocument,
            dataClass: KycDocument
        });

        return this._api.method('kyc_documents_save', callback, options);
    }

https://github.com/Mangopay/mangopay2-nodejs-sdk/blob/c0cbc7f89474f8fc0c3f3bd7c564b93c2bdbc04b/lib/services/Users.js#L350
Am i not using this correctly or is this indeed an error with typescript type ?

Hey @fredleroy
We'll check

Par ailleurs, @fredleroy, serait il possible d'échanger à ce sujet, je suis joignable à<EMAIL_ADDRESS>

Same issue here, I will force the type by casting but a fix would be very welcome.
I guess adding Id property to SubmitKycDocument should be enough ?
    interface SubmitKycDocument {
      /**
       * The status of this KYC/Dispute document
       */
      Status: "VALIDATION_ASKED";
      Id: string;
      Tag?: string;
    }

Hi,
Missing field added here,
https://github.com/Mangopay/mangopay2-nodejs-sdk/pull/211
Note, we'll try to release shortly but cannot guarantee short turn around as other devs in the queue
Max

Hey All,
This should be fixed by https://github.com/Mangopay/mangopay2-nodejs-sdk/releases/tag/1.14.4
Let me know of ongoing issues
max

Hey All,
This should be fixed by https://github.com/Mangopay/mangopay2-nodejs-sdk/releases/tag/1.14.4
Let me know of ongoing issues
max


Refactor classes MotorPort & SensorPort to return the right values using Platform class

Currently the class MotorPort returns fixed values. It is necessary to review the implementation to add support for PiBoards

This issue break the compatibility with LeJOS design. It is not a priority.
public class RegulatedMotorDemo {

    public static void main(String[] args) {

        final EV3MediumRegulatedMotor mA = new EV3MediumRegulatedMotor(MotorPort.C);
        mA.setSpeed(500);

        int ONE_SECOND = 1000;

        mA.forward();
		System.out.println(mA.isMoving());
		Delay.msDelay(ONE_SECOND);
		mA.stop();
		System.out.println(mA.isMoving());
		mA.backward();
		System.out.println(mA.isMoving());
		Delay.msDelay(ONE_SECOND);
		mA.stop();
		System.out.println(mA.isMoving());
		mA.forward();
		System.out.println(mA.isMoving());
		Delay.msDelay(ONE_SECOND);
		mA.stop();
        System.out.println(Battery.getInstance().getVoltage());

        mA.close();
        System.exit(0);
    }
}

It is necessary to create another interface for BrickPi.

Related issues: #123 & #124

This change is pretty interesting. LeJOS only give support for one board but this project offer support for 3 platforms at the moment: EV3, BrickPi+ & PiStorms. So, it is necessary to do some change in order to run a elegant way.

It is necessary to check UML diagram to see the usage of the interfaces:

MotorPort & SensorPort

Fixed.


Revert to a705235b7453bc95865a06cfad76383d820002cc

This PR reverts to this commit: https://github.com/ploomber/jupysql-plugin/tree/a705235b7453bc95865a06cfad76383d820002cc
cc: @edublancas

@yafimvo: just do a sanity check to ensure there's nothing weird (missing tests, broken features, etc)


Handle Page Reload

How do you handle page reload when using Universal Router on the client side? I'm not having any luck. If I use some routes, then reload the page, the server tries to load the non-existing route and fails. Is there any way for Universal Router to know about a page reload?

How your routes looks like?
Do you update location correctly on client side?
Do you use the same routes on server side?


Incidence History for 1 District is not updated  (after being once called! )

For example
https://api.corona-zahlen.org/districts/05117/history/incidence/7
data |
-- | --
05117 |
ags | "05117"
name | "Mülheim an der Ruhr"
history |
0 |
weekIncidence | 89.08059449575696
date | "2021-01-26T00:00:00.000Z"
1 |
weekIncidence | 90.83876412396268
date | "2021-01-27T00:00:00.000Z"
2 |
weekIncidence | 93.18299029490365
date | "2021-01-28T00:00:00.000Z"
3 |
weekIncidence | 65.63833278634722
date | "2021-01-29T00:00:00.000Z"
meta |
source | "Robert Koch-Institut"
contact | "Marlon Lueckert (m.lueckert@me.com)"
info | "https://github.com/marlon360/rki-covid-api"
lastUpdate | "2021-01-29T00:00:00.000Z"
lastCheckedForUpdate | "2021-02-02T09:45:11.406Z"

It does not matter whether with argument "days" or not
https://api.corona-zahlen.org/districts/05117/history/incidence/
........................................
315 |
-- | --
weekIncidence | 89.08059449575696
date | "2021-01-26T00:00:00.000Z"
316 |
weekIncidence | 90.83876412396268
date | "2021-01-27T00:00:00.000Z"
317 |
weekIncidence | 93.18299029490365
date | "2021-01-28T00:00:00.000Z"
318 |
weekIncidence | 65.63833278634722
date | "2021-01-29T00:00:00.000Z"
meta |
source | "Robert Koch-Institut"
contact | "Marlon Lueckert (m.lueckert@me.com)"
info | "https://github.com/marlon360/rki-covid-api"
lastUpdate | "2021-01-29T00:00:00.000Z"
lastCheckedForUpdate | "2021-02-02T10:06:27.631Z"

Other Districts are working well (maybe only today, i have opened districts 05119, and 05113 today, and it seems to me that this two one will be incomplete tomorrow to!)

It seems lika a few districts haven’t submitted their data since 29.01.2021.
I believe it is not a server issue.

It seems lika a few districts haven’t submitted their data since 29.01.2021.
it seems you are right ....
I believe it is not a server issue.
but does this not meen (no data submitted) the data is "0" ??? (RKI is taking this days with "0"  to calculate the incidenz! For RKI the sum for cases of the last 7 days for distrikt 055117 is 88 and the inzidenz today is 51,57297576

Yes you are right these days should be 0.
But at the moment it is hard to distinguish between "No data submitted for the days" and "The data has not been updated yet".
So we have to check if any data has been submitted for the day to be sure that we are not assuming 0 cases although the RKI has not updated the data yet. We don't want to deliver wrong number at any time.

you are right thats a big problem .................

Maybe it can be the solution to add "Datenstand" to the query(s)!? if this is the date from today the data should be updated!
e.g. like this (this is pjson format for better readability)
https://services7.arcgis.com/mOBPykOjAyBO2ZKk/arcgis/rest/services/RKI_COVID19/FeatureServer/0/query?where=NeuerFall%20IN(1,0)%20AND%20IdLandkreis=05117&objectIds=&time=&resultType=standard&outFields=AnzahlFall,MeldeDatum,IdLandkreis,Datenstand&returnIdsOnly=false&returnUniqueIdsOnly=false&returnCountOnly=false&returnDistinctValues=false&cacheHint=false&orderByFields=IdLandkreis,MeldeDatum&groupByFieldsForStatistics=Datenstand,IdLandkreis,MeldeDatum,Landkreis&outStatistics=[{%22statisticType%22:%22sum%22,%22onStatisticField%22:%22AnzahlFall%22,%22outStatisticFieldName%22:%22cases%22}]&having=&resultOffset=&resultRecordCount=&sqlFormat=none&f=pjson&token=
 {
      "attributes" : {
        "cases" : 15,
        "Datenstand" : "02.02.2021, 00:00 Uhr",
        "IdLandkreis" : "05117",
        "MeldeDatum" :<PHONE_NUMBER>000,
        "Landkreis" : "SK Mülheim a.d.Ruhr"
      }
    },
    {
      "attributes" : {
        "cases" : 22,
        "Datenstand" : "02.02.2021, 00:00 Uhr",
        "IdLandkreis" : "05117",
        "MeldeDatum" :<PHONE_NUMBER>000,
        "Landkreis" : "SK Mülheim a.d.Ruhr"
      }
    },
    {
      "attributes" : {
        "cases" : 36,
        "Datenstand" : "02.02.2021, 00:00 Uhr",
        "IdLandkreis" : "05117",
        "MeldeDatum" :<PHONE_NUMBER>000,
        "Landkreis" : "SK Mülheim a.d.Ruhr"
      }
    },
    {
      "attributes" : {
        "cases" : 15,
        "Datenstand" : "02.02.2021, 00:00 Uhr",
        "IdLandkreis" : "05117",
        "MeldeDatum" :<PHONE_NUMBER>000,
        "Landkreis" : "SK Mülheim a.d.Ruhr"

today it runs into an error!
{"error":{"message":"An error occurred.","details":"Request failed with status code 502","stack":"Error: Request failed with status code 502\n    at createError (/usr/src/app/node_modules/axios/lib/core/createError.js:16:15)\n    at settle (/usr/src/app/node_modules/axios/lib/core/settle.js:17:12)\n    at IncomingMessage.handleStreamEnd (/usr/src/app/node_modules/axios/lib/adapters/http.js:260:11)\n    at IncomingMessage.emit (events.js:326:22)\n    at IncomingMessage.EventEmitter.emit (domain.js:506:15)\n    at endReadableNT (_stream_readable.js:1241:12)\n    at processTicksAndRejections (internal/process/task_queues.js:84:21)"}}


MINOR: Java 9/10 fixes, gradle and minor deps update

Added dependencies so that Trogdor and Connect work with Java 9 and 10
Updated Jacoco to 0.8.1 so that it works with Java 10
Updated Gradle to 4.6
A few minor version bumps (not related to Java9/10 fixes)

I tested manually that we can run ./gradlew test with Java 10
after these changes. There are test failures as EasyMock
and PowerMock will have to be updated to use a newer
ASM version. But compiling successfully and most tests
passing is progress. :)
I also tested manually that Trogdor can be started with Java 10.
It previously failed with a ClassNotFoundError.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

retest this please

All tests passed, the JDK 8/Scala 2.12 issue was when talking to GitHub after the tests had passed.

LGTM

There's a new version of Jacoco that works with Java 10 and I updated connect in a similar way as Trogdor.

retest this please

Failure is unrelated. Merging to trunk.


Think about to fix the issues found by adapter checker

I am an automatic service that looks for possible errors in ioBroker and creates an issue for it. The link below leads directly to the test:
https://adapter-check.iobroker.in/?q=https://raw.githubusercontent.com/o0shojo0o/ioBroker.traccar

[ ] [E605] No actual year found in copyright. Please add "Copyright (c) 2022 Dennis Rathjen<EMAIL_ADDRESS>at the end of README.md
[ ] [E701] No actual year found in LICENSE. Please add "Copyright (c) 2022 Dennis Rathjen<EMAIL_ADDRESS>at the start of LICENSE

Thanks,
your automatic adapter checker.
P.S.: There is a community in Github, which supports the maintenance and further development of adapters. There you will find many experienced developers who are always ready to assist anyone. New developers are always welcome there. For more informations visit: https://github.com/iobroker-community-adapters/info

Thanks, that all bugs have been fixed.


Passive stateful conntrack mode support in loxilb

loxilb provide's its own alternate conntrack implementation. Some users have requested conntrack only mode where loxilb does nothing else but conntrack mode. It might be an interesting feature for quick debugging in the cloud-native networking arena without affecting anything.

This feature is down the priority list unless community has need for it. For now, closing it.


CSS Cleanup on Showcase Edit page

grab and grabbing
drop target styling
Replace drag content with image or text title and very tiny dummy text.

Coverage remained the same at 92.86% when pulling 14a768c6edabf13611d10a729abab37d3fc28f1f on editor-css-cleanup into 82841019ae38e3557a62800689400a6dd72ee0a6 on master.


Create a basic multiplayer example

Particularly demonstrate how to handle gamepad mapping and registration.

See https://github.com/jakobhellermann/bevy-inspector-egui/blob/main/Cargo.toml#L41 to enable more features for use in examples.

Plan is to make a simple slime-volleyball game.

Alright, this is fine for now. Gamepad registration needs to be somewhere else.


update/v7supportsPHP8

sorry, I pushed it by mistake…

@vinkla
Hi, My name is SardineTa23 and I am an engineer in Japan.
I'm not good at English, so sorry if it's hard for you to understand me.
This time, I wanted to update the PHP version of my application which is using Laravel6 to 8.
However, the wonderful package here is not compatible with PHP8 && Laravel6, so I made a modification to make v7 compatible with PHP8.0.
We have published the modified package by issuing a new release tag at https://github.com/SardineTa23/laravel-hashids/releases/tag/v7.1.0. Can you please publish 7.1.0 in this repository as well?


Minor module changes

PR to address #1036

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.71%. Comparing base (09ad916) to head (1044c49).

Additional details and impacted files
@@             Coverage Diff              @@
##           dev/1.25    #1037      +/-   ##
============================================
- Coverage     94.71%   94.71%   -0.01%
============================================
  Files           178      178
  Lines         18419    18423       +4
============================================
+ Hits          17446    17449       +3
- Misses          973      974       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

@dirkkul - Just to be clear; I haven't added any tests to confirm that the new collection configs actually work as intended. Not sure if that's something you want to add in the future or not.


wait for cert-manager pod to be up and running

Signed-off-by: Yu Cao<EMAIL_ADDRESS>closes https://github.com/open-cluster-management/grc-ui/pull/818

/retest


Possible to share DB?

Heyo,
Fairly new to docker, managed to get it set up and host it using ngrok, but the main pain point is the scraping, which will take weeks probably to finish in the current tempo (just YTS alone, and there are more).
Is there a way to import a db from someone who already finished scraping? If so, are there any dumps available?
I saw that the readme for scraper contains initial dumps for TPB and Kickass, but the mega links point to empty folders
Cheers

Is it not possible to run multiple scrapers instead of one?

I'm looking into some kind of solution to this, but the issie with sharing dbs is that it's subject to dmca claims, just like trackers.

I was able to get one of the load files from internet archive, but I am not sure how to import it.   How do I import a bulk file?

I was able to get one of the load files from internet archive, but I am not sure how to import it. How do I import a bulk file?

You would need to write a new scraper that reads the dump that you found and proceed to run each time through. You can look at the existing scrapers to examine how they process each individual torrent and model after that.

Thanks for your input again @davidjameshowell , always helpful as usual.
After taking some time to look at sharing the DB, it's not something that is easily doable.
I'm not going to spend time working into the app's code for a few reasons:

It makes it harder to keep up with the upstream
I hate JS
I have plans for a completely seperate add on
The original dev shows no interest in sharing his scrapers

I will support this fork when it comes to making the dependencies work, but I don't see this as a long term project.


Creating a Rocky 8 on ARM results in "Can't create machine" error

Describe the bug
When attempting to create a Rocky8 Linux VM on Apple ARM, the VM fails to be created and presents the following error
create 'rocky8': setup: do initial setup: run command '[useradd --uid 501 --gid 501 --badname --no-user-group --create-home --shell /bin/bash matthew.muscat]': exit status 2; output: useradd: unrecognized option '--badname'
Usage: useradd [options] LOGIN
useradd -D
useradd -D [options]

To Reproduce

Goto Linux Machines
Create a new Machine
Set Distribution to Rocky
Set Version to 8
Set CPU type to Apple

Expected behavior
The VM should be created and run successfully
Diagnostic report (required)
OrbStack info:
Version: 0.15.0 (150000)
Commit: c5bda1bf8c660116c880c5f4fae3b7625ff19030 (v0.15.0)
System info:
macOS: 13.4.1 (22F82)
CPU: arm64, 10 cores
CPU model: Apple M1 Max
Full report: https://orbstack.dev/_admin/diag/orbstack-diagreport_2023-07-24T05-05-11.309215Z.zip
Screenshots and additional context (optional)
No response

Because the --badname introduced at shadow #522, there were no badname option in the version (v4.12) before the commit. It should be --badnames or -b before version v4.12.
-       (void) fputs (_("  -b, --badnames                allow bad names\n"), usageout);
+       (void) fputs (_("  -b, --badname                 allow bad names\n"), usageout);

Fixed for the next version. Rocky 8 doesn't have --badnames either.

Tried to create an Ubuntu 18 machine with Orbstack on MacOS and getting the same error

Workaround until v0.15.1 is released: downgrade to v0.14.1, create the machine(s) you need, and then update again.

Released in v0.15.1.


rust: 1.58.1 -> 1.59.0

Tested builds of fd, firefox, and thunderbird on x86_64-linux with this change applied to master.

Motivation for this change
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

@OfBorg build fd

Build fd on x86_64-darwin.

Bisect says dc93e10397b6efadefe58fe0a74925595d273d75 rust: 1.58.1 -> 1.59.0 broke rustfmt in staging and staging-next:
$ nix build -f. rustfmt
...
rustfmt> Mismatch at src/ignore_path.rs:37:
rustfmt>      #[nightly_only_test]
rustfmt>      #[test]
rustfmt>      fn test_ignore_path_set() {
rustfmt> -        use std::path::{Path, PathBuf};
rustfmt>          use crate::config::{Config, FileName};
rustfmt>          use crate::ignore_path::IgnorePathSet;
rustfmt> +        use std::path::{Path, PathBuf};
rustfmt>
rustfmt>          let config =
rustfmt>              Config::from_toml(r#"ignore = ["foo.rs", "bar_dir/*"]"#, Path::new("")).unwrap();
rustfmt> test test::self_tests ... FAILED

Fixed at #167431.


CSGO server install fails: ./steamcmd.sh no such file or directory

I'm getting this error when trying to install a CSGO server
./steamcmd.sh: line 29: /home/csgoserver/steamcmd/linux32/steamcmd: No such file or directory

When I try to look for the file is can find it with no problem.

Forgot to install some dependencies. My bad!


fetch both admin.conf and superadmin.conf

starting from kubernetes 1.29, kubeadm creates two kubeconfig files for administrators:

admin.conf: this is a NEW user that has a rolebinding for the role kubeadm:cluster-admins and not masters as before.
super-admin.conf: this is the equivalent to the admin.conf created in previous versions. It is a member of the system:masters group, so RBAC does not apply.

Now both are downloaded and we let the user choose which one to use.

LGTM!
just a quick question, from which version the super-admin.conf file exists? There are some conditions to enable or disable the super-admin.conf creation in the roles if using the role on older versions?

super-admin.conf exists since kubeadm 1.29. I put in the role itself a condition to check if it exists if kubernetes version is greter or equal to 1.29.0
kubernetes_version is version('1.29.0', 'ge', version_type='semver')


use official prometheus client

fixes #6

Coverage remained the same at 100.0% when pulling 888282067ea99ab40dd574cdd04668dcb4dd50a9 on prom_client into a9d838edde28bf9e12bb8c7a3ec3ae14dd1cecad on master.

Coverage remained the same at 100.0% when pulling 715ab0c265c8400c4d09650654e986da9d064c5c on prom_client into a9d838edde28bf9e12bb8c7a3ec3ae14dd1cecad on master.

Changed quite a bit to make proper use of the collector class. I'm afraid this requires repeated reviewing.

Ship it!

Go ahead!


Microoptimization cleanup

Just some small micro optimizations including preferring fastutils, Removing unnecessary checks already dealt with using @NotNull, all since I had extra unplanned free time.

I am personally not a fan of returning non-standard types (like in Chunk/DynamicChunk)

I am personally not a fan of returning non-standard types (like in Chunk/DynamicChunk)

I am personally not a fan of returning non-standard types (like in Chunk/DynamicChunk)

Got it, ill change that

I am personally not a fan of returning non-standard types (like in Chunk/DynamicChunk)

Got it, ill change that


payload-commit service on-chain changes with audit-protocol cleanup

Audit-protocol clean up for onchain changes
Checklist

[x] My branch is up-to-date with upstream/main branch.
[x] Everything works and tested for major version of Python/NodeJS/Go and above.
[x] I've written tests against my changes and all the current present tests are passing.
[x] I've run pre-commit checks/hooks

Change logs

audit-protocol cleanup according to new onchain architecture. Refer complete architecture
removed all python scripts and related files
removed following go services

token-aggregator
dag-status-reporter  (no dag chains involved anymore)
Pruning-archival (dag-chain based)

updated payload-commit service for onchain changes
Added pruning (snapshot cids ipfs unpinning and local disk cleanup) service (cron-job worker based service)

Changed

payload commit service is now completely event based code ref

listens for snapshot events, uploads snapshot to ipfs and/ web3 (depending on config, store cid in cache (redis)
stores unfinalized snapshot temporarily in redis
submits payload containing snapshot cid along with other info using EIP-712 signing for finalization to relayer or contract (depending on config)
listens for snapshot finalization event, builds cache and snapshotter report accordingly. Refer payload_commit_service_callflow.png for detailed flow

pruning service unpins finalized snapshot cids older than configured max age and cleans older snapshot files. For detailed flow refer pruning_service_callflow.png and for code refer code ref

Deployment Instructions
NA

Approving since all concerns were addressed and code has been running without any issues in stg instances for some time now.


blob.js and filesaver.js from NPM

Can you update your package.json and get blob.js and filesaver.js from NPM?

These npm packages are not well-maintained. That's why I've decided to fork it and get it from github directly (https://github.com/alferov/angular-file-saver/blob/master/package.json#L24-L25). There is no sense to publish it on npm (since there are no official releases).

Your approach makes it impossible to use your package on systems where git is unavailable - i. e. our CI server. Could you consider once more using npm package instead of git, please (i.e. https://www.npmjs.com/package/cf-blob.js)?

I'm completely agree with @wips. Please consider using npm, it is absolutely necessary. Thx

+1  please remove git dependency

Hello,
Sorry to unearth the subject but I spent the whole day trying to resolve this error on an Azure pipeline and it would have been impossible without this thread.
Apparently the creator does not maintain this directory so for those like me who would need this functionality, replace the dependency "angular-file-saver" in your package.json with "file-saver": "2.0.2" ([https://www.npmjs.com/package/file-saver](npm link))
This dependency uses the same syntax so normally no impact on your existing
Hoping this will help you as much as it does for me :)


Can't work in spring cloud gateway

gateway -> consumer -> provider，but can't work in spring cloud gateway。
spring cloud gatway pom

version

    <spring-cloud.version>Greenwich.SR2</spring-cloud.version>
    <spring-boot.version>2.1.7.RELEASE</spring-boot.version>

pom

<dependency>
    <groupId>io.opentracing.contrib</groupId>
    <artifactId>opentracing-spring-jaeger-cloud-starter</artifactId>
    <version>2.0.3</version>
</dependency>

<dependency>
    <groupId>org.springframework.cloud</groupId>
    <artifactId>spring-cloud-starter-gateway</artifactId>
</dependency>

demo code

https://github.com/life-labs/jaeger-example-spring-cloud/tree/master/sc-without-sleuth

What do you mean by can't work? you don't see traces or the app crashes?

this is use spring cloud gateway

this is use spring cloud netflix zuul

in spring cloud gateway , Span is not linked 。

Hi guys, I run into the same issue. And we still couldn't find any proper solution.
We created a GlobalFilter to generate the span and pass the traceID to the next service. And it is working... but the problem is that we are creating the local spring cloud gateway span with the incoming request instead of the outgoing... that's why this solution is not so good.
Does some of you know how to interact with the underneath HttpClientConnect object?
I left the code explanation and also de question on stackoverglow.
If there is other approach to address this, please let us know, maybe we can help...
Thanks in advance!

@nicorbes
I have the same question
All I can do is pass the trace information when I receive the request, but there is no way to associate it with the request at the time of receiving the response.
Is there any temporary solution on your side?

@caorui31 partially yes, we created as mentioned before, the following filter:
@ConditionalOnProperty(value = "opentracing.jaeger.enabled", havingValue = "true")
@Configuration
public class TraceIDSenderConfiguration {

    private Logger log = LoggerFactory.getLogger(TraceIDSenderConfiguration.class);

    public TraceIDSenderConfiguration() {
        log.info("Initiating tracing configuration...");
    }

    @Bean
    @Order(-1)
    public GlobalFilter tracingFilter() {
        return (exchange, chain) -> {
            ServerHttpRequest request = exchange.getRequest();
            ServerHttpRequest.Builder requestBuilder = request.mutate();

            Span span = null;

            try {
                Tracer tracer = TracerResolver.resolveTracer();

                // TODO: This is not right, we should create the span based on the downstream request
                span = tracer.buildSpan("FORWARD")
                        .withTag(Tags.SPAN_KIND.getKey(), Tags.SPAN_KIND_CLIENT)
                        .withTag(Tags.HTTP_METHOD.getKey(), request.getMethod().name())
                        .withTag(Tags.HTTP_URL.getKey(), request.getPath().toString())
                        .asChildOf(tracer.activeSpan())
                        .start();

                tracer.inject(span.context(), Format.Builtin.HTTP_HEADERS, new RequestBuilderCarrier(requestBuilder));
            } catch (Exception e) {
                log.warn("Tracing not initiated", e);
            }

            Span finalSpan = span;
            return chain.filter(exchange.mutate()
                    .request(requestBuilder.build())
                    .build()).then(Mono.fromRunnable(() -> {
                ServerHttpResponse response = exchange.getResponse();

                if (finalSpan != null) {
                    finalSpan.setTag(Tags.HTTP_STATUS, response.getStatusCode().value());
                    finalSpan.finish();
                }
            }));
        };
    }

    public static class RequestBuilderCarrier implements TextMap {

        private final ServerHttpRequest.Builder requestBuilder;

        RequestBuilderCarrier(ServerHttpRequest.Builder requestBuilder) {
            this.requestBuilder = requestBuilder;
        }

        @Override
        public Iterator<Map.Entry<String, String>> iterator() {
            throw new UnsupportedOperationException("carrier is write-only");
        }

        @Override
        public void put(String key, String value) {
            requestBuilder.header(key, value);
        }
    }
}

It works, since you receive the traceID on the next chained service, but it you look in the information provided for the parent span it doesn't work... since it grab information for the incoming request and not the downstream one... we are still looking for the proper solution...

I have already solved this bug, I am testing it, and I will release the code later.
in spring cloud gateway, @see org.springframework.cloud.gateway.filter.headers.HttpHeadersFilter,

this is pr link!
https://github.com/opentracing-contrib/java-spring-cloud/pull/247

I met this issue too, now any update？

i saw this pr has been mergered，But when the new version will release？thanks

I had kicked off 0.3.10  yesterday but it seems to have failed. I am restarting it

0.3.10 should sync to central by tomorrow if all goes well

Is this feature already available? I'm facing the same problem


Clean up the invalid index generated after the failure of concurrent index creation

When I use “create index concurrently”, there can be failures due to various reasons such as lock timeouts, resulting in an invalid index being left behind. If the script for rebuilding indexes fails and leaves behind invalid indexes, is it possible to clean up those invalid indexes before the script execution is completed?

It's a bit tricky to distinct not valid indexes created by failure on reindex concurrently from pg_index_watch and similar not valid indexes from some other activities like manual DBA run commands. But yes you have a point that something should be done with it.  I have some ideas what to do with this issue and try implement proof of concept soon.

It's a bit tricky to distinct not valid indexes created by failure on reindex concurrently from pg_index_watch and similar not valid indexes from some other activities like manual DBA run commands. But yes you have a point that something should be done with it. I have some ideas what to do with this issue and try implement proof of concept soon.

In fact, there are few scenarios where dba use invalid indexes. I think you can judge whether there is an executing index job through the view, otherwise it can be cleaned up.

should be fixed in the latest version (exactly in way you suggested)

should be fixed in the latest version (exactly in way you suggested)

Hello！Where can I get the latest version? (๑¯◡¯๑)

checkout head  (see readme it cover checkout and update procedures)
someday I will release new official tarball, hopefully soon, but so far - git clone and go.


Convert AppMetrics Meter to StatsD Count

Thanks for helping out :+1:
Before submitting a pull request, please have a quick read through the contribution guidelines and provide the following information, where appropriate replace the [ ] with a [X]
The issue or feature being addressed

#668

Details on the issue fix or feature implementation

We're emulating what DogStatsD is doing by converting Meter into the closest metric we have to DataDog Rate metric, which is the Count metric in AppMetrics and StatsD.

Confirm the following

[x] I have ensured that I have merged the latest changes from the dev branch
[x] I have successfully run a local build
[x] I have included unit tests for the issue/feature
[x] I have included the github issue number in my commits

OK, I think I have the implementation correct now

I think this looks good @alhardy - should help fix this compat issue for DogStatsD / StatsD.
StatsD is a somewhat annoying platform to target because within that ecosystem there are a lot of different variants of its own metrics standard, but this adapts App.Metrics to match the official StatsD specification which is also what DogStatdsD supports.


When the renderer requires too many retries, try gracefully surviving

Today I had DWM or some graphics driver or something take a real long trip upstate. Fortunately, the Terminal didn't immediately crash. However, when the rendering did return, the terminal eventually did crash, because the renderer required too many tries to paint the frame.
while (tries > 0)
{
    const auto hr = _PaintFrameForEngine(pEngine);
    if (E_PENDING == hr)
    {
        if (--tries == 0)
        {
            FAIL_FAST_HR_MSG(E_UNEXPECTED, "A rendering engine required too many retries.");
        }
        continue;
    }
    LOG_IF_FAILED(hr);
    break;
}

@miniksa ca correct me if I'm wrong here, but I think this should maybe just gracefully do nothing, maybe log a message.
I have no idea how to repro this manually, maybe taskkill /f /im dwm.exe would work, but I don't really want to try again.

@miniksa Michael Niksa FTE ca correct me if I'm wrong here, but I think this should maybe just gracefully do nothing, maybe log a message.
I have no idea how to repro this manually, maybe taskkill /f /im dwm.exe would work, but I don't really want to try again.

I think maybe we need to identify the reason behind the failure and determine which ones are worth retrying and which ones are unrecoverable.
Also, I'd want to look back in time and check the blame on the file to find the commit/PR/discussion that added that retry loop to see if we can gain some insight on whether the retry loop is mitigating some other usually recoverable issue or whether we must fail for some specific reason.

@miniksa so, that was me. We were failing when we lost dcomp/dwm and the swap chain flip method failed with "E_PLEASE_RETRY_MY_DEVICE_WENT_AWAY".

I still feel like there's a maximum number of times to retry when your graphics pipeline soils the bed. Just like when you have bigger problems when your entire machine is out of available virtual memory.

@miniksa that's probably true, but I still thought it was peculiar that the Terminal was the only app that beef'd it when the display crashed like that. Even Teams survived. Maybe there's some other event we're missing, like SwapChainPanel::OnDisplayBeefedIt, that we can use to disable/re-enable the render engine.

SwapChainPanel::OnDisplayBeefedIt

Yes.

It turns out that we did this for v1 in #5353!


tc/dataset misses documentation for all options

Using tc/dataset I always need to go back to the tmd documentation, and I cannot get the clojure-doc in my editor.

We'll be fixed in the next release.

Solved in 7.007


Tag existing AWS resources

Problem description
Whenever k8s-pvc-tagger is deployed there might be already many untagged PVCs (and dynamically provisioned PVs / EBS / EFS).
Solution
If a flag (e.g. tag-existing-resources) is set, the tagger lists all the PVCs and tries to tag the underlying EBS/EFS.

I'm not sure I'm following the behavior you're expecting here. It won't tag any PVCs without the expected tags so there is no work to be done when the app first starts. If you are starting to use it for the first time, deploy the k8s-pvc-tagger first, then start to annotate the PVC(s), it will then tag the underlying EBS/EFS volumes as the modifications to the PVC(s) are made.

Sorry, you are right; i just tested it in minikube quickly and made some mistakes. Moreover, if the PVCs are tagged, after the deployment the tagger will receive "add" event from the informer for every PVC (so if they are tagged correctly, they will be processed)


Adding a cookies page

As per: https://www.pivotaltracker.com/story/show/95040606
This PR adds the new cookie page with probably correct content, then adds it into all the usual places routes and adds a couple of tests.

Follows the pattern of existing code, meging


Set line length?

Hello there. Sorry if this question is too trivial, but could not find a way to either set by either UI or in config file the line length in characters.
Any tips?
Thanks!

@GAZ082 Check out the "Column Ruler" and "CharLimit" extensions.

@peterflynn Thanks buddy.


serial initialization issue and Home Assistant logout/shutdown

I have Huawei - chint dtsu666-h. when i connect it and submit in home assistant , home assistant unresponsive and shut down. i tried again and again , same issue

please attach logs


Remove componentWillReceiveProps

Move valueCache creation to render instead of componentWillReceiveProps.
This is to prevent deprecation warning in strict mode:
Warning: Unsafe lifecycle methods were found within a strict-mode tree:
    in StrictMode (at app.js:59)
    in App
    in AppContainer (at main.js:17)

componentWillReceiveProps: Please update the following components to use static getDerivedStateFromProps instead: CalendarHeatmap

Learn more about this warning here:
https://fb.me/react-strict-mode-warnings

Also replaced this.latestProps with this.props as latestProps is not needed anymore with this change.
Fixes #96

The React 16.7 seems to enable concurrent mode, so it would be nice to have deprecated lifecycles removed before that.

Thank you! Now I can run everything under StrictMode to prevent deprecated lifecycles walking in.
Although the concurrent mode was postponed in React roadmap just yesterday.

No prob! Sorry for the delay + thanks for the contribution 👍


Scalar out of sync

Cant get into alpha wallet.  Scalar is out of sync.

Hi @fe2pluss could you elaborate? Is this in a build you made? If so, could you take a screen shot of the build error or copy/paste it in here?
Thanks!

I have the same error when I send a transaction.


CFAM read/write failure during ipl

Found issue in IPL path, if we do pdbg init and probe at  start and CFAM reset during ipl window could trigger  fsi read failure.  Currently probe function skip the rescan function if it is already in known state.

istep 0 / istep poweron and attn code will need to handle fd's changing on cfam-reset/scan.
ecmd-pdbg need to make changes to initiate  probe until after cfam-reset/scan ( Post poweron step in istep 0 sequence).
Long-running applications: SIGHUP to applications who have fd's cached? libpdbg would need a release interface or re-acquire state info. Pdbg  library is going to provide interface to support this and application can consume.


Access Request like a dictionary

Proposing adding the ability to treat request like a dictionary for shared data

Just to ask the obvious question (which i'm assuming you already checked 😛 ):
Having it inherit from dict had no performance implications?

This PR related to https://github.com/channelcat/sanic/pull/132


Adds an option to specify interface class for ip selection - fixes #255

By default we look for IPv4 addresses (as that's still the most common use case and is unlikely to change in the near future). If one so desires, we can look explicitly for IPv6 or just any address now though.

I added an explicit test for #255 @hferentschik - see test/landrush/issues/255.rb. Figured it would be a good idea to do this in order to prevent regressions accidentally.

Rebased and merged. Thanks.

I added an explicit test for #255 @hferentschik - see test/landrush/issues/255.rb. Figured it would be a good idea to do this in order to prevent regressions accidentally.

:-) +1