Another Potential Solution to Schedule with V2 Fails

Environment

Qiskit Terra version: 0.24
Python version: any
Operating system: any

What is happening?
Currently, it does not support BackendV2 for scheduling.
I check backend.instruction_schedule_map, and it seems that the difference is that BackendV1 has the simultaneous measurement operation for all qubits, while BackendV2 does not have such operation.
How can we reproduce the issue?
Simply schedule the circuit, then it fails:
from qiskit import QuantumCircuit, schedule
from qiskit_ibm_provider import IBMProvider

provider = IBMProvider()

# Create a circuit
qc = QuantumCircuit(2)
qc.x(0)
qc.cx(0, 1)
qc.measure_all()

# Select a backend.
backend = provider.get_backend("ibm_lagos")

sched = schedule(qc, backend)

What should happen?
Error information:
Exception has occurred: PulseError
"We could not find a default measurement schedule called 'measure'. Please provide another name using the 'measure_name' keyword argument. For assistance, the instructions which are defined are: ['sx', 'id', 'x', 'rz', 'cx', 'measure']"
qiskit.pulse.exceptions.PulseError: "Operation 'measure' exists, but is only defined for qubits [0, 1, 2, 3, 4, 5, 6]."
The above exception was the direct cause of the following exception:
File "D:\qiskit_test\test.py", line 29, in
sched = schedule(qc, backend)
qiskit.pulse.exceptions.PulseError: "We could not find a default measurement schedule called 'measure'. Please provide another name using the 'measure_name' keyword argument. For assistance, the instructions which are defined are: ['sx', 'id', 'x', 'rz', 'cx', 'measure']"
Any suggestions?
I found some issues and PRs mentioning and solving this problem: #9488 , #9912 , #9987 , #10105 , #10200 .
Thanks to all these efforts, it seems that with many changes, this problem has already been solved.
One thing that confuses me is that qiskit.pulse.measure (in qiskit/pulse/macro.py) has one argument backend, which will be used to decide the version of the backend and then decide the way of scheduling measurements.
However, I checked all the references of measure, but there is no place passing the backend into it, except for test files.
The issue with the current schedule is that no backend parameter will be passed for this. So even passing BackendV2 into schedule, it still uses _measure_v1 to schedule and thus leading to the bug.
I check the whole process of schedule, where the call stack is:
qiskit.compiler.schedule -> qiskit.scheduler.schedule_circuit -> qiskit.scheduler.methods.as_late_as_possible (or as_soon_as_possible) -> qiskit.scheduler.lower_gates -> qiskit.pulse.measure.
If we can somehow passing the backend for qiskit.pulse.measure to differentiate the version of the backend, then this bug will be solved.
Without changing the function interfaces, I think the best option is to include the backend into ScheduleConfig.
I knew from the above issues and PRs that possibly ScheduleConfig will be deprecated in the future, but as one simple solution, we can add the backend as one parameter into ScheduleConfig.
In this way, we only need to change a few places to remove the bug.
Also, it may be reasonable to have a backend in ScheduleConfig, because this class is said to be "Container for information needed to schedule a QuantumCircuit into a pulse Schedule.".
Backend information is important for scheduling, such as on which backend you schedule this job.
Though it is not necessary, we can make this parameter to be optional.

Since I found #10285 which is striving to solve the bug, and also there are many discussions about how to change it, I will not directly create one PR to merge.
But if you are interested, you can check #10299.


SVO Paging

Use Least Recently Used (LRU) mechanism from GigaVoxels to copy unused octree data from GPU to CPU.

Partially complete. Needs to keep track of recently used bounding box, but the push/pull mechanism is in place.

This has been replaced by a new issue.


[RFC] Branchless + Crypto robust vs Clarity/Maintainability vs Speed

While implementing the shifting operation shl and shr, I've come upon what might be an important trade-off of the library:
Branchless and cryptographically robust implementation
vs
Clear, maintainable
vs
Fast
Case in point, here are 2 implementations for shl
Implementation 1
with branches, seems fast on x86_64, unknown speed on ARM, readable
proc `shl`*[T: MpUint](x: T, y: SomeInteger): T {.noInit, noSideEffect.}=
  ## Compute the `shift left` operation of x and y

  if y == 0:
    return x

  let # cannot be const, compile-time sizeof only works for simple types
    size = (T.sizeof * 8)
    halfSize = size div 2

  type Sub = getSubType T

  if y < halfSize:
    result.hi = (x.hi shl y) or (x.lo shr (halfSize - y))
    result.lo = x.lo shl y
  else:
    result.hi = x.lo shl (y - halfSize)
    result.lo = 0.Sub

Implementation 2
branchless, unconclusive slow/fast on x86_64, unknown speed on ARM, a bit like magic
proc `shl`*[T: MpUint](x: T, y: SomeInteger): T {.noInit, noSideEffect.}=
  ## Compute the `shift left` operation of x and y
  type Sub = getSubType T

  let # cannot be const, compile-time sizeof only works for simple types
    size = Sub(T.sizeof * 8)
    halfSize = size div 2

  var S = y.Sub and (size-1) # y mod size

  let
    M1 = Sub( ((((S + size-1) or S) and halfSize) div halfSize) - 1)
    M2 = Sub( (S div halfSize) - 1)

  S = S and (halfSize-1) # y mod halfsize

  result.hi = (x.lo shl S) and not M2
  result.lo = (x.lo shl S) and M2
  result.hi = result.hi or ((
    x.hi shl S or (x.lo shr (size - S) and M1)
  ) and M2)

Implementation 3
A third implementation would be to cast the MpUint to an array of bytes and use a for loop to shift + carry. It has the advantage of:

being iterative instead of recursive like the 2 others (easier for the compiler to optimize and probably recognize what is intended)

and the disadvantages of:

working 8 bits by 8 bits instead of 64 by 64.
Short of using ASM (which would not be portable) dealing with the carry
Branching in a for loop due to the carry
Need a big endian and little endian implementation

Just IMO, in a case like that even a bit more complicated and "magic" implementation would be fine if it's documented and tested well, as this will be still not a huge cost for an important performance benefit. (bigint operations would be a hotspot)


Intersection Analysis returning indices of triangulated geometry (even if it's non triangulated)

Hi there all. I'm wondering if I have uncovered a small bug in H 18.5.
I am using the intersection analysis node to identify poly lines that cross in the zx plane.
The node has the ability to output the primitive numbers of the prims that intersect at each of the points found.
The attribute is stored as an array of 2 ints. One for each of the 2 prims that intersect at the given point.
The bug I believe I have found is that for a pair of prim lines that cross I would expect the first and second prim numbers on the sourceprim attribute would be the same as the prim numbers of the lines. For example [0,1] would suggest that an intersection point was found between prim 0 and prim 1.
What I am finding is that the second of these numbers is correct for the prim that I can see crossing but the first is out by 1 unit.
Is anyone able to test this behavior for me, or confirm if this is expected behavior?

I think I ran into the same thing, and I think what you're (and I was) getting back in fact are indices of triangulated versions of the geometry (the node itself gives a warning to triangulate your geo IIRC). Try to do that (pre-triangulate your geometry, e.g. with a Divide SOP) and then it should work as expected.
It could worth logging though, I might do that at some point. Oh and I was in 18.0 so good to know they still didn't fix this by 18.5

actually this bug report is about curves intersecting each other


Feat/graphiql explorer added clear data button

Description of changes
Added a clear data button when using amplify mock api in the Graphiql explorer:

Issue #, if available
aws-amplify/amplify-category-api#261

Description of how you validated changes
yarn test passes and created different schemas and deleted all of it's data with the newly created button. I wasn't able to delete open search indexes as they are not generated by the appsync simulator.
Checklist

[x] PR description included
[x] yarn test passes
[ ] Tests are changed or added
[ ] Relevant documentation is changed or added (and PR referenced)
[ ] New AWS SDK calls or CloudFormation actions have been added to relevant test and service IAM policies
[ ] Pull request labels are added

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #11548 (84725d3) into dev (cb22707) will decrease coverage by 0.02%.
The diff coverage is 17.64%.

@@            Coverage Diff             @@
##              dev   #11548      +/-   ##
==========================================
- Coverage   50.02%   50.00%   -0.03%
==========================================
  Files         699      699
  Lines       33870    33903      +33
  Branches     6955     6963       +8
==========================================
+ Hits        16945    16952       +7
- Misses      15438    15458      +20
- Partials     1487     1493       +6

Impacted Files
Coverage Δ

packages/amplify-appsync-simulator/src/index.ts
80.18% <11.11%> (-6.10%)
:arrow_down:

...psync-simulator/src/data-loader/dynamo-db/index.ts
11.81% <17.64%> (+0.11%)
:arrow_up:

...amplify-appsync-simulator/src/server/operations.ts
73.43% <25.00%> (-6.92%)
:arrow_down:

packages/amplify-cli/src/index.ts
66.10% <0.00%> (+0.84%)
:arrow_up:

...li/src/domain/amplify-usageData/getUsageDataUrl.ts
100.00% <0.00%> (+12.50%)
:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Thanks for the contribution, this seems like a great feature. I am working with internal teams to help get this over the line 👍🏼

@ncarvajalc have you had some time to look at the Amplify team's review? Thanks!


Internal error

When running cargo fmt, I got the following error.
error[internal]: left behind trailing whitespace
   --> /.../earley.rs:585:585:15
    |
585 | 			    .err();
    |            ^
    |

warning: rustfmt has failed to format. See previous 1 errors.

Unfortunately, after formatting within my editor, I could not reproduce the error anymore, so I'm not too sure what more information I can provide.
$ rustfmt --version
rustfmt 1.5.2-nightly (696aaad 2023-04-09)
$ cargo --version
cargo 1.70.0-nightly (0e474cfd7 2023-03-31)
$

@jthulhu Thanks for reaching out. Could you please provide a minimal code snippet that reproduces the issue. Just from what you've posted I have a hunch you're dealing with a similar issue as #5769 and other linked issues.


How can I make it work with Github actions and it's environment variables?

I have added my environment secret variables (not checked in the .env file) in the GitHub repo settings hopping that it would work with my Flutter release work flow, except I get Environment variable not found for field mySecretApiKey`. Not sure why it is not able to pick up the environment variables from GitHub.

Please do not spam Github issues with general questions about setting up Github actions. Check StackOverflow or maybe how I do it here.

I understand. But this is hardly spamming. It is natural for someone to confuse environment secrets as environment variables and wonder why envied is erroring Environment variable not found for field 'mySecretApiKey' when I have them defined. It would benefit having a little tip on GitHub Actions variables to > .env. Since it is an environment variable handling library it is a relevant topic and question. But apologies for the inconvenience caused.


Selector :hover should be removed when !important present

https://github.com/lz233/blog-with-astro/blob/270629a8deaea250ddc616f469f2ca0ba1f7687a/src/styles/index.css#L80

Fixed


fix bug with false mentions

There was a false. Instead of @username it was <@@username>
getting the ID should fix this.

The same issue is present as well here:
https://github.com/Yes-Theory-Fam/yesbot-ts/blob/4607c5c5a4623f5c322bdb79cc4c11255d91a1a1/src/programs/voice-on-demand.ts#L355-L357


Update IAM service definitions

This is an auto-generated PR with IAM service updates.

:tada: This PR is included in version 1.1.56 :tada:
The release is available on:

Visual Studio Marketplace
GitHub release

Your semantic-release bot :package::rocket:


new and improved software slides

@ChristinaLK, did you see that this PR is saying it needs fixing at the command-line level?

Maybe I didn't pull the master with my other slides. SIGH. I'll close and redo.


i18n

Solid is a decentralized worldwide movement, with the ability for applications and data to interface across borders and cultures. As such, it is important to have robust internationalization support from the start. As many developers know, i18n is something that is fairly painless to incorporate when you start making something, and quite a pain to do after the fact. We aim to provide code and demonstrate best practices for internationalization in a linked data Solid world.

We're taking a two-phased approach to i18n. This warrants a bit of explanation, starting with two key points:

i18n is something that you want to incorporate as early on in development as possible. It's barely any extra work if you do it from the start. OTOH, the lift is much larger when you have to go back retroactively and integrate it. We want to avoid that.
We believe in turtles all the way down. Linked Data should be used throughout.

We believe that LDFlex is the most appropriate place to implement i18n, and so that's what is going to happen. That won't be ready immediately, so we're going to use standard tooling from i18next in the interim. This will get things split out into JSON, and will then be very easy to migrate to turtle or json-ld when LDFlex is updated.
To recap:

Phase 1 - Use standard i18n tooling from i18next
Phase 2 - Replace with pure linked data driven solution via ldflex

Phase 1 of the i18n plan was released today in v0.3.0 of the React generator. It uses react-i18next and standard resource JSON files (with English and Spanish shipping with the generated application).

Might also be good to keep in mind the linguists view of the problem, especially when it notes language specific edgecases: https://metacpan.org/pod/distribution/Locale-Maketext/lib/Locale/Maketext/TPJ13.pod

@konobi Many thanks for the link. A very interesting read that I have encouraged the developers working on i18n and L10n to read. Thankfully at this point we are only translating static labels, but as we continue and undoubtedly need to handle parameterised translations with an extended set of languages, this seems like a good approach.

Mindful (or less so) middle comment: i18n, but no "Finnish Excel VisualBasic" problems, right?
Backgrounds:
I mean I've single- and firsthanded encountered a funny problem around 1998. Was programming VisualBasic for applications on MS Excel. I did a program to track some statistics in a cable manufacturing factory. The factory had Finnish locale Windows installed, while I had English locale at home on my PC. Guess what? Yes, Excel's VBA language had been somehow really half-baked translated (the actual programming language keywords), so my code didn't work. I would've probably had to use some esoteric transpiler to get my source code switched between FI/EN and back. The code worked only in one place, ie. where Windows had "correct" language settings. And I think that was a big turn-off for certain aspects of i18n 's usefulness.


Add a number widget to GT Magritte

Currently we have no widget for numbers in GT Magritte (so the element builder just ignores them).
We should add a widget.
Cheers

For now it re-uses the string widget; we should probably revisit this in the future.

Is this still open?

We have a working number description, but not a number widget. I think this would be a worthy addition, but maybe not part of this issue?

I close it now. We can open another issue if we have the need for an extended widget.


acme-sh: 2.9.0 -> 3.0.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/acme.sh/versions.
meta.description for acme-sh is: "A pure Unix shell script implementing ACME client protocol"
meta.homepage for acme-sh is: "https://acme.sh/"
meta.changelog for acme-sh is: ""
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

/nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0/bin/acme.sh passed the binary check.

1 of 1 passed binary check by having a zero exit code.

0 of 1 passed binary check by having the new version present in output.

found 3.0.0 with grep in /nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0

found 3.0.0 in filename of file in /nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0

directory tree listing: https://gist.github.com/eee9de6203771ba4bee5e96c9c47f5d2

du listing: https://gist.github.com/1f8386b202e37bfca877f824450e5e90

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

1 x86_64-linux rebuild(s)
0 i686-linux rebuild(s)
0 x86_64-darwin rebuild(s)
0 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
acme-sh

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A acme-sh https://github.com/r-ryantm/nixpkgs/archive/48642977c571fc2f496bf5b738ebc3a2cb76b005.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0
ls -la /nix/store/bdx10jpq3yv27rsqn4irc6vzb8h8j5wm-acme.sh-3.0.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

acme-sh

Maintainer pings
cc @balsoft @mkaito for testing.

Result of nixpkgs-review pr 132396 at 48642977 run on x86_64-linux 1

1 package built successfully:

acme-sh

1 suggestion:

warning: unclear-gpl
gpl3 is a deprecated license, please check if project uses gpl3Plus or gpl3Only and change meta.license accordingly.
Near pkgs/tools/admin/acme.sh/default.nix:41:5:
   |
41 |     license = licenses.gpl3;
   |     ^


Changing into using Swift UI instead of Storyboard

Use case

This is not a problem in the meantime but could be in the near future. The problem is that Flutter uses storyboard instead of Swift UI. As I said not a real problem but could be in the future, better to consider it as a feature :).
Proposal

The proposal is to switch from using storyboard to Swift UI. Short but to the point.

It will break the API so it may be postponed till Flutter 2.0?

Any updates?

Surprising, I can't find a duplicate at the moment.
I know this is requesting that the default template be swapped, but in the meantime you're welcome to open your ios/Runner.xcworkspace and add SwiftUI interfaces as needed.

Yup that’s right, but it is a temporary solution. So I hope the flutter team can take a look at this issue. @timsneath

Right now, my understanding is that apps need to use an Xcode storyboard for the app's launch screen: https://developer.apple.com/news/?id=03262020b. Even though Swift UI is clearly their direction, you're going to at least need one storyboard in your app. Swift UI apps include LaunchScreen.storyboard themselves.
So it's not quite clear what the benefit would be here for the time being: it might increase app size while not reducing dependencies. Feel free to comment if you or others have additional insights to offer here.

I mean changing the Main.storyboard to Main.swift. I know the launch screen has to be a storyboard, but using swift is better I guess. Correct if I am wrong 🎈

SwiftUI requires a minimum of iOS 13, and Flutter supports iOS 9.  We would need to keep the current Swift creation template to support iOS 9 (yes I know this embeds the Swift runtime).
We could add a new non-default SwiftUI flutter create --ios-language swiftui template (currently supports objc, swift), which would only support iOS 13 and newer, dropping support for the 7% of users on < iOS 13.

This hasn't been a priority since it increases our testing matrix for not much gain: it drops support for < iOS 13 and most Flutter developers never directly edit the code in their Xcode project.


[firebase_database] [iOS] CocoaPods could not find compatible versions for pod "Firebase/Database":

I'm having this problema for some time now. I can't run pod install.
This error always pop up:
[!] CocoaPods could not find compatible versions for pod "Firebase/Database":
In Podfile:
firebase_database (from .symlinks/plugins/firebase_database/ios) was resolved to 9.1.0, which depends on
Firebase/Database (= 9.3.0)
flutter_geofire (from `.symlinks/plugins/flutter_geofire/ios`) was resolved to 0.0.1, which depends on
  GeoFire (~> 4.0) was resolved to 4.1.0, which depends on
    Firebase/Database (~> 6.0)

I've tried every suggestion posted on a similar issue without success.
This is my podfile
======================================
platform :ios, '13.0'
ENV['COCOAPODS_DISABLE_STATS'] = 'true'
project 'Runner', {
'Debug' => :debug,
'Profile' => :release,
'Release' => :release,
}
def flutter_root
generated_xcode_build_settings_path = File.expand_path(File.join('..', 'Flutter', 'Generated.xcconfig'), FILE)
unless File.exist?(generated_xcode_build_settings_path)
raise "#{generated_xcode_build_settings_path} must exist. If you're running pod install manually, make sure flutter pub get is executed first"
end
File.foreach(generated_xcode_build_settings_path) do |line|
matches = line.match(/FLUTTER_ROOT=(.*)/)
return matches[1].strip if matches
end
raise "FLUTTER_ROOT not found in #{generated_xcode_build_settings_path}. Try deleting Generated.xcconfig, then run flutter pub get"
end
require File.expand_path(File.join('packages', 'flutter_tools', 'bin', 'podhelper'), flutter_root)
flutter_ios_podfile_setup
pod 'FirebaseFirestore', :git => 'https://github.com/invertase/firestore-ios-sdk-frameworks.git', :tag => '9.3.0'

target 'Runner' do
use_frameworks!
use_modular_headers!
flutter_install_all_ios_pods File.dirname(File.realpath(FILE))
end
post_install do |installer|
installer.pods_project.targets.each do |target|
target.build_configurations.each do |config|
config.build_settings.delete 'IPHONEOS_DEPLOYMENT_TARGET'
end
flutter_additional_ios_build_settings(target)
end
end
target 'OneSignalNotificationServiceExtension' do
use_frameworks!
pod 'OneSignalXCFramework', '>= 3.0.0', '< 4.0'
end
======================================
The project uses a framework (quickblox) and it depends on iOS 13.
These are the dependencies related the project uses
firebase_core: ^1.20.0
firebase_storage: ^10.3.4
firebase_database: ^9.1.0
and the Flutter/Dart version
Flutter 3.0.5 • channel stable • https://github.com/flutter/flutter.git
Framework • revision f1875d570e (3 weeks ago) • 2022-07-13 11:24:16 -0700
Engine • revision e85ea0e79c
Tools • Dart 2.17.6 • DevTools 2.12.2
It's working fine on Android.

@mvpires
You'll probably need to report this in flutter_geofire repo for further resolution. See a similar issue for your reference: https://github.com/mrdishant/flutter_geofire/issues/23
Closing from here.

@mvpires You'll probably need to report this in flutter_geofire repo for further resolution. See a similar issue for your reference: mrdishant/flutter_geofire#23
Closing from here.

Thank you, @darshankawar. I'll do that!


Usage with .cls?

Hi, thanks for writing this module. Here is an example of how I am using this:
var fs = require('fs');
var latex = require('latex');

var string = getTexDocument(); // Returns a string of .tex code
var writeStream = fs.createWriteStream('doc.pdf');
latex(string).pipe(writeStream);

This works for most situations, but what do I need to do if the string is a TeX document that wants to use a CLS file? Is there something I can do to pass CLS code as a string as well to make this work? Thanks!

+1

For now, this module allows you to pass a path to your TEXINPUTS like if you have fonts or .cls files. Example:
var latex = require('node-latex')
var path = require('path')

var pdfStream = latex(texDoc, {
  inputs: path.resolve(__dirname, 'path', 'to', 'inputs')
})

// Do something with pdfStream


Feature: Rework how logger is used

Motivation

Currently, Claudie is using zerolog, which is a great logger. However, the way Claudie is using it could be better. The zerolog is JSON based logger, meaning that is quite easy to filter out logs which you want to see. However, Claudie is putting all relevant information into the message field. I believe it would be better, if Claudie would leverage the JSON-based logging more, i.e. instead of messages like
{"level":"info","module":"ansibler","caller":"claudie/services/ansibler/server/server.go:222","time":1679568028,"message":"Finished workflow for cluster test-cluster project Test-project"}

We would do
{"level":"info","module":"ansibler","caller":"claudie/services/ansibler/server/server.go:222","time":1679568028,"message":"Finished workflow", "cluster":  "test-cluster",  "project": "Test-project"}

adding more granular fields.
Description

Logs in the Claudie should consist of more granular JSON logs, instead of putting all information into a single field.
Exit criteria

[ ] Logs in Claudie are now reworked

While this is certainly possible, I don't think it's typically strictly better.
I'd like to understand what's the exact added value on this one

I can see the value in simplification of the Go code. Instead of doing
log.Info().Msgf("some message for cluster %s project %s", cluster, project) // -> 1:00PM INF server.go:65 >some message for cluste test-cluster project test-project module=kuber
...
log.Info().Msgf("other message for cluster %s project %s", cluster, project) // -> 1:00PM INF server.go:65 >other message for cluste test-cluster project test-project module=kuber

we would define a logger, with fields already appended to every log, thus we would not have to specify those %s everywhere.
logger = log.Logger.With().Str("cluster", clusterName).Caller().Logger().With().Str("project", projectName).Caller().Logger()
logger.Info().Msg("some message") // -> 1:00PM INF server.go:65 >some message module=kuber cluster=test-cluster project=test-project
...
logger.Info().Msg("other message") // -> 1:00PM INF server.go:65 >other message module=kuber cluster=test-cluster project=test-project

Also, it might help with log aggregation in the future as the information about certain clusters can be filtered from a field, instead of the message.


Fix exception when resizing both dimensions

Pulling https://github.com/sourcelair/xterm.js/pull/873 into v3, fixing conflicts. I didn't see much benefit moving blankLine into Buffer as suggested in #873.
Fixes #860

Coverage increased (+0.03%) to 71.599% when pulling ad1a42d2107b88e85a7bb4b2fa0f4674f247f0a8 on Tyriar:860_v3_resize_exception into 91bf3197aeb9f535b05e4b1c11de3d93eca5305b on sourcelair:v3.

Ping @parisk


fix enum value manually

please pay attention for this enum value difference when your language try to release sdk from typespec directly:
typespec: typespec-azure/packages/typespec-azure-resource-manager/lib/common-types/managed-identity.tsp at main · Azure/typespec-azure (github.com)
swagger: azure-rest-api-specs/specification/common-types/resource-management/v5/managedidentity.json at main · Azure/azure-rest-api-specs (github.com)
we have to fix it manually for now

/check-enforcer override


Windows version don't support pppoe connection

English Only (except for bug reporting).
It only connections to the wrong port randomly

The windows version is based on libpcap. According to my prior test, libpcap doesn't support pppoe on windows.

It only connections to the wrong port randomly

What do you mean by connecting to the wrong port, can you provide the conf and log to help understand what you said.

Well I set the --dev to netcard and by using process explorer I find that program don't connecting to the target port but some random port on server.

The log on client is only

[2021-04-25 22:24:06][INFO]waiting for a use-able packet to be captured
[2021-04-25 22:24:07][INFO]waiting for a use-able packet to be captured
[2021-04-25 22:24:09][INFO]waiting for a use-able packet to be captured
[2021-04-25 22:24:11][INFO]waiting for a use-able packet to be captured
It repeat infinitely

client
udp2raw -c -l xxxx -r xxxxx --cipher-mode
none --hb-len 1 --dev \Device\NPF_xxxxx
server
udp2raw -s -l <IP_ADDRESS>:xxx -r xxxx --raw-mode faketcp --cipher-mode none --mtu-warn 1480 --hb-len 1 -a

If I don't set --dev it will say

[2021-04-25 22:32:03][FATAL]no matched device found foxr ip: xxx

This (random port) is as expected, before making fakeTCP connect with pcap, udp2raw windows client will send a regular packet to random port to detect the link level header.
The infinite loop is because pcap doesn't support pppoe on windows. It's hard to be fixed because it's a limitation of pcap.


Add Markdown -> HTML transform

Fix #80
Also fix precommit for node v10, see https://github.com/typicode/husky/issues/247#issuecomment-385586357

Thanks for your contribution. It is live now https://transform.now.sh/markdown-to-html/
I have added you to the contributor list.


[haproxy] sanitize bogus evil CSV with linebreak in field.

What does this PR do?
Introduces some CSV sanitizing logic that attempts to ensure broken lines like these get spliced together based on the number of quotes per line.
Motivation
Although an uncommon use case, we've encountered this in the wild. One of the CSV fields, a quotes string, contained a line break.
Testing Guidelines
Added a test case for this truly dirty and evil csv :)

Let's see if HAProxy outputs this only in very specific cases that could be easily avoided, that would allow us to avoid adding more code to the check :)
If we end up keeping this, could you check that your logic handles escaped double quotes correctly? (i.e. ""  according to https://cbonte.github.io/haproxy-dconv/1.7/management.html#9.1)


Search for most recent IBF file on Windows (UPLOAD-118)

Addresses [UPLOAD-118].

@pazaan Can you also review 3f1bc21 please? Since the version of Powershell on Windows 7 is too old for connecting to the PDMs, we'll have to fall back to the old way of doing things on Windows 7.


xHamster: Not ripping albums from subsequent pages

Ripme version:  1.7.70
Java version: 1.8.0_181
Operating system: Microsoft Windows [Version 10.0.17134.407]

Exact URL you were trying to rip when the problem occurred:  https://xhamster.com/users/galaxy10/photos
Please include any additional information about how to reproduce the problem:

Expected Behavior
To rip all albums from the first page as well as subsequent pages.
Actual Behavior
The ripper correctly grabs albums with images from the first page, but fails to get them from subsequent pages.

@cyian-1756 could this be resolved by simply moving the try/catch function for getting the next page out of the while loop?

This is happening because when you rip from a users photos you're using quick queue ripping. Instead of operating normally the ripper scans the page for albums it supports and then adds those albums to the queue. To get it to work on multiple pages we'd need to add something like getNextPage
For now however it is possible to use the {x-y} feature to rip all pages. Just enter https://xhamster.com/users/galaxy10/photos/{1-x} into ripme where x is the total number of pages and click rip. Ripme might complain about it being an unsupported url but it will still work


Defaults are no longer used for null-valued fields

The behavior of the following code changed in 0.12.0-M1:
import io.circe.generic.extras.Configuration
import io.circe.generic.extras.auto._
import io.circe.jawn.decode

implicit val config: Configuration = Configuration.default.withDefaults

case class Foo(x: String = "abc")

decode[Foo]("""{"x":null}""")

In 0.11.x and earlier versions decoding would succeed, but now it fails. I think it's pretty clear that the previous behavior was correct. See this thread for more discussion.
0.12.0-M3 will go back to the old behavior. We'll need a fix and tests, which I probably wouldn't be able to get to until this Friday at the earliest, so hopefully someone will beat me to it.
Thanks to @Falmarri for reporting this in #1109.

Note that normally I'd rush a fix for an issue like this, but this is -extras, which is explicitly experimental, and these are milestone releases, so I think a couple of days after the report isn't too terrible.

I have a question. There is a test that ensures that for Optional Values the default should not be used in case of null.
"Option[T] with default" should "be None if null decoded" in {
val json = json"""{ "a": null }"""
assert(Decoder[FooWithDefault].decodeJson(json) === Right(FooWithDefault(None, "b")))
}
So the wanted behaviour is the following?
a) if key null and Option decoder -> None
b) if key missing and Option decoder -> Default value (?)
c) if key null or missing and not Option decoder -> default value (?)

If that is the intended behaviour I hope I got it right this time :)


Has anyone successfully performed the Prime+Probe attack ?

I can't build the useful eviction set for Prime+Prome attack, since my intel version is i7-11800H equipped with Tiger Lake-H architecture. Can someone share your cpu version which can successfully perform this attack ?

 Try an i7-6700K.

Thank for your reply. I have tried the i7-6700k, but it's still not work.
I also tried the same method on i5-2520m with published reverse-engineering hash function, and it successfully worked.
Also the PROBE_COUNT parameter is inconsistent in aes/pp/spy.cpp and it's corresponding histogram/pp/calibration.c.
I can't figure out it.
Great thanks to your team. It already helped me a lot for my graduate paper. Thank you very, very much.

I have also tested the eviction set built by the PP code on i7-6700k. It shows the eviction set has effect. When I filled the eviction set and then access target address again, it does causes difference with about 30 cycles high. A bit weird number. Hope other learner can share your experiment result.

30 is not enough... should be several hundred cycles... probably needs
some fine-tuning of the parameters... eviction set size, maybe also the
access pattern...
On 1/22/24 16:39, combinedwu wrote:

I have also tested the eviction set built by the PP code on i7-6700k. It
shows the eviction set has effect. When I filled the eviction set and
then access target address again, it does causes difference with about
30 cycles high. A bit weird number. Hope other learner can share your
experiment result.
—
Reply to this email directly, view it on GitHub
https://github.com/IAIK/flush_flush/issues/15#issuecomment-1904268230,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAN2M6VZVSDVOQHSE5YSISLYP2B3XAVCNFSM6AAAAABBTNDKRCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMBUGI3DQMRTGA.
You are receiving this because you modified the open/close state.Message
ID: @.***>


Missing .hex file with pico_add_extra_outputs()

See also forum post
https://forums.raspberrypi.com/viewtopic.php?t=375084
when upgrading from sdk 1.5.1 to 2.0.0 for rp2040 target .hex files are no longer created unless
adding set(PICO_32BIT 1) in top level CMake file.

duplicate of https://github.com/raspberrypi/pico-sdk/issues/1829


Move footer translations to translations

Move the feedback footer translations to the translation files to
prevent excessive configuration in deploy through the parameters.yml.
That way also missing translations are logged when a translation is
missing and we get rid of the CompilerPass.
Change base before merging!

@thijskh I saw that for the pages below the configuration for the footer blocks were missing. Would you like me to add them now?
stepup-callout-unknown.html.twig
stepup-callout-unmet-loa.html.twig
stepup-callout-user-cancelled.html.twig
generic.html.twig
authn-context-class-ref-blacklisted.html.twig

Yes


fix: Update configuration to point to a regional cluster

Overview
Updates CircleCI configuration to point to a regional instead of zonal cluster

Coverage remained the same at ?% when pulling e55a58760a716c1b571e77a46c9a99722a2acf96 on update_circle_ci into ad1f5d635058892bd689c149800b4e46519b718b on master.


"std::out_of_range" during day time exposure

Hey, from time to time I have this exception:
Dec 31 08:01:34 allsky allsky.sh[20737]: STARTING EXPOSURE at: 2021-12-31 08:01:34   @ 2.00 ms (0.00 sec)
Dec 31 08:01:34 allsky allsky.sh[20737]:   > Capture command: raspistill --output 'image.jpg' --thumb none --burst -st --timeout 10 --nopreview --mode 3 --exposure off --shutter 2000 --analoggain 1 --awb off --awbgains 3.38,1.8 --saturation 20 --brightness 50 --quality 100  -a 1036 -ae 32,0xff,0x808000
Dec 31 08:01:38 allsky allsky.sh[20737]: terminate called after throwing an instance of 'std::out_of_range'
Dec 31 08:01:38 allsky allsky.sh[20737]:   what():  basic_string::substr: __pos (which is 140) > this->size() (which is 0)
Dec 31 08:01:39 allsky allsky.sh[20737]: /home/pi/allsky/allsky.sh: line 210: 20829 Aborted                 "${ALLSKY_HOME}/${CAPTURE}" "${ARGUMENTS[@]}"
Dec 31 08:01:39 allsky allsky.sh[20737]: 'capture_RPiHQ' exited with RETCODE=134
Dec 31 08:01:39 allsky allsky.sh[20737]: ***
Dec 31 08:01:39 allsky allsky.sh[20737]: *** After fixing, restart the allsky service. ***
Dec 31 08:01:39 allsky allsky.sh[20737]: ***

Version:
commit a6ab44efecb1a9af3e57dee93a278cd5fad581bb (HEAD -> master, origin/master, origin/HEAD)
Merge: f5c0c38 530f168
Author: AndreasLMeg<EMAIL_ADDRESS>Date:   Sat Dec 4 20:07:19 2021 +0100

    Merge pull request #843 from thomasjacquin/info_text

    capture_RPiHQ.cpp: fix info_text

@jmodrako: Please try the commands and send me the output:
cat /var/log/messages | grep out_
cat /var/log/messages | grep out_ -A15 -B20

No results at all:
/etc [astroberry@astroberry] [17:39]
> cat /var/log/messages | grep out_ -A15 -B20

/etc [astroberry@astroberry] [17:39]
> cat /var/log/messages | grep out_

And with allsky.log ?
cat /var/log/allsky.log | grep out_
cat /var/log/allsky.log | grep out_ -A15 -B20

@jmodrako:  I think I can reproduce it. But I'll do another test tomorrow.

That's awesome! Regarding logs there is nothing too in the allsky.log...

maybe allsky.log.1 contains some information

@AndreasLMeg I assume the issue is in raspistill, and not capture_RPiHQ?

@jmodrako
if I use 9ms for Daytime settings: Delay I get the "same" problem.
probably not the same trigger, but the same impact.
Can you attach the allsky.log and allsky.log.1 file ?
Jan  3 08:10:55 allsky allsky.sh[17103]: [INFO   ]: STARTING EXPOSURE at: 2022-01-03 08:10:55   @ 8.44 ms (0.01 sec)
Jan  3 08:10:58 allsky allsky.sh[17103]: [INFO   ]:   > image.jpg: 0.0 sec, mean: 0.298169 0.001831
Jan  3 08:11:00 allsky allsky.sh[17103]: [INFO   ]: Sleeping 0.0 seconds...
Jan  3 08:11:00 allsky allsky.sh[17103]: [INFO   ]: ----------------------------
Jan  3 08:11:00 allsky allsky.sh[17103]: [INFO   ]: STARTING EXPOSURE at: 2022-01-03 08:11:00   @ 8.44 ms (0.01 sec)
Jan  3 08:11:01 allsky allsky.sh[17103]: Premature end of JPEG file
Jan  3 08:11:02 allsky allsky.sh[17103]: terminate called after throwing an instance of 'std::out_of_range'
Jan  3 08:11:02 allsky allsky.sh[17103]:   what():  basic_string::substr: __pos (which is 140) > this->size() (which is 0)
Jan  3 08:11:02 allsky allsky.sh[17103]: /home/pi/allsky/allsky.sh: Zeile 210: 17178 Abgebrochen             "${ALLSKY_HOME}/${CAPTURE}" "${ARGUMENTS[@]}"
Jan  3 08:11:02 allsky allsky.sh[17103]: 'capture_RPiHQ' exited with RETCODE=134
Jan  3 08:11:07 allsky allsky.sh[17614]:      ***** Starting AllSky *****

Here are the files: allsky_logs.zip

@jmodrako thank you for the files.
as far as I can adjust the problem is a function that loads the current image into memory for further processing.
cv :: imread (fileName, cv :: IMREAD_UNCHANGED);
We still have to come up with something, because the image is currently being read and manipulated too often. (capture, meanvalue, overlay text, resize, annotate, web-ui...)
The probability of errors decreases with the waiting time after the capture.
Is there a reason for your short waiting time (10s) during the day? (Monitoring function?)
Otherwise I would recommend a waiting time of 60s. (Protects the Raspi, the SD and the camera)
I would also like to recommend the following settings:
Daytime settings:
Delay: 60000

Nighttime settings:
Auto-Exposure: Yes
Exposure: 60000
Delay: 1000
Auto-Gain: Yes
Gain: 15

# Additional Capture parameters.  Run "capture_RPiHQ -h" to see the options.
# e.g. activate autoexposure algorithm "mean" for RPiHQ: "-mean-value 0.3 -autoexposure 1"
CAPTURE_EXTRA_PARAMETERS="-mean-value 0.3 -autoexposure 1"

Thanks, I will change the settings to the recommended ones 👍🏻 And thank you for the quick investigation and provided recommendations ;)

There are still some problems though:
Jan  4 15:57:15 allsky allsky.sh[17798]:      ***** Starting AllSky *****
Jan  4 15:57:15 allsky allsky.sh[17798]: CAMERA: RPiHQ
Jan  4 15:57:15 allsky allsky.sh[17798]: CAMERA_SETTINGS: /etc/raspap/settings_RPiHQ.json
Jan  4 15:57:15 allsky allsky.sh[17798]: Starting allsky camera...

Jan  4 15:57:20 allsky allsky.sh[17798]: STARTING EXPOSURE at: 2022-01-04 15:57:20   @ 1.0 sec
Jan  4 15:57:20 allsky allsky.sh[17798]:   > Capture command: raspistill --output 'image.jpg' --thumb none --burst -st --timeout 10 --nopreview --mode 3 --exposure off --shutter 1000000 --analoggain 1 --exif IFD0.Artist=li_1000000_1 --awb off --awbgains 3.38,1.8 --saturation 20 --brightness 50 --quality 100  -a 1036 -ae 32,0xff,0x808000
Jan  4 15:57:23 allsky allsky.sh[17798]:   > Valid ExposureLevels: -718.53646850 to<PHONE_NUMBER>8
Jan  4 15:57:24 allsky allsky.sh[17798]:   > image.jpg: 1.0 sec, mean: 0.897874 -0.597874
Jan  4 15:57:24 allsky allsky.sh[17798]:   > MeanCnt: 0, mean_historySize: 3
Jan  4 15:57:24 allsky allsky.sh[17798]:   > i=1: idx=1 mean=0.3000 exp=-1
Jan  4 15:57:24 allsky allsky.sh[17798]:   > i=2: idx=2 mean=0.3000 exp=-1
Jan  4 15:57:24 allsky allsky.sh[17798]:   > i=3: idx=0 mean=0.8979 exp=-1
Jan  4 15:57:24 allsky allsky.sh[17798]:   > mean_forecast: 1.0000
Jan  4 15:57:24 allsky allsky.sh[17798]:   > values: 9
Jan  4 15:57:24 allsky allsky.sh[17798]:   > mean_diff: 0.4326
Jan  4 15:57:24 allsky allsky.sh[17798]:   > ExposureChange: 392 (392)
Jan  4 15:57:24 allsky allsky.sh[17798]:   > Mean: 0.732625, diff: 0.432625, Exposure level:-393 (-392), Exposure time:0.00051732 s, analoggain:1.00
Jan  4 15:57:24 allsky allsky.sh[17798]:   > exposure: 60000000 shutter: 0.0005 s quickstart: 9
Jan  4 15:57:25 allsky allsky.sh[17798]: Sleeping 1.0 seconds...
Jan  4 15:57:26 allsky allsky.sh[17798]: STARTING EXPOSURE at: 2022-01-04 15:57:26   @ 1.0 sec
Jan  4 15:57:26 allsky allsky.sh[17798]:   > Capture command: raspistill --output 'image.jpg' --thumb none --burst -st --timeout 10 --nopreview --mode 3 --exposure off --shutter 517 --analoggain 1 --exif IFD0.Artist=li_517_1 --awb off --awbgains 3.38,1.8 --saturation 20 --brightness 50 --quality 100  -a 1036 -ae 32,0xff,0x808000
Jan  4 15:57:29 allsky allsky.sh[17798]: Premature end of JPEG file
Jan  4 15:57:30 allsky allsky.sh[17798]:   > image.jpg: 0.0 sec, mean: 0.501961 -0.201961
Jan  4 15:57:30 allsky allsky.sh[17798]:   > MeanCnt: 1, mean_historySize: 3
Jan  4 15:57:30 allsky allsky.sh[17798]:   > i=1: idx=2 mean=0.3000 exp=-1
Jan  4 15:57:30 allsky allsky.sh[17798]:   > i=2: idx=0 mean=0.8979 exp=-1
Jan  4 15:57:30 allsky allsky.sh[17798]:   > i=3: idx=1 mean=0.5020 exp=-393
Jan  4 15:57:30 allsky allsky.sh[17798]:   > mean_forecast: 0.1060
Jan  4 15:57:30 allsky allsky.sh[17798]:   > values: 9
Jan  4 15:57:30 allsky allsky.sh[17798]:   > mean_diff: 0.1355
Jan  4 15:57:30 allsky allsky.sh[17798]:   > ExposureChange: 44 (-348)
Jan  4 15:57:30 allsky allsky.sh[17798]:   > Mean: 0.435530, diff: 0.135530, Exposure level:-437 (-44), Exposure time:0.00022173 s, analoggain:1.00
Jan  4 15:57:30 allsky allsky.sh[17798]:   > exposure: 60000000 shutter: 0.0002 s quickstart: 8
Jan  4 15:57:30 allsky allsky.sh[17798]: Sleeping 1.0 seconds...
Jan  4 15:57:30 allsky allsky.sh[17798]: convert-im6.q16: Corrupt JPEG data: 97377 extraneous bytes before marker 0xd9 `image.jpg' @ warning/jpeg.c/JPEGWarningHandler/387.
Jan  4 15:57:31 allsky allsky.sh[17798]: convert-im6.q16: Corrupt JPEG data: 48422 extraneous bytes before marker 0xd9 `image.jpg' @ warning/jpeg.c/JPEGWarningHandler/387.
Jan  4 15:57:31 allsky allsky.sh[17798]: STARTING EXPOSURE at: 2022-01-04 15:57:31   @ 517 us (0.517 ms)
Jan  4 15:57:32 allsky allsky.sh[17798]:   > Capture command: raspistill --output 'image.jpg' --thumb none --burst -st --timeout 10 --nopreview --mode 3 --exposure off --shutter 221 --analoggain 1 --exif IFD0.Artist=li_221_1 --awb off --awbgains 3.38,1.8 --saturation 20 --brightness 50 --quality 100  -a 1036 -ae 32,0xff,0x808000
Jan  4 15:57:34 allsky allsky.sh[17798]:   > image.jpg: 0.0 sec, mean: 0.000013 0.299987
Jan  4 15:57:34 allsky allsky.sh[17798]:   > MeanCnt: 2, mean_historySize: 3
Jan  4 15:57:34 allsky allsky.sh[17798]:   > i=1: idx=0 mean=0.8979 exp=-1
Jan  4 15:57:34 allsky allsky.sh[17798]:   > i=2: idx=1 mean=0.5020 exp=-393
Jan  4 15:57:34 allsky allsky.sh[17798]:   > i=3: idx=2 mean=0.0000 exp=-437
Jan  4 15:57:34 allsky allsky.sh[17798]:   > mean_forecast: 0.0000
Jan  4 15:57:34 allsky allsky.sh[17798]:   > values: 9
Jan  4 15:57:34 allsky allsky.sh[17798]:   > mean_diff: 0.0887
Jan  4 15:57:34 allsky allsky.sh[17798]:   > ExposureChange: 22 (-22)
Jan  4 15:57:34 allsky allsky.sh[17798]:   > Mean: 0.211315, diff: 0.088685, Exposure level:-415 (22), Exposure time:0.00033868 s, analoggain:1.00
Jan  4 15:57:34 allsky allsky.sh[17798]:   > exposure: 60000000 shutter: 0.0003 s quickstart: 7
Jan  4 15:57:35 allsky allsky.sh[17798]: Sleeping 1.0 seconds...
Jan  4 15:57:36 allsky allsky.sh[17798]: STARTING EXPOSURE at: 2022-01-04 15:57:36   @ 221 us
Jan  4 15:57:36 allsky allsky.sh[17798]:   > Capture command: raspistill --output 'image.jpg' --thumb none --burst -st --timeout 10 --nopreview --mode 3 --exposure off --shutter 338 --analoggain 1 --exif IFD0.Artist=li_338_1 --awb off --awbgains 3.38,1.8 --saturation 20 --brightness 50 --quality 100  -a 1036 -ae 32,0xff,0x808000
Jan  4 15:57:38 allsky allsky.sh[17798]: Premature end of JPEG file
Jan  4 15:57:39 allsky allsky.sh[17798]: terminate called after throwing an instance of 'std::out_of_range'
Jan  4 15:57:39 allsky allsky.sh[17798]:   what():  basic_string::substr: __pos (which is 140) > this->size() (which is 0)
Jan  4 15:57:39 allsky allsky.sh[17798]: /home/pi/allsky/allsky.sh: line 210: 17896 Aborted                 "${ALLSKY_HOME}/${CAPTURE}" "${ARGUMENTS[@]}"
Jan  4 15:57:39 allsky allsky.sh[17798]: 'capture_RPiHQ' exited with RETCODE=134
Jan  4 15:57:39 allsky allsky.sh[17798]: ***
Jan  4 15:57:39 allsky allsky.sh[17798]: *** After fixing, restart the allsky service. ***
Jan  4 15:57:39 allsky allsky.sh[17798]: ***

@jmodrako some questions:

is you sd card slow or defect ?

Jan  4 15:57:30 allsky allsky.sh[17798]: convert-im6.q16: Corrupt JPEG data: 97377 extraneous bytes before marker 0xd9 `image.jpg' @ warning/jpeg.c/JPEGWarningHandler/387.
Jan  4 15:57:31 allsky allsky.sh[17798]: convert-im6.q16: Corrupt JPEG data: 48422 extraneous bytes before marker 0xd9 `image.jpg' @ warning/jpeg.c/JPEGWarningHandler/387.

we have short shutter times, but the images are overexposed - is this a test (indoor) or outdoor ?
can you send me some images and the log file
Raspberry Pi type ?

@AndreasLMeg this might be due to the 1 second sleep between images when "fast" mode is on (I forget the exact name, but it's when you are quickly going through the first few pictures).  If it takes the Pi longer than a second to process the image the next exposure will overwrite the first one.
This shouldn't be an issue with the saveImage.sh PR code though since every file from raspistill/libcamera has a unique name.  However, we may want to consider not even saving the "fast" frames whose exposure is way off, sonce they will only cause flickering in videos.  In the ZWO version I have the concept of "skip frames" which are the number of frames skipped (i.e. not saved) when first starting the program.  The defaults are 5 during the day and 1 at night.

@EricClaeys  Yes, I saw that. Unfortunately I did not take over the quickstart parameter from the PR, so it is always active at the start (10x1s).
But for me there was never a problem (500ms). In addition, 10s waiting time was still problematic for Jacek.
I'm afraid there is something wrong with the Raspi (old Raspi, memory, CPU load, SD, ...)
I have to think of a test for that ...

@jmodrako
here is one test file: https://github.com/AndreasLMeg/allsky/blob/li_overlay_text/scripts/check.sh
or as file (please rename it to check.sh):
check.sh.txt
copy it to ~/allsky/scripts
chmod +x check.sh
execute it from ~/allsky/ directory: ./scripts/check.sh
and yes, I think I have to change this quickstart with 1s
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 5s
Di Jän  4 22:35:54 CET 2022
Di Jän  4 22:36:27 CET 2022
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 2s
Di Jän  4 22:36:27 CET 2022
Di Jän  4 22:36:44 CET 2022
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 1s
Di Jän  4 22:36:44 CET 2022
/home/pi/allsky/scripts/saveImageNight.sh: Zeile 46: 15426 Abgebrochen             convert "$IMAGE_TO_USE" -resize "$IMG_WIDTH"x"$IMG_HEIGHT" "$IMAGE_TO_USE"
*** saveImageNight.sh: ERROR: IMG_RESIZE failed with RET=134{}
/home/pi/allsky/scripts/saveImageNight.sh: Zeile 91: 15514 Abgebrochen             convert "$IMAGE_TO_USE" -resize "${THUMBNAIL_SIZE_X}x${THUMBNAIL_SIZE_Y}" "$THUMBNAILS_DIR/$SAVED_FILE"
*** saveImageNight.sh: WARNING: THUMBNAIL resize failed with RET=134; continuing.
Di Jän  4 22:36:56 CET 2022

@jmodrako: I have 3 new files to test (scripts)
https://github.com/AndreasLMeg/allsky/blob/c039b0f56465f98318ed631d44196b7de6a165fe/scripts/check.sh
https://github.com/AndreasLMeg/allsky/blob/c039b0f56465f98318ed631d44196b7de6a165fe/scripts/saveImageDay.sh
https://github.com/AndreasLMeg/allsky/blob/c039b0f56465f98318ed631d44196b7de6a165fe/scripts/saveImageNight.sh

@jmodrako
thank you for the response. As you can see in log1.txt everything was OK for sleep 20,10 and 5s between the captures.
For 2s, 1s the convert, upload and maybe other things take too long and the next capture will destroy the old image
This is only a simple test, so I would use 20s for the delay. The next version of allsky has solved this problem, but wait 1 week to take this - we have still some other issues inside.
Is this ok for you? Esle you have to contact me in a week or so.
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 20s
Fri 14 Jan 2022 04:05:58 PM CET
Fri 14 Jan 2022 04:07:46 PM CET
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 10s
Fri 14 Jan 2022 04:07:46 PM CET
Fri 14 Jan 2022 04:08:44 PM CET
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 5s
Fri 14 Jan 2022 04:08:44 PM CET
Fri 14 Jan 2022 04:09:17 PM CET
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 2s
Fri 14 Jan 2022 04:09:17 PM CET
*** darkSubtract.sh: ERROR: Image 'image.jpg' is corrupt; ignoring.
*** darkSubtract.sh: ERROR: Image 'image.jpg' is corrupt; ignoring.
Fri 14 Jan 2022 04:09:34 PM CET
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 1s
Fri 14 Jan 2022 04:09:34 PM CET
*** darkSubtract.sh: ERROR: Image 'image.jpg' is corrupt; ignoring.
*** darkSubtract.sh: ERROR: IMG_RESIZE failed with RET=134{}
*** darkSubtract.sh: ERROR: IMG_RESIZE failed with RET=134{}
Fri 14 Jan 2022 04:09:48 PM CET
------------------------------------------------
check 5x capture + SaveImageNight & + sleep 0.5s
Fri 14 Jan 2022 04:09:48 PM CET
*** darkSubtract.sh: ERROR: Image 'image.jpg' is corrupt; ignoring.
*** darkSubtract.sh: ERROR: IMG_RESIZE failed with RET=134{}
Fri 14 Jan 2022 04:09:58 PM CET
------------------------------------------------

I think "DARK_FRAME_SUBTRACTION" is active. Please deaktivate this.  (uses also the convert application)
Set to "true" if you want to enable dark frame subtraction on your night-time images.
You must first create dark frames - see the README.md file for instructions.
DARK_FRAME_SUBTRACTION="false"

@jmodrako As @AndreasLMeg said, this problem should be fixed in 0.8.3, which saves every image with a unique name so the images aren't overwritten.
I think it should be safe to upgrade as long as you follow directions on the second Wiki page exactly.  One of the first steps is to rename your "allsky" directory so if you have major problems you can easily revert to the prior version.
@AndreasLMeg. I assume DARK_FRAME_SUBTRACTION won't need to be disabled in 0.8.3?

@AndreasLMeg. I assume DARK_FRAME_SUBTRACTION won't need to be disabled in 0.8.3?
Yes, I think so 👍

@jmodrako What version are you running?  You can search for "Software" in /var/log/allsky.log.  It's it's prior to 0.8.3, please upgrade as that version has significantly reduced the risk of one image overwriting another, which is what I think is happening in your case.

@jmordrako,   Any update?

Closing Issue - no user response in several months, and no one else has reported this problem.


How can I know why my login failled? ( feature request?)

Hello :)
I'm using solid-node-client to login my CSS instance. When running:

const auth = require('solid-node-client');
const client = new auth.SolidNodeClient();

const session = await client.login({ idp, username, password });

Then, the value of session is:
{
  isLoggedIn: false,
  info: { isLoggedIn: false },
  fetch: [Function: bound ],
  logout: [Function: logout]
}

But I have no idea why the login failed.
Is it possible to get a more verbose fail so I can understand more why my login fail?
If this is not already possible, I think it would be a pretty useful new feature!
Cheers

Username and password login is only supported on NSS.  For all other servers, you must login with a JWT web token.  AFAIK, JWT failed logins should give you a verbose error message. You're right that the method should be say something when the username/password fails too.  Not sure when I'll have time to fix it, but it's now on the list.   Thanks for reporting!

Thanks! I will give it a try with the web token then


How to create original block with multi-lang

How to create original block with multi-lang block name?
(Do I have to pull request a core-strings.json and regist crowdin?)
Ref.
Defining blocks
Translate

@matsujirushi is this to add your own blocks via packages or to localize a "builtin" block that ships out of the box?

@pelikhan He wants to learn a method to provide international strings for his own custom blocks via packages.

@pelikhan @sgk Yes. I want to add international strings for my custom block.

Ok, I'll beef up the docs. Meanwhile, you'll need to add localization files to the package itself just like in
https://github.com/Microsoft/pxt-microbit/tree/master/libs/bluetooth/_locales
You need to update pxt.json to include the .json loc file and include the localized json files. Docs coming.

@pelikhan
I tried adding Japanese, But did not work.

Add _locales/ja/bluetooth-strings.json file.

{
  "bluetooth.startUartService|block": "bluetooth service日本語サービス",
  "{id:category}Bluetooth": "Bluetooth"
}

Update pxt.json.
Git push. (here)

Result:

Are you trying to completely clone the Bluetooth library?
Get Outlook for iOShttps://aka.ms/o0ukef

From: matsujirushi<EMAIL_ADDRESS>Sent: Friday, August 18, 2017 9:51:24 PM
To: Microsoft/pxt
Cc: Peli de Halleux; Mention
Subject: Re: [Microsoft/pxt] How to create original block with multi-lang (#2707)
@pelikhanhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fpelikhan&data=02|01|jhalleux%40microsoft.com|62e9561fc5044a7cc12908d4e6bdf21f|72f988bf86f141af91ab2d7cd011db47|1|0|636387150868822405&sdata=SqnHteveTtgDWQzjrtpsnbaxU6PnDhW4BYcqhDb4NHY%3D&reserved=0
I tried adding Japanese, But did not work.

Add _locales/ja/bluetooth-strings.json file.

{
"bluetooth.startUartService|block": "bluetooth service日本Zサ`ビス",
"{id:category}Bluetooth": "Bluetooth"
}

Update pxt.json.
Git push. (herehttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmatsujirushi%2Fbluetooth&data=02|01|jhalleux%40microsoft.com|62e9561fc5044a7cc12908d4e6bdf21f|72f988bf86f141af91ab2d7cd011db47|1|0|636387150868822405&sdata=BuEE%2F10ia5C3vXhj9T11Ff3MQe9hqZ1lXu%2FPzF7y98M%3D&reserved=0)

Result:
[image]https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fuser-images.githubusercontent.com%2F8079404%2F29483628-4f521348-84e5-11e7-8292-a845ae7d24c1.png&data=02|01|jhalleux%40microsoft.com|62e9561fc5044a7cc12908d4e6bdf21f|72f988bf86f141af91ab2d7cd011db47|1|0|636387150868822405&sdata=J%2BU3oMHmpGJPaA5av5bRMICQO0Vfq6p0znIa9YCrrmU%3D&reserved=0
―
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoft%2Fpxt%2Fissues%2F2707%23issuecomment-323500446&data=02|01|jhalleux%40microsoft.com|62e9561fc5044a7cc12908d4e6bdf21f|72f988bf86f141af91ab2d7cd011db47|1|0|636387150868822405&sdata=9aQ63XSPhlYAPMObATN%2FY3DoJmhXzZsMcNsc5eIaEHY%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAD-4KbL37woBBzV1ACZ-DoPBfssPQhwTks5sZmnMgaJpZM4O1-ow&data=02|01|jhalleux%40microsoft.com|62e9561fc5044a7cc12908d4e6bdf21f|72f988bf86f141af91ab2d7cd011db47|1|0|636387150868822405&sdata=ERHyedWb%2BKI4K9hlYgkUuJPPbpnbZcWisqN5SYFITJ0%3D&reserved=0.

I copied from bluetooth folder.
Please look here.
Add package from https://github.com/matsujirushi/bluetooth on MakeCode.

I can add Japanese strings. It's fine.
https://github.com/Seeed-Studio/pxt-grove
Thank you.


Auth

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.5 out of 6 committers have signed the CLA.:white_check_mark: jbethuel:white_check_mark: Ehesp:white_check_mark: bvangraafeiland:white_check_mark: vomchik:white_check_mark: cabljac:x: yunseop-devYou have signed the CLA already but the status is still pending? Let us recheck it.


[CODE_GEN] Added remote_store.restore action

Description
All files, excepts .rubocop.yml and CHANGELOG.md, were generated by the API generator I'm working on. Once this has been merged, I'll follow up with a PR for the generator into this repo.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@VachaShah I'm happy with what we've got so far with this generated code. Going to do some refactoring before creating the PR to move the generator here. We can merge this now. Thanks

@VachaShah We will need to include this info in the API spec. Something like x-experimental: true. Then the generator will look for that flag to display the warning. Thanks for pointing that out!


hand font argument being a path

Gets the basename of the font argument so a path can be used. Sorry - this should have been in the last pull request.

Thanks!
I'll release it as 0.3.0


Remove futures & rework connection termination

While trying to document the opening_handshake and closing_handshake futures, I discovered they didn't actually served a purpose.
connection_closed does serve a purpose, but I took this opportunity to reconsider how connections are closed. I reworked the implementation and fixed some RFC-compliance problems.

@cjerdonek I'd love if you could take a look at this PR.
The first and second commits are relatively straightforward refactorings.
The third commit rewrites connection termination. It splits the "worker task" in two: now there's a "transfer data task" which is in charge until the closing handshake and a "close connection task" that takes care of closing the TCP connection. I'm planning to explain why in #265 but I haven't written that part yet.
The fourth commit does what you said here: https://github.com/aaugustin/websockets/issues/142#issuecomment-326827967

I'll try to take a look within the next few days. Thank you. I did see a notification earlier about the fourth commit I think.

I proof-read and tweaked this pull request a bit this week-end. I think it's ready.
The corresponding documentation is also complete in #265.
I'd like to merge both.

I'm planning to explain why in #265 but I haven't written that part yet.

In terms of this PR that you wanted me to take a look at, can you point me to the portion of #265 that explains this PR, or explain briefly here? #265 is large and seems to cover the entire library, so it's hard to tell the part focusing on the difference. I'm mostly interested in the reasons behind the changes you described here (what problems it solves, how it helps, perhaps some limitations it introduces that weren't there before, etc). Thanks.

Yes, sorry, #265 is built on top of this PR (#267), that's why it contains so many changes.
Checking out #267, building the docs and looking at docs/_build/html/design.html is probably the easiest.
The relevant parts for connection termination are:

https://github.com/aaugustin/websockets/pull/265/files#diff-c7f13470cacdf0634e185d4313d02a12R64
https://github.com/aaugustin/websockets/pull/265/files#diff-c7f13470cacdf0634e185d4313d02a12R231
https://github.com/aaugustin/websockets/pull/265/files#diff-c7f13470cacdf0634e185d4313d02a12R257
https://github.com/aaugustin/websockets/pull/265/files#diff-c7f13470cacdf0634e185d4313d02a12R286

I added a couple comments to #267 in the #265 changes starting here: https://github.com/aaugustin/websockets/pull/265/files#r140941685


PacReq: Postman

Types
-bin
URL
https://www.postman.com/downloads/?utm_source=postman-home
Building guide
No response
Additional context
No response

This needs fixing as Postman does not offer deb files and only in bin format through a .tar.gz file so the correct type would have been -bin

yea fixed it


docs: add glossary page to KSD docs

Signed-off-by: gauravsitlani<EMAIL_ADDRESS>
Description of your changes:
Which issue is resolved by this Pull Request:
Resolves #
Checklist:

[ ] Commit Message Formatting: Commit titles and messages follow guidelines in the developer guide).
[ ] Skip Tests for Docs: If this is only a documentation change, add the label skip-ci on the PR.
[ ] Reviewed the developer guide on Submitting a Pull Request
[ ] Pending release notes updated with breaking and/or notable changes for the next minor release.
[ ] Documentation has been updated, if necessary.
[ ] Unit tests have been added, if necessary.
[ ] Integration tests have been added, if necessary.

Waiting for final approval on https://github.com/rook/rook/pull/11525 now.

Closing this for the meantime, will re-open soon once the other rook PR is merged.

docs-check failed due to :
WARNING  -  Documentation file 'Getting-Started/glossary.md' contains a link to 'CRDs/Object-Storage/ceph-object-realm-crd.md' which is not found in the documentation files.
WARNING  -  Documentation file 'Getting-Started/glossary.md' contains a link to 'CRDs/Object-Storage/ceph-object-zonegroup-crd.md' which is not found in the documentation files.
WARNING  -  Documentation file 'Getting-Started/glossary.md' contains a link to 'CRDs/Object-Storage/ceph-object-zone-crd.md' which is not found in the documentation files.
WARNING  -  Documentation file 'Getting-Started/glossary.md' contains a link to 'Troubleshooting/krew-plugin.md' which is not found in the documentation files.

hey @galexrt and @ideepika please review and share your feedback as well.

hey @galexrt I believe we're good to go ahead as soon as all the tests return green.


Record, who banned someone.

What's this mean exactly?

Who exactly banned someone. This needs to be pulled from the audit log. Sorry for the boor explenation.

Might need to be re-thought, as we are planning to remove the ban-table

This comes down to will we use bans at all. If so, /pardon may not be needed


feat(utils): adds orphan identification and cleanup utils

This PR includes the following:

Closes #35; will warn if (potentially) orphaned services/containers are found at runtime
Adds devlab --cleanup to stop and rm any Devlab services
Adds devlab --cleanup-all to stop and rm ALL containers

🍪


Not compatible with Java 7

Although the build.gradle has:
targetCompatibility = 1.7
Version 0.1.4 (and newer) fail to start with:
java.lang.UnsupportedClassVersionError: org/jetbrains/intellij/IntelliJPlugin : Unsupported major.minor version 52.0
The newest that does not fail with this is version 0.0.41.  It looks like the dependence on 1.8 was from this commit: https://github.com/JetBrains/gradle-intellij-plugin/commit/56c5794afd36e31caee90e3f41cf671c63c2258e
Please update the README that java 8 is required

0.2.0-SNAPSHOT is compatible with 1.7


Namespace pod tolerations

What does this PR do?
Adds support for namespace-level configuration of pod tolerations and node selector via namespace annotations

"controller.devfile.io/pod-tolerations"
"controller.devfile.io/node-selector"

The value of the tolerations annotation must be json-formatted []corev1.Toleration. The value of the node-selector annotation must be map[string]string. If these annotations are applied to a namespace, their values are used for all pods created for workspaces in that namespace. This includes:

The workspace pod itself
The pod created as part of the PVC cleanup job
The async storage server deployment

What issues does this PR fix or reference?
Closes https://github.com/devfile/devworkspace-operator/issues/614 (assuming this implementation is sufficient)
Is it tested? How?
Instructions written for minikube, on other clusters node name should be changed

Taint a node and add a label to it# Apply a taint to the minikube node
kubectl taint nodes minikube key1=value1:NoSchedule
# Apply a new label to the minikube node
kubectl label nodes minikube test-node-selector=test

Add annotations to the namespace to be used:metadata:
  annotations:
    controller.devfile.io/node-selector: |
      {
        "test-node-selector": "test"
      }
    controller.devfile.io/pod-tolerations: |
      [
        {
          "key": "key1",
          "operator": "Equal",
          "value": "value1",
          "effect": "NoSchedule"
        }
      ]

Note: formatting can be finicky, if annotations cannot be unmarshalled, all DWO activity in the namespace fails.
Create DevWorkspace and verify it can start in the cluster (and deployment has appropriate nodeSelector/tolerations)kubectl apply -f samples/theia-next.yaml

Once workspace is started, delete it and verify cleanup succeedskubectl delete dw theia-next --wait

PR Checklist

[ ] E2E tests pass (when PR is ready, comment /test v8-devworkspace-operator-e2e, v8-che-happy-path to trigger)

[ ] v8-devworkspace-operator-e2e: DevWorkspace e2e test
[ ] v8-che-happy-path: Happy path for verification integration with Che

/test v8-devworkspace-operator-e2e


[Monitor Query] Migrate to data plane metrics query API

As part of the migration away from the ARM API, we'll need to add API surface to support batch metrics queries. Up to 50 resource IDs in the same subscription and region can be queried in a single API call.

Hey @scottaddie and @gracewilcox. We are super excited and can't wait to have the batch API available in the golang SDK!

Hey @scottaddie. Is there an ETA for when the golang SDK will support the new Azure Monitor metrics batch API? My team has an application that makes heavy use of Azure Monitor, and would benefit from batched requests. While we could write our own implementation for interacting with the batch API, we are happy with the golang SDK and would like to use it for this use case as well.

@lchelsmaersk Thank you for your interest in this feature. We're busy discussing a couple design options with the architecture team. Late July to early August is our target for the initial Beta release that includes this feature.

Hey @scottaddie. Is there an ETA for when the golang SDK will support the new Azure Monitor metrics batch API? My team has an application that makes heavy use of Azure Monitor, and would benefit from batched requests. While we could write our own implementation for interacting with the batch API, we are happy with the golang SDK and would like to use it for this use case as well.

Hi @LasseHels! We released the first beta for metrics batch query yesterday. You can use this feature with azquery v1.2.0-beta.1.

@gracewilcox Thanks for letting us know! We will take a look 🎉.


Refactor packages and codebase

What package?

Settled already. Wait for merge.

Refactor Task class to fall under model.task package?

All the codes. Including removing unused classes. I have a pending merge.

May want to take a look at AddCommand. Should move new Task() from ctor to execute() for consistency.

Okay. Will do in #72

Closed. See #71


json::infer inconsistent with ndjson::infer

Arrow version: latest
rust version: rustc 1.64.0-nightly (0f4bcadb4 2022-07-30)
The ndjson::infer method takes in a reader, and num_rows as seen here
json::infer only takes in a json_deserializer::Value
It would be a nice improvement if the api's were consistent, and you could easily infer schemas for json arrays as well as ndjson.

The main reason is that it is possible to infer from ndjson in a streaming fashion (item by item), but it is usually not possible to do it with json, since we need the whole object.
But maybe there is a better API?


Invalidate connection after computer standby

System information:

Operating system (distribution) and version: Windows 10 / Ubuntu 18.04
DBeaver version: CE v.7.0.0 (Eclipse IDE Plugin Version)
Additional information: Eclipse version: 2019-12 (4.14) Build: I20191210-0610

Connection specification:

Database name and version: MySQL 10.1.44-MariaDB-0ubuntu<IP_ADDRESS>
Driver name: MariaDB connector/J 1.5.5

Describe the problem you're observing:
When I connect to a Database it does everything correctly, without problems, but when I close the connection and try to connect again, it stays trying to connect but without success. To reconnect, I need to restart Eclipse.  It seems that the connector stays open or something like that, does this happen to anyone else? Can anyone help me to find a solution?
This happens to me all the time.
Steps to reproduce, if exist:

Include any warning/errors/backtraces from the logs

I can confirm this also for PostgreSQL 11.7 / PostgreSQL JDBC driver... After a while without work, database logout and I can not reconect by "Invalidate / Reconnect" from context menu as same as I can not connect after disconnect - after this, following errmsg shown:
Connection attempt timed out.
Connection attempt timed out.

It is needed to restart whole DBeaver.
(maybe related with #8085 / #8086 / #8087)

Hi @TyrannoRex ,
cannot reproduce an issue. Does anything appear in log?

I meet this issue. My way to reproduce:
Leave open connection, workspace.
Suspend computer (laptop lid close) and start (lid open).
Open Dbeaver (connection is closed after suspend) and Scipt editor where just left execute command (any like select *...).

Ubuntu, DBeaver7.0.0, connection PostgreSQL(ssh)

Hi there,
Here is a gif reproducing the issue.
Firstly I can edit a table without poblems, but then I disconnect from the datatbase, and when try to reconnect and open another table, it doesn't open.

Here is the screen few second after:

By the way, once I have received this error:

Thanks for your help,
MH

@TyrannoRex could you post error/debug log? (https://github.com/dbeaver/dbeaver/wiki/Log-files)
Maybe this is Eclipse-specific behavior.
Maybe dbeaver conflicts with some other plugin and hangs.

I attach the error/debug log.
Hope it helps you.
error_log.log
Thank you very much for your help.

Sorry, I closed it by error.

Any news about this issue?
Thank you for your help.

Having same issues


Feature - Implement fine grained permission control for "cluster:admin/snapshot/restore"

This PR implements the fine grained permission control for cluster:admin/snapshot/restore as extension of the work in https://github.com/floragunncom/search-guard/pull/245. This extension was already outlined in the before mentioned PR.
I would very much appreciate your feedback to this proposal / implementation.
Implementation
The current implementation allows a snapshot restore operation only, if the following conditions are met:

User has the snapshot restore privilege (cluster:admin/snapshot/restore)
User has the below listed rights for all types (*) on the target index:

indices:admin/create
indices:data/write/index

For the definition of the required permissions to perform a restore, I see two approaches:

Make the list hard coded in SearchGuard (the way it is done at the moment)
Make the list of the required permissions on the indices configurable

I am open to discussion.
Configuration
The whole functionality may be disabled using the following configuration:
searchguard.check_snapshot_restore_write_privileges: false

Future development
With the fine grained permission control in place for the snapshot restore feature, the same should be implemented for snapshot create (cluster:admin/snapshot/create) for this functionality to be feature complete. In this case, a user who wants to create a snapshot does need to have the following permissions:

Permission to create a snapshot cluster:admin/snapshot/create
Permission to read all indices, which are selected for the snapshot. The following permissions should be hold by the user on every type (*) within the index (final list to be defined):

indices:data/read/exists
indices:data/read/get
maybe indices:data/read/mget
maybe indices:data/read/scroll

Coverage remained the same at 0.0% when pulling 9300f7607fc95ebec616647df50f069588e85707 on breml:feature-user-restore-check-write into 5d8c5486004897b95c64458862dc498aaebe7b30 on floragunncom:es-5.0.0.

I have signed the CLA last week, hopefully we can now go forward with this PR.

Will start work on this PR and https://github.com/floragunncom/search-guard/pull/245 soon

I have merged #245 into https://github.com/floragunncom/search-guard/tree/breml-feature-user-restore. This PR (#257) breaks compatibility by altering the (now/meanwhile public) PrivilegesEvaluator.IndexType class. It would be necessary to either rebase this PR onto https://github.com/floragunncom/search-guard/tree/breml-feature-user-restore and find a solution to avoid altering the PrivilegesEvaluator.IndexType class. Can you do this @breml ?

@floragunncom I will try to have a look at this in the next view days, but currently I can not promise anything, as I am working on other topics right now.

@floragunncom Unfortunately I did not yet find the time to update the PR. I hope, I will find the time in week 11.

@breml Why is a restore of the global state not allowed?

Because this PR implements the verification of specific rights on indices (indices:admin/create
indices:data/write/index). The global state would therefore need an additional right which could be granted to an user, if it should be possible at all. In my opinion, a restore of the global state should always be an operation performed by an admin user.

thx and +1

Merged this PR with branch https://github.com/floragunncom/search-guard/tree/breml-feature-user-restore as suggested in https://github.com/floragunncom/search-guard/pull/257#issuecomment-281176706 and created a new PR #311.

merged https://github.com/floragunncom/search-guard/pull/311 so this PR is obsolete now


Saving best model and training statistics

Saving best model, epochs, loss, best_loss, trained params, visualizations.

This feature should probably be probably implemented in the BaseModel (maybe called BaseMateModel)

Yes. We need to define a standard to return val_loss in all classes that extend BaseMateModel.


Enhance pre-release Q/C

Let's enhance the qc command with few more checks on top of the existing checks.
Each phenopacket:

must have an individual id and id
must include at least one phenotypic feature, one disease, and one interpretation

@ielis
Closing this, we now have QC. Let's reopen if there are additional specific things.


⚠ ClamAV has degraded performance

In 5de5c5a, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 54 ms

Resolved: ClamAV performance has improved in 57f643d.


[Feature Request] Disable screen rotation

I want keep screen orientation in portrait when scan barcode ,any config can support it?

Any update on this?

Feel free to create a PR


[FEATURE] Add knn builder and query search support

Is your feature request related to a problem?
It's not possible to build a search query using knn. With old java rest high client we can copy and reuse code like that thread cover https://forum.opensearch.org/t/k-nn-query-from-es-high-level-client/3155
What solution would you like?
Get classes for create and use query builders for search.
What alternatives have you considered?
At the moment I will tried to parse a json for raw search request.
Do you have any additional context?

Seems it would be best to look into adding plugins to opensearch-api-specification: https://github.com/opensearch-project/opensearch-clients/issues/19.
There appears to be an issue already tracking this: https://github.com/opensearch-project/opensearch-api-specification/issues/23.

Right now, I am using KnnQueryBuilder copied from knn repo.

@adrian-arapiles , How exactly are you doing this? I'm asking since I'm not able to add org.opensearch.plugin:opensearch-knn as a dependent and import from org.opensearch.knn. I'm also using the Java high-level REST client.

Right now, I am using KnnQueryBuilder copied from knn repo.

@adrian-arapiles , How exactly are you doing this? I'm asking since I'm not able to add org.opensearch.plugin:opensearch-knn as a dependent and import from org.opensearch.knn. I'm also using the Java high-level REST client.

I just created a KnnQueryBuilder class in my project and copied code from the class. https://github.com/opensearch-project/k-NN/blob/main/src/main/java/org/opensearch/knn/index/query/KNNQueryBuilder.java
Then I use as another QueryBuilder. For example:
float [] value = ...;
int k = 2;
KnnQueryBuilder knnQueryBuilder = new KnnQueryBuilder("field", value, k);
BoolQueryBuilder query = QueryBuilders.boolQuery().must(knnQueryBuilder);

I hope that I explained well. The problems is that you can't get as dependency this class, so I replicated the class in my repo.

I just created a KnnQueryBuilder class in my project and copied code from the class. https://github.com/opensearch-project/k-NN/blob/main/src/main/java/org/opensearch/knn/index/query/KNNQueryBuilder.java

My problem is that that class has a lot of dependencies on other classes such as org.opensearch.knn.index.KNNMethodContext, org.opensearch.knn.index.mapper.KNNVectorFieldMapper, org.opensearch.knn.index.util.KNNEngine. So do you also copy all those classes to your repo?

I just created a KnnQueryBuilder class in my project and copied code from the class. https://github.com/opensearch-project/k-NN/blob/main/src/main/java/org/opensearch/knn/index/query/KNNQueryBuilder.java

My problem is that that class has a lot of dependencies on other classes such as org.opensearch.knn.index.KNNMethodContext, org.opensearch.knn.index.mapper.KNNVectorFieldMapper, org.opensearch.knn.index.util.KNNEngine. So do you also copy all those classes to your repo?

Hi,
Sorry about my late.
I only copied 2 classes, the rest come from opensearch dependencies from maven (in my case).
KnnQueryBuilder.java
KnnQuery.java

Just a heads up that the opensearch-java client has an open PR to add knn support:
https://github.com/opensearch-project/opensearch-java/pull/524

@wbeckler thanks.. @SeyedAlirezaFatemi @adrian-arapiles

Is this the same as https://github.com/opensearch-project/opensearch-java/issues/539 and belongs in the opensearch-java project? If so, let's move this issue there and close the above as dup?

@dblock the issues seems to be same. @wbeckler can provide more details. But the idea was k-NN query builder was not supported by any opensearch client, and in this issue customer are specifically for k-NN queryBuilder in java client.

I am moving this issue back to the opensearch-java client, as it's still a need and that's where the work would go.


Download file from AWS S3 temporary link

The library does not download file from AWS S3 bucket,
Example: https://s3.amazonaws.com/bucket_name/answer.jpg?Signature=8YUTeuIQlUcjcWWpVeWqfWJGlgw%3D&Expires=1434498549&AWSAccessKeyId=AKIAJC6FLWJBE2KYNQKQ
The link above is just a sample link. The library will be able to download the file if the link ends with .jpg

This is sincerely untestable for me, is it possible to provide any way to re-generate the temporary download link so we could test it?

Hi smarek,
Can you try this link?
https://paperistic-scans.s3.amazonaws.com/tuan/bc69d59ae04d5710508255998ebcc98b.jpg?Signature=slwQd2SEQi7gMH8AUGr12o6TsZc%3D&Expires=1439315518&AWSAccessKeyId=AKIAJHQAI7RFWPYH43SQ

@tnguyenquy well, I've just put this into Sample application (GET to File sample) and file downloaded successfully. Are you using correct ResponseHandler? Because putting the response into String (TextAsyncHttpResponseHandler) would probably break the process (OOM)

Yes it would download the file (xml) file, not the image.
On Sun, Jul 12, 2015, 12:06 PM Marek Sebera<EMAIL_ADDRESS>wrote:

@tnguyenquy https://github.com/tnguyenquy well, I've just put this into
Sample application (GET to File sample) and file downloaded successfully.
Are you using correct ResponseHandler? Because putting the response into
String (TextAsyncHttpResponseHandler) would probably break the process (OOM)
—
Reply to this email directly or view it on GitHub
https://github.com/loopj/android-async-http/issues/885#issuecomment-120751372
.

No, in my case it downloaded the image directly. From what I see it was probably problem on your side.
I see this output, which is correct for image/jpeg file with size 44170 bytes
07-12 20:09:11.268  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 4096 from 44170 ( 9%)
07-12 20:09:11.269  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 8192 from 44170 (19%)
07-12 20:09:11.269  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 12288 from 44170 (28%)
07-12 20:09:11.270  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 16384 from 44170 (37%)
07-12 20:09:11.270  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 17000 from 44170 (38%)
07-12 20:09:11.493  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 21096 from 44170 (48%)
07-12 20:09:11.498  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 25192 from 44170 (57%)
07-12 20:09:11.498  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 29288 from 44170 (66%)
07-12 20:09:11.502  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 33384 from 44170 (76%)
07-12 20:09:11.502  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 34408 from 44170 (78%)
07-12 20:09:11.706  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 38504 from 44170 (87%)
07-12 20:09:11.707  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 42600 from 44170 (96%)
07-12 20:09:11.707  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 44170 from 44170 (100%)
07-12 20:09:11.709  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Return Headers:
07-12 20:09:11.709  30426-30426/com.loopj.android.http.sample D/FileSample﹕ x-amz-id-2 : AJ7fFF+7St+fz0y0h3JZYdg17+b88LZUj30Arv6GL2zT8F5vhyNPB06jMR773EFeO2vXC9R9z3I=
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ x-amz-request-id : DDA0F93B9D67A30D
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Date : Sun, 12 Jul 2015 18:09:12 GMT
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Cache-Control : private, max-age=0, no-transform
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Last-Modified : Tue, 07 Jul 2015 22:04:45 GMT
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ ETag : "3ab57b81261d65b04d0e18cc6d8ea1e3"
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Accept-Ranges : bytes
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Content-Type : image/jpeg
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Content-Length : 44170
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Server : AmazonS3
07-12 20:09:11.724  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Return Status Code: 200
07-12 20:09:11.744  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Response data:
07-12 20:09:11.746  30426-30426/com.loopj.android.http.sample D/FileSample﹕ /data/data/com.loopj.android.http.sample/cache/temp_-1482503850_handled

perfect, thank you very much for your time. I will try it out.
On Sun, Jul 12, 2015, 12:11 PM Marek Sebera<EMAIL_ADDRESS>wrote:

No, in my case it downloaded the image directly. From what I see it was
probably problem on your side.
I see this output, which is correct for image/jpeg file with size 44170
bytes
07-12 20:09:11.268  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 4096 from 44170 ( 9%)
07-12 20:09:11.269  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 8192 from 44170 (19%)
07-12 20:09:11.269  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 12288 from 44170 (28%)
07-12 20:09:11.270  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 16384 from 44170 (37%)
07-12 20:09:11.270  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 17000 from 44170 (38%)
07-12 20:09:11.493  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 21096 from 44170 (48%)
07-12 20:09:11.498  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 25192 from 44170 (57%)
07-12 20:09:11.498  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 29288 from 44170 (66%)
07-12 20:09:11.502  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 33384 from 44170 (76%)
07-12 20:09:11.502  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 34408 from 44170 (78%)
07-12 20:09:11.706  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 38504 from 44170 (87%)
07-12 20:09:11.707  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 42600 from 44170 (96%)
07-12 20:09:11.707  30426-30426/com.loopj.android.http.sample V/AsyncHttpRH﹕ Progress 44170 from 44170 (100%)
07-12 20:09:11.709  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Return Headers:
07-12 20:09:11.709  30426-30426/com.loopj.android.http.sample D/FileSample﹕ x-amz-id-2 : AJ7fFF+7St+fz0y0h3JZYdg17+b88LZUj30Arv6GL2zT8F5vhyNPB06jMR773EFeO2vXC9R9z3I=
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ x-amz-request-id : DDA0F93B9D67A30D
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Date : Sun, 12 Jul 2015 18:09:12 GMT
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Cache-Control : private, max-age=0, no-transform
07-12 20:09:11.710  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Last-Modified : Tue, 07 Jul 2015 22:04:45 GMT
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ ETag : "3ab57b81261d65b04d0e18cc6d8ea1e3"
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Accept-Ranges : bytes
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Content-Type : image/jpeg
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Content-Length : 44170
07-12 20:09:11.711  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Server : AmazonS3
07-12 20:09:11.724  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Return Status Code: 200
07-12 20:09:11.744  30426-30426/com.loopj.android.http.sample D/FileSample﹕ Response data:
07-12 20:09:11.746  30426-30426/com.loopj.android.http.sample D/FileSample﹕ /data/data/com.loopj.android.http.sample/cache/temp_-1482503850_handled
—
Reply to this email directly or view it on GitHub
https://github.com/loopj/android-async-http/issues/885#issuecomment-120751605
.

Which ResponseHandler do you use smarek? FileAsyncHttpResponseHandler or BinaryHttpResponseHandler? If you use FileAsyncHttpResponseHandler then how would use specify the file path of image?

@tnguyenquy FileAsyncHttpResponseHandler, and please, read the docs, i'm not here to do the work instead of you, i'm just maintainer.

Thank you Marek
On Sun, Jul 12, 2015, 12:51 PM Marek Sebera<EMAIL_ADDRESS>wrote:

@tnguyenquy https://github.com/tnguyenquy FileAsyncHttpResponseHandler,
and please, read the docs, i'm not here to do the work instead of you, i'm
just maintainer.
—
Reply to this email directly or view it on GitHub
https://github.com/loopj/android-async-http/issues/885#issuecomment-120753933
.


Refactor nix flake file to build noir_wasm using external .sh files

Tried to refactor this, but seems like the solution is non-trivial. Got a second opinion from @phated about it, the reason why the flake is not allowing for external .sh files to be loaded up is not obvious. I tried adding a .sh filter to the srcFilter on the flake with no success.

@jonybur whats the status of this?

This has been done and merged. I'll close this.


What's the point of having "var toast = await ToastBreadAsync(number);"?

Even more generally speaking, whats the point of having an async task in another async task, where it is immediately awaited for?
considering the next code, When Main starts making the toast, it is already free to keep on running. When the toast is making the bread in hangs there anyway for the bread to be ready before applying the jam. So why would we make it an asynchronous task?
private async void main()
{
var toast = async MakeToast()
// ...
}
private async Task MakeToast()
{
await MakeBread();
applyJam();
}
private async Task MakeBread()
{
// ...
}

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 17d27a0d-c072-8c9f-7e31-3de60bee9ae8
Version Independent ID: e0c09794-e712-19ff-cb9f-12648d60d4f6
Content: Asynchronous programming in C#
Content Source: docs/csharp/programming-guide/concepts/async/index.md
Product: dotnet-csharp
Technology: csharp-async
GitHub Login: @BillWagner
Microsoft Alias: wiwagn

Thanks for the question @c0dilla
In this program, it's a step along the path to transform the initial synchronous sample to a fully asynchronous one.
In larger programs, this construct frees a thread resource to possible do other work. If a thread waits synchronously, it can't be used for other work.
This is most common in web applications, where responding to a request often involves retrieving data from another service or a database. While that request is in flight, the thread can be active servicing other requests.
I didn't cover that in this article, both for length and to keep this as an introduction. Other articles in this section cover this information, and we'll be adding more in the futre.
I hope that answers your question. I'll close this, but if this didn't help, re-open the issue and add more questions.


Fix for Monterey

Neither the test app nor the Unity plugin seem to get scan results. Possibly a new privacy setting or a difference in the way ObjC events happen?

This might be an issue with Monterey, not with Apple Silicon - getting same results on Intel MBP.

This also seems to happen in a build, not just in the Editor (on an Intel Monterey machine)

This also happens in the command-line example app, not just in Unity projects, so that narrows the search...

Scan results are found as expected when running nRF Connect for Mobile (iOS app) within macOS on Apple Silicon. So it's not a hardware or driver issue, there's something specific to Monterey.

default	16:04:33.995342+0000	bluetoothd	Sending 'session detached' event for session "cobble_mac-central-50542-547"
default	16:04:33.995371+0000	bluetoothd	Erasing session 0x156e76170 from SessionMap for "cobble_mac-central-50542-547"
default	16:04:33.998328+0000	bluetoothd	Scanning stopped successfully.  42 Advertising Events, 0 dropped pkts

So the events have been produced by bluetoothd, but not received by the app?

Looks like this may be related to running scanForPeripheralsWithServices:nil. With a non-nil argument, I get events matching the filter, as expected.

Worked around in 5d9ff796b90c77374a5b6efc15ef38d4575756a7 but keeping this open until I've confirmed that this is a macOS bug.

Confirmed as a bug, which is fixed in Monterey 12.3 beta 21E5212f. I've left a note in the code documenting this issue, as it's likely that people will continue to use affected versions of macOS for a while.


Providers: Summary

Summary of what providers there are for EF7, their current state, platforms they work on, etc.

Done, we now keep this up to date with each release


Bug 2087540: Adding popover to the CPU | Memory

Signed-off-by: Dana Orr<EMAIL_ADDRESS>
📝 Description
Adding a popover to the CPU | Memory that shows how the calculation is performed.
In addition, each vm has its own calculation according to the amount of threads, cores and sockets it has.
🎥 Demo
CPU | Memory - VM

CPU | Memory - VMI

CPU | Memory - Catalog

CPU | Memory - Template

/retest

/retest

/retest

/retest

/retest

/retest

/retest

/approve


Disable the extension on wordpress admin panel

Apparently having the extension sending GET requests when hovering a button triggers action in wordpress and can lead to the deletion of some articles for example.

Hey @mdolr! So I take it you mean that if a user who has the extension enabled and is in the admin panel of their own WordPress site, it can accidentally delete articles?

Exactly, if the user hovers an action the extension will send a GET request to the link behind the button and from what I understand wordpress uses GET requests for its API so the ectension should be disabled on any wordpress admin panel

Awesome, thanks for clarifying! I'd love to work on this; could you assign it to me?

Hey @mdolr, I haven’t had the time to work on either of them but yes, I still plan to work on both of them. I’ll have more time to work on it this weekend. I hope that’s okay with you.