Segfault on building MacOS

Building on MacOS with Julia 1.7.2 gives me
bin  % ./create_sys_image
Updating packages...
[ Info: Loading packages ...
[ Info: Creating sysimage ...
[ Info: PackageCompiler: Executing /Users/tallakt/kitesims/test/test_for_precompile.jl => /var/folders/0g/0zjw8w1n76b0sqzn5vd8tb3r0000gn/T/jl_packagecompiler_mSRrHy/jl_WO0WIa
[ Info: Makie/Makie is caching fonts, this may take a while. Needed only on first run!

signal (11): Segmentation fault: 11
in expression starting at /Users/tallakt/kitesims/test/test_for_precompile.jl:1
calc_wind_factor at /Users/tallakt/.julia/packages/AtmosphericModels/JaPSH/src/AtmosphericModels.jl:0 [inlined]
calc_wind_factor at /Users/tallakt/.julia/packages/AtmosphericModels/JaPSH/src/AtmosphericModels.jl:102 [inlined]
inner_loop! at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:328 [inlined]
loop! at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:364
residual! at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:415
unknown function (ip: 0x10509c3fb)
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
test_initial_condition! at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:525
fj_finitediff! at /Users/tallakt/.julia/packages/NLSolversBase/cfJrN/src/objective_types/oncedifferentiable.jl:138
unknown function (ip: 0x10508e22b)
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
value_jacobian!! at /Users/tallakt/.julia/packages/NLSolversBase/cfJrN/src/interface.jl:124
value_jacobian!! at /Users/tallakt/.julia/packages/NLSolversBase/cfJrN/src/interface.jl:122 [inlined]
trust_region_ at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/solvers/trust_region.jl:119
trust_region at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/solvers/trust_region.jl:235 [inlined]
trust_region at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/solvers/trust_region.jl:235 [inlined]
#nlsolve#25 at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/nlsolve/nlsolve.jl:26
nlsolve##kw at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/nlsolve/nlsolve.jl:18 [inlined]
#nlsolve#30 at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/nlsolve/nlsolve.jl:52
nlsolve##kw at /Users/tallakt/.julia/packages/NLsolve/gJL1I/src/nlsolve/nlsolve.jl:46
unknown function (ip: 0x105089b83)
#find_steady_state!#17 at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:548
find_steady_state!##kw at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KPS4.jl:517 [inlined]
#init_sim!#39 at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KiteModels.jl:368
init_sim!##kw at /Users/tallakt/.julia/packages/KiteModels/fAylU/src/KiteModels.jl:366
unknown function (ip: 0x10506308b)
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
do_call at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
eval_body at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
jl_interpret_toplevel_thunk at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
jl_toplevel_eval_flex at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
jl_toplevel_eval_flex at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
jl_toplevel_eval_in at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
eval at ./boot.jl:373 [inlined]
include_string at ./loading.jl:1196
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
_include at ./loading.jl:1253
include at ./Base.jl:418
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
exec_options at ./client.jl:292
_start at ./client.jl:495
jfptr__start_41470 at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/sys.dylib (unknown line)
jl_apply_generic at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
true_main at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
jl_repl_entrypoint at /Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/libjulia-internal.1.7.dylib (unknown line)
Allocations: 282549928 (Pool: 282497173; Big: 52755); GC: 211
ERROR: LoadError: failed process: Process(setenv(`/Applications/Julia-1.7.app/Contents/Resources/julia/bin/julia --color=yes --startup-file=no --sysimage=/Applications/Julia-1.7.app/Contents/Resources/julia/lib/julia/sys.dylib --compile=all --trace-compile=/var/folders/0g/0zjw8w1n76b0sqzn5vd8tb3r0000gn/T/jl_packagecompiler_mSRrHy/jl_WO0WIa test/test_for_precompile.jl`,["XPC_FLAGS=0x0", "COMMAND_MODE=unix2003", "PATH=/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/kitty.app/Contents/MacOS:/Users/tallakt/.mix/escripts", "PWD=/Users/tallakt/kitesims", "XPC_SERVICE_NAME=0", "HOMEBREW_PREFIX=/opt/homebrew", "SHELL=/bin/zsh", "KITTY_PID=584", "__CF_USER_TEXT_ENCODING=0x1F5:0x0:0xC", "ERL_AFLAGS=-kernel shell_history enabled"  …   If yes, are you using Rosetta?

Just gathering information. So the error happens on a Mac with ARM CPU using Rosetta...
I will try to reproduce it with Julia 1.7.2 on Linux...

I am using the ARM compiled version of Julia, no Rosetta

So I made a bit more progress on this. Actually I use Julia 1.8.0-beta3, started with the command julia1.8
The scripts generated do not work with a different executable than julia
I was able to get around this by editing the generated scripts.
Still my progress stopped because I did not have a generated examples folder... thus I was missing joystick.jl

Other than tah, it is working well except I have no joystick on my machine

Great, good progress! Native Julia for ARM is know not to work with Julia versions before 1.8 ...
Did you execute:
using KiteSimulators
cp_examples()

as explained in the README.md ?

That was the missing part it seems. I guess we can close this issue then

Solved...
Without modification of the scripts in the bin folder it is required that the Julia executable is named julia and not julia-1.8 or whatever...
Thanks for testing on Mac! :+1:

Installation of Julia is explained on https://ufechner7.github.io/2022/08/18/installing-julia.html
You can also use jill.py if you want to easily switch between Julia versions...


add new option --file to specify the name of the generated output image file

I'm using screenshoteer from within a script where the name of the generated image file has to be predetermined (to enable further processing), so I added a --file /tmp/outputfile.png option.

Thanks!


Extract alphabets configuration into a separate file

Fixes #81
In order to keep future merging simpler, I based the code on the #78 that are not merged yet but it is not required and can be easily rebased.
The biggest chunk of this PR is to make an ability to construct bricks asynchronously. Bunch of API methods were changed to async
This was required as loading configuration from an external file is an asynchronous operation by its nature
In order to support loading resources from both Node.JS and browser, I detect the environment and use fs or fetch accordingly

Hmm... locally tests are passing...

Got it! I just had to merge the latest changes

@ffraenz do you mind me asking why my pull request is not merged? I think even if you are not happy with the implementation, it can be easily refactored afterward.

@mnaoumov Sorry for the lack of feedback about your contributions. You are proposing profound structural changes to the project which do take time to consider. In addition my studies require a lot of attention at the moment.
I am currently working on a prototype for the next major version to test a different strategy. I'd like to use Webpack to introduce code splitting and dynamic importing of bricks and their dependencies. This may allow us to (1) load the brick's source in the browser only when it's actually added to the pipe and to (2) move bricks with their dependencies into own repositories. At this point the resources needed by a brick won't matter neither to the page load stats nor to the repository size. It would even be possible to allow third party bricks from foreign repositories to be run on the platform.
I am currently awaiting feedback on a related Stackoverflow question. Once a final strategy is found for the next major version (which may also introduce breaking changes to the structure) I will definitely consider your proposals.

@ffraenz thanks for your reply. But I think what you are trying to address with Webpack is slightly unrelated to the changes I've suggested. Essentially the idea is to add initAsync methods to cover a lack of async constructors in JavaScript. Having that implemented will allow you to delay bricks construction until they are fully ready to be constructed. I think this approach would be useful even if you switch to your Webpack approach


Coda Daemon crashed after doing ledger catchup.

coda.log
Coda daemon crashed when restart with "coda daemon -peer $SEED1 -peer $SEED2" after doing ledger catchup.
error.log

	exn: "(monitor.ml.Error\n  \"Assert_failure src/lib/block_producer/block_producer.ml:598:16\"\n  (\"Raised at file \\\"src/lib/block_producer/block_producer.ml\\\", line 598, characters 16-234\"\n    \"Called from file \\\"src/result.ml\\\", line 151, characters 9-15\"\n    \"Caught by monitor coda\"))"
2020-06-16 02:12:58 UTC [Fatal] Unhandled top-level exception: $exn
Generating crash report
	exn: "(monitor.ml.Error\n  (Failure\n    \"traced task `R&check next block timing` failed, exception reported to parent monitor\")\n  (\"Raised at file \\\"stdlib.ml\\\", line 33, characters 17-33\"\n    \"Called from file \\\"src/deferred1.ml\\\", line 17, characters 40-45\"\n    \"Called from file \\\"src/job_queue.ml\\\" (inlined), line 131, characters 2-5\"\n    \"Called from file \\\"src/job_queue.ml\\\", line 171, characters 6-47\"\n    \"Caught by monitor coda\"))"

This seems to be a duplicate of the required_local_state bug #5079

Thanks for sharing!


[plugin|purify] Keep shadows for floating windows

Hi, I'm trying to modify purify so that floating windows keep their shadow, but I haven't managed to find a way to detect if a window is floating from the plugin.
I first tried to check the window's Flags but that doesn't take into account custom rules that the tiling uses.
Is there a way to do this or would this require inter plugin communication?

You need to listen for the event sent by the tiling plugin when a window changes its floating status - check the ffm plugin for reference.

I got it to listen for Tiling_focused_window_float but that event fires after chunkwm_export_window_created.
Am I correct in assuming that their's no way to undo shadow removal from a window? I'm guessing based on the message's name: window_shadow_irreversible.
If that is the case, then I couldn't just add some code in the float event to put the shadow back.
Aditionaly that would mean there's no way for the shadow to toggle every time the window toggles between floating an non floating.
What solution would you recommend?
I was thinking of either having a set of created, but not focused window ids, and in the Tiling_focused_window_float event checking if the target window is in the set, in which case I could decide whether to remove the shadow or not based on if the window is floating.

I have not attempted to restore a window shadow with the method used by window_shadow_irreversible, but there is a corresponding function to retrieve a windows shadow parameters. I assume you could cache the old values for a window before clearing the shadow. When a call to restore the shadow is received, it would do a lookup in the cache and if found, set those values back.
To do this you would also need to modify the code for chunkwm-sa:
https://github.com/koekeishiya/chwm-sa/blob/master/payload/payload.mm#L667
The other function is called CGSGetWindowShadowParameters. If you don't have experience with reversing yourself, I'm sure there is some information online for that function. I might investigate and implement the chunkwm-sa part myself for some other application I'm working on.

I did what you suggested in your edit and it works great, thanks!
The edge case of Dock.app restarting shouldn't happen to often, so I'm fine with living with that downside.
Would you be interested in a PR with a floating_windows_keep_shadow setting for purify?
The plugin could still use window_shadow_irreversible when the setting is set to false.


value overflow

Hi! I noticed a small bug when working on an API that returns a huge hash URL. The value overflows horizontally with scroll (expected behavior I presume, but maybe wrapping would be better? It would in this instance but maybe not always), but the background color does not grow with it.

Fixed in v0.7.2


Change Timezone

Actually i need to change timezone,i mean i wanna set a timezone.Is there any way to do this?

Timeago handles all time zones out and any combination of server vs client time zone. Just use properly formatted ISO 8601 timestamps.
https://en.wikipedia.org/wiki/ISO_8601

@rmm5t  thank for your reply
where i set timezone,can you give me an example please?

I did give you a example. Read the ISO 8602 spec. Specifically the time
zone section.
On Thursday, October 29, 2015, Imtiaz Ahmed<EMAIL_ADDRESS>wrote:

@rmm5t https://github.com/rmm5t thank for your reply
where i set timezone,can you give me an example please?
—
Reply to this email directly or view it on GitHub
https://github.com/rmm5t/jquery-timeago/issues/249#issuecomment-152262753
.


Refactor: move some methods out of interface but just as a function

for example:
func (g game) GetPlayerMapByStoneType() map[model.StoneType]model.Player {
	playerMap := make(map[model.StoneType]model.Player, len(g.playerSet))
	for _, pl := range g.playerSet {
		playerMap[pl.GetStoneType()] = pl
	}
	return playerMap
}

The function above could move out of interface Game, but just as a function that recieve a Game instance.

Or as a function that recieve a slice of player, of cource.


⚠ Bofrost.de has degraded performance

In f99d931, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1779 ms

Resolved: Bofrost.de performance has improved in 7b7278b.


Allow to control the output file extension of the generated javascript file during compilation

Background:
Please refer to the following stack overflow post for the issues caused during runtime: https://stackoverflow.com/questions/62619058/appending-js-extension-on-relative-import-statements-during-typescript-compilat
Issues summary:
Typescript doesn't need ".js" or ".ts" extension in local relative import statements, and doesn't report any error during compilation.
However, runtime environments such as Node want the ".js" extension for ES6 modules in the import statements.
Solution:
Please kindly provide at least 1 of the following:

A setting to remove the extension from the generated output Javascript filename itself. Now file is extension-less runtime is happy.
A setting to automatically add .js extension in the generated javascript file's import statements for the relative imports (since it just needs to be done for the relative Typescript imports it should be a trivial task for the compiler and also it will not cause any issues with external libraries or other modules).

Duplicate #16577 and so many others. Please search before logging new issues.

@RyanCavanaugh
It's not an exact duplicate if you take a moment to read the title and issue carefully please -- only the request 2 above is duplicate request 1 is not.
To be specific issue 1 asked for feature to control the extension of the output Javascript filename -- just the output filename itself, makes sense? Hope it does! For example: every other compiler out there allows you to control the output filename and extension, don't they?
If not please, see the example below in context of other compilers:
For example, you can do: gcc -o main.exe main.c or gcc -o main.out main.c or gcc -o main main.c.  Can you see how they allow you to have different extensions (or no extension) for the output file?
Could you please confirm if it is still a duplicate?


How to use load_dataset() by local dataset?

Hello,in the _common_voice_process method, because my server has no network, I cannot use load_dataset to download the dataset online.For example common_voice_georgian, I manually downloaded ka.tar.gz which contains tsv and mp3 files. I don't know how to use them by load_dataset(). Could you please give me some advice or guidance？Looking forward to your reply, thank you.

I think you can approach in either two ways:

Inside the computer where the internet is enabled, download the common_voice dataset using the huggingface's datasets.load_dataset with cache_dir set. Then copy the downloaded files inside cache directory (of the internet-enabled computer) to your server's cache directory. (Highly recommended)
Fix the tsv files to accomodate load_dataset's API.

Thanks for your reply, I will try again.

Excuse me, I still haven't solved the problem.I don't have a server that can be downloaded online. Can I trouble you to upload the dataset about ka (file of MP3 is not needed, I just want to observe its structure) for subsequent offline download. I'm really sorry to bother you like this, thank you.

Huggingface datasets are stored in Apache arrow format. It won't be easy to transform the raw dataset downloaded from CommonVoice homepage to huggingface datasets-friendly format.
/data/dataset/public/huggingface_datasets/common_voice/el/6.1.0/f7a9d973839b7706e9e281c19b7e512f31badf3c0fdbd21c671f3c4bf9acf3b9
❯❯❯ ls
cache-03260f036d8f8550.arrow  cache-543c70d9a34a54d3.arrow  cache-bf0503aa47014cfe.arrow    common_voice-train.arrow
cache-29755082a04363f1.arrow  cache-74f277a2665ac3d0.arrow  cache-c877d966202bb822.arrow    common_voice-validation.arrow
cache-3b6cad32ab84fb05.arrow  cache-80f70e767190d986.arrow  common_voice-invalidated.arrow  dataset_info.json
cache-4249427b5cbb230d.arrow  cache-9e73302b23032d3f.arrow  common_voice-other.arrow        LICENSE
cache-4e923f1658086de4.arrow  cache-aad5004f5698d353.arrow  common_voice-test.arrow

Ok，thanks for your help, i will try again.


Table structure and related code changes

This pull request does:

Naming convention for all table names and field names are lower case letters joined by underscores such as "lower_case_with_underscores". This is because Postgres requires camel case names be quoted when they are used in SQL. The new naming convention will simplify SQL statements;
"user" is a reserved table name in Postgres. This table is now named "local_user";
The table structure of "user" table is modified to only keep "preferences" data. This change also addresses https://github.com/fluid-project/personal-data-server/issues/15;
Address https://github.com/fluid-project/personal-data-server/issues/16: remove sso_provider_id from the access_token table;
Corresponding code logic change to accommodate the database change.

@amb26 all comments have been addressed. Ready for another review.


Need Import React in Example

When trying to replicate the example it will fail since in the example the React instance is being requested in:
     return {
                ...initialProps,
                styles: React.Children.toArray([initialProps.styles])
     //                  ^
};
  }

and this at no time matters

Closes #
📝 Description

When trying to replicate the example it will fail since in the example the React instance is being requested and this at no time matters

⛳ Current behavior (updates)

I add the line import React from 'react'

🚀 New behavior

Please describe the behavior or changes this PR adds

At the time of following the steps and copying and pasting the example, this error will stop appearing

💣 Is this a breaking change (Yes/No):  No

📝 Additional Information
It's something simple that users can add, but for novice programmers it can be a headache to understand what is going wrong, and the idea that the learning curve or creating your project can be as simple as copy and paste.

Hey @MrScrappy , thanks 🙌🏻


Autogenerate comments for ui module

Summary
Use the TS compiler API to automatically generate examples to put on top of ui.tsx render functions.
What this PR does
I've added a new CI step, similar to the one that checks for oclif manifests, that will check if there are any changes to the files that are affected by the autogenerated docs. For now this is only one file, ui.tsx.
What to look for in the PR

Check out all the changes in ui.tsx and see if they look nice to you or not. You might have to expand the file here on Github as there are many lines that have been changed
I've also tried to make sure that all the changes to ui.tsx are backwards compatible, but please let me know if I've missed something!

Thank you @Arkham I've addressed the comments 👍


bump sbt-comms-packaging to enable metaspace limit

This PR was successfully deployed to production by CircleCI build 157 at 2017-03-09 15:25 GMT.


[tests] add more test case in test_multi_ail.py

The new test cases is testing 7 BRs (in 3 partitions) on 3 infra link. The target is to verify the following number and content are expected:

The number of BRs on infra link (link-local address is also verified)
The number of BRs in the Thread network partition (rloc16 is also verified)

The previous test case in test_multi_ail.py is kept as an example test case, but is skipped when running.

To reviewers, please kindly only review the top of the commit, another commit is in PR https://github.com/openthread/openthread/pull/10613


Send error messages and command help output to stderr

This is to mitigate template failures in Github Actions builds when the step fails but no error messages are displayed.
Towards: https://github.com/giantswarm/thg/issues/140
Pushed this change to THG repos:

https://github.com/TheHutGroup/ice-clusters/pull/686

This was also added to https://github.com/TheHutGroup/ice-clusters/pull/686 where the same change got approved by @piontec, proceeding to force merge this.


OCSP caches "revoked" for a valid stamp

Got cached OCSP check result=0 for yastatic.net

core/pull-requests/1070

For QA:
HTTPS connections to mail.yandex.ru should not be bypassed.


COPY ... PARTITIONED BY with parquet causes "out of bounds" panic

Describe the bug
While investigating #10709, I tried using datafusion CLI to require parquet files to a better size.
But I got a panic:
thread 'tokio-runtime-worker' panicked at /Users/samuel/.cargo/registry/src/index.crates.io-6f17d22bba15001f/datafusion-38.0.0/src/datasource/file_format/write/demux.rs:381:31:
index out of bounds: the len is 1 but the index is 1

To Reproduce
I can't share the file, but we have some parquet data with project_id and day columns (here both are interpreted as strings). I run the following:
RUST_BACKTRACE=1 datafusion-cli
DataFusion CLI v38.0.0
> CREATE EXTERNAL TABLE records
PARTITIONED BY (project_id, day) STORED AS PARQUET
LOCATION 'path/to/records/';
0 row(s) fetched.
Elapsed 0.015 seconds.

> COPY records to 'path/to/records-big/' partitioned by (project_id, day) stored as parquet;
thread 'tokio-runtime-worker' panicked at /Users/samuel/.cargo/registry/src/index.crates.io-6f17d22bba15001f/datafusion-38.0.0/src/datasource/file_format/write/demux.rs:381:31:
index out of bounds: the len is 1 but the index is 1
stack backtrace:
   0: _rust_begin_unwind
   1: core::panicking::panic_fmt
   2: core::panicking::panic_bounds_check
   3: datafusion::datasource::file_format::write::demux::compute_take_arrays
   4: datafusion::datasource::file_format::write::demux::start_demuxer_task::{{closure}}
   5: tokio::runtime::task::core::Core<T,S>::poll
   6: tokio::runtime::task::harness::Harness<T,S>::poll
   7: tokio::runtime::scheduler::multi_thread::worker::Context::run_task
   8: tokio::runtime::scheduler::multi_thread::worker::Context::run
   9: tokio::runtime::context::scoped::Scoped<T>::set
  10: tokio::runtime::context::runtime::enter_runtime
  11: tokio::runtime::scheduler::multi_thread::worker::run
  12: <tokio::runtime::blocking::task::BlockingTask<T> as core::future::future::Future>::poll
  13: tokio::runtime::task::core::Core<T,S>::poll
  14: tokio::runtime::task::harness::Harness<T,S>::poll
  15: tokio::runtime::blocking::pool::Inner::run
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

If I remove partitioned by (project_id, day) it finishes fine.
Expected behavior
No response
Additional context
I also tried with v37.0.0 and got the same panic.

Thank you for the report @samuelcolvin. I will look into this and try to make a self contained reproducer. This panic should not be possible. I suspect there could be a bug in how dictionary encoded arrays are handled in the relevant code, since that could cause this panic but I have yet to confirm.

I was unable to reproduce this panic on main or v38. @samuelcolvin if you are able to provide more details about the parquet files which are triggering the issue (schema, sanitized values, directory structure) that may help reproduce.
Here is what I tried to reproduce:
datafusion-cli
DataFusion CLI v38.0.0
> COPY (values ('1', 'a', 'x'), ('2', 'b', 'y'), ('3', 'c', 'z')) TO 'test_files/scratch/copy/partitioned_table3/' STORED AS parquet PARTITIONED BY (column1, column3)
;
+-------+
| count |
+-------+
| 3     |
+-------+
1 row(s) fetched.
Elapsed 0.003 seconds.

> CREATE EXTERNAL TABLE validate_partitioned_parquet3 STORED AS PARQUET
LOCATION 'test_files/scratch/copy/partitioned_table3/' PARTITIONED BY (column1, column3);
0 row(s) fetched.
Elapsed 0.001 seconds.

> COPY validate_partitioned_parquet3
TO 'test_files/scratch/copy/partitioned_table3_rewrite'
PARTITIONED BY (column1, column3)
STORED AS PARQUET;
+-------+
| count |
+-------+
| 3     |
+-------+
1 row(s) fetched.
Elapsed 0.003 seconds.

And trying to force dictionary encoding where possible also runs without panic
DataFusion CLI v38.0.0
> COPY (values
('c', arrow_cast('foo', 'Dictionary(Int32, Utf8)'), arrow_cast('foo2', 'Dictionary(Int32, Utf8)')),
('d', arrow_cast('bar', 'Dictionary(Int32, Utf8)'), arrow_cast('bar2', 'Dictionary(Int32, Utf8)')))
to 'test_files/scratch/copy/part_dict_test' STORED AS PARQUET PARTITIONED BY (column2, column3);
+-------+
| count |
+-------+
| 2     |
+-------+
1 row(s) fetched.
Elapsed 0.004 seconds.

> CREATE EXTERNAL TABLE dict_partitioned_test STORED AS PARQUET
LOCATION 'test_files/scratch/copy/part_dict_test/' PARTITIONED BY (column2, column3);
0 row(s) fetched.
Elapsed 0.001 seconds.

> select * from dict_partitioned_test;
+---------+---------+---------+
| column1 | column2 | column3 |
+---------+---------+---------+
| d       | bar     | bar2    |
| c       | foo     | foo2    |
+---------+---------+---------+
2 row(s) fetched.
Elapsed 0.002 seconds.

> COPY (select column1, arrow_cast(column2, 'Dictionary(Int32, Utf8)') as column2,
arrow_cast(column3, 'Dictionary(Int32, Utf8)') as column3 from dict_partitioned_test)
TO 'test_files/scratch/copy/part_dict_test_rewrite'
PARTITIONED BY (column2, column3)
STORED AS PARQUET;
+-------+
| count |
+-------+
| 2     |
+-------+
1 row(s) fetched.
Elapsed 0.003 seconds.

The line that is panicking with index OOB would only happen if one of the partition arrays in the RecordBatch was extracted with fewer values than RecordBatch::num_rows().
For plain Utf8 arrays, this seems completely impossible given this code executes first (array.value(i) would panic first):
https://github.com/apache/datafusion/blob/c775e4d6ea6dfe9c26a772b676552b9711004a3d/datafusion/core/src/datasource/file_format/write/demux.rs#L339-L341
For dictionary encoded arrays, I could imagine something in the downcast / iteration code here producing fewer values. I thought that the iteration over the downcasted array should always produce exactly RecordBatch::num_rows() values, but perhaps there is a case where this is wrong.
https://github.com/apache/datafusion/blob/c775e4d6ea6dfe9c26a772b676552b9711004a3d/datafusion/core/src/datasource/file_format/write/demux.rs#L346-L353
Finally, the arrays constructed above are accessed like this:
https://github.com/apache/datafusion/blob/c775e4d6ea6dfe9c26a772b676552b9711004a3d/datafusion/core/src/datasource/file_format/write/demux.rs#L378-L385

Has this been fixed @samuelcolvin ?

I don't have the data, but the example as provided above works for me now in datafusion 43
DataFusion CLI v43.0.0
> CREATE EXTERNAL TABLE records
PARTITIONED BY (project_id, day) STORED AS PARQUET
LOCATION 'path/to/records/';
0 row(s) fetched.
Elapsed 0.006 seconds.

> COPY records to 'path/to/records-big/' partitioned by (project_id, day) stored as parquet;
+-------+
| count |
+-------+
| 0     |
+-------+
1 row(s) fetched.
Elapsed 0.006 seconds.


reenable some account-registration tests for Ergo

These were incorrectly being skipped. If CAP LS 302 precedes
requestCapabilities, requestCapabilities sees the LS response
instead of the ACK it expects. Then it assumes that the request was
NAK'ed and skips the test.

What if you remove self.sendLine("bar", "CAP LS 302") entirely?

ah, nvm


More complete cmos rtc emulation

As usual, the osdev page on this is a good starting point: https://wiki.osdev.org/CMOS
We need to support reading most of the registers, because OVMF reads through them during startup.

Closing this via 375de828b72d51cded302bde72618873f607b103


feat: add preset configuration support to webpack

Summary
Motivation:
Currently, setting up Webpack configurations can be a time-consuming process, especially for new users. By introducing preset support, we aim to simplify this process and provide a more streamlined experience. Users can select a preset that aligns with their project requirements, reducing the need to write complex configurations from scratch.
This PR introduces a new feature to Webpack, allowing users to add presets as their configuration. A preset is a base configuration that can be extended from, providing a convenient way for users to set up their projects quickly and efficiently.

🤖 Generated by Copilot at 15be2ad
This pull request adds a new feature to support Presets in webpack configuration. Presets are arrays of predefined options that can be applied to the whole configuration or to individual configurations in an array. The pull request introduces a new class PresetProcessor that uses the webpack-merge module to merge the preset configurations into the webpack options object. It also updates the lib/webpack.js, schemas/WebpackOptions.json, lib/config/normalization.js, .eslintignore, package.json, and package-lock.json files to enable and support the new feature.
Details
The syntax i am working towards is:
module.exports = {
  presets: WebpackOptions[]
  // Other configuration options...
};

so that the usage looks something like this
// non existent packages
const react = require("react-preset-webpack");
const tailwind = require("tailwind-preset-webpack");

module.exports = {
  presets: [react(), tailwind()]
  // Other configuration options...
};

This opens up the possibility to pass an options object to the plugin
// non existent packages
const tailwind = require("tailwind-preset-webpack");

module.exports = {
  presets: [tailwind({
    config: "./tailwind.config.js"
  })]
  // Other configuration options...
};

🤖 Generated by Copilot at 15be2ad

Add support for presets in webpack configuration (link, link, link, link, link)
Exclude .mjs files from linting process (link)
Add webpack-merge dependency to package.json (link)

@alexander-akait @TheLarkInn @snitin315 let me know your thoughts on this. if this is not the approach we want to take, i'll drop this

@TheLarkInn had built that previously for the extends option in webpack-cli https://github.com/webpack/webpack-cli/pull/3738
I'll port that code here https://github.com/webpack/webpack-cli/pull/3738/files#diff-fbc9bd0ae2f54d7f45607dc7979f8c1721de2e9ccf4a5934504bab29e7204805R1945-R1991

@TheLarkInn added a complex working example with the situation you mentioned above
The webpack.config.js has two presets simple and react. The simple preset depends on preset css
webpack.config.js
        => simple
              => css
        => react

Opened a PR in webpack-merge to deep merge loader options - https://github.com/survivejs/webpack-merge/pull/206

The webpack-merge PR has been merged. It means that options will now be deep merged. This approach is viable 🎉

@TheLarkInn friendly ping here

Let's rebase @burhanuday and this is going through review here this week. Appreciate the patience and work on this. 👏


💀 Remove handle_response from redis call sites

#777  👈 (View in Graphite)
main

This stack of pull requests is managed by Graphite. Learn more about stacking.


Question (Core modes)

This plugin is working with Core modes?

I think that is in the TO-DO list
El dia 21/01/2015 8.37, "vYuri"<EMAIL_ADDRESS>va escriure:

This plugin is working with Core modes?
—
Reply to this email directly or view it on GitHub
https://github.com/twizmwazin/CardinalPGM/issues/88.

I'll do them tonight if I have time


Cannot use deployment().location on location property for Microsoft.Resources/deployments resource

Bicep version
Bicep CLI version 0.7.4 (5afc312467)
Describe the bug
trying to do this:
targetScope = 'subscription'

resource deployment 'Microsoft.Resources/deployments@2021-04-01' = {
  name: 'collectorLoop-${partnerTenantId}-0'
  location: deployment().location
  properties: {
    mode:
  }
}

but getting error: This expression is referencing its own declaration, which is not allowed.bicep(BCP079)
Yet this is is possible in ARM templates as I am actually re-writing existing code from ARM to bicep

    "resources": [
        {
            "name": "[concat( 'collectorLoop-', parameters( 'partnerTenantId' ) , '-0' )]",
            "type": "Microsoft.Resources/deployments",
            "apiVersion": "[variables( 'apiVersions' ).deployments]",
            "location": "[deployment().location]",
            "properties": {
                "mode": "Incremental",

To Reproduce
See above
Additional context
Add any other context about the problem here.

Sounds like #4892

@SSKLCP yes, it works that way. Thanks!

Closing this one in favor of #4892
If you want to fix it without having to rename the symbol, then you need to fully-qualify the deployment() function:
targetScope = 'subscription'

resource deployment 'Microsoft.Resources/deployments@2021-04-01' = {
  name: 'collectorLoop-${partnerTenantId}-0'
  location: az.deployment().location
  properties: {
    mode:
  }
}

@anthony-c-martin just for information it was pure coincidence that I named the deployment deployment. I do not consider this even a bug but the error message could be better. In actual template I would never use that name for deployment.


Customize Airnode packing

(old issue: https://github.com/api3dao/airnode/issues/112)
Currently, we are using serverless-plugin-optimize for packing, which doesn't support non-AWS cloud providers (https://github.com/FidelLimited/serverless-plugin-optimize/issues/35, https://github.com/FidelLimited/serverless-plugin-optimize/issues/51). It's not clear if this is actually difficult to do, or if people simply didn't attempt it (probably the latter).
We need a packing solution that wouldn't have this limitation. Furthermore, we want the packing solution to be customized to omit config.json (so there would be two outputs of the packer, index.js and config.json), which we can then replace with the user-provided one at deployment-time. This essentially allows us to distribute the pre-built and packed node in the deployer container, making it a lot smaller (this would require https://github.com/api3dao/airnode/issues/136 because the user provided config.json will no longer be typechecked).
This will also allow us to distribute the packed node in the api3/airnode-client image, making it a lot smaller.

Update on this issue
Currently we are exploring three options:

As burak stated one of the options is to fork the existing serverless-plugin-optimize  and have it work for Azure and GCP.
The second option revolves around using serverless-webpack. One thing to keep in mind is that the deployer runs with reference to other packages in the monorepo is via symlinks. This might  help.
Another solution would be to drop serverless and only use Terraform to package and deploy our own webpack solution.

As I understand, currently Lerna builds symlink dependencies inside package.json, these symlink dependencies however interfere with serverless packaging.
Having tried packing with serverless-webpack with a webpack.config.js, the packing fails with the following output
src/handlers/aws/index.ts:2:23 - error TS2307: Cannot find module '@airnode/node' or its corresponding type declarations.

The same error also occurs when trying to pack with serverless-plugin-monorepo.  My assumption is that these are designed to work with Yarn workspaces and not Lerna monorepos
Interestingly serverless-plugin-optimize  also gives this output but still successfully compiles
Serverless: Compiling with Typescript...
Serverless: Using local tsconfig.json
src/handlers/aws/index.ts (2,23): Cannot find module '@airnode/node' or its corresponding type declarations.
Serverless: Typescript compiled.
Serverless: Optimize: starting engines
Serverless: Optimize: airnode-1234567-dev-startCoordinator
Serverless: Optimize: airnode-1234567-dev-initializeProvider
Serverless: Optimize: airnode-1234567-dev-callApi
Serverless: Optimize: airnode-1234567-dev-processProviderRequests
Serverless: Packaging service...
Serverless: Excluding development dependencies...
Serverless: Excluding development dependencies...
Serverless: Excluding development dependencies...
Serverless: Excluding development dependencies..

There is an issue , that talks about this for lerna monorepos in particular but the commentor gave up on it....
I am interested in knowing why serverless-plugin-optimize in particular complies even though the error exists.

Did you inspect this from the article? @poll/service seems to import @poll/model and is deployed only with serverless-webpack.

I did, but I was still encountering this error, I thought maybe it was a problem with tsconfig, so I played around with that as well but wasn't able to get it to work. The babel configuration and webpack.config.js don't seem to be wrong. must be something small that I am missing , so I will dig around in their git issues a bit more.

A minimal POC with serverless-webpack
https://github.com/bbenligiray/serverless-lerna
Confirmed that it works with AWS. GCP & Azure are yet to be tested.

Closed in https://github.com/api3dao/airnode/pull/291


chore(4.4): release 1.7.3

:robot: I have created a release beep boop
1.7.3 (2022-08-01)
Bug Fixes

release 1.7.3 (97a3093)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/GluuFederation/cloud-native-edition/releases/tag/v1.7.3 :sunflower:


2.0.8 Wireless Carplay does not Work after Userspace Reboot

Hey Opa, before I start, thanks for all your work on this latest jailbreak.  In Dopamine 2.0.6, I'm able to connect to wireless carplay and the connection will reestablish when necessary after a Userspace Reboot in the Dopamine application.  Wireless carplay would not connect at all on Dopamine 2.0.7, and the initial connection was fixed on Dopamine 2.0.8.  However, when I trigger a Userspace Reboot on 2.0.8, I am unable to connect to wireless carplay afterwards.

What device? What version?...

Ah my bad, iPhone 8, ios version 16.6.1

I use wireless CarPlay every day and have not had any issues with it related to Dopamine.
I've even userspace rebooted while its connected and it reconnects almost instantly.
Do you have the same problem with tweak injection disabled?
iPhone 14 Pro Max 16.4.1

Okay so if there is a problem, it most likely only affects arm64. So it works after the phone is jailbroken (e.g. after Dopamine has rebooted the userspace) but if you trigger a userspace reboot later, it breaks it?

Ok it turns out I may just have been in a deadzone of some kind networking wise, I can confirm that in my usual areas, I'm able to use wireless carplay like expected when using Dopamine 2.0.8.  Sorry for opening this issue unnecessarily!

Ok, I tested a bit more on 2.0.8, and I closed the issue yesterday after jailbreaking on Dopamine 2.0.8 and connecting to wireless Carplay for the first time.  However after disconnecting from wireless Carplay on 2.0.8, I was not able to reconnect, even if forgetting the phone from the vehicle and the vehicle from the phone, and connecting them both again.  The issue does still occur if tweak injection is disabled in Dopamine 2.0.8, and if the jailbreak is hidden.  For some reason, 2.0.6 allows me to continually connect and reconnect to wireless Carplay, while 2.0.8 does not.

my issues seem to have been resolved in 2.0.10.


almost white image when saving grayscale image with libturbojpeg

Considering the original image:

and the following code:
    public void iiiftest2() throws IOException {
        InputStream input = IIIFImageTest.class.getClassLoader().getResourceAsStream("I1PD1274640004.jpg");
        ImageInputStream iis;
        try {
            iis = ImageIO.createImageInputStream(input);
        } catch (IOException e) {
            e.printStackTrace();
            return;
        }
        ImageReader reader = ImageIO.getImageReaders(iis).next();
        System.out.println("using reader " + (reader.getClass()));
        reader.setInput(iis);
        ImageReadParam readParam = reader.getDefaultReadParam();
        BufferedImage outImg = null;
        try {
            outImg = reader.read(0, readParam);
        } catch (IOException e1) {
            // TODO Auto-generated catch block
            e1.printStackTrace();
        }
        System.out.println("out " + outImg);
        Iterator<ImageWriter> it = ImageIO.getImageWritersByMIMEType("image/jpeg");
        ImageWriter writer = ImageIO.getImageWritersByMIMEType("image/jpeg").next();
        System.out.println("using writer " + writer);
        ImageWriteParam jpgWriteParam = writer.getDefaultWriteParam();
        jpgWriteParam.setCompressionMode(ImageWriteParam.MODE_EXPLICIT);
        jpgWriteParam.setCompressionQuality(0.75f);
        OutputStream os = new FileOutputStream(new File("imgresultgray.jpg"));
        ImageOutputStream ios = ImageIO.createImageOutputStream(os);
        writer.setOutput(ios);
        writer.write(null, new IIOImage(outImg, null, null), jpgWriteParam);
        ios.flush();
        ios.close();
        writer.dispose();
    }

the result log is
using reader class de.digitalcollections.turbojpeg.imageio.TurboJpegImageReader
out BufferedImage@6973bf95: type = 10 ColorModel: #pixelBits = 8 numComponents = 1 color space = java.awt.color.ICC_ColorSpace@2ddc8ecb transparency = 1 has alpha = false isAlphaPre = false ByteInterleavedRaster: width = 1955 height = 524 #numDataElements 1 dataOff[0] = 0
using writer de.digitalcollections.turbojpeg.imageio.TurboJpegImageWriter@1a04f701

and the (incorrectly white) result image is:

Is this a side effect of the previous bugfix of binary images?

@jbaiter @morpheus-87 any idea?

Sorry, rough mix between vacation/sickness/conference season, will take a look next week!

no problem, thanks!

@jbaiter any news?

@jbaiter thanks! the original issue is with turbojpeg though, not openjpeg

Hah, sorry, should've read a bit better, reopening :-)

So I've just tried to reproduce this with the image you uploaded with the issue, and everything seems to be working just fine with the latest HEAD :thinking:
Here's my Test-Case:
  @Test
  public void testEncodeGrayscale() throws IOException {
    ImageWriter writer =
        Streams.stream(ImageIO.getImageWritersByFormatName("jpeg"))
            .filter(TurboJpegImageWriter.class::isInstance)
            .findFirst()
            .get();
    ImageWriteParam param = writer.getDefaultWriteParam();
    param.setCompressionMode(ImageWriteParam.MODE_EXPLICIT);
    param.setCompressionQuality(0.85f);
    BufferedImage in = ImageIO.read(ClassLoader.getSystemResource("grayscale.jpg"));
    ByteArrayOutputStream os = new ByteArrayOutputStream();
    try (ImageOutputStream ios = ImageIO.createImageOutputStream(os)) {
      writer.setOutput(ios);
      writer.write(null, new IIOImage(in, null, null), param);
    }
    os.flush();
    Files.write(Paths.get("/tmp/debug.jpg"), os.toByteArray());
    assertThat(os.toByteArray()).isNotEmpty();
    ByteArrayInputStream bis = new ByteArrayInputStream(os.toByteArray());
    BufferedImage jpegImg = ImageIO.read(bis);
    assertThat(jpegImg).hasNoPixelsOfColor(255);
}

grayscale.jpg is the image you uploaded with your issue.
The resulting /tmp/debug.jpg image looks identical to your input image:

Is the image the actual input image you used? If not, can you upload it somewhere?

just did some more testing and indeed it's fixed now, thanks a lot!


[QUESTION] Can actual file paths be allowed?

Prerequisites
Versions

PHP version: 7.2
Laravel version: 5.7
Package version: 3.1

Description
I guess I don't quite understand the decision to not allow direct file pathing and was wondering why?
I'm sure there must be many instances where, given there is a command line example, where import via artisan command would be worthwhile, but it's explicitly disabled by forcing using the filesystems.
Specifically, the command could allow for a developer or maintainer of an application the ability to run imports on various files for various importers and as an example perhaps data migration is a great example. For this you wouldn't want to store the data in the storage path because it's not permanent and likely will be updated and don't want to have an import from UI maybe due to validation requirements of the file. OR maybe even more simply you just want to test the importer, but without putting it in the storage path, and specifically in a configured location available to the rest of the app.
I guess I just don't understand showing a console example, but then forcing that the file to import be located somewhere that a console location would potentially never need to go and in some cases should never go.

You can just create a local disk in Laravel pointing to the folder that you want. The storage folder is just the default Laravel filesystem disk. After the import you can just clear out this folder (or remove the files that are imported)
I'm fine with accepting a PR that allows for full file paths, but it's not on the top of my priority list right now.


Crashing on iOS11 device

Hello @yannickl,
Love the framework, great work!
Maybe it is connected to #16, building the app with the iOS11 SDK, it crashes on the device (not on simulator, though).

0 : "0   ???                                 0x0000000109880474 0x0 +<PHONE_NUMBER>"
1 : "1   App Development                 0x0000000103e11e1c main + 0"
2 : "2   AwaitKit                            0x0000000104721ca0 _T08AwaitKit9ExtensionCAASo13DispatchQueueCRbzlE5awaitqd__07PromiseB00G0Cyqd__GKlF + 2020"
3 : "3   AwaitKit                            0x0000000104720810 _T08AwaitKit5awaitx07PromiseB00D0CyxGKlF + 172"
4 : "4   App Development                 0x0000000103e110e0 T019App_Development11AppDelegateC11applicationSbSo13UIApplicationC_s10DictionaryVySo0F16LaunchOptionsKeyVypGSg022didFinishLaunchingWithI0tFyycfU + 352"
5 : "5   AwaitKit                            0x00000001047211f0 _T0s5Error_pIxzo_ytsAA_pIxrzo_TR + 32"
6 : "6   AwaitKit                            0x00000001047212e4 _T0s5Error_pIxzo_ytsAA_pIxrzo_TRTA + 88"
7 : "7   PromiseKit                          0x00000001069820ac T0So13DispatchQueueC10PromiseKitE7promiseAC0C0CyxGSo0A5GroupCSg5group_0A00A3QoSV3qosAL0A13WorkItemFlagsV5flagsxyKc7executetlFyyAC10ResolutionOyxGccfU_yycfU + 216"
8 : "8   PromiseKit                          0x00000001069737b0 _T0Ix_IyB_TR + 48"
9 : "9   libdispatch.dylib                   0x000000010764f334 _dispatch_block_async_invoke_and_release + 100"
10 : "10  libdispatch.dylib                   0x0000000107641d4c _dispatch_client_callout + 16"
11 : "11  libdispatch.dylib                   0x000000010764f9a0 _dispatch_continuation_pop + 624"
12 : "12  libdispatch.dylib                   0x000000010764de48 _dispatch_async_redirect_invoke + 684"
13 : "13  libdispatch.dylib                   0x0000000107654080 _dispatch_root_queue_drain + 616"
14 : "14  libdispatch.dylib                   0x0000000107653db8 _dispatch_worker_thread4 + 68"
15 : "15  libsystem_pthread.dylib             0x00000001864bf338 _pthread_wqthread + 1260"
16 : "16  libsystem_pthread.dylib             0x00000001864bee40 start_wqthread + 4"

The exception brake point stops at DispatchQueue+AwaitKit,swift line 79.

Thank you for the report @eriadam,
I don't have any device in iOS11 for the moment. Once I'll find one I will try it.

Oh no!

Observed the same issue:
I used to use await to queue up my task executions
for a in self.aaa {
    try await(self.do[a].execute())
}

But I upgraded to ios 11 today and run into a EXC_BREAKPOINT here. The call stack is

And the error is

I've found an iPad with iOS 11, I'll test it tomorrow. I don't know what is the issue, may be the UInt64.max which is not allowed now...

lol. I hope not...thanks! Let me know if I can help on anything.

As I thought, the issue came from DispatchTime(uptimeNanoseconds: UInt64.mx). I replaced it with the DispatchTime.distantFuture and it works perfectly!

@yannickl I updated the library and now get stuck at the line you made the change from UInt64.mx) to .distantFuture. Have you seen similar problems when you made the fix?

@hy9be what kind of problems have you?

@yannickl Stuck at await statement. No CPU usage, no network or IO activities. If I pause the execution of the app in xcode, the code stops at the line: https://github.com/yannickl/AwaitKit/blob/cd5a8cae34606d5d160ee5e35a8ad84c851aee76/Sources/DispatchQueue%2BAwait.swift#L79
My code is very simple:
for mission in self.missions {
    try await(mission.execute())
}

mission.execute() returns a promise.

@hy9be I have the same issue - is this fixed?

@J7mbo J I have not tested recently.

maybe you should place it inside an async { } block. But that leaves me with the question: how do you get to the main thread again if you have to be inside asyncs all the time?


Is ConsumerGroup commit automatically ?

Bug Report
I have a problem with the ConsumerGroup object.

Because I've not commited message, when I restart the app I should get the 3 messages again, but I don't. Is the ConsumerGroup object is by default in autocommit mode ?
Thx.
Environment

Node version: 6.6.0
Kafka-node version: 1.6.0
Kafka version: 0.10

For specific cases also provide

Number of Brokers: 1
Number partitions for topic: 1

Include Sample Code to reproduce behavior
self.options = {
    host: config['metadata.broker.list'], //zkhost
    autoCommit: false
    groupId: MY-GROUPID
    fetchMaxWaitMs: 1000,
    fetchMaxBytes: 1024 * 1024,
    fromOffset: 'earliest',
    connectOnReady: false,
    ssl : {
      rejectUnauthorized : "true",
      cert : fs.readFileSync(config['ssl.cert.path']+"/certs/kafka_client.pem", 'utf8'),
      key : fs.readFileSync(config['ssl.cert.path']+"/private/kafka_client.key", 'utf8'),
      ca : fs.readFileSync(config['ssl.cert.path']+"/certs/ca-cert", 'utf8'),
      passphrase : config['ssl.key.password']
    }
};

self.consumer = new ConsumerGroup(self.options, self.topics);

self.consumer.on('connect', function() {
  console.log('connect');
    debug("Consumer is ready");
})
.on('message', function(data) {
    debug("got message "+data);
});

Yes, autoCommit is by default true but since you set it to false in your options It shouldn't be committing.
How is your consumer connecting if you have connectOnReady set to false? Are you calling .connect method somewhere else?

@hyperlink , thx for your reply.
Yes I call the connect method next I've registered my "connect" and "message" handler.

Is it possible that I have this problem because commits are save in kafka (in consumer_offsets) and kafka-node is connected with zookeeper ?

ConsumerGroup only uses zookeeper for broker discovery and also migration from old zookeeper based HLC offsets if that option was turned on (off by default).

Is it possible to explicitly declare which offset the ConsumerGroup will read from regardless of its committed offset?

@michallevin correct. fromOffset only applies when no offsets were committed previously. What's the use case for specifying a specific offset to read from?

@hyperlink Thanks for the clarification!
In most case, we use the last committed offset to read from topics, but when there are changes in logic we sometimes need to re-process the data from the beginning. We thought about committing all of the necessary topics to offset 0, and then reading as a solution to this. What do think think?

For that case I recommend changing to a different groupId and then using fromOffset "earliest". Giving a specific offset could lead to an InvalidConsumerOffsetError if those offsets are out of retention.

@hyperlink  I am commiting my messages by using sendOffsetCommitRequest function. But when i restart my consumer. I get last committed message again. Do you have any idea how to resolve this?

@hyperlink Regarding fromOffset that we discussed earlier...
I am manually committing my messages using offset.commit, and expect the ConsumerGroup to start from the last committed offset each time I run the program.
I log the latest committed offset using offset.fetchCommits, which looks correct (the last offset when I last stopped the program), but the consumer does not begin to read from this offset (and the commit callback is never called). Furthermore, its behavior changes depending on the value of fromOffset, which should not matter since I have a committed offset ('none' returns [Error: kafka-node-client owns topics and partitions which contains no saved offsets for group 'Test'], and there is only 1 partition).
How can it be that offset.fetchCommits returns the correct commit, but that the ConsumerGroup behaves as if there is no committed offset?
const kafka = require('kafka-node');
const sleep = require('sleep');

const options = {
  groupId: 'Test',
  autoCommit: false,
  host: '<IP_ADDRESS>:2181',
  sessionTimeout: 15000,
  protocol: ['roundrobin'],
  fromOffset: 'none'
};

const client = new kafka.Client();
const offset = new kafka.Offset(client);

const ConsumerGroup = kafka.ConsumerGroup;
const consumerGroup1 = new ConsumerGroup(options, ['fake-topic']);

offset.fetchCommits('Test', [{ topic: 'fake-topic', partition: 0 }], (error, offsets) => { console.log(offsets) })

consumerGroup1.on('message', (message) => {
  console.log(`topic ${message.topic} partition ${message.partition} offset ${message.offset}`);
  offset.commit('Test', [{
                                        topic: message.topic,
                                        partition: message.partition, //default 0
                                        offset: message.offset,
                                        metadata: 'm', //default 'm'
                                     }], (err, data) => {
                                     console.log("successfully committed");
                                     console.log("err:" + err);
                                     console.log("data: " + data);
                                     });
  sleep.sleep(1);
});

consumerGroup1.on('error', (error) => {
  console.log(error);
});

The ConsumerGroup has state on what offsets it's supposed to have. If you commit a different offset than what it expects it could be overwritten next time autoCommit/commit is called.

@hyperlink My question is - shouldn't the offset returned by offset.fetchCommits be the same as the offset that the ConsumerGroup uses (according to testing it is not)?
Also, running 2 process that each have a consumerGroup with the same group-id read from the same topic and commit each message manually using sendOffsetCommitRequest results in both consumers reading all messages. Is this a bug or expected behavior?

@hyperlink Can you please elaborate on it, as i dont want to process the message again if its commited.
How to prevent consumergroup to get the last uncommited message?

How to prevent consumergroup to get the uncommited message only if its there?

Not sure what that means but committing manually is tricky to get right.

I meant, that right now, if i start my consumer i get the last committed message.
I dont want that. I only want messages which are not committed. And if there is 0 uncommitted message in topic. I dont want my consumer to consume anything, till a new message is added in the topic.

Would it be correct to manually commit offset+1 ?


Combine repos?

The plots in gallery are stored in different github repos, where the "Border Adjustment Calculator" is in PolicyBrain, and the rest are in plots.
I think it is weird to have different repos to store these plots, and it would be more sensible to put these plots in a single repo. (Personally I'd prefer to have them within the PolicyBrain repo.)
cc @MattHJensen @hdoupe

This would be convenient. However, heroku's hard cap on application size would probably prevent us from combining repos given that the files in the gallery repo can be pretty large.


Not able to get the correct total stake form Postgres

Hello,
This is more like a question and not an issue,
I am trying to get some stats from the Postgres DB so I made this query that returns the number of delegators per pool:
select pool_hash_id,count(*) from public.delegation as d
    join public.tx_out as tx on tx.tx_id = d.tx_id
    where pool_hash_id = 1218 and  d.tx_id in (select max (tx_id) from public.delegation group by addr_id)
    group by pool_hash_id;

The query seem to return the correct number of delegators after cross checking with 3rd party tools.
Now to get the amount of stake delegated per delegator  I use this one :
select pool_hash_id, d.tx_id,tx.address,ballance from public.delegation as d
    join public.tx_out as tx on tx.tx_id = d.tx_id
    join (select address,sum (value) as ballance  from public.utxo_view  group by  address)
    as v on v.address =tx.address
    where pool_hash_id = 1218 and  d.tx_id
    in (select max (tx_id) from public.delegation group by addr_id) ;

I can see that the value  are not correct for some Addresses.
Can you please help me to  fix this query

Sorry, I do not have a working/running db-sync instance at the moment because I am working on functionality to add ledger state information to the DB.
When I get my db-sync instance fixed and synced to mainnet I will look at this query. It should be later this week.

Hello Erikd,
I think that I am missing the delegators that did delegate from an HW wallet.

I think that I am missing the delegators that did delegate from an HW wallet.

Why do you think that?

It was because the balance is showing wrong for them.
Even the vew UTXO is not showing the right balance for some addresses.
But on the other hand tools like graphql are accurate.
I can query the adress and get the right balance in graphql console.

Without providing me with the exact query you are running, the block height, what you got and what you expect, there is little I can do to help (even I get my db-sync instance working).

Hello Eric,
sorry for the delay ,I switched to graphql as it is easier for me to get the data that I need.
Thank you for your help

Hello @erikd  ,
I am Back,  So here is what I want to do Let take an example of this adress staking address:
stake1uy6p6z6nad8n46vhw6r7gvw4rvgxt2y4f2xgmeq3u4cvj2cm4tztt.
when query the registered stake using the query :
select *  from  public.stake_address as d where d.view ='stake1uy6p6z6nad8n46vhw6r7gvw4rvgxt2y4f2xgmeq3u4cvj2cm4tztt'
I get the reg id = 2681471
If I query the tx table :
select * from public.tx where id = 2681471
I can see the transaction with out_sum : 19,996.825567 ADA
Now I query the tx_out with the same id:
select * from public.tx_out where tx_id =2681471
id : 6507111
Index = 0
address = 'addr1qxmpe8yrr3f3a8ygp2vutrtajsfesyer805gm83pyf580dp5r59486608t5ewa58usca2xcsvk5f2j5v3hjpretsey4s99c6l7'
what I need to get is the sum of all UTXO for the stake1uy6p6z6nad8n46vhw6r7gvw4rvgxt2y4f2xgmeq3u4cvj2cm4tztt.
Abd it seems that it is not possible Because I checked in 3rdparty tools like https://adapools.org/ and https://cardanoscan.io/
And I know this adress  control a stake of : 112K and not 19K
it seems that I cant find the other UTXO linked to that staking key
I hope that it a bit more clear now.

It probably is possible to get this from the database as it is now, but it is difficult and complicated. I am working on something right now that will make it relatively easy.

@djalillounis I have just reread this ticket and I am now less sure of what you are trying to do than I was previously. It would help if you could describe what you are trying to do, and then I can come up with the query or figure out what is missing from the current schema.

Hello Eric,
I have solved the  issue,  I wanted to get all the stake addresses with the
correspondent balances.
To solve the issue I had to convert the stake address to hex and then query
the tx table with the condition that the last 54  chars of the
address UTXO are the same as the stake address.
On Mon, Oct 12, 2020 at 9:26 AM Erik de Castro Lopo <
<EMAIL_ADDRESS>wrote:

@djalillounis https://github.com/djalillounis I have just reread this
ticket and I am now less sure of what you are trying to do than I was
previously. It would help if you could describe what you are trying to do,
and then I can come up with the query or figure out what is missing from
the current schema.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/input-output-hk/cardano-db-sync/issues/292#issuecomment-706931009,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADFW22JTNP6J2HSVLDAFWCLSKKVRHANCNFSM4RK2LLKA
.

To solve the issue I had to convert the stake address to hex and then query the tx table with the condition that the last 54  chars of the address UTXO are the same as the stake address.

Still need to come up with an easier solution to this.

Still need to come up with an easier/better solution for this.

Can easily achieve this with a simple aggregate query of the rewards table. It's just the sum by address

Its the pulling aprt of the address that needs to be made un-necessary.

I havent upgrade my db-sync to the latest version yet.
I dont I will upgrade and check what can be done from the reward table.
On Monday, October 12, 2020, Erik de Castro Lopo<EMAIL_ADDRESS>wrote:

Its the pulling aprt of the address that needs to be made un-necessary.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/input-output-hk/cardano-db-sync/issues/292#issuecomment-707323895,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADFW22PRWUKHXLXG6GUW7QLSKNPTHANCNFSM4RK2LLKA
.

Seems like a stale ticket for something that has been fixed some time ago.

Just the previous epoch everything was working fine and no updates were pushed recently.
I could try to restart my core but the problem I dont know when I will he slotleader again and risk missing blocks

@djalillounis This sounds like it should be a new issue. You will need to specify what version of db-sync you are running. You wll also need to specify what as working fine and why you think what you see now is wrong.


[FEATURE] add filter like algorithm.

Is your feature request related to a problem? Please describe.
Sometimes it is nice to be able to filter out elements from a product-type, and work only with subset.
Describe the solution you'd like
A filter like algorithm that takes a product-type and a predicate, and removes elements for which the predicate returns false.
Describe alternatives you've considered
I instead used something like:
constexpr bool is_supported_thing(thing t){
  return some-expr-with-t;
}
inline constexpr auto supported_things = []{
  constexpr auto n = []{
    return std::ranges::count_if(all_things, &is_supported_thing);
  }();
  std::array<thing, n> t;
  std::ranges::copy_if(all_things, t.data(), &is_supported_thing);
  return t;
}();

@jfalcou suggested https://godbolt.org/z/sYq4Pecxh as a workaround, which is pretty close.

Just need to wrap it nicely I guess


is there anyway to remove the busy button and all day check box. on pop up ?

i want to remove the busy and check box

Fork this repository so you can use the handlebar template.
https://github.com/nhn/tui.calendar/blob/master/src/js/view/template/popup/scheduleCreationPopup.hbs
or
You can use your custom popup.
https://github.com/nhn/tui.calendar/blob/master/docs/getting-started.md#templatecustomize-ui

thank you for the fast response. is there anyway to add another input box  text like Location and Subject ? i tried the second option to use a costume pop up. but still kinda having a problem on where should I put the code.

Hi, Krucht
You can put the code in here.
https://github.com/nhn/tui.calendar/blob/master/dist/tui-calendar.js

After you change the string, you will see the effects in pop up.
It works for me, hope it helps you as well.

https://github.com/nhn/tui.calendar/blob/master/docs/getting-started.md#customize-popups
You can use beforeCreateSchedule event hook.
After opening your custom popup, you can add a schedule using cal.createSchedule.
(https://nhn.github.io/tui.calendar/latest/Calendar#createSchedules)
var cal = new Calendar('#calendar', {
    useCreationPopup: false,
    useDetailPopup: false,
...
});

// event handlers
cal.on({
    'clickSchedule': function(e) {
        console.log('clickSchedule', e);
    },
    'beforeCreateSchedule': function(e) {
        console.log('beforeCreateSchedule', e);
        // You can write your code here :)
        // open a creation popup

        // If you dont' want to show any popup, just use `e.guide.clearGuideElement()`

        // then close guide element(blue box from dragging or clicking days)
        e.guide.clearGuideElement();
    },
    'beforeUpdateSchedule': function(e) {
        console.log('beforeUpdateSchedule', e);
        e.schedule.start = e.start;
        e.schedule.end = e.end;
        cal.updateSchedule(e.schedule.id, e.schedule.calendarId, e.schedule);
    },
    'beforeDeleteSchedule': function(e) {
        console.log('beforeDeleteSchedule', e);
        cal.deleteSchedule(e.schedule.id, e.schedule.calendarId);
    }
});

Thank you @jungeun-cho finally managed to do it

There is some request about creation popup and detail popup of an event, but it's still a default functionality which is everyone can add their own. The default popup can only be customizable as we are intended.

    /**
     * @description will modify the creation popup by watch for parent dom element and on the moment that children are
     *              added it will attempt to find the popup elements and modify them
     */
    private modifyScheduleCreationPopup(): void
    {
        let parentWrapperObserver = new MutationObserver( (mutations) => {
            $('.tui-full-calendar-section-allday').addClass('d-none');
            $('.tui-full-calendar-section-state').addClass('d-none');
        })

        let htmlDomElement = document.querySelector('.tui-full-calendar-floating-layer');
        parentWrapperObserver.observe(htmlDomElement, {
            childList: true,
        })
    }

The elements cannot be removed as the errors are thrown.


Episerver 11.5.3 Yellowscreen

I updated episerver to 11.5.3 and I get a yellow screen when trying to load Commerce Manager.
With the error below:
While loading .NET types from "BVNetwork.EPi404" the following error(s) was reported:
- System.TypeLoadException: Could not load type 'EPiServer.SimplePage' from assembly 'EPiServer, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=8fe83dea738b45b7'.
- System.TypeLoadException: Could not load type 'EPiServer.Framework.IInitializableHttpModule' from assembly 'EPiServer.Framework, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=8fe83dea738b45b7'.

Stack trace:
[InitializationException: While loading .NET types from "BVNetwork.EPi404" the following error(s) was reported:

     - System.TypeLoadException: Could not load type 'EPiServer.SimplePage' from assembly 'EPiServer, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=8fe83dea738b45b7'.
     - System.TypeLoadException: Could not load type 'EPiServer.Framework.IInitializableHttpModule' from assembly 'EPiServer.Framework, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=8fe83dea738b45b7'.

]
   EPiServer.Framework.Initialization.Internal.InitializationExceptionHelper.ThrowFriendlyTypeScannerException(IEnumerable`1 reflectionExceptions, IEnumerable`1 addonsWithErrors) +114
   EPiServer.Framework.Initialization.InitializationModule.EngineExecute(HostType hostType, Action`1 engineAction) +1347
   EPiServer.Framework.Initialization.InitializationModule.FrameworkInitialization(HostType hostType) +225
   EPiServer.Global..ctor() +103
   ASP.global_asax..ctor() in c:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\root\6ad79c2f\836b8a2c\App_global.asax.hyulgj-w.0.cs:0

[TargetInvocationException: Exception has been thrown by the target of an invocation.]

   System.Web.HttpRuntime.FirstRequestInit(HttpContext context) +523
   System.Web.HttpRuntime.EnsureFirstRequestInit(HttpContext context) +107
   System.Web.HttpRuntime.ProcessRequestNotificationPrivate(IIS7WorkerRequest wr, HttpContext context) +688

Which version of the 404 handler do you use?

I had this error with 11.0.0 and then I updated to the latest one 11.1.12 but still got this error

I was having this error with 11.0.0 and so I updated to the latest one 11.1.12 but still getting the error.

Do you have assembly bindings set correctly for these Episerver assemblies?

This is from my .csproj file (I don't know why it's version:<IP_ADDRESS>):
<Reference Include="BVNetwork.EPi404, Version=<IP_ADDRESS>, Culture=neutral, processorArchitecture=MSIL">
      <HintPath>..\packages\BVN.404Handler.11.1.12\lib\net461\BVNetwork.EPi404.dll</HintPath>
    </Reference>

And this from web.config:
<section name="bvn404Handler" type="BVNetwork.NotFound.Configuration.Bvn404HandlerConfiguration, BVNetwork.EPi404" />
I also added everything mentioned in configuration

Have you tried to clean ASP.NET cache?
The path:
C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files

Didn't work. Neither empting bin folder and restarting VS

Thanks for the help! :)
I managed to solve this problem. After deleting BVNetwork.EPi404.dll from Commerce Manager's bin folder, I got a new error
Value cannot be null.Parameter name: virtualPath]in EPiServer.Shell.ShellInitialization.WaitForInitializeModules()
which got solved by restoring removed episerver.shell web.config entries after commerce update, as mentioned here


Type error raised in IE9

"TypeError: Unable to get value of the property 'split': object is null or undefined"
This is again a problem with stack traces in IE, error.stack is undefined. I would think that the simplest option would to just return no method name for such an old and broken browser.
  try { throw new Error('') } catch (e) { error = e }
  if (error.stack === undefined) {
    return ""
  }

@timberkeley
Thanks for the suggestion, I will update the the library so it is compatible with IE9.


Server

What servers does this work for? Like does it work for Paper servers or PurPur or Spigot?

It only works on vanilla servers as it is a really really old dupe.


Modified layout of the application

Modified layout of the application to provide space for custom BMM widget:

'Run Engine' tab is split into 'Run Experiment' and 'Organize Queue' tabs.
The space for the custom BMM plan editor widget is left in 'Run Experiment' tab.
The 'Organize Queue' tab contains three widgets: Queue Widget, History Widget and generic Plan Editor.
The widgets in 'Organize Queue' tab are organized using QSplitter widgets: the widgets could be resized or completely removed from the screen.
The project was formatted using black, which generated some irrelevant code changes.

I have no time for a closer review but I support moving ahead on this. Merge at will.

@danielballan Sorry for the mess produced by black. I didn't think it will make than many changes. Obviously some of the autogenerated files had to be formatted. There are only few meaningful changes, and all of them are in widgets.py.


Document watch event annotation kubernetes.io/initial-events-list-blueprint

This is a Feature Request

What would you like to be added
Ensure that our docs mention kubernetes.io/initial-events-list-blueprint somewhere. This is an annotation that appears on some watch events.
Comments
/sig api-machinery
/language en
/kind feature

/assign

How about this:
kubernetes.io/initial-events-list-blueprint
Type: Annotation
Example: kubernetes.io/initial-events-list-blueprint: "Description of K8s object."
Used on: Events
The annotation is added to the synthetic "Bookmark" event for the watch stream and is used by clients
to guarantee the format consistency when reconstructing the list during WatchList processing. This annotation will store an empty, versioned list encoded as a Base64 string. This annotation will be added to the same object/place the k8s.io/initial-events-end annotation is added.

@sftim
reference: KEP-3157
&&
k8s/k8s..types.go

How about this:
kubernetes.io/initial-events-list-blueprint
Type: Annotation Example: kubernetes.io/initial-events-list-blueprint: "Description of K8s object." Used on: Events The annotation is added to the synthetic "Bookmark" event for the watch stream and is used by clients to guarantee the format consistency when reconstructing the list during WatchList processing. This annotation will store an empty, versioned list encoded as a Base64 string. This annotation will be added to the same object/place the k8s.io/initial-events-end annotation is added.

I'm afraid that's wrong; watch events are not the same as Events.

How about this:
kubernetes.io/initial-events-list-blueprint
Type: Annotation Example: kubernetes.io/initial-events-list-blueprint: "Description of K8s object." Used on: Events the annotation is added to the synthetic "Bookmark" event for the watch stream and is used by clients to guarantee the format consistency when reconstructing the list during WatchList processing. This annotation will store an empty, versioned list encoded as a base64 string. This annotation will be added to the same object/place the k8s.io/initial-events-end annotation is added.

I'm afraid that's wrong; watch events are not the same as Events.

You mean on the used on section? I was contemplating whether to write watch events . Is there any other thing wrong with the description?

(I'm not familiar with this annotation, even though I am able to tell that it isn't documented)

I got the content from KEP and changelog for the same. there are very few instances of its use in the code or k8s github organization, I'll try to investigate more about it and let you know. What about the second annotation though, i have checked and it's also not recorded.

(I'm also not familiar with the second annotation, even though I am able to tell that it isn't documented)


Pass on securityOpts from podInfraContainer to container added to pod.

This is an incomplete fix, as it would be best for the libpod library to be in charge of coordinating the container's dependencies on the infra container. A TODO was left as such. UTS is a special case, because the docker library that namespace handling is based off of doesn't recognize a UTS based on another container as valid, despite the library being able to handle it correctly. Thus, it is left in the old way.
Signed-off-by: haircommander<EMAIL_ADDRESS>Signed-off-by: Daniel J Walsh<EMAIL_ADDRESS>

@rhatdan Needs a rebase

bot, retest this please

@mheon @vrothberg @giuseppe @umohnani8 PTAL
I think we are close to passing the tests.

One small question, otherwise LGTM.  Some of the tests are still giving you a run for your money @rhatdan

bot, retest this please

bot, retest this please

Reminder
@mheon @umohnani8 @baude @TomSweeneyRedHat @vrothberg @giuseppe PTAL

LGTM
@rh-atomic-bot r+

@rh-atomic-bot retry


Visual Code now working?

I tried running npm install and npm run start multiple times no matter what I do it never works with your project. Could you possibly upload a small youtube tutorial on your process to open the project? Thank you!

git clone https://github.com/tamani-coding/threejs-character-controls-example.git
cd threejs-character-controls-example
npm i
npm run start

Project is running at http://localhost:8080/
Works fine for me..
If this does not work for you ,  could you provide more information on the error you are getting..


use scripts to define UDUNITS2_XML_PATH

@pelson can you take a look at this? It should help with the cf_units issue.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

Looks great. 👍


improve

this is a serve script for LLM, I remove the langchain for better model behavior

thanks!


add admonition support

leverage Terminal.css alert class?

see https://facelessuser.github.io/pymdown-extensions/extensions/details/

new option: https://facelessuser.github.io/pymdown-extensions/extensions/blocks/plugins/details/


Conditional Formatting: Use a formula to determine which cells to format

Hi
Is it possible to add a conditional formatting that is using a formula?
In the screenshot below I created a rule that compares values in two columns:

But I had no luck configuring it with Add-ConditionalFormatting
Should I use -RuleType  Expression?
If this is supported, could you share an example?
Thank you in advance!
Kinga

Here is a start. I have not played with that feature in either Excel or with the module
The code below does set the conditional formatting, you can see and edit it in Excel.
Not sure how the formula needs to be set up. I tried it manually different ways, it colored cells, but not what I expected.

$data = ConvertFrom-Csv @"
Region,State,Units,Price
West,Texas,927,923.71
North,Tennessee,466,770.67
East,Florida,520,458.68
East,Maine,828,661.24
West,Virginia,465,053.58
North,Missouri,436,235.67
South,Kansas,214,992.47
North,North Dakota,789,640.72
South,Delaware,712,508.55
"@

$xlfilename = "test.xlsx"
Remove-Item $xlfilename -ErrorAction SilentlyContinue

$excel = $data | Export-Excel $xlfilename -AutoSize -PassThru

Add-ConditionalFormatting -Worksheet $excel.sheet1 -Range "A1:D10" -ConditionValue '=A3="North"' -RuleType Expression -BackgroundColor Cyan

Close-ExcelPackage $excel -Show

Thank you @dfinke  for your answer.
Your code is currently selecting wrong cells, because of the =A3="North" rule for the range starting at A1
Correcting it to  =A1="North"`` generates correct results. Not that it matters so much.
And indeed, it set me in the right direction =)
A summary for anyone looking for the same answer:
To create a formula that compares two cells in the spreadsheet, using Excel UI:

select range (column or a table) which should be formatted

Select Conditional Formatting > New Rule
Choose Use a formula to determine which cells to format and type =A2=B2 to compare cells in columns A and B and define formatting

The formula starts at row 2 because the range selected in step 1 start at row 2.

And to do the same (reusing the code above) change the Add-ConditionalFormatting command to:
Add-ConditionalFormatting -Worksheet $excel.sheet1 -Range "A1:A10" -ConditionValue '=A1=B1' -RuleType Expression -BackgroundColor Cyan`

When the excel is generated, it's not yet formatted because the values is columns A and B differ for the selected range (A1:A10).
But change the data to the same values and the cells in column A are formatted:

Thanks once again!

@kkazala Great! Would you be up to doing a PR and adding this as an example in this directory? https://github.com/dfinke/ImportExcel/tree/master/Examples/ConditionalFormatting


FOGL-6352: Add plugin_package_name in Package file

With this Pull Request, packaging and installation are good but there is an issue in the discovery of the plugin, following are the logs.
Apr 25 06:57:08 ip-10-0-0-53 Fledge[23326] ERROR: plugin_discovery: fledge.common.plugin_discovery: Plugin "/usr/local/fledge/python/fledge/plugins/south/s7_python" import problem from path "/usr/local/fledge/python/fledge/plugins/south/s7_python".
Apr 25 06:57:08 ip-10-0-0-53 Fledge[23326] WARNING: common: fledge.services.core.api.plugins.common: Python plugin not found......invalid syntax (s7_python.py, line 783), try C-plugin
Apr 25 06:57:06 ip-10-0-0-53 Fledge[25098] INFO: install: fledge.services.core.api.plugins.install: fledge-south-s7-python plugin installed successfully
Apr 25 06:57:02 ip-10-0-0-53 Fledge[23326] INFO: install: fledge.services.core.api.plugins.install: fledge-south-s7-python plugin install started...

The latest commit should solve the discovery issue.


build issues with ppc64le on travis ci environment

/on ppc64le environment :
when we go for travis ci build with ppc64le there is failure in build with master branch of code.
the error log is :
0.00s$ travis_install_go_dependencies 1.11.x -v
2.10s$ travis_script_go -v
go build -ldflags="-w -X github.com/openshift/odo/pkg/version.GITCOMMIT=f8ea5a5" cmd/odo/odo.go
cmd/odo/odo.go:7:2: cannot find package "github.com/openshift/odo/pkg/log" in any of:
/home/travis/gopath/src/github.com/PradipPanigrahi/odo/vendor/github.com/openshift/odo/pkg/log (vendor tree)
your suggestion helpful for me .

From the travis environment it is failed to import "github.com/openshift/odo/pkg/odo/cli"
And the dependency "go " library is make some issues during the build.

Problem is location of odo source code. It needs to be in $GOPATH/src/github.com/openshift/odo on Travis that would be  /home/travis/gopath/src/github.com/openshift/odo. You have it in /home/travis/gopath/src/github.com/PradipPanigrahi/odo.
You need to make sure that the odo's go source code is correctly placed in $GOPATH. You should be able to achieve that by setting go_import_path(https://docs.travis-ci.com/user/languages/go/#go-import-path) directive in .travis.yaml. See our .travis.yaml https://github.com/openshift/odo/blob/67da8a12c085ad18996ca271ba553249416686e1/.travis.yml#L11

/area system-pz

Issue seems to have been resolved by setting the correct path variables, can be closed out for now, will reopen again if required.

Issue seems to have been resolved by setting the correct path variables, can be closed out for now, will reopen again if required.

/close


APT source whitelist request for ppa:ubuntu-cloud-archive/icehouse-staging

deb source: ppa:ubuntu-cloud-archive/icehouse-staging
needed for a more recent libusb for the building of ola

Any update on this please? Or another source we can use for libusb >= 1.0.16? Thanks


Why use empty instead of is_null?

I think that would be better to use is_null to verify if the input is "empty" on the applyField method.
Like this:
    /**
     *  Apply the given filter by its name
     *  @param  $name
     *  @return Filter
     */
    protected function applyFilter($name, $value, $options = [])
    {
        // If the filter does not exist, throw an Exception:
        if (!isset($this->filters[$name])) {
            throw new InvalidArgumentException("No filter found by the name of $name");
        }
        // If the given value is null, skip the sanitizer
        if (is_null($value)) {
            return $value;
        }
        $filter = $this->filters[$name];
        if ($filter instanceof Closure) {
            return call_user_func_array($filter, [$value, $options]);
        } else {
            $filter = new $filter;
            return $filter->apply($value, $options);
        }
    }

I want use a filter that trim empty fields to null instead of leaving just an empty string.
If you accept it I can make a pull request with the feature.
I really like the package and would be very nice to contribute with you guys! There are some features that you need some help to implement? I have some in mind...

Hi Brunoti,
There is no point in sanitizing an empty string or array, and because the main purpose of the Sanitization library is to be used with input coming from HTML forms, no null values are expected (and therefore a null value check would be of little value).
I'm sorry but we can't make this change at this time, you are free to fork the project if you feel this is a mistake though.
Best!

Thanks for the feedback! You are right.
But what about the ideia of transform the empty string in null? Or casting numbers and booleans?
You think that this is not a job for the sanitizer?

@brunoti we've implemented the changes you asked for. I just pushed v1.0.5 with no is_empty check and a new filter called 'cast'.

Thanks @sildraug! Me and my coworkers are very happy to use this lib.
Cheers!

I think this error appeared again in version 1.0.11 :(
Example code generating issue (filter-text index not found - because sanitizer returns null)
It worked from 1.0.5 till 1.0.10
$cleaned = \Sanitizer::make($request->all(), ['filter-text' => 'trim|strip_tags'])->sanitize();
}
$filterName = preg_replace('/[^a-zA-Z0 -]/u', ' ', $cleaned['filter-text']);


Extension point

From @dario-hd on Wednesday, June 21, 2017 9:31:39 AM
As far as I can see the extension point is the ObjectAdapter. So, basically the idea is to create a wrapper around it which implements the same interface. But ObjectAdapter is not injectable because of the Action<JsonPatchError> constructor parameter.
In addition, I saw that here and here it is explicitly set to null.
Does it make sense to make it optional in order to allow it to be injectable?
That's what I did when I used this version https://github.com/KevinDockx/JsonPatch, but the parameterless constructor is not available anymore.
public interface IPatchAdapter : IObjectAdapter
{
}

public class PatchAdapter : IPatchAdapter
{
    private readonly IObjectAdapter _objectAdapter;

    public PatchAdapter(IObjectAdapter objectAdapter)
    {
        _objectAdapter = Check.NotNull(objectAdapter, nameof(objectAdapter));
    }

    public void Add(Operation operation, object objectToApplyTo)
    {
        // ...
    }

    public void Copy(Operation operation, object objectToApplyTo)
    {
        // ...
    }

    public void Move(Operation operation, object objectToApplyTo)
    {
        // ...
    }

    public void Remove(Operation operation, object objectToApplyTo)
    {
        // ...
    }

    public void Replace(Operation operation, object objectToApplyTo)
    {
        // ...
    }
}

Copied from original issue: aspnet/JsonPatch#88

From @Eilon on Monday, August 28, 2017 1:48:27 PM
@dario-hd can you provide more info on the scenario you are trying to accomplish?

From @dario-hd on Tuesday, August 29, 2017 12:42:26 PM
@Eilon the idea is to enhance the original ObjectAdapter implementation. In the end I managed to do it by registering IObjectAdapter as follow in Autofac:
builder.Register(c => new ObjectAdapter(new DefaultContractResolver(), logErrorAction: null))
       .As<IObjectAdapter>();

I would create a constructor without logErrorAction in order to make it "more injectable".

From @Eilon on Wednesday, August 30, 2017 9:50:44 AM
@dario-hd thanks for the extra info, we will evaluate this in our next team bug discussion.

From @Eilon on Thursday, September 7, 2017 4:56:09 PM
@dario-hd we took a quick look at this and we think we still need a bit more info. Can you provide info on what it is you're trying to inject? Maybe show the code that you'd like to be able to write when setting up your container and services?

Hi. We're closing this issue as we have heard no response from you for some time now. If you have more details and are encountering this issue please add a new reply and re-open the issue.


test result error

Hi i retrain the mobiliNet+SSD using voc0712 , after 25000 iters, mAp is 0.724 and loss decrease ~2.0
but when i using python demo.py after merge_bn.py ,the result is poor..like this:

what's the wrong

@chuanqi305 Sorry ,i have solver the problem ,
i Use caffe time to test the speed of Network.

average ~65ms Is it normal ？

@zhanglaplace, how did you solve the problem, i met the same problem


Check user file locations during upgrade

When a user adds or changes a setting that points to a file, like Tuning file the makeChanges.sh checks that the file exists.
The same checks should happen during upgrades, especially for system files.  Bookworm changed the location of the tuning files and this check would have caught that.

These checks should go in a common file so can be used by both install.sh and makeChanges.sh.


Decrypt base64 encoded SOPS encrypted secrets

Kustomize-controller can currently decrypt SOPS encrypted files - but whole files only. It does this by, among other things, string matching "sops" and "ENC".
Kubernetes Secrets are base64 encoded, therefore when a SOPS encrypted file is added as base64 encoded data to a Kubernetes Secret, it is not decrypted.
I tried to explain this here  https://github.com/fluxcd/flux2/discussions/745#discussioncomment-601014
You may well ask yourself, why someone would want to base64 encode a SOPS encrypted file. We, and I believe others, would and have (using fluxv1 workaround not available in v2) been using Kustomize secretGenerator. It is a useful feature in that it appends a hash of the content of the secret, and propagates that suffixed name to pods that need that secret. This enables that if the underlying secret should change, appropriate deployment/pod rollouts are scheduled.
I will submit a very rough PR, showing a functional solution. This is my first foray into Go development, with such a complicated project I'm surprised it worked - credit to the CONTRIBUTING instructions on getting a local version running so easily. If there is appetite to accept the idea, then I and hopefully others can work to improve the quality of the code and tests etc..

https://github.com/fluxcd/kustomize-controller/pull/329

Can you say more about this solution and what it looks like in practice?
Eg. from my current understanding, the secret presents as a regular secret when opened as YAML in an editor, but if you decode the base64 data, it is a SOPS-encrypted (original plaintext) file?
I appreciate that you've done some work and are presenting an implementation approach! This makes it much easier to talk about what it does and how it might need to change, in order to be accepted for merge.
Can you present some minimal usage examples too? (Ideally in the form of documentation, but it would help my understanding of what you've tried to do, just to see an example secret and explanation of how you're using it.)

@kingdonb I was also confused about this, but now that @bob-rohan has added tests to the PR, I can understand what it does. Thanks @bob-rohan for adding those tests 🏅

No worries, I appreciate the guidance. Do you have any recommended next steps with regards to getting the PR in a state to be merged?


Update glob.py and test/test_glob.py from CPython v3.11.2

https://github.com/RustPython/RustPython/issues/4564

Could you check git config user.email? it seems different from your github account email settings.


Request for Non-GUI version

Due to GUI bugs referred to here
https://github.com/Gazuntype/graphQL-client-unity/issues/6
and here
https://github.com/Gazuntype/graphQL-client-unity/issues/10
I have a GUI version working on another machine but it doesn't work on my machine. The Api reference GUI crashes all the time on my machine and sometimes on another machine.
I attempted to create a non-GUI script but failed. Do you have a non-GUI script-only version available? Happy to compensate with some $.

This may be of use to you: https://github.com/Gazuntype/graphQL-client-unity/issues/7#issuecomment-641043332
Maybe consider offloading more of this to actual .gql files rather than inlining some of that text.

@kaifaust and @netpoetica I know it's been a while but how did you finally solved this problem? Did you go with another graphQL client for Unity?
Cheers

@kaifaust and @netpoetica I know it's been a while but how did you finally solved this problem? Did you go with another graphQL client for Unity? Cheers

I actually just used the solution from my comments there. This wasn't going to production in an enterprise sense (was for a scholarly endeavor), so it was good enough at the time.

@netpoetica I see, thanks for the heads up!


Correct Python unit test docs for tox v4

As of tox v4, this no longer works:
tox -e unittest path.to.tests

Instead you have to do:
tox -e unittest -- path.to.tests

See tox documentation here:
https://tox.wiki/en/latest/upgrading.html#cli-arguments-changed
Checklist

[x] PR has an informative and human-readable title
[x] Changes are limited to a single goal (no scope creep)
[x] Code follows the standards laid out in the CFPB development guidelines

Should https://github.com/cfpb/consumerfinance.gov/blob/main/requirements/local.txt#L6 and https://github.com/cfpb/consumerfinance.gov/blob/main/requirements/ci.txt#L4 be updated to v4.x?

@anselmbradford that's happening in #8188. This documentation change (the use of --) is compatible with tox 3.x as well, I just noticed this while testing that PR.


XML import

Hi all,
Is there a way in Grav to set up xml import cronjobs to import specific data into pages?
for example; wp all import plugin in Wordpress does exactly this.
Thank you in advance,
Jeffrey

I'm not sure exactly what you're shooting for, but there's an Import plugin. You could update the data files via cron, and the pages should update (based on cache settings).


[Feature] Add an afterBundle function to the Node Plugin API

I'm planning to replicate https://github.com/axe312ger/gatsby-plugin-netlify-cache, but also want to explore the possibility of caching the output of react-static bundle and restoring it before react-static export. This isn't currently possible as there is no function that is fired at the end of a successful bundle. I'm happy to create a PR to achieve this, but wanted to check that no one foresees any issues with doing so?

Closed by #1159


Provide source reformatting

Need the equivalent of Source... Format and/or Source... Correct Indentation.
(Imported from Bitbucket #6 reported by maxg on 2010-03-13)

(Changed responsible from nobody to phy.)
(maxg on 2010-06-21)

Rev 1 in 6731f64c3f6aceeda1517318d72e91f778ecd0bd
(maxg on 2010-06-22)


MapGrpcService link needed

MapGrpcService should be linked but it can't be found in API docs
@scottaddie  why can't I find it? Need it in other docs too.
https://docs.microsoft.com/en-us/dotnet/api/?view=aspnetcore-3.1&term=MapGrpcService

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4e072aff-35c1-1fc2-3f94-97dc7a809414
Version Independent ID: 2f05b9da-0d50-ce84-d6af-332da7d9d625
Content: gRPC services with ASP.NET Core
Content Source: aspnetcore/grpc/aspnetcore.md
Product: aspnet-core
Technology: aspnetcore-grpc
GitHub Login: @JunTaoLuo
Microsoft Alias: johluo

@Rick-Anderson The method comes from the following NuGet package: https://www.nuget.org/packages/Grpc.AspNetCore/.


Add -DiskId functionality and refactoring for Disk.ps1

30-April-2030 - I've implemented a few changes to Get-DsccDisk

Implemented the -DiskId parameter. This accepts one or more disk IDs.
Implemented the default -WhatIf functionality available in PowerShell.
Refactored the code to reduce the number of API calls (improved performance) and generally flattened and simplified the code.

01-May-2023 - Added another pull request with the following updates:

Refactored Get-DsccStorageSystem so that it creates a Global Variable called $DsccStorageSystem. This has name, ID and device type in it. The idea I'm suggesting is run this with no parameters in Connect-DSCC to initalise this variable. Then all other cmdlets can access the variable rather than calling Get-DsccStorageSystem. This improves performance dramatically because there are fewer RESTApi calls being made. This can be used to resolve SystemId from SystemName and DeviceType from SystemID, for example.
Renamed Invoke-DsscStorageSystemLocate to Enable-DsccStorageSystemLocate and also written a new cmdlet called Disable-DsccStorageSystemLocate. Both tested and working on an Alletra 9080.
Updated above cmdlets and Get-DsccDisk to implement -SystemName parameter. Now either -SystemName or -SystemId can be specified (Using parameter sets). This uses the $DssStorageSystem global variable implemented, as above.
Implemented the default -WhatIf functionality to all the above cmdlets.
Updated HPEDSCC.psm1 to add the two new cmdlets.

09-May-2023 - V1.0.2
Refactored Get-DsccController to support one or more systems and one or more controllers. Also added the -Component and -Performance parameters. Get-DsccControllerSubComponent and Get-DsccControllerPerf are refactored but are no longer exported - they implement the new parameters in Get-DsccController. This provides a more intuitive way of displaying the required information. NOTE: I have not added custom objects for components yet - like DSCC.StorageSystem.Battery, DSCC.StorageSystem.Performance etc.

Excellent Contributions, These are some great enhancement.


Remove shoulda-matchers

Removing them is preferable as we only use them in two places where we need to verify a regular expression in a validation.
This is a follow up of #6110 after discussing on Gitter. (Followup == :smiling_imp: :fire: :fire: :fire:)

Please be :green_heart: travis!!!

Wow nice!

Nice work @chrisarcand!