code-coverage --output property issue

dotnet-coverage: 17.6.6
I'm a little confused by --output property. The docs say it set the "code coverage report output file".
I configured it as --output D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml and it resulted in the code coverage results written to D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml.cobertura.xml:
Generating script.
Script contents: shell
D:\a\_work\1\s/.dotnet/dotnet dotnet-coverage collect --settings D:\a\_work\1\s/eng/CodeCoverage.config --output D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml "D:\a\_work\1\s/eng/cibuild.cmd -test -configuration Release /bl:D:\a\_work\1\s/artifacts//log/Release//tests.binlog"
========================== Starting Command Output ===========================
"C:\Windows\system32\cmd.exe" /D /E:ON /V:OFF /S /C "CALL "D:\a\_work\_temp\b9e9d123-b4e0-46f5-8fe1-595fdf5cf243.cmd""
Microsoft (R) Code Coverage Command Line Tool (x64)
Copyright (c) Microsoft Corporation. All rights reserved.

SessionId: d1697d6c-03ba-4d62-9667-c96fd4abeb8e

....

Build succeeded.
    0 Warning(s)
    0 Error(s)

Time Elapsed 00:31:46.68
Code coverage results: D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml.cobertura.xml.
Finishing: Run tests

This kind of feels like a bug.... If it's meant to be a path, then I'd expect D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml/cobertura.xml. If it's meant to be a path + filename, then it should be (and that's what I expected): D:\a\_work\1\s/artifacts//TestResults/Release//Cobertura.xml. However, it appears to be a "[path + file name prefix] that gets suffixed with '.cobertura.xml'".
If this is by-design (which I found somewhat unexpected), please update the docs to clearly spell it out.
Thank you.

@RussKie, thanks for reporting.
We have resolved the issue, please use 17.6.9 version.
That means when you specify the output path, that would be the output filename.
The output format (extension) will no longer be appended to the filename.

I've updated to 17.6.9 and I'm seeing .cobertura.xml produced:
PS D:\dev> dotnet dotnet-coverage --version
Microsoft (R) Code Coverage Command Line Tool (x64)
Copyright (c) Microsoft Corporation. All rights reserved.

17.6.9+3b0f2ec653d1973d7d140557f01122da5acfc444

PS D:\dev> dotnet dotnet-coverage collect --settings ./eng/CodeCoverage.config --output ./artifacts/TestResults/ "build.cmd -test -bl"
Microsoft (R) Code Coverage Command Line Tool (x64)
Copyright (c) Microsoft Corporation. All rights reserved.

SessionId: 76daffb4-f85a-41fb-91bb-a6ce58d87ff9
....
Time Elapsed 00:00:21.26

Code coverage results: ./artifacts/TestResults/.cobertura.xml.

So, from a layman perspective it doesn't look as fixed. ¯\_(ツ)_/¯

We expect a filename for the --output as mentioned in the help, and we append the extension if it's not provided.

If I set --output ./artifacts/TestResults/bla the result will be ./artifacts/TestResults/bla.cobertura.xml. .cobertura.xml is not an extension, .xml is.
The docs state --output sets the output file and not a path to the output file. Nor the prefix of the file which will have something appended to it:

The current behaviour is contrary to the docs, inconsistent with pretty much everything else and, frankly, unexpected. So, it is fair to categorise it as a bug.


How to disable unity rendering windows?

Thank you very much for your open source spirit!
When I trying to train embclip-zeroshot) , each training process will display an unity window, such I modify the DEFAULT_NUM_TRAIN_PROCESSES  to 4 processes (at embodied-clip/projects/objectnav_baselines/experiments/robothor/objectnav_robothor_base.py )，it will render 4 unity windows on my screen (Ubuntu 16.04 system):

I tried to set DEFAULT_THOR_IS_HEADLESS to True (at embodied-clip/projects/objectnav_baselines/experiments/objectnav_thor_base.py ), but it didn't work....
How can I disable RoboThor unity rendering windows? Because I want to migrate the training to the cloud server (with GPU but no monitor).
Looking forward to your reply, thank you!

Please take a look at the AllenAct Distributed ObjectNav tutorial(https://allenact.org/tutorials/distributed-objectnav-tutorial/) for more details about how to enable headless mode.

@xuexidi I have the same issue as I want to run the code without display on a server, did you work it out?
Sorry I am very new to the AI2-THOR codebase. I tried to follow the AllenAct Distributed ObjectNav tutorial, but sorry I can't really see what/how exactly should I modify the code -- it says "Note that this command is included in the configuration script below, so we don't need to run" -- but I don't know where/how exactly to "override ObjectNavRoboThorBaseConfig's THOR_COMMIT_ID to match the installed headless one"
THOR_COMMIT_ID = "91139c909576f3bf95a187c5b02c6fd455d06b48"
and "indicate that we're using headless THOR:"
THOR_IS_HEADLESS = True
I tried to change DEFAULT_THOR_IS_HEADLESS to True as you did but then I got another error relating to
Exception: Unity process has exited - check Player.log for errors. Confirm that Vulkan is properly configured on this system using vulkaninfo from the vulkan-utils package. returncode=-11
Could I get some help for this issue? Thanks!

Hi Yicong. I can help you find this variable -- for the regular (not zero-shot) RoboTHOR ObjectNav setting, you can find THOR_COMMIT_ID at L16 of projects/objectnav_baselines/experiments/robothor/objectnav_robothor_base.py . Please try to change this and see if you still encounter the issue!

Hello Apoorv, Thank you so much for your guide and your time.
But I ams still getting the same error when I change the line 😢

OSError: Could not find any open X-displays on which to run AI2-THOR processes.

@xuexidi I have the same issue as I want to run the code without display on a server, did you work it out? Sorry I am very new to the AI2-THOR codebase. I tried to follow the AllenAct Distributed ObjectNav tutorial, but sorry I can't really see what/how exactly should I modify the code -- it says

"Note that this command is included in the configuration script below, so we don't need to run."

-- but I don't know where/how exactly to

"Override ObjectNavRoboThorBaseConfig's THOR_COMMIT_ID to match the installed headless one"

THOR_COMMIT_ID = "91139c909576f3bf95a187c5b02c6fd455d06b48"
and

"Indicate that we're using headless THOR:"

THOR_IS_HEADLESS = True
I tried to change DEFAULT_THOR_IS_HEADLESS to True as you did but then I got another error relating to

Exception: Unity process has exited - check Player.log for errors. Confirm that Vulkan is properly configured on this system using vulkaninfo from the vulkan-utils package. returncode=-11

Could I get some help for this issue? Thanks!

I'm sorry for the delay reply, I am very new to the AI2-THOR codebase, too. I did not successfully run the headless mode of AI2THOR at that time （I tried the headless mode under zero-shot code）, so I moved all the experiments to Habitat 2020. If you have made new progress in the headless mode of AI2THOR, please also tell me, thank you!

Hello Apoorv, Thank you so much for your guide and your time. But I ams still getting the same error when I change the line 😢

OSError: Could not find any open X-displays on which to run AI2-THOR processes.

I meet the same issue...

Update: I got some progress after changing the THOR_COMMIT_ID in objectnav_robothor_base.py and set all headless options to True in embclip-allenact/projects/objectnav_baselines/experiments/objectnav_thor_base.py, it downloaded thro-CloudRendering and then it stucks there

[08/24 01:27:02 INFO:] Starting 0-th SingleProcessVectorSampledTasks generator with args {'mp_ctx': <multiprocessing.context.ForkServerContext object at 0x7fccb6bcb820>, 'scenes': ['FloorPlan_Train4_4', 'FloorPlan_Train6_2', 'FloorPlan_Train12_5', 'FloorPlan_Train5_3', 'FloorPlan_Train7_1', 'FloorPlan_Train3_5', 'FloorPlan_Train10_3', 'FloorPlan_Train2_2', 'FloorPlan_Train12_1', 'FloorPlan_Train11_2', 'FloorPlan_Train1_3', 'FloorPlan_Train3_1', 'FloorPlan_Train8_4', 'FloorPlan_Train9_3', 'FloorPlan_Train7_5', 'FloorPlan_Train10_1', 'FloorPlan_Train1_1', 'FloorPlan_Train8_2', 'FloorPlan_Train6_4', 'FloorPlan_Train5_5', 'FloorPlan_Train9_1', 'FloorPlan_Train7_3', 'FloorPlan_Train4_2', 'FloorPlan_Train10_5', 'FloorPlan_Train12_3', 'FloorPlan_Train2_4', 'FloorPlan_Train5_1', 'FloorPlan_Train1_5', 'FloorPlan_Train11_4', 'FloorPlan_Train3_3', 'FloorPlan_Train9_5', 'FloorPlan_Train8_1', 'FloorPlan_Train4_5', 'FloorPlan_Train6_3', 'FloorPlan_Train5_4', 'FloorPlan_Train7_2', 'FloorPlan_Train10_4', 'FloorPlan_Train4_1', 'FloorPlan_Train12_2', 'FloorPlan_Train2_3', 'FloorPlan_Train1_4', 'FloorPlan_Train11_3', 'FloorPlan_Train3_2', 'FloorPlan_Train8_5', 'FloorPlan_Train9_4', 'FloorPlan_Train10_2', 'FloorPlan_Train2_1', 'FloorPlan_Train11_1', 'FloorPlan_Train1_2', 'FloorPlan_Train8_3', 'FloorPlan_Train6_5', 'FloorPlan_Train9_2', 'FloorPlan_Train7_4', 'FloorPlan_Train4_3', 'FloorPlan_Train2_5', 'FloorPlan_Train12_4', 'FloorPlan_Train6_1', 'FloorPlan_Train11_5', 'FloorPlan_Train5_2', 'FloorPlan_Train3_4'], 'object_types': ('AlarmClock', 'Apple', 'BaseballBat', 'BasketBall', 'Bowl', 'GarbageCan', 'HousePlant', 'Laptop', 'Mug', 'SprayBottle', 'Television', 'Vase'), 'max_steps': 500, 'sensors': [<allenact_plugins.ithor_plugin.ithor_sensors.RGBSensorThor object at 0x7fcd620c7b20>, <allenact_plugins.ithor_plugin.ithor_sensors.GoalObjectTypeThorSensor object at 0x7fccb6bcb6d0>], 'action_space': Discrete(6), 'seed':<PHONE_NUMBER>, 'deterministic_cudnn': False, 'rewards_config': {'step_penalty': -0.01, 'goal_success_reward': 10.0, 'failed_stop_reward': 0.0, 'shaping_weight': 1.0}, 'env_args': {'width': 400, 'height': 300, 'commit_id': 'bdcefe04c17bef073ecfe3d90786e84740f7addf', 'stochastic': True, 'continuousMode': True, 'applyActionNoise': True, 'rotateStepDegrees': 30.0, 'visibilityDistance': 1.0, 'gridSize': 0.25, 'snapToGrid': False, 'agentMode': 'locobot', 'fieldOfView': 63.453048374758716, 'include_private_scenes': False, 'renderDepthImage': False, 'gpu_device': 7, 'platform': <class 'ai2thor.platform.CloudRendering'>}, 'scene_directory': '/trainman-mount/trainman-k8s-storage-c7d81357-8548-4847-8138-bb56b99fe9a5/project/embclip-allenact/datasets/robothor-objectnav/train', 'loop_dataset': True, 'allow_flipping': True, 'randomize_materials_in_training': False}  [vector_sampled_tasks.py: 1035]
thor-CloudRendering-22d62af5da45708e7bc40bf07a861e7397f9d2f9.zip: [|||||||||||||||||||||||||||||||||||||||||||||||||| 100%  27.8 MiB/s]  of 540.MB

Update: I got some progress after changing the THOR_COMMIT_ID in objectnav_robothor_base.py and set all headless options to True in embclip-allenact/projects/objectnav_baselines/experiments/objectnav_thor_base.py, it downloaded thro-CloudRendering and then it stucks there

[08/24 01:27:02 INFO:] Starting 0-th SingleProcessVectorSampledTasks generator with args {'mp_ctx': <multiprocessing.context.ForkServerContext object at 0x7fccb6bcb820>, 'scenes': ['FloorPlan_Train4_4', 'FloorPlan_Train6_2', 'FloorPlan_Train12_5', 'FloorPlan_Train5_3', 'FloorPlan_Train7_1', 'FloorPlan_Train3_5', 'FloorPlan_Train10_3', 'FloorPlan_Train2_2', 'FloorPlan_Train12_1', 'FloorPlan_Train11_2', 'FloorPlan_Train1_3', 'FloorPlan_Train3_1', 'FloorPlan_Train8_4', 'FloorPlan_Train9_3', 'FloorPlan_Train7_5', 'FloorPlan_Train10_1', 'FloorPlan_Train1_1', 'FloorPlan_Train8_2', 'FloorPlan_Train6_4', 'FloorPlan_Train5_5', 'FloorPlan_Train9_1', 'FloorPlan_Train7_3', 'FloorPlan_Train4_2', 'FloorPlan_Train10_5', 'FloorPlan_Train12_3', 'FloorPlan_Train2_4', 'FloorPlan_Train5_1', 'FloorPlan_Train1_5', 'FloorPlan_Train11_4', 'FloorPlan_Train3_3', 'FloorPlan_Train9_5', 'FloorPlan_Train8_1', 'FloorPlan_Train4_5', 'FloorPlan_Train6_3', 'FloorPlan_Train5_4', 'FloorPlan_Train7_2', 'FloorPlan_Train10_4', 'FloorPlan_Train4_1', 'FloorPlan_Train12_2', 'FloorPlan_Train2_3', 'FloorPlan_Train1_4', 'FloorPlan_Train11_3', 'FloorPlan_Train3_2', 'FloorPlan_Train8_5', 'FloorPlan_Train9_4', 'FloorPlan_Train10_2', 'FloorPlan_Train2_1', 'FloorPlan_Train11_1', 'FloorPlan_Train1_2', 'FloorPlan_Train8_3', 'FloorPlan_Train6_5', 'FloorPlan_Train9_2', 'FloorPlan_Train7_4', 'FloorPlan_Train4_3', 'FloorPlan_Train2_5', 'FloorPlan_Train12_4', 'FloorPlan_Train6_1', 'FloorPlan_Train11_5', 'FloorPlan_Train5_2', 'FloorPlan_Train3_4'], 'object_types': ('AlarmClock', 'Apple', 'BaseballBat', 'BasketBall', 'Bowl', 'GarbageCan', 'HousePlant', 'Laptop', 'Mug', 'SprayBottle', 'Television', 'Vase'), 'max_steps': 500, 'sensors': [<allenact_plugins.ithor_plugin.ithor_sensors.RGBSensorThor object at 0x7fcd620c7b20>, <allenact_plugins.ithor_plugin.ithor_sensors.GoalObjectTypeThorSensor object at 0x7fccb6bcb6d0>], 'action_space': Discrete(6), 'seed':<PHONE_NUMBER>, 'deterministic_cudnn': False, 'rewards_config': {'step_penalty': -0.01, 'goal_success_reward': 10.0, 'failed_stop_reward': 0.0, 'shaping_weight': 1.0}, 'env_args': {'width': 400, 'height': 300, 'commit_id': 'bdcefe04c17bef073ecfe3d90786e84740f7addf', 'stochastic': True, 'continuousMode': True, 'applyActionNoise': True, 'rotateStepDegrees': 30.0, 'visibilityDistance': 1.0, 'gridSize': 0.25, 'snapToGrid': False, 'agentMode': 'locobot', 'fieldOfView': 63.453048374758716, 'include_private_scenes': False, 'renderDepthImage': False, 'gpu_device': 7, 'platform': <class 'ai2thor.platform.CloudRendering'>}, 'scene_directory': '/trainman-mount/trainman-k8s-storage-c7d81357-8548-4847-8138-bb56b99fe9a5/project/embclip-allenact/datasets/robothor-objectnav/train', 'loop_dataset': True, 'allow_flipping': True, 'randomize_materials_in_training': False}  [vector_sampled_tasks.py: 1035]
thor-CloudRendering-22d62af5da45708e7bc40bf07a861e7397f9d2f9.zip: [|||||||||||||||||||||||||||||||||||||||||||||||||| 100%  27.8 MiB/s]  of 540.MB

Same situation. at this time, check whether the CPU utilization rate is nearly 0%? I guess it's the wrong setting that causes the program process to jam.

After some tracing, I found the code hangs here https://github.com/allenai/embodied-clip/blob/855fe741ddecaaf2492966d52d3f130e58d3c48f/allenact/algorithms/onpolicy_sync/vector_sampled_tasks.py#L212, which I guess it is still related to rendering views.

OSError: Could not find any open X-displays on which to run AI2-THOR processes

You're going to need to also start x-displays. Please see more details here.
sudo python scripts/startx.py &

Hello Apoorv,
Thanks for keep tracing this issue for us. Yesterday I was hoping to run the code without X-display at all because enabling X-display is really a pain on my servers, but it seems that it is very hard to find a way around.
Today I finally enabled the X-display on my machine, now I come back to re-run the code but now it hangs at a different place with my keyboard irresponsive in the terminal and 100% CPU utilization

(embclip-allenact) yhong@ip-10-216-180-104:~/test_projects/embclip-allenact$ PYTHONPATH=. python allenact/main.py -o storage/objectnav-robothor-rgb-clip-rn50 -b projects/objectnav_baselines/experiments/robothor/clip objectnav_robothor_rgb_clipresnet50gru_ddppo
[08/24 22:33:52 INFO:] Running with args Namespace(approx_ckpt_step_interval=None, approx_ckpt_steps_count=None, checkpoint=None, collect_valid_results=False, config_kwargs=None, deterministic_agents=False, deterministic_cudnn=False, disable_config_saving=False, disable_tensorboard=False, distributed_ip_and_port='<IP_ADDRESS>:0', eval=False, experiment='objectnav_robothor_rgb_clipresnet50gru_ddppo', experiment_base='projects/objectnav_baselines/experiments/robothor/clip', extra_tag='', infer_output_dir=False, log_level='info', machine_id=0, max_sampler_processes_per_worker=None, output_dir='storage/objectnav-robothor-rgb-clip-rn50', restart_pipeline=False, save_dir_fmt=<SaveDirFormat.FLAT: 'FLAT'>, seed=None, skip_checkpoints=0, test_date=None, test_expert=False)     [main.py: 420]
[08/24 22:33:56 INFO:] Git diff saved to storage/objectnav-robothor-rgb-clip-rn50/used_configs/ObjectNav-RoboTHOR-RGB-ClipResNet50GRU-DDPPO/2022-08-24_22-33-56    [runner.py: 754]
[08/24 22:33:56 INFO:] Config files saved to storage/objectnav-robothor-rgb-clip-rn50/used_configs/ObjectNav-RoboTHOR-RGB-ClipResNet50GRU-DDPPO/2022-08-24_22-33-56        [runner.py: 798]
[08/24 22:33:56 INFO:] Using 1 train workers on devices (device(type='cuda', index=7),) [runner.py: 239]

Will keep trying to run the code. Cheers.

Ok I finally get it running, the issue is from my side, should be pretty easy with x-display enabled. 😅
Thanks angain Apoorv for sharing this wonderful code and easy installation, will start building my work based on your paper. Cheers!

Glad you were able to get training working! I will add details about AllenAct headless mode to my instructions :) Looking forward to seeing your work.


Video does not play were I left off ..plays from first

Your library is really good it works fine ..ya thanks for creating this library it saved lot of time for me ...but I have a 2 issue 1) is video shows black screen while scrolling 2)video does not resume when scroll down and  when come back it starts again from first  can u tell me how can I do this

video shows black screen while scrolling I fixed that issue by placing image in video view and load image from firebase ..when video starts playing I set image.visiblitiy to Gone it worked ..but I don't know 2) issue please help

@thealpha Container doesn't save/restore playback info by default, this is intended. You can enable it by calling container.setCacheManager(CacheManager.DEFAULT). It will work most of the time (if you have custom caching logic, you need to provide custom CacheManager as well). About issue 1, yes current work around is to put an Image view as thumbnail and show/hide it at certain timing.

should I initialize this method in    @Override
public void initialize(@NonNull Container container, @Nullable PlaybackInfo playbackInfo) {
if (helper == null) {
helper = new SimpleExoPlayerViewHelper(container, this, mediaUri);
}
helper.initialize(playbackInfo);
container.setCacheManager(CacheManager.DEFAULT)
RequestOptions requestOptions = new RequestOptions()
.placeholder(R.color.black);
Glide.with(mContext)
.setDefaultRequestOptions(requestOptions)
.load(mediaUri)
.into(thumb);
}

thanks a lot it worked

@thealpha You should call container.setCacheManager(CacheManager.DEFAULT) in your Activity/Fragment, not in your ViewHolder, and just need to call once.

ya it worked ..thanks man..


workflows: set GITHUB_TOKEN for gh usage

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.
[ ] Have you successfully run brew style with your changes locally?
[ ] Have you successfully run brew typecheck with your changes locally?

Review period skipped due to critical label.


goocanvas2: fix build with gcc-14

Closes https://github.com/NixOS/nixpkgs/issues/369621
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

@GrahamcOfBorg build gpredict

https://github.com/NixOS/nixpkgs/pull/369348


Created lib/domains/es/euncet.txt

Created euncet.txt for domain http://www.euncet.es
Can you merge this pr?
Thanks

Created euncet.txt for domain http://www.euncet.es
Can you merge this pr?
Thanks

@kardona please excuse our delay with replying you. I see that you've merged other requests from original repository. Please make a separate new request with euncet.es - we check the domains manually so we won't be able to check all 1900 pulls. Thanks.

Thanks @zweizwei !
I've just pushed another pull request to do it well.
https://github.com/JetBrains/swot/pull/1362
Thanks.


After Rebalancing Consumers Offset go back

Description
When we scale consumers up  Rebalancing started. And 1 partition suddenly has 60k lag. And It has data from 3 day ago. There was not any lag until rebalancing.
We write a Wrapper DI library with confluent kafka in company. We consume and process as batch. Normally in production our RPM was 30k and 80 ms Response Time with 20 pod. But now RPM is 4M with 20 pod instance.  It works perfectly. But This issue happened twice in month. Normally There is no any lag.
If consumer could not commit, the lag would increase and we would see this. It happened after rebalancing.
BatchSize: 200
Concurrency: 25
Partition 60
Our Config:
var consumerConfig = new ConsumerConfig
            {
                BootstrapServers = servers,
                GroupId = groupId,
                EnableAutoCommit = true,
                EnableAutoOffsetStore = false,
                AutoOffsetReset = AutoOffsetReset.Latest
            };

 public static IReadOnlyCollection<ConsumeResult<TKey, TValue>> ConsumeBatch<TKey, TValue>(this IConsumer<TKey, TValue> consumer,CancellationToken cancellationToken,  int maxBatchSize)
            {
                var message = consumer.Consume(cancellationToken);

                if (message?.Message is null)
                    return Array.Empty<ConsumeResult<TKey, TValue>>();

                var messageBatch = new List<ConsumeResult<TKey, TValue>> { message };

                while (messageBatch.Count < maxBatchSize)
                {
                    message = consumer.Consume(TimeSpan.Zero);
                    if (message?.Message is null)
                        break;

                    messageBatch.Add(message);
                }

                return messageBatch;
            }

while (!token.IsCancellationRequested)
                {
                    try
                    {
                        var results = _consumer.ConsumeBatch(token,_kafkaConfiguration.BatchSize);
                        var taskList = results.Select(message => Process(message, provider, logger, token)).ToList();

                        var totalPages = (int)Math.Ceiling((decimal)taskList.Count / (decimal)_kafkaConfiguration.Concurrency);

                        for (var i = 0; i < totalPages; i++)
                        {
                            await Task.WhenAll(taskList
                                .Skip(i * _kafkaConfiguration.Concurrency)
                                .Take(_kafkaConfiguration.Concurrency));
                        }

                        _consumer.StoreOffset(results.Last());
                    }
                    catch (Exception e)
                    {
                        logger.LogError($"[ERROR]  Consumer error  . Topic : {_kafkaConfiguration.Topics.FirstOrDefault()} Error: {e}");
                    }

Checklist
Please provide the following information:

[1.7.0 ] Confluent.Kafka nuget version.

may be related with AutoCommitIntervalMs. when you store offset using StoreOffset function, kafka clients commits periodically using AutoCommitIntervalMs.
you can override SetPartitionsRevokedHandler callback method, in this method you can use Commit function to commit last offset immediately

But this is the problem actually. if consumer could not commit, the lag would increase and we would see this. Committing is okey I think. After Rebalancing AutoOffsetReset acting like earliest . And This is not happing always. Randomly
There is another issue like this. We update version to 1.8.0. We hope that fixed
#1672

this seems like #1672 - closing in favor of that. we're currently investigating it.


whereNotNull  does not work

Laravel Version: 8.83
PHP Version: 8.0.10
Database Driver & Version: mysql8

Description:
whereNotNull    does not work

Steps To Reproduce:

Probably does into your if statement because $type equals 1.

In fact, it has nothing to do with tpye

In fact, it has nothing to do with type

Are you absolutely sure?

In fact, it has nothing to do with type

Are you absolutely sure? try dd($searchType)

I am sure ~

In fact, it has nothing to do with type

Are you absolutely sure? try dd($searchType)

sorry
My code is wrong
thank you


[Feature] add data structure comment

Verify steps

[X]  我已经在 Issue Tracker 中找过我要提出的请求 I have searched on the Issue Tracker for a related feature request.
[X]  我已经仔细看过 Documentation 并无法自行解决问题 I have read the Documentation and was unable to solve the issue.

Description
Wishing there was a data structure comment that uses in the code inserts before the document.
suck like this in problem 25.reverse nodes in k-group
/**
 * Definition for singly-linked list.
 * function ListNode(val, next) {
 *     this.val = (val===undefined ? 0 : val)
 *     this.next = (next===undefined ? null : next)
 * }
 */

Possible Solution
No response

Thank you for opening this!
These comments are deleted intentionally by removeUselessComments modifiers, if you need them, you can remove removeUselessComments from code.modifiers in your config file(located in ~/.config/leetgo/config.yaml).

Thanks! It works!


Automate closing of scheduled workflows

🚀 The feature
We need to currently close the Issues raised by our automated tests for datasets manually.
https://github.com/pytorch/vision/issues?q=is%3Aissue+is%3Aopen+Scheduled+workflow+failed ?
Sometimes they get bunched up or we forget to close them.
Motivation
The cronjob runs daily. So ideally we should be closing the issue the next day if it doesn't fail. (If it does fail anyway another issue is created).
I propose a simple GitHub action that closes only this issue once the issue gets stale by 3 days. The logic is that if the issue is open for 3 days.

Everything is working fine and hence we don't have a problem to close it. (It was one off error)
There is another issue which is newer that supersedes this old issue.

So we should be fine closing it.
Pitch
I think a simple GitHub action can do this job. Would need to investigate but think that technically it's very much possible.
Additional context
I don't propose to extend this functionality to close all stale issues. An issue is well documented user feedback which is very valuable indeed. An old issue can be gem of resource for someone and keeping it open doesn't harm.
But for bot issues :( It isn't nice to be flooded with them being open :(
Some references
https://github.com/marketplace/actions/close-stale-issues
cc @pmeier @seemethere

This seems like a cool idea. Given that they currently only spamming me, I don't think this is urgent. But if you (or someone else) wants to look into this, I would be happy to review a PR.

Good idea, thanks @oke-aditya
Alternatively, if we have a lot of one-off, we can also decide to only open an issue if the download fails twice (or thrice) in a row

It's actually rare to have lot of one-off. Also, while downloading and testing we do 5 retries I think?

I'm tempted to fix this. I really don't like

Lot at my plate in the office and at stuff. Will tackle this next. Especially I felt, sad that these issues annoyed phillip during his well deserved break.

I think if we determine a server to be down there are two ways forward:

Disable the download test like I did in #6389.
Remove the download functionality from the dataset, which in turn also stops the issues.

My goto strategy is to do 1. first and wait for 2. until the next release. If the server comes back up, we simply reactivate the test. Otherwise we want to disable the download option to avoid more issues coming from users. Of course we don't just need to wait for the authors to fix the issue, but can actively notify them.


(Fix) Use web3 HttpProvider in dev environment

Depends on #324.
If web3 is not injected and you are in the development environment (using npm start), try to connect directly to testrpc (localhost:8545).
I think this can be very useful during development, since the transactions are submitted automatically.

@15chrjef Change applied.


Add warning for set-touch xxx fixed

In the Require touch section, it would be good to either add a warning about not being able to disable the touch requirement if fixed is used or change the default to on. It would also be beneficial to tell users to run ykman openpgp set-touch -h to see what other options there are depending on their use-case.
A lot of people will probably run that command without reading the help page expecting that they would be able to change it later if needed (like me). The current state would put them in a frustrating situation where they have to reset the slot and go through the process of importing the keys again or continue using it as-is even though it might be a huge hassle.

I feel like some explanation is necessary for why this is such a pain point for me. I recently set up OfflineIMAP and my passwords are encrypted with my GPG key. When OfflineIMAP syncs with my mail providers, it does so incrementally and I have to touch my YubiKey every second or two while it goes through my 20-odd accounts. I then have to repeat this the next time it syncs. My systemd timer is currently set to run the program every hour but I would really rather have it run every 15-20 minutes to get emails in a more timely manner. However, requiring interaction every few seconds every 15 minutes is ridiculous.
I'm going to reset the slot and configure it with cached but I opened the issue so that future users are less likely to run into the same problem.

I'll try to open a PR this evening if I have time :+1:

Thanks for the update!


document opening is very slow

Issue Type: Performance Issue
I am running vscode on Ubuntu, but if I open documents it is very slow. I do not think this is a harddrive issue, as there is almost no disk activity. CPU usage is almost at 45%. I hava an older i7 in my thinkpad (T520) but I do not think the CPU should be the problem here.
I hope you can help me make this better!
VS Code version: Code 1.26.1 (493869ee8e8a846b0855873886fc79d480d342de, 2018-08-16T18:34:20.517Z)
OS version: Linux x64 4.15.0-33-generic

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-2620M CPU @ 2.70GHz (4 x 2999)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: disabled_softwarevideo_decode: unavailable_softwarevideo_encode: unavailable_softwarewebgl: enabledwebgl2: enabled

Load (avg)
1, 1, 1

Memory (System)
11.62GB (2.09GB free)

Process Argv
/snap/vscode/51/usr/share/code/code

Screen Reader
no

VM
0%

Process Info
CPU %	Mem MB	   PID	Process
    3	   131	  2983	code main
    0	    36	  2985	   zygote
    4	   488	  3146	     window (● Startup.cs - AdaFrontend - Visual Studio Code)
    0	     0	  3243	       /bin/bash
    0	    59	  3259	       searchService
    0	   119	  3264	       extensionHost
    0	    59	  3293	         searchService
    0	     0	  3324	         bash /home/olaf/.vscode/extensions/ms-vscode.csharp-1.15.2/.omnisharp/1.30.1/run -s /home/olaf/git/ada/AdaFrontend --hostPID 3264 --stdio DotNet:enablePackageRestore=false --encoding utf-8 --loglevel information formattingOptions:useTabs=false formattingOptions:tabSize=4 formattingOptions:indentationSize=4
    0	   357	  3332	           /home/olaf/.vscode/extensions/ms-vscode.csharp-1.15.2/.omnisharp/1.30.1/bin/mono.linux-x86_64 /home/olaf/.vscode/extensions/ms-vscode.csharp-1.15.2/.omnisharp/1.30.1/omnisharp/OmniSharp.exe -s /home/olaf/git/ada/AdaFrontend --hostPID 3264 --stdio DotNet:enablePackageRestore=false --encoding utf-8 --loglevel information formattingOptions:useTabs=false formattingOptions:tabSize=4 formattingOptions:indentationSize=4
    0	    59	  8507	         electron_node jsonServerMain.js
    0	   155	 15843	         electron_node electronForkStart.js tsserver.js
    0	    83	 15848	           electron_node typingsInstaller.js tsserver.js typesMap.js
    0	    71	  3280	       watcherService
    0	   119	  3178	     shared-process
    1	   107	 17947	     window (Issue Reporter)
    4	   143	  3131	   gpu-process
    0	     0	 17965	   /bin/sh -c /bin/ps -ax -o pid=,ppid=,pcpu=,pmem=,command=
    0	     0	 17966	     /bin/ps -ax -o pid=,ppid=,pcpu=,pmem=,command=

Workspace Info
|  Window (● Startup.cs - AdaFrontend - Visual Studio Code)
|    Folder (AdaFrontend): 861 files
|      File types: dll(645) json(49) pdb(24) cache(24) js(19) so(18) ts(13)
|                  cs(10) svg(8) html(6)
|      Conf files: package.json(4) tsconfig.json(4) csproj(1)
|                  webpack.config.js(1) launch.json(1) tasks.json(1)
|      Launch Configs: coreclr(4);

Extensions (4)

Extension
Author (truncated)
Version

vscode-npm-script
eg2
0.3.5

vscode-npm
fkn
3.3.0

dotnet-core-essentials
Kis
0.0.5

csharp
ms-
1.15.2

@olijf the attached performance trace doesn't show any high CPU usage for VS Code. Can you do the following:

open Help > Process Explorer
open the document and record which processes cause high CPU load.

And does it reproduce if you disable all extensions (e.g. start vscode from the terminal and pass --disable-extensions

Hi Dirk,
I figured it out, I had several extensions running, but not very high cpu usage, however when I disabled almost all and enabled them one by one I found that everything was quicker and more responsive. When it took 4 seconds to open 1 *.cs file I figured which was the process that was making everything slow. I have disabled that extension for now. Thanks for pointing me in the right direction.
You can close this for now.


Replace train! with a custom loop

The current requirement to zip inputs X and targets y in the data object required by MLJFlux.train! is a deal breaker as far as implementing the new data front-end provided by MLJ. Moreover, a discussion on slack has revealed no clear performance reason for zipping the X and y.
So, with implementing a new data front-end in mind, I propose we refactor MLJFlux.fit! as follows:

Write and test a customised version of Flux.train!(loss_func, Flux.params(chain), data, optimiser) with new signature train!(loss_func, Flux.params(chain), optimiser, X, y). Here X is a vector of arrays - one array for each input observation - where the last dimension of the array corresponds to batches. The same for y, but this is for target observations. Basically, this is the unzipped version of the status quo.

Change the signature of MLJFlux.fit! accordingly, from

fit!(chain, optimiser, loss, epochs, lambda, alpha, verbosity, data, acceleration)

to
fit!(chain, optimiser, loss, epochs, lambda, alpha, verbosity, acceleration, X, y)

Refactor the collate method to spit out X, y in the form above, rather than the zipped version (easy). This function essentially becomes the refactor methods for the new data font-end - but let's leave that discussion for another issue.

@ayush-1506 You interested in this?

Sure, will pick this up.


Add cloudron to img-src CSP

As title, it's currently broken.

Ughhh, https://cloudron.io/img/button.svg redirects to https://www.cloudron.io/img/button.svg, so it's still busted. 😓
I'm not overly familiar with CSP directives, would https://*.cloudron.io work, or would it need to be *.cloudron.io? Or is it better to just also add https://www.cloudron.io?


falco-0-26-1.md file translate Chinese

falco-0-26-1.md file translate Chinese
Signed-off-by: tianying<EMAIL_ADDRESS>

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: cytianying
To complete the pull request process, please assign jasondellaluce after the PR has been reviewed.
You can assign the PR to them by writing /assign @jasondellaluce in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


[stable/spotify-docker-gc] add ability to define resources on container in daemonset

What this PR does / why we need it:
Currently the spotify-docker-gc chart does not allow us to define the resource requests and limits on the container defined in the daemonset. It is currently considered best practice to define resource requests and limits [1]. This PR adds the ability to set the values if an operator chooses to do so.
References:

https://cloudplatform.googleblog.com/2018/05/Kubernetes-best-practices-Resource-requests-and-limits.html

cc: @vdice

/assign @mgoodness

hi @mgoodness @foxish @unguiculus would greatly appreciate if you can review or refer me to someone else who has bandwidth to review

hey @unguiculus  we would like to get this update deployed on our Kubernetes clusters as well. We're trying to keep a tight control over the resource usage on our clusters and this is the last helm chart that is holding out that doesn't have support for it

@mgoodness @foxish @unguiculus  ^^ this.  It would be nice to not have to fork this chart to be able to set resource limits.

/ok-to-test
/assign

/lgtm
thanks for the PR!

thanks @davidkarlsen !!


Flashcopy support

Basic design

New services to import, query, and delete flashcopy sources stored in a new sqlite table
Flashcopy sources consist of a userid/device address pair to identify the source of the flashcopy operation
Modify the guest_deploy service to check if a flashcopy source exists for the image. If so, use the flash copy as the source rather than unpackdiskimage.

To use flashcopy, create an image by calling the import API.  This doesn't actually import anything.  Instead it is defining a relationship between an image name and an existing disk.  For example, in our environment we have disk LNXEC34I.2770 that has an installation of RHEL7.7 on it.  So, we have a flash image "rhel77" associated with id LNXEC34I and vdev 2770.  Then on a deploy of the "rhel77" image, it will flashcopy from LNXEC34I.2770 to the target DASD instead of using unpackdiskimage.
Yes, this PR only handles the same size flashcopy.  However, handling increasing the disk size might be straightforward.  The flashcopy operation takes beginning and ending cylinders.  In the current code, it's "0 END" for both source and target.  If the target is larger, we can specify something like "FLASHCOPY $src_vdev 0 10015 $tgt_vdev 0 10015".  Then it seems the logic in unpackdiskimage to extend might be able to work from there?
I apologize, but I'm not sure how to run pep8.  Any chance you have information on how to do that?  As far as unit tests I've run my own unit tests already, but I'm guessing you're talking about those in zvmsdk/tests/unit?  Are there instructions on how those are setup and how to run them?
Thanks!

@jasealpers run
tox -e pep8
tox -e py27
at your python-zvm-sdk folder to run pep8 (python grammar) and unit test respectively

ok, now I understand the purpose ,so it should be something like

create a flash image , just like we did to create a non-FLASHCOPY image
through the API you defined, create db record about the image
start deploy and it will find it has a record for flashcopy then it will go to flashcopy route and
do the FLASHCOPY command instead of dd
same size is ok then if it's different size, the resize2fs or something like that will do the partition and file system update, correct?

@bjhuangr @dongyanyang @SeanHQF FYI, this is a very important thing will be helpful to us
if you have any comments, please add, thanks

close the inactive PR


Cosmos Spark End to End Integration Test against Cosmos Emulator runs in CI

implemented in https://github.com/Azure/azure-sdk-for-java/pull/17952


Sidebar lag on collapse

Discover why the sidebar lags when we open and close it.

Use this as reference: https://github.com/skyscope-app/skyscope-web/blob/main/src/app/[locale]/(map)/_components/page-shell.tsx


Change the Thumbnail when sharing dashboards

Is your feature request related to a problem? Please describe.
Sharing dashboards internally, every time the Rill Data dashboard is shown, any way to customize this?
Describe the solution you'd like
Either 1) shorter graph/dashboard icon or 2) something so it's more apparent what's in the link. Like a low res version of a rill dashboard
Additional context
FR from Angel:
https://rilldata.slack.com/archives/C07KSF2DPPV/p1725657045034699

@ericpgreen2 any chance we could squeeze in the change of our unfurl preview images in this upcoming sprint?

@ericpgreen2 any chance we could squeeze in the change of our unfurl preview images in this upcoming sprint?

I'll defer to @jkhwu :). This actually doesn't require any Application changes. Once we have the new image, we just need to overwrite rill-admin.png referenced here:
<meta
  property="og:image"
  content="https://storage.googleapis.com/prod-cdn.rilldata.com/images/rill-admin.png"
/>


Maixpy Load error 2: ERR KMODEL VERSION: only supported kmodel v3/v4 now

Hi, this is the error I get when I try to run my detectors (both the custom detectors and the ones in the Yolo example). The only models that I was able to make work are the Smodels generated by the Maixhub. I tried many versions with the same results, here you can see a screen while I was running the script boot.py with the firmware   v0.5.0_31

Hi! Well, first thing I can see is that you need to set the outputs of the model, as in this example :)
https://github.com/AIWintermuteAI/aXeleRate/blob/bb7f3deda509d7f310b231fa9a39d0b529eb35f5/example_scripts/k210/detector/racoon_detector.py#L14
Let's see if it solves the problem or gives us a better clue

a = kpu.set_outputs(task, 0, 7,7,30) #the actual shape needs to match the last layer shape of your model(before Reshape)

Unfortunately, I got the same result

I tried to modify the final layer shape with mine (0,7,7,125) but it gave me the same result, the program does not even get there, it stops at the model loading

Alright, just to give some updates I tried to run my model (created with the notebook) inside the sample script for the 20 classes yolo demo, of course changing the parameters to fit my model and I got the kpu load error 6: memory not enough

You closed the issue? Have you found the solution? If you did, can you describe it here, it will help other people to solve similar problems in the future :)

Sure, I was going to do that but I encountered some other issues (running the model it was not detecting any object, despite the Colab testing was working well, do not know why).
Anyway, this is the code that worked for me at least to run the script without system errors:
`#refer to http://blog.sipeed.com/p/677.html
import sensor,image,lcd,time
import KPU as kpu
lcd.init(freq=15000000)
sensor.reset()
sensor.set_pixformat(sensor.RGB565)
sensor.set_framesize(sensor.QVGA)
sensor.set_vflip(1)
sensor.run(1)
clock = time.clock()
classes = ["person", "bird", "cat", "cow", "dog", "horse", "sheep", "aeroplane", "bicycle", "boat", "bus", "car", "motorbike", "train","bottle", "chair", "diningtable", "pottedplant", "sofa", "tvmonitor"]
task = kpu.load(0x500000)
a = kpu.set_outputs(task, 0, 7,7,125)
anchor = (0.57273, 0.677385, 1.87446, 2.06253, 3.33843, 5.47434, 7.88282, 3.52778, 9.77052, 9.16828)
a = kpu.init_yolo2(task, 0.3, 0.3, 5, anchor)
while(True):
clock.tick()
img = sensor.snapshot()
code = kpu.run_yolo2(task, img)
print(clock.fps())
if code:
for i in code:
a=img.draw_rectangle(i.rect())
a = lcd.display(img)
for i in code:
lcd.draw_string(i.x(), i.y(), classes[i.classid()], lcd.RED, lcd.WHITE)
lcd.draw_string(i.x(), i.y()+12, '%.3f'%i.value(), lcd.RED, lcd.WHITE)
else:
a = lcd.display(img)
a = kpu.deinit(task)`
If you have my same issue and get the memory error or the Kmodel version error, use a minimum firmware version with the IDE support (5.0_31 worked for me) and remember to press the reset button between one try and the successive one.

What is your model architecture? Mobilenet7_5 or Mobilenet 1_0?
I can have a look at the colab notebooks, if you're okay with that. You can add me on LinkedIn and share privately if sharing here is not okay.

Thank you very much for your help, I really appreciate.
I'm using directly your example (detection) with the Pascal Voc dataset, I have not changed anything (I trained for 100 epochs as standard in the notebook). The architecture is Mobilenet 1_0 just to be sure here is the notebook:
https://colab.research.google.com/github/AIWintermuteAI/aXeleRate/blob/master/resources/aXeleRate_pascal20_detector.ipynb
I'm able to run with the code you can see in the previous message, but it does not detect anything, also if I open the serial terminal while the code is running it continuously prints numbers from 7 to 9 with 6 decimals. As I said the model seems to work when I test it using the last cell of your notebook in Coolab.
Its probably something that I'm forgetting because I'm a newbie.

Have you reached any conclusion ?? I'm having the same mistakes.


feat: add repository labels pagination

fix #2902

I didn't manage to test it though

@rnystrom @jdisho @BasThomas

Guys, can we this merge ASAP, since it's causing counter behaviour for repositories having 100+ labels ?!


Template?

Is there a way to create a common template that all examples will be nested inside of?  My issue is that I have a component somewhere in the tree do a setContext command to set a theme file and then my individual components do a getContext to pull in the theme I'd like to not have every example repeat  ...

Currently no.  I will implement it in future version, I think.

Currently no.  I will implement it in future version, I think.

Can I help?

Can I help?

Thanks, will see when I'll start reworking.

Thanks, will see when I'll start reworking.


Trigger run

Right, I guess you can't download artifacts from a separate workflow using actions/download-artifact.


Add support for WebSocket protocol extensions

As a part of the support for WebSocket extensions, this pull request includes:

Augment the ProtocolHandlerFactory protocol to support protocol extensions
Return the right headers after negotiations
Adding the extension handlers to the channel pipeline

Codecov Report

Merging #174 into master will decrease coverage by 0.36%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master     #174      +/-   ##
==========================================
- Coverage   68.64%   68.27%   -0.37%
==========================================
  Files          20       20
  Lines        1298     1305       +7
==========================================
  Hits          891      891
- Misses        407      414       +7

Flag
Coverage Δ

#KituraNet
68.27% <0%> (-0.37%)
:arrow_down:

Impacted Files
Coverage Δ

Sources/KituraNet/ConnectionUpgrader.swift
25% <ø> (ø)
:arrow_up:

Sources/KituraNet/HTTP/HTTPServer.swift
54.59% <0%> (-2.03%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a54fffe...e0a2ed5. Read the comment docs.


Random (?) crash

Seems to happen whenever bot has been open for a while.
Unhandled Exception:
System.InvalidOperationException: The task has already completed
  at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.SetResult () [0x00000] in <filename unknown>:0
  at Discord.Net.WebSockets.VoiceSocket+<ProcessMessage>d__55.MoveNext () [0x00000] in <filename unknown>:0
  at (wrapper unbox) Discord.Net.WebSockets.VoiceSocket/<ProcessMessage>d__55:MoveNext ()
  at System.Threading.Tasks.AwaiterActionContinuation.Execute () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.ProcessCompleteDelegates () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.Finish () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.<Delay>m__1 (System.Object state) [0x00000] in <filename unknown>:0
  at System.Threading.Timer+Scheduler.TimerCB (System.Object o) [0x00000] in <filename unknown>:0

It has happened twice now, once I wasn't at my computer, the other time was for seemingly no reason.

I believe it has something to do with music, the crashes only seem to occur if music has been played since the bot was last started.

First time i see this.

Is this error still occuring?

I haven't updated NadekoBot since before, but yes it occurs very frequently on whatever version I'm using, have it setup to restart every time it crashes ;) Will update and test again probably tomorrow.

Just updated to latest version, and still got this error
Unhandled Exception:
System.InvalidOperationException: The task has already completed
  at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.SetResult () [0x00000] in <filename unknown>:0
  at Discord.Net.WebSockets.VoiceSocket+<ProcessMessage>d__55.MoveNext () [0x00000] in <filename unknown>:0
  at (wrapper unbox) Discord.Net.WebSockets.VoiceSocket/<ProcessMessage>d__55:MoveNext ()
  at System.Threading.Tasks.AwaiterActionContinuation.Execute () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.ProcessCompleteDelegates () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.Finish () [0x00000] in <filename unknown>:0
  at System.Threading.Tasks.Task.<Delay>m__1 (System.Object state) [0x00000] in <filename unknown>:0
  at System.Threading.Timer+Scheduler.TimerCB (System.Object o) [0x00000] in <filename unknown>:0

this time it was right after queueing a song that returned
>>Command !m q
Failed resolving the link.Exception of type 'VideoLibrary.Exceptions.BadQueryException' was thrown

while it was playing another song. Not sure if that had anything to do with it.

nvm, its unrelated to the second thing there, did it a second time and it just crashes randomly, not when someone queues broken things. However it only seems to crash while playing music.

Running it on Ubuntu 14.04 Server if that helps.

I'm still confused as to why is this happening. The error itself doesn't show anything that can be of use >.>

I really don't think this is a bot issue since nobody else reported it. Try hosting it on a VPS or another linux machine.


Clumping of items with Bootstrap 4

JS Fiddle
In order to stay relevant Filterizr needs to work well with upcoming Bootstrap 4 - the dominating frontend framework.
Bootstrap 4 is major rework of framework. Much changing here.
Me tried to implement Filterizr in Bootstrap 4 alpha v6.
Unfortunately no longer working: Items clump up - forming irregular heaps, instead of evenly distributed grid. Filterizr does not position them correctly anymore.
This is issue with Filterizr + Bootstrap 4, as equivalent example works right in Bootstrap 3.
Good to know: The clumped mess, can be made into intended grid structure on "shuffle".
Yet: Just attaching shuffle at the end of filtering process no solution - as clumping still occurs, yet at lower frequency. It appears shuffle process sometimes not finishing. Shuffle callback not reached, see console log for missing "shuffling ended" message.
JS Fiddle
Instructions:

You may want to use different dimensions of HTML window.
Just hit the filter buttons several times to reproduce issue.
When clumped use shuffle to unclump to get and idea of what is meant.

NOTE: I changed line 85 of jquery.filterizr.js: self.slector -> self to make work good with jqery 3,
as suggested here: other issue

Update: After thorough testing I found the issue to be with jQuery version versus Bootstrap.
jquery 1 % 2 working fine, jquery 3 causing issue here.
This good to know: Best to explain dependencies on filterizr info page.

Unfortunately, I'm in the same boat.  Filterizr is awesome and I would love to use it.  However, until it catches up with the latest JQuery/Bootstrap technologies I have to pursue other options.  Suggestions for alternatives would be appreciated.

@martian-warlord Filterizr now supports the latest jQuery versions


Optimize / Improve Dask Backend

Re-engineer the data backend organization and plot implementations to work optimally with Dask, in order to optimize user experience by
decreasing lag time for initial data load,
decreasing lag time for adding/removing columns, and for executing queries, and
ensuring that scaling to larger datasets (e.g., ~100 tracts) can be accomplished simply by providing a larger dask cluster

This refactor is represented in the kartothek partitioning.  There are still issues around holoviews interacting with a persisted dask Dataframe, but we should break those out into other issues.


Adds drift and import support to the provider

Adds drift and import support to the provider.
Ref: LOG-7824
Semver: Patch

closing in favor of #23


Update neus.py

#this make sure it will be saved after training, if not, when execute test scripts  by setting '--test', this hyperparameter will be set to zero, Which will cause significant drops in performance. When testing ,on_predict_batch_start will set cos_anneal_ratio to zero, because self.current_epoch  equals to zero at the beginning.

This pull request is to deal with the bugs mentioned in #120 .

Thanks for this change, it's very helpful!


Adding RFC2307 (openLDAP/Posix) style LDAP group memberships

OpenLDAP servers (or maybe other Non-AD Servers as well), predominately used in Unix/Linux environments may not have the memberOf overlay configured and rely on RFC2307 style group memberships, where an extra query is required to resolve the username or uid against the memberUid attributes of the group. With this PR I'd like to add support these kinds of group memberships.
For this I added the following config values to the .env:

LDAP_GROUP_STYLE which has to be set to RFC2307 to activate posix groups. Any other value will default to AD/memberOf behavior
LDAP_GROUP_BASE_DN which is the base for the groups to be searched
LDAP_GROUP_MEMBER_ATTRIBUTE which is the group attribute the username/uid is matched against. Defaults to memberUid
LDAP_GROUP_FILTER is a filter for the group search, that defaults to (&(objectClass=posixGroup))

Thanks for offering this @bennet0496, but I'm not really keen to expand the scope of the what we maintain/support here without some decent proven user-base need to avoid a continuously growing maintenance & support scope for auth. And since there's been no significant prior request for this so far, I feel the demand for this will be quite minor.

I get that concern. And I can't really speak in the commonality of running openLDAP this way, I just can say that it basically is the default, as it requires a bit of extra setup to get it running with the memberOf attribute, and once you have it running one way it is not trivial just switching to the other. This is the reason, that where I work, we have run Bookstack with with a similar hack since about 3 years ago (and little to no changes to it since then) where we started using it. I basically just cleaned up the code a little to make it fit better into the code base.
But I also totally get that you may not want to add more complexity for potentially a single installation. I and we would just appreciate support for this upstream as it would make updates a little easier, but if you don't want then this is fine as well and we will continue to maintain it the way we did it until now.


[RFW] Add examples that show how can RFW be used multiple flavors of apps.

Some ideas

Add an example where RFW is being used in a small portion of the app.
Add an example where the app is completely driven by the server.
Add an example where is shown to to leverage cool things like Theme or Colors or LayoutBuilder can be used in RFW.
Add an example that shows how adaptative/responsive UIs can be built with RFW.
Add an example that shows how routing can be handled in RFW.

As with https://github.com/flutter/flutter/issues/141668, PRs are very welcome but I don't know that there's much point having an open-ended issue like this on file, since we'll never be done writing examples. (I don't personally intend to write any more examples.)

Closing per last comment.


Batch modeling commands

The engine now supports handling multiple commands in a single WebSocket message, which should be much faster!
We should update the frontend to take advantage of this. If you're drawing an octogon, don't send all 8 lineTo commands in their own WebSocket messages. Instead, send a single WebSocket message with all the commands.
The schema will be published soon, but basically the request type changes from "modeling_cmd_req" to "modeling_cmd_batch_req". And the JSON object changes from
{
  "cmd": {},
  "cmd_id": {}
}

to
{ "requests":
  [
    { "cmd": {}, "cmd_id": {} },
    { "cmd": {}, "cmd_id": {} }
  ]
}

The relevant API client part in Rust is here

Is there proof that batching works well? From what I've observed, batching does not drastically increase throughput.
Additionally, you should be able to batch an entire model, which I've tried, but the engine is not happy with it. It should be possible to do because you can assign UUIDs to all pieces of the model before-hand so there's no need to do setup commands.


[3.x] Restore shader parsing errors with lack of semicolon in a block

Backport https://github.com/godotengine/godot/pull/55821

Thanks!


Updating spacing and style nits

To merge, do we just need to fix CI and rebase/squash commits? Or is there more work to be done?


Unexpected failure message for nested fields with the same name

require 'bundler/setup'
require 'dry-validation'

schema = Dry::Validation.Schema do
  required(:code).filled(:str?, eql?: 'foo')

  required(:nested).schema do
    required(:code).filled(:str?, eql?: 'bar')
  end
end

result = schema.call(code: 'x', nested: { code: 'y' })
puts result.success?
puts result.messages

__END__

Expected:
  false
  {:code=>["must be equal to foo"], :nested=>{:code=>["must be equal to bar"]}}

Actual:
  false
  {:code=>["must be equal to foo"], :nested=>{:code=>["must be equal to bar", "must be equal to foo"]}}

It's a bug in hint compiler, somehow we lose info that it's a message for a nested value and only match against :code key name. I'll be simplifying err/hint compiler implementations and make sure this scenario works correctly.


Custom portfolio page

In order to view the pages and posts inside of the _portfolio directory in the portfolio archive html page you would use a liquid tag such as:
{% for post in site.portfolio %}
{% include archive-single.html type="grid" %}
{% endfor %}
However, I was wondering if there would be a way to use this liquid tag to view posts and pages from a custom directory such as "_illustrations" in the root directory. Using something like {% for post in site.illustrations %} does not work. Any ideas?

How have you setup your illustrations collection in _config.yml? Does it have it's output set to true? The for loop used for site.portfolio collection should work the same way for any other collection as long as it's properly setup and has content.

Hi Michael, thanks for getting back to me! I think I managed to sort it out. I had set up the new collection in _config.yml with its own permalink as /:portfolio/:illustrations/ to try and make it as a subsection of the portfolio only to run into errors, so I removed it and it works fine now (should I have done that?). I also forgot to include the defaults for illustrations, thanks for the link!

Hi Michael, thanks for getting back to me! I think I managed to sort it out. I had set up the new collection in _config.yml with its own permalink as /:portfolio/:illustrations/ to try and make it as a subsection of the portfolio only to run into errors, so I removed it and it works fine now (should I have done that?). I also forgot to include the defaults for illustrations, thanks for the link!

That could have been the problem, not sure. I've never tried to make a child collection before.
If you run into any other Collection related issues, might be worth your time asking for help on https://talk.jekyllrb.com/ since it's more of a "using Jekyll" question than something directly tied to my theme.
Closing because it seems you've sorting it out.

Thanks :smile: will do!


Add files via upload

Includes 4 sets of mismatches:
(1) Evaluating MOMA artist (P2174) for P569 mismatches; 164 found
(2) Evaluating MOMA artist (P2174) for P570 mismatches; 38 found
(3) Evaluating NGA artist (P2252) for P569 mismatches; 1514 found
(4) Evaluating NGA artist (P2252) for P570 mismatches; 1141 found

CC @mgaoann for the review :)
Initial glances at this look really good! Big thing is, if the external year appears on the Wikidata statement as any of the property values, then we should not report it as a mismatch. Again sorry that this wasn't more clear at the start (wasn't really for me either). More details about this are on Mattermost.
An example of this for the National Gallery of Art is Q42319452 where the entry from the external source is on the item, but there's two entries. Maybe there's value in uploading it and saying that National Art Gallery should be added as a reference, but the for sure uploads are the ones where the external value does not appear on the item at all for the given property :)
Also, @msteever, can you put all of this in a single directory?

Aside from the things Andrew already mentioned, looks good! Love how thorough your comments are. :)

An example of this for the National Gallery of Art is Q42319452 where the entry from the external source is on the item, but there's two entries. Maybe there's value in uploading it and saying that National Art Gallery should be added as a reference, but the for sure uploads are the ones where the external value does not appear on the item at all for the given property :)

It appears that several of us have had this occur in our mismatch finding. Given that mismatches are a manual review process, would you want us to include those "additional reference" not-really-mismatches so they can be added in, or would you like us to filter these out somehow? Seth says it's your call on if you want them in or not.

Hey @msteever :wave: We can talk more about this in the meeting today, but word is that these should not be included as there are better means of fixing these issues than putting them on Mismatch Finder :)


Scan slaves looking for (optionally deleting) items that do not exist in master

@onebytegone please review. I believe once this is merged we can cut 1.0.0


Reverse the ping option

Please reverse the ping option and disable it by default (or maybe even better to remove it completely).

Are you using go-micro?

We are looking into it since yesterday and stumbled over this thingy


Adding modification check to clearing the route cache of the ext_proc filter.

Commit Message: Modifying clear route cache logic for the ext_proc filter.
Additional Description: Adding in the ability to disable route cache clearing ont he ext_proc filter. Changing the behavior of the clearing to check if there is a header mutation.
Risk Level: Low
Testing: test/extensions/filters/http/ext_proc/filter_test.cc
Docs Changes: docs/root/configuration/http/http_filters/ext_proc_filter.rst
Release Notes: changelogs/current.yaml
Platform Specific Features:

/assign @tyxia

Thanks for adding this! Left minor comments on the API.
A high-level comment (probably not in the scope of this PR), from the point-of-view of the external processor, it will be difficult to reason why the external-processor sent a response to clear the route cache, but the Envoy did not act accordingly. Specifically, the provider of an ext-proc service will see that their service works for Envoy deployment A (that allows cache clearing) but not for Envoy deployment B (that prevents cache clearing), but will not be able to debug why this is happening. A better approach may be to "publish a contract" when connecting to the external-processor stating what features are enabled/disabled. @htuch WDYT?

The context/intention (we probably could add it to PR description) is:  third-party extension server (which send back response) can do whatever they want. On the other hand, our product (which create ext_proc filter through filter config) want to force clearing behavior off regardless extension's behavior (e.g., due to product requirement, security, etc). So, ext_proc don't really need to set up the contract with extension or report for permission.
I agree it is good to improve the observability/debuggability. We can add the log (,even stats) when common_response.clear_route_cache() == true && filter_.config().disableRouteCacheClearing() == true for this behavior. WDYT?

The context/intention (we probably could add it to PR description) is: third-party extension server (which send back response) can do whatever they want. On the other hand, our product (which create ext_proc filter through filter config) want to force clearing behavior off regardless extension's behavior (e.g., due to product requirement, security, etc). So, ext_proc don't really need to set up the contract with extension or report for permission.

I agree that from a security perspective this is a valid feature. FWIW, other fields should also be restricted, depending on the threat-model.
I think we should address the general case, where the extension and the deployment are handled by different entities, and the extension can either be a third-part extensions server or a specific service. The case of an extensions server is probably easier (if the extension server and Envoy are managed by the same entity), as the extensions server should prevent accepting extensions that clear the routes, and this "contract" should be enforced by the extensions server.
The added benefits for a "contract" for the extensions server are: 1) it can clearly reason what kind of extensions can be executed using the Envoy; 2) allows the operators to debug things on their end and do not need to access Envoy's logs/stats. I think it is better to decouple the things as much as possible, and as things stand, if the Envoy deployer updates the ext-proc config on their side, they may break the third-party extension server.

I agree it is good to improve the observability/debuggability. We can add the log (,even stats) when common_response.clear_route_cache() == true && filter_.config().disableRouteCacheClearing() == true for this behavior. WDYT?

I thought of suggesting counters (IMHO logs are typically less useful in large deployments), but the downsides are that stats require more memory, are useful to know if an event happens but not so useful to understand what triggered that event (e.g., which response from the external processor caused it), and don't scale if a similar fix will be needed on different fields.

The context/intention (we probably could add it to PR description) is: third-party extension server (which send back response) can do whatever they want. On the other hand, our product (which create ext_proc filter through filter config) want to force clearing behavior off regardless extension's behavior (e.g., due to product requirement, security, etc). So, ext_proc don't really need to set up the contract with extension or report for permission.

I agree that from a security perspective this is a valid feature. FWIW, other fields should also be restricted, depending on the threat-model.
I think we should address the general case, where the extension and the deployment are handled by different entities, and the extension can either be a third-part extensions server or a specific service. The case of an extensions server is probably easier (if the extension server and Envoy are managed by the same entity), as the extensions server should prevent accepting extensions that clear the routes, and this "contract" should be enforced by the extensions server. The added benefits for a "contract" for the extensions server are: 1) it can clearly reason what kind of extensions can be executed using the Envoy; 2) allows the operators to debug things on their end and do not need to access Envoy's logs/stats. I think it is better to decouple the things as much as possible, and as things stand, if the Envoy deployer updates the ext-proc config on their side, they may break the third-party extension server.

Please first let me confirm I understand your "contract" and "this contract should be enforced by the extensions server" correctly. Are you suggesting : 1) ext_proc reports that setting clear_route_cache is off to the Server (to which ext_proc call out) 2) Sever evaluate it and make the final decision.
AFAIU, this is contrary to our goal. what we want to achieve because the server can choose to ignore ext_proc setting and that is out of our control.
I think ext_proc can report its setting/feature to server to help their observability but our end goal here is enforcement on ext_proc side not server side. @htuch Please correct me if I misunderstand the motivation behind this change.

Please first let me confirm I understand your "contract" and "this contract should be enforced by the extensions server" correctly. Are you suggesting : 1) ext_proc reports that setting clear_route_cache is off to the external processor (to which ext_proc call out) 2) External processor evaluate it and make the final decision whether clear route cache or not.
AFAIU, this is contrary to what we want to achieve here because the external processor can choose to ignore ext_proc setting and that is out of our control.
I think ext_proc can report its setting/feature to external processor to help their observability but our end goal here is enforcement on ext_proc side not external processor side. @htuch Please correct me if I misunderstand our goal.

This is similar to how Envoy talks with an xDS-server and sends a list of all supported extensions. It allows the server to decide what kind of configs to send back. If the server sends a config with a wrong extension, the client can reject the config.
In the ext-proc case, the Envoy will send the "contract" (supported abilities). If it is configured to disable route-cleaning, it will disregard whatever the ext-proc service returns in the field (just as this PR suggests). The only difference is that the ext-proc service operator can clearly observe that the Envoy that connects to it does or doesn't support some feature and they can debug things on their end without needing to look at the logs/counters on the Envoy side.

Please first let me confirm I understand your "contract" and "this contract should be enforced by the extensions server" correctly. Are you suggesting : 1) ext_proc reports that setting clear_route_cache is off to the external processor (to which ext_proc call out) 2) External processor evaluate it and make the final decision whether clear route cache or not.
AFAIU, this is contrary to what we want to achieve here because the external processor can choose to ignore ext_proc setting and that is out of our control.
I think ext_proc can report its setting/feature to external processor to help their observability but our end goal here is enforcement on ext_proc side not external processor side. @htuch Please correct me if I misunderstand our goal.

This is similar to how Envoy talks with an xDS-server and sends a list of all supported extensions. It allows the server to decide what kind of configs to send back. If the server sends a config with a wrong extension, the client can reject the config.
In the ext-proc case, the Envoy will send the "contract" (supported abilities). If it is configured to disable route-cleaning, it will disregard whatever the ext-proc service returns in the field (just as this PR suggests). The only difference is that the ext-proc service operator can clearly observe that the Envoy that connects to it does or doesn't support some feature and they can debug things on their end without needing to look at the logs/counters on the Envoy side.

I am not sure if we need full/similar capability of xDS for service callout since data <->control plane seems to be more complicated (at least at this moment). Though, the mechanism you described sound like a good design .

If it is configured to disable route-cleaning, it will disregard whatever the ext-proc service returns in the field (just as this PR suggests)
Since we need this discard behavior anyways to enforce ext_proc side enforcement, then IMHO we can proceed with this PR.  Adding contracts can be a separate part that will be added later (e.g., as post-MVP) if it is determined to be desired for service callout. WDYT?

Since we need this discard behavior anyways to enable ext_proc side enforcement, then IMHO we can proceed with this PR. Adding contracts can be a separate part that will be added later (e.g., as post-MVP) if it is determined to be desired for service callout. WDYT?

Yeah, as stated in the first comment, this is probably not part of this PR.

@adisuissa yeah, I can see this being something to add in the future as the range of behaviors becomes harder to debug.
I do think we need something here that is more than silent failure though, that is basically impossible to debug, even in the situation where you control client / server. Typically a stat would make sense and/or we could consider this a protocol violation and terminate the connection with the ext_proc server.

/retest

I was having some client side issues with the status of the branch.
I believe that I initially branched it from something that wasn't main.
It should be in sync now though, I'm unsure why it keeps getting out of sync.
I have tried git pull upstream main but that also complains about ff, and git pull --rebase upstream main makes it complain when I push. I believe that it should be fixed now.

Please also check code format (see CI errors).

CI error:
/tmp/tmp2etuagir/generated/rst/version_history/v1.27/v1.27.0.rst:76: WARNING: undefined label: 'envoy_v3_api_field_service.ext_proc.v3.externalprocessor.disable_clear_route_cache'
seems that the field identifier is incorrect. Can you PTAL?

Snow is OOO.
@wbpcode can you review this code as a non-Googler?
/assign @wbpcode

/wait

ping @adisuissa to merge after ci is done.

Needs a senior maintainer review.
/assign @htuch


HasQuanity value for Water Meter

For a water meter of a building, I have associated to this onthology : dtmi:org:brickschema:schema:Brick:Water_Meter;1 and then I have made a relationship "HasPoint" to a point object (dtmi:org:brickschema:schema:Brick:Point;1). I wanted to fill in the "HasQuantity" property but I haven't found "Volume" value in the list of value. What is the best option to fill in for a point of a water meter ?

Thanks in advance,
Louis Lenoir

Brick references 41 of the 933 "quantity kinds" from QUDT.org. It would be pretty easy to add a brick:Volume that refers to the QUDT concept, qudtqk:Volume, and it's associated units.
Maybe I'll just submit a PR for that. (I'm a custodian of the QUDT ontology).

Hi Louis! There should be a brick:Volume in there that you can use (if this isn't present in the REC docs I'm not sure what's going on...probably want to raise an issue with them). However in https://github.com/BrickSchema/Brick/pull/570 we are looking to allow you to refer to QUDT types directly rather than having them mirrored in Brick


feat(PeriphDrivers): API to get the package type of part and test date.

Pull Request Template
Description
Starting in 10/23, the USN was updated to include the test date and package type. These APIs cover getting those.

/clang-format-run

/clang-format-run

/clang-format-run

/clang-format-run

not stale just busy


Tutorial with no Login View and spring ressource-server

Hi, I'm not sure where to put this, so here I am.
I'm developing a rather big micro service cloud application with dozen of services, two of whom have a vaadin frontend.
They are obviously behind a reverse proxy (nginx) which handles the authentication (forwards to an IDP).
In the documentation (https://vaadin.com/docs/latest/security/enabling-security) it states the requirement for a login view and a log out capability. I have the latter, but no vaadin log in view.
On the other hand I just wan't to configure the jwt security with spring using a ressource-server to check the provided bearer token.
Could you please provide a tutorial, how this is supposed to be configured?
I currently have this configuration, but am not sure, if this is correct.
@Override
    protected void configure(final HttpSecurity http) throws Exception {
        http.authorizeRequests().antMatchers(ACTUATOR_HEALTH_ENDPOINT).permitAll();
        http.authorizeRequests().antMatchers(ACTUATOR_PROMETHEUS_ENDPOINT).permitAll();

        super.configure(http);

        http.cors()
                .and()
                .oauth2ResourceServer()
                .jwt();
    }

#126 ideally together with this one since we'll move to spring boot 3 soon.

Hi, the current tutorial is now updated to V24 & SB 3. I also think this topic would be good to be covered, probably as a separate how-to guide instead of this introduction tutorial. We can keep this issue open here to remind about that, although it probably is going to be a separate article and separate example repository.


new pr

Coverage increased (+19.4%) to 80.567% when pulling b1b316c61a38141ea8a4974cee4b108284d15a1b on ashpa:master into 85d8c2f416cc59a6c09639a5ce037c0987b5a2f1 on CS2103JUN2017-T4:master.


Add files via upload

the university official website URL:
http://iesjoanalcover.cat/
a URL of a page on the official website where a long-term (>1 year) IT related course is offered by the university
http://iesjoanalcover.cat/matricula
--> In the section "matèries elegibles d’batxillerat", there is this document https://docs.google.com/document/d/e/2PACX-1vTOm-hd2rKAVCsG1JTMl18HbtQw614BTnzwFhPCIklaESjbBOUIJdiNr7tgv-Z9ozgPmwtpkkQPdKNE/pub
where you can find a subject called Technology and Engineering
a URL of a page or some other proof (.pdf or a screenshot are OK) showing that the university recognizes the domain which you are submitting as an official email domain for the enrolled students.
http://iesjoanalcover.cat/contacte

@rafelj First stage of verification passed, official domain is iesjoanalcover.cat as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@rafelj Pull request merged. Thank you.


macos-13 Python can't find Tcl/Tk 8.6 shared libraries

Description
Hi !
I'm experiencing a similar issue on macos-13 runner as described in #6442 for macos-12 and #4931 for macos-11.
Basically, Python fails to find libtcl8.6.dylib in all the locations in tries.
Unlike the referenced issues, the bug is not solved by adding the symlinks suggested in #4931.
(I still added them in the minimal repro example for demonstration)
I'm demonstrating the issue with Python 3.9, but I'm also experiencing it for versions 3.7, 3.8 and 3.10.
Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] Ubuntu 24.04
[ ] macOS 12
[X] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[ ] macOS 14 Arm64
[ ] macOS 15
[ ] macOS 15 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
Version: 20241125.399
https://github.com/TissueEngineeringLab/MyoFInDer/actions/runs/12116070585/job/33775709298
Is it regression?
Yes
Version: 20241023.237
Not exactly the same workflow, but symlink could be found by Python.
import tkinter is included in the import myofinder call, in the Import MyoFInDer step.
Link: https://github.com/TissueEngineeringLab/MyoFInDer/actions/runs/11629304885/job/32386049285
Expected behavior
tkinter can be imported in Python
Actual behavior
import tkinter crashes with error:
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/tkinter/__init__.py", line 37, in <module>
    import _tkinter # If this fails your Python may not be configured for Tk
ImportError: dlopen(/Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/lib-dynload/_tkinter.cpython-39-darwin.so, 0x0002): Library not loaded: /usr/local/opt/tcl-tk/lib/libtcl8.6.dylib
  Referenced from: <0E547FD7-F776-378C-B4DE-8D241CDFE19E> /Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/lib-dynload/_tkinter.cpython-39-darwin.so
  Reason: tried: '/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/usr/local/lib/libtcl8.6.dylib' (no such file), '/usr/lib/libtcl8.6.dylib' (no such file, not in dyld cache), '/usr/local/Cellar/tcl-tk/9.0.0_1/lib/libtcl8.6.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/Cellar/tcl-tk/9.0.0_1/lib/libtcl8.6.dylib' (no such file), '/usr/local/Cellar/tcl-tk/9.0.0_1/lib/libtcl8.6.dylib' (no such file), '/usr/local/lib/libtcl8.6.dylib' (no such file), '/usr/lib/libtcl8.6.dylib' (no such file, not in dyld cache)

Repro steps
Note that the brew install tcl-tk step was not included in the last successful run, I added it in my minimal example to make sure tcl/tk is installed
name: tkinter minimal

on:
  workflow_dispatch:

jobs:
  minimal:
    runs-on: macos-13
    steps:
        - name: Install Python
          uses: actions/setup-python@v5
          with:
            python-version: "3.9"
        - name: Install tcl/tk
          run: brew install tcl-tk
        - name: Symlink tcl/tk
          run: |
            version=$(brew info tcl-tk --json | jq -r '.[].installed[].version')
            ln -s /usr/local/Cellar/tcl-tk/$version/lib/libtcl8.6.dylib /usr/local/lib/libtcl8.6.dylib
            ln -s /usr/local/Cellar/tcl-tk/$version/lib/libtk8.6.dylib /usr/local/lib/libtk8.6.dylib
        - name: Install python-tk
          run: brew install<EMAIL_ADDRESS>        - name: import tkinter
          run: python -c "import tkinter"

Hi @WeisLeDocto ,
Thank you for your patience and for bringing this to our attention. We are currently working on a solution to address the issue you're facing. We ask that you bear with us while we resolve it.
In the meantime, if you have any additional information or questions, feel free to let us know. We appreciate your understanding and will keep you updated as we make progress.

The issue you’re encountering might be due to the fact that the python -c "import tkinter" command works fine for all our macOS runner images, including macOS-13 and macOS-14. This is because these images come pre-configured with the necessary Tcl/Tk libraries, so Python can directly use the already installed version of Tcl/Tk without requiring manual installation or symlink creation.
In fact, if you use the following simple python -c "import tkinter" command, it should work without additional setup:

on:
  workflow_dispatch:

jobs:
  build:
    strategy:
      fail-fast: false
      matrix:
        os: ['macos-13', 'macos-13-xlarge', 'macos-14', 'macos-14-large']

    runs-on: ${{ matrix.os }}
    steps:
      - name: Import Tkinter
        run: |
          python -c "import tkinter; print(f'Tkinter imported successfully. Version: {tkinter.TkVersion}')"

this command ensures that tkinter imports and outputs the version successfully using the pre-installed libraries available in the runner image.
If you are still encountering issues, please feel free to share your workflow file, and we can take a closer look!

Thank you for your swift reply.
Indeed, the following workflow runs smoothly:
name: tkinter minimal

on:
  workflow_dispatch:

jobs:
  minimal:
    runs-on: macos-13
    steps:
      - name: import tkinter
        run: python -c "import tkinter"

I should've tried that first. :sweat_smile:
However, the only Python version installed by default is 3.13 (checked using ls /usr/bin/python* in a workflow).
I would like to be able to run tests with various Python versions on the macos-13 runner, and therefore I need to use the actions/setup-python@v5 action. But that seems to be the source of the bug.
The following workflow crashes, still with the same Python error as previously:
name: tkinter minimal

on:
  workflow_dispatch:

jobs:
  minimal:
    runs-on: macos-13
    steps:
      - name: Install Python
        uses: actions/setup-python@v5
        with:
          python-version: "3.9"
      - name: import tkinter
        run: python3.9 -c "import tkinter"

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/tkinter/__init__.py", line 37, in <module>
    import _tkinter # If this fails your Python may not be configured for Tk
ImportError: dlopen(/Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/lib-dynload/_tkinter.cpython-39-darwin.so, 0x0002): Library not loaded: /usr/local/opt/tcl-tk/lib/libtcl8.6.dylib
  Referenced from: <0E547FD7-F776-378C-B4DE-8D241CDFE19E> /Users/runner/hostedtoolcache/Python/3.9.20/x64/lib/python3.9/lib-dynload/_tkinter.cpython-39-darwin.so
  Reason: tried: '/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/usr/local/opt/tcl-tk/lib/libtcl8.6.dylib' (no such file), '/usr/local/lib/libtcl8.6.dylib' (no such file), '/usr/lib/libtcl8.6.dylib' (no such file, not in dyld cache)

Looks like I cannot open an issue in the setup-python action repo, is here still the right place to discuss this bug ?

Hi @WeisLeDocto
Could you please try the workaround below to see if it resolves the issue for you? This should allow you to test with different Python versions on the macOS 13 runner.
Please let us know if this helps !
name: tkinter minimal
on:
workflow_dispatch:
jobs:
build:
runs-on: macos-13
steps:
- name: Install Python
uses: actions/setup-python@v5
with:
python-version: “3.9”
  - name: Adding Symlink
    run: |
      ln -sf /usr/local/opt/tcl-tk@8 /usr/local/opt/tcl-tk

  - name: Import tkinter
    run: |
      python3.9 -c "import tkinter; print(f'Tkinter imported successfully. Version: {tkinter.TkVersion}')"

The following workflow runs gracefully :+1:
name: tkinter minimal

on:
  workflow_dispatch:

jobs:
  build:
    runs-on: macos-13
    steps:
      - name: Install Python
        uses: actions/setup-python@v5
        with:
          python-version: "3.9"
      - name: Adding Symlink
        run: ln -sf /usr/local/opt/tcl-tk@8 /usr/local/opt/tcl-tk
      - name: import tkinter
        run: python3.9 -c "import tkinter; print(f'Tkinter imported successfully. Version {tkinter.TkVersion}')"

Many thanks for your help !
Will the runner images be fixed to avoid having to symlink tcl-tk, or should I consider this the new normal ?

We're investigating this issue and working on a fix. We'll keep you informed as soon as it's resolved.


pythonPackages.mautrix: 0.5.4 -> 0.5.7

Motivation for this change
Packaging mautrix-facebook (would there be interest to have this in nixpkgs?) and it needs mautrix>=0.5.6.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
3 packages built:
- mautrix-telegram
  - python37Packages.mautrix (python37Packages.mautrix-appservice)
  - python38Packages.mautrix (python38Packages.mautrix-appservice)

[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

would there be interest to have this in nixpkgs

Yes!

would there be interest to have this in nixpkgs

Yes!

I'm not using mautrix-facebook anymore but here is the latest state:

https://github.com/otevrenamesta/otevrenamesta-cz-configuration/blob/master/packages/mautrix-facebook/default.nix
https://github.com/otevrenamesta/otevrenamesta-cz-configuration/blob/master/modules/mautrix-facebook.nix

Also @eyjhb may or may not be working on this package as well.

I'm not using mautrix-facebook anymore but here is the latest state:

https://github.com/otevrenamesta/otevrenamesta-cz-configuration/blob/master/packages/mautrix-facebook/default.nix
https://github.com/otevrenamesta/otevrenamesta-cz-configuration/blob/master/modules/mautrix-facebook.nix

Also @eyjhb may or may not be working on this package as well.

I have a working version, I can make a PR for it soon ! :) I want to rework the mautrix module as well. Thanks for the reminder @mmilata !

I have a working version, I can make a PR for it soon ! :) I want to rework the mautrix module as well. Thanks for the reminder @mmilata !

Sounds great @eyJhb, looking forward to it!

Sounds great @eyJhb, looking forward to it!


time travel debug commands

In the ill-fated original 1.5.x branch, one of the things Dustin added was time traveling to avoid sleeps/races for the test suite.
The command would be used to pause the timer event, move current_time forward or backward by N seconds, and resume time. This could just compiled on debug mode only. Note that it won't help for cases where we wait for threads to do things, but it'll fix issues like expirations.t failing on some platforms, and reduce the amount of time the test suite takes by cutting probably 90% of the sleeps.
This isn't too hard to do but it's not my top priority right now, so putting this up as a note to self or open to someone else if they want to try.
Off the top of my head I'd suggest:
debugtime p # pauses clock
debugtime r # resumes clock
debugtime -5 # move 5 seconds into the past (could underflow! that's fine.)
debugtime 30 # move 30 seconds into the future

a decision to be made is if debugtime is implemented as a static delta to apply to the internal timer before. IE: if you pause, add 30s, then resume; without holding the delta somewhere time will snap back to 30 seconds ago.

Out in 1.6.10


ESP-TLS: esp_tls_conn_new_sync cannot open non-TLS connection (IDFGH-13865)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
I'm using ESP-IDF v5.3.1
In esp_tsl.h there is the esp_tls_conn_new_sync function
`/**

@brief      Create a new blocking TLS/SSL connection

This function establishes a TLS/SSL connection with the specified host in blocking manner.

@param[in]  hostname  Hostname of the host.
@param[in]  hostlen   Length of hostname.
@param[in]  port      Port number of the host.
@param[in]  cfg       TLS configuration as esp_tls_cfg_t. If you wish to open
non-TLS connection, keep this NULL. For TLS connection,
a pass pointer to esp_tls_cfg_t. At a minimum, this
structure should be zero-initialized.
@param[in]  tls       Pointer to esp-tls as esp-tls handle.

@return
-1      If connection establishment fails.
1      If connection establishment is successful.
0      If connection state is in progress.
*/
int esp_tls_conn_new_sync(const char *hostname, int hostlen, int port, const esp_tls_cfg_t *cfg, esp_tls_t *tls);
`

if I pass a cfg=NULL param, the function return -1.
In fact, the function implementation is
int esp_tls_conn_new_sync(const char *hostname, int hostlen, int port, const esp_tls_cfg_t *cfg, esp_tls_t *tls)
{
if (!cfg || !tls || !hostname || hostlen < 0) {
return -1;
}
uint64_t start_time_us;
start_time_us = esp_tls_get_platform_time();
...
There is a mismatch between the header doc and the func implementation.

Hi @aenima1891 Did you try providing a zero initialised cfg parameter instead of just passing cfg = NULL

Hi @aenima1891 I am closing the issue due to lack of response.
Please feel free to re-open if you are still facing the issue.
Thanks,
Aditya


Update hide-all-apps extension: speed up hiding of other applications

Description
I've noticed that the extension hangs in the Finder for a second or two before hiding the other applications' windows. I believe that's because of AppleScript's iteration of processes and imperatively setting their visibility to false.
We can speed this up by issuing the native Hide Others command through its ⌥ ⌘ H keyboard shortcut. The trade-off is that the command won't work for users who override Finder's ⌥ ⌘ H shortcut to do some other command.
Apologies for not providing any specific benchmarking data via console.time() or something. I couldn't get any console statements to appear in my terminal. I'm not sure if that's a ray develop shortcoming or user error (likely the latter).
Screencast

Before
Note that the other applications' windows stay hanging around for a second after invoking the command.
https://github.com/raycast/extensions/assets/14554/ad2a828d-8698-41c4-8b47-610e8edf1942
After
https://github.com/raycast/extensions/assets/14554/51cd5124-8521-44f8-811e-595e9081b7d1
Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Thanks for this! Really appreciate it 🚀

The trade-off is that the command won't work for users who override Finder's ⌥ ⌘ H shortcut to do some other command.

Good point. Is it worth adding some sort of preference for this? I dont know what we could call it though, but essentially something that users can check, and internally we use either this strategy or what we were using before.

Is it worth adding some sort of preference for this? I dont know what we could call it though

That's a good question, as it's one I'm struggling to answer. I feel like a preference would be overkill, and/or confusing; it's exposing an inner implementation detail. But I'm also hesitant about potentially invoking an unknown command. I'll see if there's some automatic detection that can be done. I'll think on it. Thanks!

But I'm also hesitant about potentially invoking an unknown command

yeah, my thoughts too!

What should we do about this?

What should we do about this?

I just pushed up a new change (https://github.com/raycast/extensions/pull/10551/commits/5ede3a643818a4a0d1ebfedb7f709cad6b9b7172), which does not rely on a consistent keyboard shortcut while maintaining the performance improvement. We're still using the native Hide Others command, but now invoking it through AppleScript's menu bar commands.
I think this should be good to go ✅

Love it! Let's take it for a spin. Thanks!