Client Should Be Anonymous When Calling GetEntry API

Currently, the client can be configured to either use a service key or a client secret (which is translated into an OAuth token). If both are configured, client secret takes over which doesn't make GetEntry anonymous. For GetEntry to be anonymous, client config should be changed every time GetEntry is called after UpdateEntry and vice versa.
There should be a flexible way to specify authentication requirements for each API.

After some chats, I'm reconsidering this requirement.
Motivating use cases:

Users that want to block someone from talking to them, or discovering when they change keys.
Blocking accounts that are engaging in spammy behavior.
Blocking accounts that are engaging in DoS behavior.

Motivating use cases for an anonymous get function:

Obtain key material without revealing identity of communicating parties.
Obtain key material without needing to rely on gossip for consistency.

The current setup of an OAuth and service keys is adding extra complexity to the client without obvious benefit and make it more difficult to use.  Until we have a properly anonymous Get function, consider reverting to OAuth for all operations.
As a future feature, anonymous tokenization schemes might be able to meet both requirements.

Upspin solved the problem by removing authentication token generation in
the client and token checking in the server for key fetch, but of course
still requiring auth for all other operations.  Some of our users say lack
of anonymous GetEntry would be a showstopper.
Consider that your users could create a series of accounts like
<EMAIL_ADDRESS>and publish the keys.  So real identification or
blocking is impossible anyway, though you can add complexity to the client
if you attempt that arms race.
In Upspin, blocking by user is in effect done at the client.  All keys and
key changes are public.  The key server is intended to be fast enough to
absorb DoS.   There is no reason you should do it our way, just pointing
out the existence proof.
On Tue, Mar 21, 2017 at 7:36 AM, Gary Belvin<EMAIL_ADDRESS>wrote:

After some chats, I'm reconsidering this requirement.
Motivating use cases:

Users that want to block someone from talking to them, or
discovering when they change keys.
Blocking accounts that are engaging in spammy behavior.
Blocking accounts that are engaging in DoS behavior.

Motivating use cases for an anonymous get function:

Obtain key material without revealing identity of communicating
parties.
Obtain key material without needing to rely on gossip for
consistency.

The current setup of an OAuth and service keys is adding extra complexity
to the client without obvious benefit and make it more difficult to use.
Until we have a properly anonymous Get function, consider reverting to
OAuth for all operations.
As a future feature, anonymous tokenization schemes might be able to meet
both requirements.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/google/keytransparency/issues/506#issuecomment-288098000,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AIA3ulXOSPHbYnSdU-UANWYpGWX-x75uks5rn-BkgaJpZM4MUgZ6
.

Fixed by #975


[Jellyfin] Store data in other folder (/share)

Which addon?
Jellyfin and Emby
Is your feature request related to a problem? Please describe.
No, but i would like to keep data away from the config folder as it is backed up and takes a lot of space
Describe the solution you'd like
Option to specify folder
Additional context
I see that your addons store data in /config/addons_config/(ADDON_NAME)/, yet it also creates similar folders in /share/(ADDON_NAME), yet those folders are left empty. In Jellyfin, I can specify to store cache, metadata and transcodes individually, but database files, log files and settings files are still stored under config. I like to keep "non-critical" data away from the folders that are backed up by HA.

Hi,
What is the size of your files ?
I'm using Emby :

/config/addons_config/emby : 304 ko
/share/emby : 699.4 Mo

So it already seems to be the case...

I've done a new version of Jellyfin with a "data_location" tag in addons. Could you please test? thanks.

Is this something on my end?
400 Client Error for http+docker://localhost/v1.41/build?t=db21ed7f%2Famd64-addon-jellyfin%3A10.7.7-1-ls150-2&q=False&nocache=False&rm=False&forcerm=True&pull=True&buildargs=%7B%22BUILD_FROM%22%3A+%22linuxserver%2Fjellyfin%3Aamd64-latest%22%2C+%22BUILD_VERSION%22%3A+%2210.7.7-1-ls150-2%22%2C+%22BUILD_ARCH%22%3A+%22amd64%22%7D&labels=%7B%22io.hass.version%22%3A+%2210.7.7-1-ls150-2%22%2C+%22io.hass.arch%22%3A+%22amd64%22%2C+%22io.hass.type%22%3A+%22addon%22%2C+%22io.hass.name%22%3A+%22Jellyfin+NAS%22%2C+%22io.hass.description%22%3A+%22A+Free+Software+Media+System+that+puts+you+in+control+of+managing+and+streaming+your+media.%22%2C+%22io.hass.url%22%3A+%22https%3A%2F%2Fgithub.com%2Falexbelgium%2Fhassio-addons%22%7D: Bad Request ("dockerfile parse error line 31: unknown instruction: ECHO")

Yup, pushed a new version I hadn't yet had to test it. ;) new version should work better

It seems to be all good now, thanks for your quick action :) It's a really nice collection of addons you've got here ;)

Thanks!


Update image

I use this template - should I update it in mine as well?

Thanks for all the approvals @samruddhikhandale 😄
@vadi2 Yes, I'd recommend you update the image! There's more context here: https://github.com/microsoft/vscode-dev-containers/issues/1589.

@samruddhikhandale Super odd, but it looks like I'm still blocked from merging - I think these PRs may require an actual approving review step? Would you be able to try again?

@bamurtaugh  Looking at the PR status, someone with write access to the repos needs to approve as well.
Apparently, I don’t have that :sweat: Probably @Chuxel could help?

Thanks for looking into this @samruddhikhandale!
@Chuxel I looked into adding write access for Samruddhi to this repo, but I couldn't access the access tab I think I'd need to use. Any thoughts?


Errors loading CLI dependencies in nextjs project but they are not needed

Hi I am using umzug "umzug": "^3.8.1 in a nextjs project and run the migration programmatically.
I was wondering if the dependencies for the CLI can be loaded dynamically as I have the impression they generate errors and are not needed.
This is what the error trace I have:
Import trace for requested module:
./node_modules/umzug/lib/umzug.js
./node_modules/umzug/lib/index.js
./app/lib/server/mongodb.ts
./app/[lang]/layout.tsx
 ⚠<EMAIL_ADDRESS>Critical dependency: require function is used in a way in which dependencies cannot be statically extracted

Import trace for requested module:
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>./node_modules/umzug/lib/cli.js
./node_modules/umzug/lib/index.js
./app/lib/server/mongodb.ts
./app/[lang]/layout.tsx

I am using the MongoDBStorage in my Umzug configuration.

Also the CLI dependencies has a big impact on loading time. On an app deployed on Google Cloud Run requiring Umzug takes ~700ms, ~650 of them are the require of @rushstack/ts-command-line.
Would you accept a PR that removes the cli from the default index.ts, and add a new one to be imported as umzug/cli?
That would be a BC and would require a v4, but it would speed up bootstrap of all apps that use Umzug only through it's node API.

I'm looking into moving to https://github.com/mmkal/trpc-cli instead. It has dependencies too, but none big. Hopefully that will be enough.

👍
TBH it feels right to allow to import only what's needed for a programmatic usage only, it could also be a new umzuk/api export so it would not need a major release

👍 TBH it feels right to allow to import only what's needed for a programmatic usage only, it could also be a new umzuk/api export so it would not need a major release

+1
I am working on adding umzug to [Audiobookshelf](https://github.com/advplyr/audiobookshelf] and had an issue pkging the app because of some unsupported dependency type of @rushstack/ts-command-line on @rushstack/terminal (see package.json.
Please consider separating the CLI from the main umzug package.


Support for regulating volume of background music

Fix #37
Volume level option is made as an integer that can be used to reduce volume, with 2 levels:
for menu and for game levels (environment). As this volume level is defined on
logic subsystem of the game, it has to be passed down all the way to media player subsystem.
Right now, volume for menu is left as it was, while volume for levels is reduced 10 times.

@jogrimst Yes, it is easier to reduce volume for all audio tracks, but that would include tracks in menu and at the start of the game. Is it acceptable? What do you think about deleting music from the levels instead?
This additional code can be used if there would be new parts of the game involving background music that require control over volume.


parsers: default to not include unknown parameters

Changes the default query string/header parsing to not include unknowns.

I've updated the PR to remove webargs and rely on vanilla Marshmallow instead. This way we have full control of when we pass unvalidated or validated parameters.
Basically with webargs in the game, it wasn't possible to e.g. implement the facets properly in records-rest, and we cannot upgrade webargs easily.

I've updated the PR to remove webargs and rely on vanilla Marshmallow instead. This way we have full control of when we pass unvalidated or validated parameters.
Basically with webargs in the game, it wasn't possible to e.g. implement the facets properly in records-rest, and we cannot upgrade webargs easily.

Solved the header issue in discussion: we will start strict and see what breaks. Then if too many things break, we will switch to include. If few things break, we will just add the few things to the header parser.

Solved the header issue in discussion: we will start strict and see what breaks. Then if too many things break, we will switch to include. If few things break, we will just add the few things to the header parser.


Cannot install KB5015733 in windows/server:ltsc2022

Describe the bug
I'm trying to create a Windows Server 2022 (mcr.microsoft.com/windows/server:ltsc2022) (i.e. full edition) image w/ .NET Framework 3.5.
Installation of the 2022-08 Cumulative Update for .NET Framework 3.5 and 4.8 for Microsoft server operating system version 21H2 for x64 (KB5015733) fails, apparently due to a reboot being required.
I based my Dockerfile on the one from the official MS .NET Docker repo: https://github.com/microsoft/dotnet-framework-docker/blob/main/src/runtime/3.5/windowsservercore-ltsc2022/Dockerfile.
I guess the issue is that a reboot is requested by DISM, which, of course, is not possible when building a container. I tried wrapping the DISM command like this
@if not defined _echo echo off
setlocal enabledelayedexpansion

call %*
if "%ERRORLEVEL%"=="3010" ( exit /b 0 )

to deal with the non-zero exit code, but no matter what I do, the Hotfix is not installed in the final image.
Installation of the base CAB (microsoft-windows-netfx3-ondemand-package~31bf3856ad364e35~amd64~~.cab) works fine.
This is what the list of hotfixes looks like in the final image:
$ Get-HotFix

Source        Description      HotFixID      InstalledBy          InstalledOn
------        -----------      --------      -----------          -----------
ED8F5C4EF702  Update           KB5013630                          8/14/2022 12:00:00 AM
ED8F5C4EF702  Security Update  KB5016627                          8/6/2022 12:00:00 AM
ED8F5C4EF702  Update           KB5015897                          8/6/2022 12:00:00 AM

Configuration:

Edition: Windows Server 2022
Base Image being used: mcr.microsoft.com/windows/server:ltsc2022
Container engine: Docker
Container Engine version: 20.10.9

@mthalman Maybe you have an idea how to deal with this? Any feedback would be appreciated :)

Here's the dism.log

@sphr2k - I'm not seeing the same thing you are. I took the Dockerfile at https://github.com/microsoft/dotnet-framework-docker/blob/main/src/runtime/3.5/windowsservercore-ltsc2022/Dockerfile, replaced servercore with server in the base image tag, and it built fine. Make sure you've pulled the latest server base image.

@mthalman Sorry, you're right. I might have made a mistake along the way somehow.


1.5 preview 1: Heap corruption for self-contained unpackaged apps

Describe the bug
After updating to 1.5 preview 1, I observe the debugger stopping with the following message:
HEAP[App.exe]: Heap block at<PHONE_NUMBER>A81B50 modified at<PHONE_NUMBER>A81C36 past requested size of d6
This error does not occur with the 1.4 or 1.5 experimental releases. I can also avoid this issue by setting the MICROSOFT_WINDOWSAPPRUNTIME_BASE_DIRECTORY environment variable to null.
Stack trace:
[0x0]   ntdll!RtlpBreakPointHeap+0x16   0x579d57d6b8   0x7ffc25812d9a
[0x1]   ntdll!RtlpCheckBusyBlockTail+0x212   0x579d57d6c0   0x7ffc257e17a3
[0x2]   ntdll!RtlpValidateHeapEntry+0x4a82f   0x579d57d700   0x7ffc25815278
[0x3]   ntdll!RtlDebugFreeHeap+0xd8   0x579d57d740   0x7ffc257cc62e
[0x4]   ntdll!RtlpFreeHeap+0x8351e   0x579d57d7d0   0x7ffc2574be44
[0x5]   ntdll!RtlpFreeHeapInternal+0x7c4   0x579d57d930   0x7ffc2574ab11
[0x6]   ntdll!RtlFreeHeap+0x51   0x579d57d9f0   0x7ffb8e024d71
[0x7]   MRM!MrmFreeResource+0x21   0x579d57da30   0x7ffbf70b1160
[0x8]   Microsoft_Windows_ApplicationModel_Resources + 0x1160!Microsoft_Windows_ApplicationModel_Resources+0x1160   0x579d57da60   0x7ffbf70b9d66
[0x9]   Microsoft_Windows_ApplicationModel_Resources!DllGetActivationFactory+0x6976   0x579d57dab0   0x7ffbf70baad8
[0xa]   Microsoft_Windows_ApplicationModel_Resources!DllGetActivationFactory+0x76e8   0x579d57db40   0x7ffb43950acc
[0xb]   Microsoft_WindowsAppRuntime!MddGetIdForPackageDependencyContext+0xc86c   0x579d57db70   0x7ffb30ce6c53
[0xc]   Microsoft_ui_xaml!Windows::Foundation::ActivateInstanceABI::Microsoft::Windows::ApplicationModel::Resources::IResourceManager+0x2b   0x579d57dc10   0x7ffb30b65b9d
[0xd]   Microsoft_ui_xaml!ABI::Windows::Foundation::ActivateInstance+0xb   0x579d57dc50   0x7ffb30cdf095
[0xe]   Microsoft_ui_xaml!ABI::Windows::Foundation::ActivateInstance+0x13   0x579d57dc50   0x7ffb30cdf095
[0xf]   Microsoft_ui_xaml!ModernResourceProvider::Create+0x151   0x579d57dc50   0x7ffb30cdf095
[0x10]   Microsoft_ui_xaml!ModernResourceProvider::TryCreate+0x11   0x579d57dce0   0x7ffb30cc4806
[0x11]   Microsoft_ui_xaml!CWindowsServices::CreateResourceProvider+0x25   0x579d57dce0   0x7ffb30cc4806
[0x12]   Microsoft_ui_xaml!ResourceManager::Create+0x46   0x579d57dd40   0x7ffb30cc4794
[0x13]   Microsoft_ui_xaml!CJupiterControl::CreateResourceManager+0x44   0x579d57dd90   0x7ffb30b7bbad
[0x14]   Microsoft_ui_xaml!CCoreServices::GetResourceManager+0x5d   0x579d57ddc0   0x7ffb30bfa7d9
[0x15]   Microsoft_ui_xaml!CCoreServices::TryLoadXamlResourceHelper+0x75   0x579d57ddf0   0x7ffb30b6b0c1
[0x16]   Microsoft_ui_xaml!CCoreServices::TryLoadXamlResource+0x1f   0x579d57deb0   0x7ffb30b6afca
[0x17]   Microsoft_ui_xaml!CoreImports::CoreServices_TryGetApplicationResource+0x99   0x579d57deb0   0x7ffb30b6afca
[0x18]   Microsoft_ui_xaml!DirectUI::DXamlCore::ShouldTryLoadAppXaml+0x82   0x579d57df30   0x7ffb30b6b3e3
[0x19]   Microsoft_ui_xaml!DirectUI::DXamlCore::EnsureCoreApplicationInitialized+0xc3   0x579d57df80   0x7ffb30c2c1f5
[0x1a]   Microsoft_ui_xaml!DirectUI::FrameworkApplication::StartOnCurrentThreadImpl+0x55   0x579d57dfe0   0x7ffb30c2c177
[0x1b]   Microsoft_ui_xaml!DirectUI::FrameworkApplicationGenerated::StartOnCurrentThread+0x27   0x579d57e020   0x7ffb30cbc907
[0x1c]   Microsoft_ui_xaml!DirectUI::WindowsXamlManager::XamlCore::Initialize+0xe3   0x579d57e060   0x7ffb30b6a751
[0x1d]   Microsoft_ui_xaml!DirectUI::WindowsXamlManager::Initialize+0x1b1   0x579d57e0e0   0x7ffb30adcc03
[0x1e]   Microsoft_ui_xaml!ctl::ComObjectBase::CreateInstanceBase+0x13   0x579d57e170   0x7ffb30ccd6f4
[0x1f]   Microsoft_ui_xaml!ctl::ComObjectDirectUI::WindowsXamlManager::CreateInstanceDirectUI::WindowsXamlManager+0x60   0x579d57e1a0   0x7ffb30cc91f8
[0x20]   Microsoft_ui_xaml!ctl::ComObjectDirectUI::WindowsXamlManager::CreateInstance+0xd   0x579d57e1d0   0x7ffb30cc913d
[0x21]   Microsoft_ui_xaml!ctl::makeDirectUI::WindowsXamlManager+0x2c   0x579d57e1d0   0x7ffb30cc913d
[0x22]   Microsoft_ui_xaml!DirectUI::WindowsXamlManagerFactory::InitializeForCurrentThreadImpl+0x71   0x579d57e210   0x7ffb30cc90a3
[0x23]   Microsoft_ui_xaml!DirectUI::WindowsXamlManagerFactory::InitializeForCurrentThread+0x33   0x579d57e270   0x7ffb30c66470
[0x24]   Microsoft_ui_xaml!DirectUI::FrameworkApplication::StartDesktop+0x1e0   0x579d57e2b0   0x7ffb30c2c090
[0x25]   Microsoft_ui_xaml!DirectUI::FrameworkApplicationFactory::StartImpl+0x45   0x579d57e3b0   0x7ffae05fa305
[0x26]   Microsoft_ui_xaml!DirectUI::FrameworkApplicationFactory::Start+0x70   0x579d57e3b0   0x7ffae05fa305
[0x27]   Microsoft_WinUI!ABI.Microsoft.UI.Xaml.IApplicationStaticsMethods.Start+0x145   0x579d57e400   0x7ffae05f76ac
[0x28]   Microsoft_WinUI!Microsoft.UI.Xaml.Application.Start+0x2c   0x579d57e550   0x7ffae05f6fc2
Steps to reproduce the bug
Build a self-contained, unpackaged app with appsdk 1.5 preview 1
Expected behavior
No heap corruption
Screenshots
No response
NuGet package version
Windows App SDK 1.5 Preview 1: 1.5.240205001-preview1
Packaging type
Unpackaged
Windows version
Windows 11 version 22H2 (22621, 2022 Update)
IDE
Visual Studio 2022
Additional context
No response

Thank you!  I've attempted the repro the issue, but I'm not seeing a problem.  Can you please share a minimal sample that reproes the issue?
Hmm, I'm personally not aware of the significance of the "MICROSOFT_WINDOWSAPPRUNTIME_BASE_DIRECTORY" environment variable.

@lhak Thanks for your report.  I'm unable to repro this issue as well.
Here were my steps, based on your description:

Created a solution from the "Blank App, Packaged (WinUI 3 in Desktop)" template.
Edited the .csproj with these property additions:

     <WindowsAppSdkSelfContained>true</WindowsAppSdkSelfContained>
     <WindowsPackageType>None</WindowsPackageType>

Built the app against Windows App SDK 1.4
F5 launched with the Unpackaged profile
App ran successfully
Updated the Windows App SDK nuget reference to 1.5.240205001-preview1
Built the app again, and F5 launched successfully

@lhak I was able to repro a crash when launching a PublishSingleFile-generated exe.  This was due to a stale app manifest, created before I had set PublishSingleFile=true, and not later updated.  A workaround for that is to manually remove these manifests to force re-creation.  In my case, the files were obj\x64\Debug\net6.0-windows10.0.19041.0\win10-x64\Manifests*.manifest.  This is a bug we'll address in future.

I have attached a repro project here:
MrtCrashRepro.zip
Steps to reproduce the issue:
-Build project as Release / x64
-Launch the resulting .exe with windbg

@lhak Thanks for taking the trouble to provide a repro.  We'll have a fix for this available shortly.

The fix is in 1.5.0, now available


Cursor in editors turn white when using copilot in VSCode

My VSCode and Copilot is up to date
I've also added these lines to settings.json which sometimes (during today) fixes this issue, sometimes not:
{"workbench.colorCustomizations": {
    "editorCursor.foreground": "#000000"
}}

When I disable Copilot, the issue disappears.
I can just not see my cursor...

I have the same problem, and its really annoying ;)


Want to add links to the Boxes link[BUG]

Description
Describe the bug:
A clear and concise description of what the bug is.
There is no landing page please assign me the work.

Expected behavior:
It will show when we click on hackathons it has to show all the information about hackathons or upcoming hackathons.

No we are just giving a overview there, of what you can get. It's not a bug.


Information about Home Manager

First of all thanks for the awesome repo, I'm using a lot of things from it.
I just was wondering why u decided to not use Home Manager and copy and past the home config files manually,  did u found any issues or blockers with Home Manager?
Thanks for the incredible help :+1:

Thank you for using my repo. It's really nice to know that I've been able to help someone. 🤍
To be honest, there are no specific dealbreakers for me; perhaps all my configurations from the .config directory can be represented through the Home Manager configuration. Home Manager supports a wide range of configuration options (see here), and if there's an application that isn't directly supported, you can use the home.file option for such cases.
However, there were some reasons why I chose to configure my programs separately and manually:

Flexibility: I wasn't entirely sure if I could represent all my configurations through Home Manager, given that I use a variety of software and often experiment with cutting-edge tools. To avoid potential future problems and incompatibilities, I decided not to rely on Home Manager.

Consistency: I made a conscious decision to clearly separate system configurations from application configurations. I attempted to encapsulate all my system configurations in Nix config files, while keeping my application configurations in their native formats within the .config directory. I wanted to avoid a situation where some configurations are in Nix format (and applies through Home Manager) and others are in their native formats.

Efficiency: It was quicker and easier for me to work with native file formats for applications. This approach allowed me to reference official documentation, guides, or use default generated configs without the need to transform configurations into Nix format, which can be time-consuming.

Thank you once again for using my repository. I hope this answer addresses your question and assists you with your own configurations. Have a great day! 😊

Gotcha, thx for the very detailed response mate, it makes total sense 🫡

You're very welcome! 🌟😊


Shard errors due to too many indexes searched per visualization

Continuous shard exceptions in Kibana when process intensive visualizations are used in Dashboards.  This is due to the amount of data across indexes.

Changing logstash logging from daily timestamped indexes to monthly.

Fixed in v3.4
Reduced number of threat-* indexes.  Threat indexes are now done by month, rather than day.  New format is threat-.
Examples
Sep 2018 is threat-2018.09
Oct 2018 is threat-2018.10
This is controlled by the logstash pan-sfn.conf file in the Output stanza.


Deepvariant integration

Hi! Do you think about integrating deepvariant?

Hi @kokyriakidis,
Brad did a bunch of work comparing DeepVariant to the other callers here: https://github.com/bcbio/bcbio_validations/tree/master/deepvariant
and it is integrated in bcbio, but isn't documented. I think the ultimate conclusion was that the other callers did about just as well, but we haven't tested it since v0.6 and v0.8 is out so that conclusion might no longer hold. @chapmanb does that sound about right?

V0.8 is a major improvement. I would be nice compare it again with the
current version :)
Στις Πέμ, 22 Αυγ 2019 στις 11:37 μμ ο χρήστης Rory Kirchner <
<EMAIL_ADDRESS>έγραψε:

Hi @kokyriakidis https://github.com/kokyriakidis,
Brad did a bunch of work comparing DeepVariant to the other callers here:
https://github.com/bcbio/bcbio_validations/tree/master/deepvariant
and it is integrated in bcbio, but isn't documented. I think the ultimate
conclusion was that the other callers did about just as well, but we
haven't tested it since v0.6 and v0.8 is out so that conclusion might no
longer hold. @chapmanb https://github.com/chapmanb does that sound
about right?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bcbio/bcbio-nextgen/issues/2911?email_source=notifications&email_token=AIBLFXPUZEAPDLKPV2THAELQF32HHA5CNFSM4IOYTH6KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD46KGHQ#issuecomment-524067614,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AIBLFXL24VJPAWGTQ3RNL3LQF32HHANCNFSM4IOYTH6A
.

Thanks for this discussion. DeepVariant will work within bcbio and the main reason for lack of documentation is that the DeepVariant conda binary is pre-built so won't run on all of the platforms we support. We've worked hard to try and build from scratch to port to additional platforms but haven't been able to get that all working with the build dependencies. You should just be able to add variantcaller: deepvariant to your configuration and have it run. Please let us know if you run into any issues.

Thanks for the info! Does deepvariant in Bcbio use 0.8 model?

Yes, it'll include the latest release from bioconda (https://anaconda.org/bioconda/deepvariant) which is the 0.8 release. It'll be installed in the dv conda environment as part of the install. Hope this helps.

Thanks Brad! Let us know how deepvariant works for you Konstantinos!


new-feature/approval_reconcilation-api-endpoint

Pull Request Template
User Story
As an Admin-User I want to see the highest occurring and agreed upon location in the Admin Dashboard for an incident we've requested more information on. Determine how to handle consensus on suggestions for location information on incidents we request more information on via form.
Reasoning for the addition:  Admins want to review city , state, and time differences between different tweets about the incident id.  Currently there is no feature with the admin dashboard that allows the admin to look at other tweets.  This endpoints enables the front end team to be able to post incidents id and retrieve different data.
1.) Get data on different incident_ids for admin review
pass action parameter 0
This allows the admin to look at different cities, states, and dates
2.)  Bring all tweet ids that associated with incident_id
pass action parameter 1
This allows the admin to see all tweet ids in the system that have the same incident id
3.) Bring the total number of incident ids in conversation table to the admin.
pass action parameter 2
This allows the admin to see count of rows with the same incident id
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Locally and a new api end point will be added to the test file
Test Configuration:

Firmware version:
Hardware:
Toolchain:
SDK:

Checklist:

[X ] My code follows the style guidelines of this project
[ X] I have performed a self-review of my own code
[ X] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ X] My changes generate no new warnings
[ X] I have added tests that prove my fix is effective or that my feature works
[ X] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[ X] I have checked my code and corrected any misspellings

New API endpoint Test Here
curl -X 'POST'
'http://<IP_ADDRESS>:8000/approval_reconciliation/'
-H 'accept: application/json'
-H 'Content-Type: application/json'
-d '{
"incident_id": 1224,
"action": 0
}'
{
"0": [
{
"count": 3,
"root_tweet_city": "cHicago"
},
{
"count": 1,
"root_tweet_city": "foxlike"
}
],
"1": [
{
"count": 3,
"root_tweet_state": "ILLInoIs"
},
{
"count": 1,
"root_tweet_state": "Wisconsin"
}
],
"2": [
{
"count": 4,
"incident_date": "2020-05-30"
}
]
}

curl -X 'POST'
'http://<IP_ADDRESS>:8000/approval_reconciliation/'
-H 'accept: application/json'
-H 'Content-Type: application/json'
-d '{
"incident_id": 1224,
"action": 1
}'
[
{
"tweet_id": "7832"
},
{
"tweet_id": "9655585230177891645"
},
{
"tweet_id": "6615007953146320971"
},
{
"tweet_id": "2581507576373219659"
}
]

curl -X 'POST'
'http://<IP_ADDRESS>:8000/approval_reconciliation/'
-H 'accept: application/json'
-H 'Content-Type: application/json'
-d '{
"incident_id": 1224,
"action": 2
}'
[
{
"anon_1": 4
}
]


[FIF 244] Update the main README to reduce confusion with install instructions

Our main readme does not mention why we have README and install markdown files, or their purpose. This PR updates the install instructions specific to the database project and adds a list of our READMEs to distinguish them from install instructions.

Removing the installation instructions per @david-clements-ed-fi


Add missing streamer for TStreamerInfo::kCharStar (char *)

Are there ROOT class with such data member?
Should I apply patch for master?

Alice has one (at least), see for example AliPerformanceObject

P.S. I don't think is is needed in the master.
BTW, there are still issues when reading some Alice files (see this example)

Problem is fixed now - it was missing support of members like:
TH1F *fhArr[3]; //-> several preallocated histograms

Now should work.


ecs.Service deployment marked successfully updated in pulumi when ECS deployment failed and has been rolled back

Describe what happened
When the ECS service has deployment_circuit_breaker configured with rollback=True, even if deployment of a new version of task definition failed and ECS rolled back service to the previous stable version, pulumi still marks the deployment of ecs.Service resources as successfullyupdated.
     Type                 Name                            Status             Info
     pulumi:pulumi:Stack  dev                         2 warnings
 ~   └─ aws:ecs:Service   service  updated (246s)     [diff: ~taskDefinition]

Sample program
name ="test"

ecs_cluster = aws.ecs.Cluster(
    name,
    settings=[
        aws.ecs.ClusterSettingArgs(
            name="containerInsights",
            value="enabled",
        )
    ],
)

aws.ecs.Service(
    name,
    cluster=ecs_cluster.arn,
    desired_count=2,
    launch_type="FARGATE",
    task_definition=task_definition.arn,
    name="service",
    deployment_circuit_breaker=aws.ecs.ServiceDeploymentCircuitBreakerArgs(enable=True, rollback=True),
    deployment_maximum_percent=200,
    deployment_minimum_healthy_percent=100,
    network_configuration=aws.ecs.ServiceNetworkConfigurationArgs(
        assign_public_ip=False,
        subnets=ecs_subnets.ids,
        security_groups=[sg.id],
    ),
    wait_for_steady_state=True,
  )

Log output
No response
Affected Resource(s)
No response
Output of pulumi about
CLI
Version      3.130.0
Go Version   go1.22.6
Go Compiler  gc

Host
OS       darwin
Version  14.6.1
Arch     arm64

Backend
Name           pulumi.com
Token type     personal

Additional context
No response
Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

Thanks for reporting this bug @eliskovets , at a first glance this appears to be the result of https://github.com/hashicorp/terraform-provider-aws/issues/19519
A fully-self contained example including a task that fails the health checks to reproduce this would be highly appreciated.

I guess it's more connected to the issue https://github.com/hashicorp/terraform-provider-aws/issues/20858


[enhancement] cluster variable support

Thanks for very nice dashboards.
One thing missing is a variable "cluster" maybe. Having multiple clusters it is useful to limit scope to a single cluster. A multi-select variable accepting all and queries adding "cluster=~"$cluster".

Hi @tesharp, you can achieve this by using the Datasource variable; just configure each of your clusters as datasources.

Hi @dotdc , first of I really think this is great stuff. Came here from your Medium post, and I'm glad some of us show that FR people can do stuffs too :)
Anyway, even though you're right for Datasources, there is the use-case of people using a Prom federation, or who uses tools like Thanos (even Grafana Mimir but I haven't tried it) in order to achieve global monitoring of several clusters from the same point.
In the case of Thanos - for which I'm familiar with - we get all the data in the same "bucket", therefore our Grafanas usually point to 1 DS to viz a several clusters.
I was about to open an issue before finding this one, I'm keen to propose a PR adding a cluster var and let you decide whether or not you want to integrate it, wdyt ?

It makes completely sense. I'll probably fork the project and add the variable in our project, at least for now.

I'd be happy to include this feature if you make a tool or script that injects the necessary variables and labels to the dashboards.
This way, everyone will benefit from your work and it will also be easier for you to update.

We could use GitHub Actions to publish a set of new dashboards, maybe prefixed with multicluster-, with a cluster variable in the queries ?
That way, it would be possible to have both types of dashboards in the same repo, and even publish both version on Grafana.
But at the very least, they would be here to be consumed by the Grafana configuration as raw.
I've never really work with Actions as I'm mostly using GitLab, but I could give it a try.
I guess a quite simple working solution could be a shell script doing some sed.

That was the idea, if you create a tool that can inject the labels & variables in the script, I will make a special release for them.

@dotdc how about usage of jsonnet?
i know that https://github.com/grafana/grafonnet-lib doesn't support grafana 9. but i can try to build dashboard generation on bare jsonnet, without grafonnet
I can prepare changes if you are fine with the approach

Hi @k1rk,
The only requirement I have is that the source must remain flat JSON Grafana dashboards.
If you can provide a script, in any language, that can generate a copy of the dashboards and inject the missing cluster label in them, it would be the perfect solution to me.
Let me know.

I am still slow do not know what to do

Help

Blocked @jud336 for spamming issues and commits.

Did anyone manage to script this? Would love to add the functionality for multi-cluster support.
Excellent dashboards btw, thanks!

I have same issue, too..

Hi @keith-e-munro,
I don't think anyone did it yet, but we can discuss the topic further if you're willing to do it.
I personally use one datasource per cluster, even when using Thanos, so I don't have to rely on the cluster variable.

i opened MR https://github.com/dotdc/grafana-dashboards-kubernetes/pull/59 on this issue

Thank you @cebidhem! I understand the need and also used the $cluster variable in the past. The problem is that the cluster label is not available by default, I guess you have a custom rule that adds it. If I add the cluster variable and label in my dashboards, they will not work without it, and will break the dashboards for most users.
I don't think you can create a PromQL query with an optional label, if any of you know a way of doing this, I'm really interested. If you have other ideas to solve this, we can discuss it here.

First of all, very nice set of dashboards 👏 .
Not sure if I have all the context, but non-existing labels should not break the query, at least not in recent versions of Prometheus e.g. > 2.45.0 (could not find whether this was a fix at some point); so adding a variable with default empty value and a label like cluster="$cluster" in the dashboard queries will work since the metric value is returned in case the label is not defined {cluster=""}

I am not sure whether this is related, but I am experiencing issue that dashboard picks up non-kubernetes nodes (in this case openwrt node-exporter).
It incorrectly shows other non-kubernetes node.

As I use kube-prometheus-stack I am adding the openwrt node-export with prom operator CRD. Could it be that it is picking it up as k8s node due it being defined as service endpoint?
`---
kind: Service
apiVersion: v1
metadata:
name: openwrt-prometheus-metrics
labels:
app: openwrt-prometheus-metrics
spec:
type: ClusterIP
ports:

name: metrics
port: 9100
targetPort: 9100

kind: Endpoints
apiVersion: v1
metadata:
name: openwrt-prometheus-metrics
subsets:

addresses:

ip: <IP_ADDRESS>
ports:
name: metrics
port: 9100

apiVersion: monitoring.coreos.com/v1
kind: ServiceMonitor
metadata:
name: openwrt-servicemonitor
spec:
selector:
matchLabels:
app: openwrt-prometheus-metrics
endpoints:
- port: metrics
interval: 30s
path: /metrics
namespaceSelector:
any: true`

Hi @AndrisJé,
There is no differentiating label for Kubernetes nodes here.
I would recommend running a dedicated Prometheus instance for your cluster.
In order to keep the issue on topic, please open a dedicated issue if you want to discuss it further.

@dotdc I retest this in Promtheus 2.0.0 and cluster="" still works there. From my point of view, this should unlock the Feature Request

Sorry for the delay, I know this has been asked for quite some time.
@jkroepke thank you for this input, I think it's safe enough to give it a shot.
I'll convert the global view and share it beginning of next week so you can test and let me know if it works on your various setups.

Just added the cluster variable in k8s-views-global.json in this PR : https://github.com/dotdc/grafana-dashboards-kubernetes/pull/78
If anyone has time to try it, and let me know if it works on your side.

I give some feedback on PR

Thank you @jkroepke, just made the according change :+1:
Let me know if you notice anything else.

Just did the namespaces, nodes and pods views (https://github.com/dotdc/grafana-dashboards-kubernetes/pull/82).
I'll wait for more feedback before doing the same for the remaining dashboards.

How to add additional label in Prometheus Operator? As it isn't default label.

How to add additional label in Prometheus Operator? As "cluster" isn't default label.

Hi @AndrisJrs, you can add this label using static_configs or relabel_configs, but only if you need it.
This addition was made for Thanos users (or similar) using a single datasource for multiple clusters (global queries).
All PromQL queries should work without this label, let me know if it's not the case on your setup.

Hi @doc,
I looked into #82. Since multi-value is dropped, the query can be optimized to cluster="$cluster" instead cluster=~"$cluster". Not sure if it really has an impact.

True, made the change in #84

Hi @dotdc, Thanks for the tip. It works fine without label. I wanted to see whether it will fix non-kubernetes node-exporters leaking into dashboard like I reported earlier in this thread.
Works perfectly after adding relabelings. Thank you 👍

Just merged https://github.com/dotdc/grafana-dashboards-kubernetes/pull/90 with the missing dashboards. :tada:
Please open a new issue if you see any bugs related to this.
Thank you all for your ideas !

:tada: This issue has been resolved in version 1.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Improve error messages

Some common errors that should be checked and result in a useful error message:

git not installed
git version not supported
repository not found
commit not found
merge conflict

--create-branch
_pygit2.AlreadyExistsError: failed to write reference 'refs/heads/release-drafter-5.11.0': a reference with that name already exists.


Removed some dangerous adapter delegate mothods

Details:

Removed onViewRecycled
Removed onFailedToRecycleView
Removed onViewAttachedToWindow
Removed onViewDetachedFromWindow

If you need to do something on the removed methods above, you'd better
inherit MultiTypeAdapter do it.

Relate to #102

Sorry to do so. Perhaps wait until v3.0, we can again to consider another form to support these interfaces, that is, establish a linker role, maybe.

Fixed #102


add Laravel 11.x support

closes #13

Hello @ousid ,
Any plans to setup a release for the Laravel 11.x compatibility?
Many thanks

Hi, @markcameron
yes, will try to close this today, or tomorrow max.


Migrate the article about public access in vpc

Fixes #394

Hey, what kind of help you need here?

Added improvements to the content, @encima, could you have another look?


choco pin isn't working

Boxstarter 2.9.26 is misinterpreting choco pin and thinks there are package names to install, rather than pinning a package.
Such that choco pin add -n=GoogleChrome looks for a package named 'add' and also 'googlechrome'

Install-BoxstarterPackage https://gist.githubusercontent.com/flcdrg/87802af4c92527eb8a30/raw/pin-example.ps1
Boxstarter: Installing package https://gist.githubusercontent.com/flcdrg/87802af4c92527eb8a30/raw/pin-example.ps1
Boxstarter Version 2.9.26
(c) 2017 Matt Wrock. http://boxstarter.org
Boxstarter: Disabling Automatic Updates from Windows Update
Attempting to build package from 'tmp3C90.tmp.nuspec'.
Successfully created package 'C:\Users\David\AppData\Roaming\Boxstarter\BuildPackages\tmp3C90.tmp.1.0.0.nupkg'
Boxstarter: Created a temporary package tmp3C90.tmp from https://gist.githubusercontent.com/flcdrg/87802af4c92527eb8a30/
raw/pin-example.ps1 in C:\Users\David\AppData\Roaming\Boxstarter\BuildPackages
++ Boxstarter starting Calling Chocolatey to install tmp3C90.tmp. This may take several minutes to complete...
Installing the following packages:
tmp3C90.tmp
By installing you accept licenses for the packages.
[NuGet] Installing 'tmp3C90.tmp 1.0.0'.
[NuGet] Successfully installed 'tmp3C90.tmp 1.0.0'.
tmp3C90.tmp v1.0.0 (forced)
tmp3c90.tmp package files install completed. Performing other installation steps.

Boxstarter starting Calling Chocolatey to install add. This may take several minutes to complete...
Boxstarter starting Calling Chocolatey to install add. This may take several minutes to complete...
Installing the following packages:
add;GoogleChrome
By installing you accept licenses for the packages.
add not installed. The package was not found with the source(s) listed.
If you specified a particular version and are receiving this message, it is possible that the package name exists but the version does not.
Version: ""
Source(s): "https://licensedpackages.chocolatey.org/api/v2/;https://chocolatey.org/api/v2/"
GoogleChrome v59.0.3071.104 already installed. Forcing reinstall of version '59.0.3071.104'.
Please use upgrade if you meant to upgrade to a new version.
[NuGet] Uninstalling 'GoogleChrome 59.0.3071.104'.

Boxstarter is currently very install/update centric. In other words, it does not work well with other choco commands. I experimented with a fix so that if one runs another command like pin, that command gets propperly forwarded to the chocolatey library call.
Unfortunate I think this is suffering from the same issue as #264 because although it is clearly passing pin to the choco dll, chocolatey is trying to perform an install. My hypothesis is that it does this because the "outer" package is performing an install and this "sticks" to the inner calls.

bump - same here with choco source
I'm trying to install a chocolatey-patches package that uses choco source a couple of times i.e.
  $(choco source) | ForEach-Object {
    $feed = $_
    foreach ($lf in $legacyFeeds) {
      if (-Not $feed.Contains($lf)) {
        continue
      }
      $feedname = $feed.Split(" ")[0]
      Remove-ChocoFeed $feedname
    }
  }

Any chance to get this fixed soon?

Use Install-ChocolateyPinnedTaskBarItem instead

Are you sure? I think you're mixing two different concepts.
Choco pin fixes the version number so that chocolatey won't upgrade the package.
The cmdlet you mention is for creating a shortcut on the Windows task bar (which no longer works on Windows 10 anyway)
Get Outlook for iOShttps://aka.ms/o0ukef

From: Matt Kerr<EMAIL_ADDRESS>Sent: Thursday, October 12, 2017 6:54:45 AM
To: mwrock/boxstarter
Cc: David Gardiner; Author
Subject: Re: [mwrock/boxstarter] choco pin isn't working (#265)
Use Install-ChocolateyPinnedTaskBarItem instead
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/mwrock/boxstarter/issues/265#issuecomment-335936827, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAXe6wt8NQB1LYSsFIgKQhAzxACE5UEVks5srSQNgaJpZM4OA2TD.

Boxstarter function "chocolatey" completely ignores what command is passed to chocolatey, (i.e. install, update, source, pin, ...)
see https://github.com/chocolatey/boxstarter/blob/master/Boxstarter.Chocolatey/Chocolatey.ps1#L94
There should be something like
    if ($command -ne "install" -and $command -ne "update") {
        Call-Chocolatey @PSBoundParameters @args
        return
    }

that would probably fix this issue and a couple of other "weird issues"

need to look a bit further into this, but want to get it fixed for the next release.


[ltsr] new artifactory image endpoint (cs operator)

Signed-off-by: YuChen Shen

/retest

/retest


Caching layer + API tests

Probably the quickest band-aid is to include tests/e2e_regression/reindex_and_run.sh in CI (needs to be tweaked first). The script runs the indexer on a fixed set of blocks, then queries the API and compares responses against hardcoded expected responses. Limitations:

Can only use the public grpc node because we'd be accessing the node from CI. This means no sapphire; does it limit us in other ways?
If we're desperate, we can even just check the expected responses into git and then manually hold each other accountable to run the test locally when modifying the API layer. Not an acceptable long-term solution, but perhaps better than nothing right now.

Alternatives:

Dump a good number of blocks (100-1000?) from the node into file(s), refactor analyzer to be able to read those. That's been on the long-term wishlist anyway, for quick local testing and for e2e testing.
Large manual test inputs: Hand-craft "blocks" (structs of types that would normally be responses from the node) that explicitly test individual APIs.

My current vote would be to go with the minimal-effort thing (regression e2e test), then add Alternative 1 (or even block the task on it, if the public node does not suffice). But I'm very open to other thoughts.

Implemented by https://github.com/oasisprotocol/nexus/pull/360


Strange behaviour in the votes of these reports

In these reports there seems to be a problem with the number of abstention votes. However when looking at the report they seem to be correct.
~~https://www.dekamer.be/doc/PCRI/html/54/ip259x.html~~
https://www.dekamer.be/doc/PCRI/html/54/ip228x.html
~~https://www.dekamer.be/doc/PCRI/html/53/ip078x.html~~
~~https://www.dekamer.be/doc/PCRI/html/53/ip061x.html~~

For the double abstention voters I already have a theory: If these reports do not contain any more <p> tags at the end of the page the parsing algorithm will double them

This theory turned out to be true, fix was quick however the issue with meeting 228 seems to be more involved.


Hive 21386: Extend the fetch task enhancement done in HIVE-21279 to make it work with query result cache

This patch brings the following changes:

If result cache is enable for a query (select), results will be written to result cache dir instead of tmp scratch dir.
Query result cache will then cache the set of files if it can for the query, instead of moving and caching the result directory.

Merged


Try alternative view for date range facet

background: #164 was merged in response to the default behavior of blacklight's date facet displaying oddly when there was only 1 date option.
However, showing the date range slider when their is only 1 date is also awkward.
Done when we take a stab at reverting to Blacklight's default behavior, but tweak the placement to make it look pretty.

One round-about approach to this would be tag-ex (#208): even after narrowing you would still see the full range of years.

@afred / @caseyedavis12 : what should happen with this? Options I can think of:

Fine as is.
use tag-ex to always show the full date-range of the collection.
hide the graph if there is only 1 (or 2 or 3?) years covered.

@mccalluc: I think it is fine as is.

From: mccalluc<EMAIL_ADDRESS>Sent: Thursday, May 5, 2016 3:16:30 PM
To: WGBH/openvault3
Cc: Casey Davis; Mention
Subject: Re: [WGBH/openvault3] Try alternative view for date range facet (#170)
@afredhttps://github.com/afred / @caseyedavis12https://github.com/caseyedavis12 : what should happen with this? Options I can think of:

Fine as is.
use tag-ex to always show the full date-range of the collection.
hide the graph if there is only 1 (or 2 or 3?) years covered.

You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHubhttps://github.com/WGBH/openvault3/issues/170#issuecomment-217249811

ok. closing.


EventHubConsumerClient is restarting reading of the partitions from the start of partition instead of respecting starting_position

Package Name: azure-eventhub
Package Version:
azure-eventhub5.1.0
azure-eventhub-checkpointstoreblob==1.1.0
Operating System: Linux
Python Version: 3.8.1

Describe the bug
We are using EventHubConsumerClient  as as intelligent consumer agents for managing the reading of different readers from one consumer group. We use BlobCheckpointStore as  checkpoint_store when creating a consumer but we use it only for managing of the readers not for check-pointing since we need to go back 50h in the past when the consumer is restarted. We are providing the starting_position in receive method. Our starting position is 50h in the past and works fine when the consumer group is started for the first time. But if there is any restart or we decide to stop and start the reader again, the reading of the partitions is starting from the start and with 50h offset as we want.
To Reproduce
Steps to reproduce the behavior:

Create a new consumer group for the topic

Create EventHubConsumerClient
consumer_client = EventHubConsumerClient.from_connection_string(
conn_str=connection_str,
consumer_group=consumer_group,
checkpoint_store=checkpoint_store,
auth_timeout=0
)

Start receiving event
consumer_client.receive(on_event=on_event, **{'starting_position': offsetdate})

Result: The events are received starting from the offset - which is correct

Stop the consumer and run it again with the same consumer group

Result: The events are received from the start of the partition
Expected behavior
After restarting the consumer with the same consumer group, it should start reading from the offset which we set on receive method.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.

Hey Snezhana, thanks for reaching out.
From a brief read of the docstrings for starting_position and the code surrounding the checkpoint init logic the behavior would seem to line up with the symptoms you observed wherein the starting_position is only observed if there isn't a checkpoint in the store; this begs the question if you're checkpointing at all?  (Given your mentioned intent to only use offset I might assume not, which would connect the dots as the checkpoint store would likely be initialized to the start of the partition, but figured I should ask.)
We'll need to look into this in the coming week if the above doesn't explain what's going on, but I would mention that this isn't the first request we've had for a "offset prior to now" style of read, and I'll make sure to convey this.  In terms of potential workarounds;  perhaps hold onto some amount of history and not checkpoint until you know you have, in your case, 50h of new events? (so that you can rely on the checkpoint store exclusively)
Don't hesitate to let me know if I've misunderstood some aspect of this, or if further clarity is needed.

Hi, Thanks for the replay.
Yes, indeed, we use the checkpoint store only to manage the reading of more pods with same consumer group, but we don't checkpoint the offset cause of the 50h history we need.
So, as I understood, currently there is no way to use starting_postition and checkpoint store together in our situation, unless we implement workaround?

Correct; sorry to not be able to give a neater solution to this out-of-box.
That said, don't hesitate to let me know if you had any other questions or help I could provide in line with this.

Closing as I believe we have a mitigation/understanding of the current interaction.  Don't hesitate to reopen this, and if this scenario continues to be a friction point for folks, I'm more than happy to accumulate those asks to present a case to allow this, so anyone (addressing this both to OP and anyone who comes across this in the future) can feel free to give a shout if relevant.


[UNIVERSAL MODE] Nuxtjs fetches 2x on async created

Version
v2.10.2
Reproduction link
https://github.com/ram231/INFORM.ED
Steps to reproduce
I'm using strapi for API prototyping. then I found out that whenever I reload the page, the logger prints 2 HTTP methods per request, if I'm navigating to other routes, it only fetches 1 request.
async beforeCreate(){
    try {
     // using @nuxt/axios plugin.
     await this.$axios.get('url') // dummy url. but you get the point.
    } catch (error) {
      console.log(error)
    }
}

What is expected ?
Single requests
[2019-11-01T14:51:20.019Z] debug GET \API(68 ms) 200
What is actually happening?
2 Request on loading the page(SSR + CSR).
[2019-11-01T14:51:20.019Z] debug GET \API(68 ms) 200
[2019-11-01T14:51:21.486Z] debug GET \API(17 ms) 200
Additional comments?
Although, using asyncData will only fetch the data once. putting in to other methods(such as created/mounted/beforeMount/beforeCreate) will have 2 requests instead of 1

This bug report is available on Nuxt community (#c9975)

Hi. You have to use either fetch or asyncData. If you want to fetch data only on client side, then mounted hook. Don't use created or beforeCreate for data fetching and async operations.

Thanks. If I want to fetch data that is not in the page component. I'll be likely to use mounted instead of other methods.


Performance problem and Error handling

Windows 11/MSVC Rustc 1.70
and Debian 12 Rustc 1.76
iceoryx 0.2.2 and also iox2-100-pub-sub-without-lifetime-arg
Observed result or behavior:
I've adapted the examples into a single program that i run with either subscriber or publisher as a command line argument. The main difference from the examples is that sending and receiving the messages at a much higher rate.
use core::time::Duration;
use std::env;
use std::thread::sleep;
use iceoryx2::prelude::*;
use iceoryx2_bb_container::byte_string::FixedSizeByteString;
use iceoryx2_bb_container::vec::FixedSizeVec;
use iceoryx2_bb_posix::signal::SignalHandler;

const CYCLE_TIME: Duration = Duration::from_nanos(1);

#[derive(Debug)]
pub struct BigMessage {
    pub process_id: u32,
    pub req_id: u32,
    pub op_type: i32,
    pub file_id: FixedSizeByteString<128>,
    pub txn_id: u64,
    pub key_data: FixedSizeVec<u8, 64>,
    pub record_data: FixedSizeVec<u8, 64000>,
    pub original_data: FixedSizeVec<u8, 64000>,
}

fn main() -> Result<(), Box<dyn std::error::Error>> {

    let service_name = ServiceName::new("My/Funk/ServiceName")?;

    let service = zero_copy::Service::new(&service_name)
        .publish_subscribe()
        .open_or_create::<BigMessage>()?;

    let args: Vec<String> = env::args().collect();

    if args.len() < 2 {
        println!("Usage: {} <publisher|subscriber>", args[0]);
        return Ok(());
    }

    println!("Running as {}", args[1]);

    if args[1] == "publisher" {
        let publisher = service.publisher().create()?;
        let mut counter = 0;
        loop {
            if SignalHandler::termination_requested() {
                break;
            }
            counter += 1;
            loop {
                let sample = publisher.loan_uninit()?;
                let sample = sample.write_payload(BigMessage {
                    process_id: 1,
                    req_id: counter,
                    op_type: 3,
                    file_id: FixedSizeByteString::from_bytes(b"test").map_err(|e| { "error" })?,
                    txn_id: 4,
                    key_data: FixedSizeVec::new(),
                    record_data: FixedSizeVec::new(),
                    original_data: FixedSizeVec::new(),
                });
                if publisher.send(sample)? == 0 {
                    //it didnt work but also didnt return a real error, sleep and try again
                    sleep(CYCLE_TIME);
                } else {
                    break;
                }
            }
            //println!("sent");
        }
    } else {
        let subscriber = service.subscriber().create()?;
        let counter = 0;{
        loop {
            match subscriber.receive()? {
                None => {
                    sleep(CYCLE_TIME);
                    if SignalHandler::termination_requested() {
                        break;
                    }
                },
                Some(sample) => {
                    if sample.payload().req_id % 1000 == 0 {
                        println!("received");
                    }
                }
            }
        }

        }
    }
    Ok(())
}

I've also been fiddling with the config file mostly these four settings
publisher_history_size
subscriber_max_buffer_size
enable_safe_overflow
unable_to_deliver_strategy

Part 1 of my issue is that I just cant seem to move the messages around very fast, its less than 1k messages per second on my 7900x. Ive tried debug and release builds and haven't noticed any significant difference.
Part 2 of my issue is that I cant seem to make it reliable. If I just give it a big number for publisher_history_size and subscriber_max_buffer_size it seems to be mostly reliable but occasionally I will still see publisher.send(...) return 0 and print something like this to the console. Rather than return 0 I would have thought it would return an error.
Publisher { port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>562966903244646632352716 }), sample_reference_counter: [2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 2, 1, 1, 1, 2,
              1, 1, 2, 1, 1, 1, 2, 1, 2, 1, 1, 1, 1, 1, 1, 2, 1, 2, 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 2, 1, 1, 2, 1, 1, 1, 1, 1, 1, 2, 1, 2, 1, 1, 1, 2, 2, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
              0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,
              0, 0, 0, 0, 0], data_segment: Memory { shared_memory: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 60, data: "iox2_21940_1738265885562966903244646632352716.publish
              er_data" } }, size: 19383105, base_address: 0x1f8ac2d0000, has_ownership: true, file_descriptor: FileDescriptor { value: 0, is_owned: true }, memory_lock: None }, name: FileName { value: Fi
              xedSizeByteString<255> { len: 40, data: "21940_1738265885562966903244646632352716" } }, allocator: 0x1f8ac2d0000 }, config: LocalPublisherConfig { max_loaned_samples: 2, unable_to_deliver_s
              trategy: Block }, subscriber_connections: SubscriberConnections { connections: [UnsafeCell { .. }, UnsafeCell { .. }], port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>562966903
<PHONE_NUMBER>52716 }), config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services",
               publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connect
              ion" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, publisher_
              max_loaned_samples: 2, publisher_history_size: 16, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, static_config:
               StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 16, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, enable_safe_overflow: false, type_name: "iceo
              ryx_test::BigMessage" } }, subscriber_list_state: UnsafeCell { .. }, history: Some(UnsafeCell { .. }), service: Service { state: ServiceState { static_config: StaticConfig { uuid: "b61bd15e
              8c3ea16146985e960906a8e125156a73", service_name: ServiceName { value: FixedSizeByteString<255> { len: 19, data: "My/Funk/ServiceName" } }, messaging_pattern: PublishSubscribe(StaticConfig {
               max_subscribers: 2, max_publishers: 5000, history_size: 16, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, enable_safe_overflow: false, type_name: "iceoryx_test::BigMe
              ssage" }) }, global_config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services",
               publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connect
              ion" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, publisher_
              max_loaned_samples: 2, publisher_history_size: 16, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, dynamic_storag
              e: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105238, base_address: 0
              x1f8ac2b0000, has_ownership: false, file_descriptor: FileDescriptor { value: 2, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61
              bd15e8c3ea16146985e960906a8e125156a73" } }, _phantom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, static_storage: Storage { name: FileName { value: FixedSizeByteSt
              ring<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, config: Configuration { path: Path { value: FixedSizeByteString<255> { len: 25, data: "c:\Temp\iceoryx2\services"
              } }, suffix: FileName { value: FixedSizeByteString<255> { len: 8, data: ".service" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, data: "iox2_" } } }, has_ownership: fals
              e, file: File { path: Some(FilePath { value: FixedSizeByteString<255> { len: 79, data: "c:\Temp\iceoryx2\services\iox2_b61bd15e8c3ea16146985e960906a8e125156a73.service" } }), file_descripto
              r: FileDescriptor { value: 1, is_owned: true } }, len: 343 } } }, degration_callback: None, loan_counter: 1, _dynamic_config_guard: UniqueIndex { value: 0, index_set addr: 0xc3acd1f920 }, _
              phantom_message_type: PhantomData<iceoryx_test::BigMessage> }
              | Unable to send sample via connection Connection { sender: Sender { shared_memory: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 85, data: "iox2_173826588556296690
              |<PHONE_NUMBER>352716_2349590387523030532116418894603304.connection" } }, size: 1182, base_address: 0x1f8ac290000, has_ownership: false, file_descriptor: FileDescriptor { value: 3, is_owned: t
              | rue }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 69, data: "1738265885562966903244646632352716_2349590387523030532116418894603304" } } } } since the ret
              | rieve buffer is full. This can be caused by a corrupted retrieve channel.

Any help, pointers or suggestions you can provide would be much appreciated.

@hippiehunter
For Part 2 of your error message, this is a bug and it seems I have miscalculated the required size of the retrieve channel - possibly the usual off by one error ;) . I will fix this!
For Part 1. I think the bottleneck is maybe the line sleep(CYCLE_TIME); with a cycle time of 1 ns. In the worst case, the process states to the OS scheduler, please let me sleep and then is wakened up some time later and this process of scheduling another process and then wake the current process up again and continue can be very expensive.
But the solution is simple: remove the line sleep(CYCLE_TIME); and let's see if it changes anything.

@hippiehunter Btw, the settings can also be set via:

publisher_history_size
subscriber_max_buffer_size
enable_safe_overflow
unable_to_deliver_strategy

 let service_name = ServiceName::new("My/Funk/ServiceName")?;
 let service = zero_copy::Service::new(&service_name)
     .publish_subscribe()
     .history_size(12)
     .subscriber_max_buffer_size(5)
     .enable_safe_overflow(true)
     .open_or_create::<TransmissionData>()?;
 service
     .publisher()
     .unable_to_deliver_strategy(UnableToDeliverStrategy::DiscardSample);

@hippiehunter Part 2 should be fixed now.
If you confirm that the removal of every occurrence of sleep(CYCLE_TIME); fixes your performance problem, I would close the issue.

When i remove the sleep(CYCLE_TIME); call I cant get the publisher connected to the subscriber.
PublisherConnections { connections: [UnsafeCell { .. }, UnsafeCell { .. }, UnsafeCell { .. },
...
UnsafeCell continues for a while
...
, subscriber_id: UniqueSubscriberId(UniqueSystemId { value:<PHONE_NUMBER>441627454765778268903520 }), config: Config { global: Global {
               root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creat
              ion_timeout: 500ms, connection_suffix: ".connection" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, publisher_max_loaned_samples: 2, publisher_history
              _size: 16, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, static_config: StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 16, subscriber_max_buffer_size: 64, subscriber_max_borro
              wed_samples: 2, enable_safe_overflow: false, type_name: "iceoryx_test::BigMessage" } }, service: Service { state: ServiceState { static_config: StaticConfig { uuid: "b61bd15e8c3ea16146985e960906a8e125156a73", service_name: ServiceName { value: FixedSizeByteString<255> { len: 1
              9, data: "My/Funk/ServiceName" } }, messaging_pattern: PublishSubscribe(StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 16, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2, enable_safe_overflow: false, type_name: "iceoryx_test::BigMess
              age" }) }, global_config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service
              ", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connection" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 64, subscriber_max_borrowed_samples: 2,
               publisher_max_loaned_samples: 2, publisher_history_size: 16, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, dynamic_storage: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<
              255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105238, base_address: 0x1e925fe0000, has_ownership: false, file_descriptor: FileDescriptor { value: 1, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<25
              5> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, _phantom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, static_storage: Storage { name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e12515
              6a73" } }, config: Configuration { path: Path { value: FixedSizeByteString<255> { len: 25, data: "c:\Temp\iceoryx2\services" } }, suffix: FileName { value: FixedSizeByteString<255> { len: 8, data: ".service" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, dat
              a: "iox2_" } } }, has_ownership: false, file: File { path: Some(FilePath { value: FixedSizeByteString<255> { len: 79, data: "c:\Temp\iceoryx2\services\iox2_b61bd15e8c3ea16146985e960906a8e125156a73.service" } }), file_descriptor: FileDescriptor { value: 0, is_owned: true } }, l
              en: 343 } } }, degration_callback: None, publisher_list_state: UnsafeCell { .. }, _phantom_message_type: PhantomData<iceoryx_test::BigMessage> }
              | Unable to establish connection to new publisher UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>656926372933486367672852 })

@hippiehunter I used your code can confirm the bug. It is a little weird race, both check successfully that the underlying resource is not existing, then both want to create this resource and only one can win this race - the other one is then complaining that the resource already exists and this is the error message you see.
The solution is simple, try to open it again and everything shall work. We encountered exactly the same thing on a different place already. I will try to fix this today.

@hippiehunter I fixed the connection issue, but there is still homework left:

I still encountered one very rare occasions the retrieve buffer is full issue
We need to introduce a flag to track the connection creation

I will look into them and fix them as soon as possible. But in the meantime you should be able to continue when you base your work on: https://github.com/eclipse-iceoryx/iceoryx2/pull/124
I adjusted your code a bit to get a clearer understanding, and when I removed the sleep I got roughly a throughput of around 20k. (Laptop with i7-10875H CPU @ 2.30GHz)
use core::time::Duration;
use iceoryx2::prelude::*;
use iceoryx2_bb_container::byte_string::FixedSizeByteString;
use iceoryx2_bb_container::vec::FixedSizeVec;
use iceoryx2_bb_posix::signal::SignalHandler;
use std::env;
use std::thread::sleep;
use std::time::Instant;

const CYCLE_TIME: Duration = Duration::from_nanos(1);

#[derive(Debug)]
pub struct BigMessage {
    pub process_id: u32,
    pub req_id: u32,
    pub op_type: i32,
    pub file_id: FixedSizeByteString<128>,
    pub txn_id: u64,
    pub key_data: FixedSizeVec<u8, 64>,
    pub record_data: FixedSizeVec<u8, 64000>,
    pub original_data: FixedSizeVec<u8, 64000>,
}

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let service_name = ServiceName::new("My/Funk/ServiceName")?;

    let service = zero_copy::Service::new(&service_name)
        .publish_subscribe()
        .open_or_create::<BigMessage>()?;

    let args: Vec<String> = env::args().collect();

    if args.len() < 2 {
        println!("Usage: {} <publisher|subscriber>", args[0]);
        return Ok(());
    }

    println!("Running as {}", args[1]);

    if args[1] == "publisher" {
        let publisher = service.publisher().create()?;
        let mut counter = 0;
        loop {
            if SignalHandler::termination_requested() {
                break;
            }
            counter += 1;

            let sample = publisher.loan_uninit()?;
            let sample = sample.write_payload(BigMessage {
                process_id: 1,
                req_id: counter,
                op_type: 3,
                file_id: FixedSizeByteString::from_bytes(b"test").map_err(|e| "error")?,
                txn_id: 4,
                key_data: FixedSizeVec::new(),
                record_data: FixedSizeVec::new(),
                original_data: FixedSizeVec::new(),
            });
            if sample.send()? == 0 {
                //it didnt work but also didnt return a real error, sleep and try again
                //sleep(CYCLE_TIME);
            } else {
                //    break;
            }
        }
    } else {
        let subscriber = service.subscriber().create()?;
        let counter = 0;
        let start = Instant::now();
        {
            loop {
                match subscriber.receive()? {
                    None => {
                        //sleep(CYCLE_TIME);
                        if SignalHandler::termination_requested() {
                            break;
                        }
                    }
                    Some(sample) => {
                        if sample.payload().req_id % 10000 == 0 {
                            println!(
                                "received: {}, time: {:?}",
                                sample.payload().req_id,
                                start.elapsed()
                            );
                        }
                    }
                }
            }
        }
    }
    Ok(())
}

And the output:
received: 10000, time: 1.430437594s
received: 20000, time: 1.896037592s
received: 30000, time: 2.372263314s
received: 40000, time: 2.844562772s
received: 50000, time: 3.357285109s
received: 60000, time: 3.836857632s
received: 70000, time: 4.304958051s
received: 80000, time: 4.778587094s
received: 90000, time: 5.242260115s
received: 100000, time: 5.707258093s
received: 110000, time: 6.17250077s
received: 120000, time: 6.63923506s
received: 130000, time: 7.112825314s
received: 140000, time: 7.582082056s
received: 150000, time: 8.046913373s
received: 160000, time: 8.515481013s
received: 170000, time: 8.985831923s
received: 180000, time: 9.451750306s
received: 190000, time: 9.91745711s
received: 200000, time: 10.385213389s
received: 210000, time: 10.859284136s

@hippiehunter Everything on main should be fixed now. Could you please confirm.

I just updated to the current checked in on main and It crashes the consumer with this
Running as consumer
        8 [D] SharedMemoryBuilder { name: FileName { value: FixedSizeByteString<255> { len: 84, data: "iox2_3203353066776743035165720297650548_928870977317242431530252316446368.connection" } }, size: 166, is_memory_locked: false, has_ownership: true, permission: OWNER_READ | OWNER_WRITE | O
              WNER_EXEC | OWNER_ALL, creation_mode: Some(OpenOrCreate), zero_memory: true, access_mode: ReadWrite, enforce_base_address: None }
              | Unable to open shared memory since the shared memory does not exist.
< Win32 API error > C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2-pal\posix\src\windows\mman.rs:225 CreateFileA(shm_file_path(name, SHM_STATE_SUFFIX).as_ptr(),
    GENERIC_WRITE | GENERIC_READ,
    FILE_SHARE_READ | FILE_SHARE_WRITE | FILE_SHARE_DELETE,
    core::ptr::null::<SECURITY_ATTRIBUTES>(), CREATE_NEW,
    FILE_ATTRIBUTE_NORMAL, 0)
 [ 80 ] The file exists.

        9 [D] SharedMemoryBuilder { name: FileName { value: FixedSizeByteString<255> { len: 84, data: "iox2_3203353066776743035165720297650548_928870977317242431530252316446368.connection" } }, size: 166, is_memory_locked: false, has_ownership: true, permission: OWNER_READ | OWNER_WRITE | O
              WNER_EXEC | OWNER_ALL, creation_mode: Some(OpenOrCreate), zero_memory: true, access_mode: ReadWrite, enforce_base_address: None }
              | Unable to create shared memory since it already exists.
< Win32 API error > C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2-pal\posix\src\windows\mman.rs:258 WriteFile(fd_handle, (&shm_size as *const u64) as *const u8, 8,
    &mut bytes_written, core::ptr::null_mut::<OVERLAPPED>())
 [ 5 ] Access is denied.

       10 [T] SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 84, data: "iox2_3203353066776743035165720297650548_928870977317242431530252316446368.connection" } }, size: 166, base_address: 0x2992c7d0000, has_ownership: true, file_descriptor: FileDescriptor { value: 2,
               is_owned: true }, memory_lock: None }
              | create
       11 [T] SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 60, data: "iox2_40432_3203353066776743035165720297650548.publisher_data" } }, size: 898689, base_address: 0x2992d050000, has_ownership: false, file_descriptor: FileDescriptor { value: 3, is_owned: true }, m
              emory_lock: None }
              | open
thread 'main' panicked at 'misaligned pointer dereference: address must be a multiple of 0x8 but is 0x2992d0500a2', C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2\src\raw_sample.rs:62:18
stack backtrace:
   0: std::panicking::begin_panic_handler
             at /rustc/90c541806f23a127002de5b4038be731ba1458ca/library\std\src\panicking.rs:578
   1: core::panicking::panic_fmt
             at /rustc/90c541806f23a127002de5b4038be731ba1458ca/library\core\src\panicking.rs:67
   2: core::panicking::panic_misaligned_pointer_dereference
             at /rustc/90c541806f23a127002de5b4038be731ba1458ca/library\core\src\panicking.rs:174
   3: iceoryx2::raw_sample::RawSample<iceoryx2::service::header::publish_subscribe::Header,iceoryx_test::BigMessage>::as_ref
             at C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2\src\raw_sample.rs:62
   4: iceoryx2::raw_sample::RawSample<iceoryx2::service::header::publish_subscribe::Header,iceoryx_test::BigMessage>::as_data_ref
             at C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2\src\raw_sample.rs:76
   5: iceoryx2::sample::impl$2::payload<iceoryx_test::BigMessage>
             at C:\Users\the_e\.cargo\git\checkouts\iceoryx2-1e1d4490bb91753f\80db0c4\iceoryx2\src\sample.rs:68
   6: iceoryx_test::main
             at D:\repos\iceoryx_test\src\main.rs:84
   7: core::ops::function::FnOnce::call_once<enum2$<core::result::Result<tuple$<>,alloc::boxed::Box<dyn$<core::error::Error>,alloc::alloc::Global> > > (*)(),tuple$<> >
             at /rustc/90c541806f23a127002de5b4038be731ba1458ca\library\core\src\ops\function.rs:250

@hippiehunter Could you please try it also on linux? The error message on Windows that the file already exists is expected and in the next step iceoryx tries to open it when it already exists. But we have to get rid of the error message, otherwise it's a bit confusing.
And I think Windows seems to have a totally new problem here - misaligned pointers :/ ... Theoretically, this can only happen when the shared memory is not aligned - but it should be always page size aligned. I have to dig into this.

I tried running it a few times on linux and it seems to work fine

I tried building the linux side with --release and i sometimes see this error on the publisher. Thanks for looking!
Running as publisher
        9 [T] SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 60, data: "iox2_13704_1085742739095478483720882696449008.publisher_data" } }, size: 898689, base_address: 0x7fbc5a761000, has_ownership: true, file_descriptor: FileDescriptor { value: 3
              , is_owned: true }, memory_lock: None }
              | create
       10 [D] SharedMemoryBuilder { name: FileName { value: FixedSizeByteString<255> { len: 85, data: "iox2_1085742739095478483720882696449008_1085584282770449955045338807874010.connection" } }, size: 166, is_memory_locked: false, has_ownership: true, permission: OWNER_
              READ | OWNER_WRITE | OWNER_EXEC | OWNER_ALL, creation_mode: Some(OpenOrCreate), zero_memory: true, access_mode: ReadWrite, enforce_base_address: None }
              | Unable to open shared memory since the shared memory does not exist.
       11 [T] SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 85, data: "iox2_1085742739095478483720882696449008_1085584282770449955045338807874010.connection" } }, size: 166, base_address: 0x7fbc5ab3b000, has_ownership: true, file_descriptor: Fil
              eDescriptor { value: 6, is_owned: true }, memory_lock: None }
              | create
       12 [D] PoolAllocator { buckets: UniqueIndexSet { data_ptr: RelocatablePointer { distance: 112, _phantom: PhantomData<core::cell::UnsafeCell<u32>> }, capacity: 7, borrowed_indices: 4, head:<PHONE_NUMBER>8, is_memory_initialized: true }, bucket_size: 128360, bucket_al
              ignment: 8, start:<PHONE_NUMBER>66152, size: 898527, is_memory_initialized: true }
              | Tried to release memory<PHONE_NUMBER>66146) which does not belong to this allocator.
       13 [D] PoolAllocator { allocator: PoolAllocator { buckets: UniqueIndexSet { data_ptr: RelocatablePointer { distance: 112, _phantom: PhantomData<core::cell::UnsafeCell<u32>> }, capacity: 7, borrowed_indices: 4, head:<PHONE_NUMBER>8, is_memory_initialized: true }, buc
              ket_size: 128360, bucket_alignment: 8, start:<PHONE_NUMBER>66152, size: 898527, is_memory_initialized: true }, base_address:<PHONE_NUMBER>66146, max_supported_alignment_by_memory: 4096 }
              | Failed to release shared memory chunk
       14 [D] Memory { shared_memory: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 60, data: "iox2_13704_1085742739095478483720882696449008.publisher_data" } }, size: 898689, base_address: 0x7fbc5a761000, has_ownership: true, file_descriptor: F
              ileDescriptor { value: 3, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "13704_1085742739095478483720882696449008" } }, allocator: 0x7fbc5a761000 }
              | Failed to deallocate shared memory chunk due to an internal allocator failure.
       15 [F] Publisher { port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>095478483720882696449008 }), sample_reference_counter: [0, 1, 1, 2, 0, 0, 0], data_segment: Memory { shared_memory: SharedMemory { name: FileName { value: FixedSizeByteString<255> { l
              en: 60, data: "iox2_13704_1085742739095478483720882696449008.publisher_data" } }, size: 898689, base_address: 0x7fbc5a761000, has_ownership: true, file_descriptor: FileDescriptor { value: 3, is_owned: true }, memory_lock: None }, name: FileName { value: Fi
              xedSizeByteString<255> { len: 40, data: "13704_1085742739095478483720882696449008" } }, allocator: 0x7fbc5a761000 }, config: LocalPublisherConfig { max_loaned_samples: 1, unable_to_deliver_strategy: Block }, dynamic_storage: Storage { shm: SharedMemory { n
              ame: FileName { value: FixedSizeByteString<255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105254, base_address: 0x7fbc5a83d000, has_ownership: false, file_descriptor: FileDescriptor { value: 5, is_owned: true }, me
              mory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, _phantom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, subscriber_connections: SubscriberConnectio
              ns { connections: [UnsafeCell { .. }, UnsafeCell { .. }], port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>095478483720882696449008 }), config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\
              ", prefix: "iox2_", service: Service { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connection" }
               }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, publisher_max_loaned_samples: 1, publisher_history_size: 1, enable_safe_overflow: fa
              lse, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, static_config: StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 1, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1,
              enable_safe_overflow: false, type_name: "iceoryx_test::BigMessage" } }, subscriber_list_state: UnsafeCell { .. }, history: Some(UnsafeCell { .. }), service: Service { state: ServiceState { static_config: StaticConfig { uuid: "b61bd15e8c3ea16146985e960906a8
              e125156a73", service_name: ServiceName { value: FixedSizeByteString<255> { len: 19, data: "My/Funk/ServiceName" } }, messaging_pattern: PublishSubscribe(StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 1, subscriber_max_buffer_size: 1
              , subscriber_max_borrowed_samples: 1, enable_safe_overflow: false, type_name: "iceoryx_test::BigMessage" }) }, global_config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: S
              ervice { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connection" } }, defaults: Defaults { publi
              sh_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, publisher_max_loaned_samples: 1, publisher_history_size: 1, enable_safe_overflow: false, unable_to_deliver_strateg
              y: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, dynamic_storage: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105254
              , base_address: 0x7fbc5a83d000, has_ownership: false, file_descriptor: FileDescriptor { value: 5, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, _phan
              tom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, static_storage: Storage { name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, config: Configuration { path: Path { valu
              e: FixedSizeByteString<4096> { len: 22, data: "/tmp/iceoryx2/services" } }, suffix: FileName { value: FixedSizeByteString<255> { len: 8, data: ".service" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, data: "iox2_" } } }, has_ownership:
              false, file: File { path: Some(FilePath { value: FixedSizeByteString<4096> { len: 76, data: "/tmp/iceoryx2/services/iox2_b61bd15e8c3ea16146985e960906a8e125156a73.service" } }), file_descriptor: FileDescriptor { value: 4, is_owned: true }, has_ownership: fa
              lse }, len: 341 } } }, degration_callback: None, loan_counter: 1, dynamic_publisher_handle: ContainerHandle { index: 0, container_id: 1 }, _phantom_message_type: PhantomData<iceoryx_test::BigMessage> }
              | This should never happen! Failed to deallocate the reclaimed ptr. Either the data was corrupted or an invalid ptr was returned.
thread 'main' panicked at /home/hh/.cargo/git/checkouts/iceoryx2-1e1d4490bb91753f/80db0c4/iceoryx2/src/port/publisher.rs:387:37:
From: Publisher { port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>095478483720882696449008 }), sample_reference_counter: [0, 1, 1, 2, 0, 0, 0], data_segment: Memory { shared_memory: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 60, data: "iox2_13704_1085742739095478483720882696449008.publisher_data" } }, size: 898689, base_address: 0x7fbc5a761000, has_ownership: true, file_descriptor: FileDescriptor { value: 3, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "13704_1085742739095478483720882696449008" } }, allocator: 0x7fbc5a761000 }, config: LocalPublisherConfig { max_loaned_samples: 1, unable_to_deliver_strategy: Block }, dynamic_storage: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105254, base_address: 0x7fbc5a83d000, has_ownership: false, file_descriptor: FileDescriptor { value: 5, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, _phantom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, subscriber_connections: SubscriberConnections { connections: [UnsafeCell { .. }, UnsafeCell { .. }], port_id: UniquePublisherId(UniqueSystemId { value:<PHONE_NUMBER>095478483720882696449008 }), config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connection" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, publisher_max_loaned_samples: 1, publisher_history_size: 1, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, static_config: StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 1, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, enable_safe_overflow: false, type_name: "iceoryx_test::BigMessage" } }, subscriber_list_state: UnsafeCell { .. }, history: Some(UnsafeCell { .. }), service: Service { state: ServiceState { static_config: StaticConfig { uuid: "b61bd15e8c3ea16146985e960906a8e125156a73", service_name: ServiceName { value: FixedSizeByteString<255> { len: 19, data: "My/Funk/ServiceName" } }, messaging_pattern: PublishSubscribe(StaticConfig { max_subscribers: 2, max_publishers: 5000, history_size: 1, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, enable_safe_overflow: false, type_name: "iceoryx_test::BigMessage" }) }, global_config: Config { global: Global { root_path_unix: "/tmp/iceoryx2/", root_path_windows: "c:\\Temp\\iceoryx2\\", prefix: "iox2_", service: Service { directory: "services", publisher_data_segment_suffix: ".publisher_data", static_config_storage_suffix: ".service", dynamic_config_storage_suffix: ".dynamic", creation_timeout: 500ms, connection_suffix: ".connection" } }, defaults: Defaults { publish_subscribe: PublishSubscribe { max_subscribers: 2, max_publishers: 5000, subscriber_max_buffer_size: 1, subscriber_max_borrowed_samples: 1, publisher_max_loaned_samples: 1, publisher_history_size: 1, enable_safe_overflow: false, unable_to_deliver_strategy: Block }, event: Event { max_listeners: 2, max_notifiers: 16 } } }, dynamic_storage: Storage { shm: SharedMemory { name: FileName { value: FixedSizeByteString<255> { len: 53, data: "iox2_b61bd15e8c3ea16146985e960906a8e125156a73.dynamic" } }, size: 105254, base_address: 0x7fbc5a83d000, has_ownership: false, file_descriptor: FileDescriptor { value: 5, is_owned: true }, memory_lock: None }, name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, _phantom_data: PhantomData<iceoryx2::service::dynamic_config::DynamicConfig> }, static_storage: Storage { name: FileName { value: FixedSizeByteString<255> { len: 40, data: "b61bd15e8c3ea16146985e960906a8e125156a73" } }, config: Configuration { path: Path { value: FixedSizeByteString<4096> { len: 22, data: "/tmp/iceoryx2/services" } }, suffix: FileName { value: FixedSizeByteString<255> { len: 8, data: ".service" } }, prefix: FileName { value: FixedSizeByteString<255> { len: 5, data: "iox2_" } } }, has_ownership: false, file: File { path: Some(FilePath { value: FixedSizeByteString<4096> { len: 76, data: "/tmp/iceoryx2/services/iox2_b61bd15e8c3ea16146985e960906a8e125156a73.service" } }), file_descriptor: FileDescriptor { value: 4, is_owned: true }, has_ownership: false }, len: 341 } } }, degration_callback: None, loan_counter: 1, dynamic_publisher_handle: ContainerHandle { index: 0, container_id: 1 }, _phantom_message_type: PhantomData<iceoryx_test::BigMessage> } ::: This should never happen! Failed to deallocate the reclaimed ptr. Either the data was corrupted or an invalid ptr was returned.
stack backtrace:
   0: rust_begin_unwind
             at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
   1: core::panicking::panic_fmt
             at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
   2: iceoryx2::port::publisher::Publisher<Service,MessageType>::retrieve_returned_samples
   3: <iceoryx2::port::publisher::Publisher<Service,MessageType> as iceoryx2::port::publish::internal::PublishMgmt>::send_impl
   4: iceoryx_test::main

@hippiehunter I wrote a lot of tests, some careful reviews and discovered and fixed all bugs you unraveled - hopefully.
There are still some issues left I will tackle in the next days:

Calling this concurrently in busy loops from multiple processes may result in a state where no new services can be created.

let service = zero_copy::Service::new(&service_name)
        .publish_subscribe()
        .open_or_create::<BigMessage>()?;
// do stuff
drop(service);

Creating and destroying Listeners in a busy loop may lead to connection failures on Notifier side. The tests are already written, and the solution is a combination of shared memory bit set and a trigger like semaphore, unix domain socket etc. - in the end the iceoryx1 approach.

But your code should now be completely stable. So if you have time to confirm this, I would close the issue and ping you on the other issues when the two remaining problems are also fixed.

I think my stuff is all stable now, I tried my actual, slightly more complicated use case and it seems reliable now. Thanks for all your efforts in this!


Introduce DEVICE_QUIRKS_LOCATION

In order to allow installation of device-quirks in a retro-compatible way that can take advantage of the new frzr refactor I introduced an environment variable that can control the "install" location.

If this is ready please mark ready for review


How can I use fontawesome 5?

I am sorry that this is not technically an issue but I've asked two other questions on SO and did not get an answer for any of them.
I have the font awesome 5 downloaded and I've put them under assets/fonts and I am trying to use it inside a components directory.

You can also import the font-awesome style sheets directly in your App.vue's <style> tag using an @import.


[Intel MKL] Enable DepthwiseConv2D + BiasAdd (+ Relu/Relu6/Elu) fusion

@penpornk Could you please review this PR?

I'm sorry for the delay! I'll review this in a few days.

@penpornk Thanks for the comments. I have updated my code, please check. Thank you!

@penpornk Thank you for your comments! The two nits are fixed, please check.


Deprecate Bower Support

Bower has been discontinued for support and developers are being told to move to Yarn or Webpack. We should remove our use of Bower and standardize the development and build process on NPM.

Completed.


Updating macOS always breaks Nix package manager

I have retired to use macOS from this issue in these months
https://github.com/NixOS/nix/issues/3616 or will use nix on lima?

Adding following code into /etc/zshrc (need sudo) fixed the problem
# See https://github.com/NixOS/nix/issues/3616
# Nix
if [ -e '/nix/var/nix/profiles/default/etc/profile.d/nix-daemon.sh' ]; then
  . '/nix/var/nix/profiles/default/etc/profile.d/nix-daemon.sh'
fi
# End Nix

Again and again ...

Updating to 14 from 13 did not make this problem again, above commit works
However the zsh is +50ms slow now 🙄


Have it been tested on pytorch v0.2 and CIFAR100?

@wandering007  Have you reproduced the result of DenseNet 40 on CIFAR100? I have just got acc of 70.86%, lower than the 75.58% in paper.

@Albert0147  Sorry, I forget it...

Sadly...


请问有没有接口可以获取用户请求了哪个url？

也就是记录上网记录，谢谢。

ss目的是匿名代理，不应该记录这些
Best regards
✉✉✉✉✉✉✉✉✉✉✉✉✉✉
Arthur lee
Sent from my iPhone

On 8 Jun 2017, at 3:52 PM, rafael w<EMAIL_ADDRESS>wrote:
也就是记录上网记录，谢谢。
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

不过，新版里面的log 的info 级别会有所有的访问记录

On 8 Jun 2017, at 3:52 PM, rafael w<EMAIL_ADDRESS><EMAIL_ADDRESS>wrote:
也就是记录上网记录，谢谢。
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/shadowsocks/shadowsocks-go/issues/229, or mute the thread https://github.com/notifications/unsubscribe-auth/AKnjrnCXnYpG4XH2m5QkuINMGjVrQzvnks5sB6gygaJpZM4Nzsyn.

也就是说，当前Github最新原版就已经在日志里包含了访问记录了，对吗？

I think maybe we can develop such a function ,let the server's owner to define how to use.

please develop such functions on your own


I'm getting an "Object reference not set to an instance of an object." when I try to use adr new

On a clean computer, trying to run the commands like in the TLDR section will return the error when I try to use adr new "test"

Please let me know if you need any additional information

I can only apologise... let me investigate!

Ah OK. I've spotted an issue. The tool assumes you're in a folder structure that's part of a git repo. If you're just using it in a folder, like "adr" it will blow up. I'll add a fix - thanks for useful repro steps!

I can confirm that it works as expected if you are inside a folder that is part of a git repo

That should be fixed in v1.1.4 which is available on nuget.org. Thanks for all the feedback - much appreciated. ♥


Fix for WindowDialog and Tabs controls translation

Fixes:

WindowDialog stores original title and re-translates it on locale change
WindowDialog::minimum_size_changed() called upon title or locale change
Tabs text is made translatable and updated on locale change

Closes #32437

Thanks!

Cherry-picked for 3.1.2.