Add automations resource REST specification to Microsoft.Security

Latest improvements:
MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Contribution checklist:

[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and have all been fixed in this PR.
[ ] The OpenAPI Hub was used for checking validation status and next steps.

ARM API Review Checklist

[x] Service team MUST add the "WaitForARMFeedback" label if the management plane API changes fall into one of the below categories.
adding/removing APIs.
adding/removing properties.
adding/removing API-version.
adding a new service in Azure.

Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs.

[ ] If you are blocked on ARM review and want to get the PR merged urgently, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.
Please follow the link to find more details on API review process.

Can one of the admins verify this patch?

Automation for azure-sdk-for-go

dear reviewers, there is a spell check the fails on the new resource name "automations", please advise, thanks!

@njuCZ  , there is a spell check the fails on the new resource name "automations", please advise, thanks!

@anthony-c-martin , there is a spell check that fails on the new resource name "automations", please advise how it should be white-listed

@anthony-c-martin , there is a spell check that fails on the new resource name "automations", please advise how it should be white-listed

ARM doesn't own these validations. @njuCZ please could you answer @mikreite's question?

Automation for azure-sdk-for-python

@mikreite sorry for not noticing this thread. How is the matter now? It seems all CI/CD have passed, and there are some new changes after ARMSignedOff? So I guess it needs to be reviewed by ARM team again ?

hi @njuCZ , the important changes were required by ARM and reviewed already, no further review is needed

@mikreite LGTM, I will merge this PR

It seems I can not merge this MR because of there is a requested changes, @mikreite could you please resolve it

Hi Chen and Anthony,
It seems that you are required to approve the PR.
Could you please approve?
Thanks,
Miri
From: njucz<EMAIL_ADDRESS>Sent: November 28, 2019 5:19 AM
To: Azure/azure-rest-api-specs<EMAIL_ADDRESS>Cc: Miri Kreitenberger<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [Azure/azure-rest-api-specs] Add automations resource REST specification to Microsoft.Security (#7580)
It seems I can not merge this MR because of there is a requested changes, @mikreitehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmikreite&data=02|01|Miri.Kreitenberger%40microsoft.com|ab89bf6efddb453f6b8108d773b1b7a2|72f988bf86f141af91ab2d7cd011db47|1|0|637105079444817187&sdata=TIJYqLFqJCFa9iA2QmGba14bK9ATMWV0A9WZx2Y5UKw%3D&reserved=0 could you please resolve it
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FAzure%2Fazure-rest-api-specs%2Fpull%2F7580%3Femail_source%3Dnotifications%26email_token%3DALFXZHTLNXATDYLBPJ7Q2YLQV42CLA5CNFSM4JDRMNC2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFLKBGI%23issuecomment-559325337&data=02|01|Miri.Kreitenberger%40microsoft.com|ab89bf6efddb453f6b8108d773b1b7a2|72f988bf86f141af91ab2d7cd011db47|1|0|637105079444827182&sdata=3isj%2Bu8a4oh6n%2BOJIiLIrwhLXyGE85tBxYyifUMh6EQ%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FALFXZHU5DHWGPY3VKRSFJ6LQV42CLANCNFSM4JDRMNCQ&data=02|01|Miri.Kreitenberger%40microsoft.com|ab89bf6efddb453f6b8108d773b1b7a2|72f988bf86f141af91ab2d7cd011db47|1|0|637105079444827182&sdata=Elno%2F6pplv8R8PYu0%2Fpx1uGLnQQZnbFvSSIvkbBe9oI%3D&reserved=0.


nil pointer haapended when not set globalConfig

If I don't set sharedValues and globalConfig, an error will be reported when running make helm

There will be a {} in the values.yaml file

Thanks for the PR!


refactor: separate app router headless ssr examples

In prep for adding a pages router example move existing app router src under a app-router dir

so as to minimize merge conflicts with app-router

TODO

[x] Check if the e2e ssr samples tests are executing in CI as expected.

https://coveord.atlassian.net/browse/KIT-2795

Unrelated quantic test failure, proceeding to merge.


Issue after upgrading from 9.1.2 to 9.2.0.

I am using type guard for a function which works flawlessly in v9.1.2 but when I upgraded to v9.2.0 it started giving error.
A type predicate's type must be assignable to its parameter's type.
import { MarkRequired } from "ts-essentials";

export enum AttachmentType {
  "IMAGE" = "IMAGE",
  "FILE" = "FILE",
  "CODE" = "CODE"
}

type AttachmentToBeUploaded =
  | {
      attachmentType: AttachmentType.IMAGE;
      id: string;
      localImageFileUrl?: string;
      localFile?: File;
      attachmentTypeSpecificFields: {
        name: string;
        type: string;
      };
    }
  | {
      attachmentType: AttachmentType.FILE;
      id: string;
      localImageFileUrl?: string;
      localFile?: File;
      attachmentTypeSpecificFields: {
        name: string;
      };
    }
  | {
      attachmentType: AttachmentType.CODE;
      id: string;
      attachmentTypeSpecificFields: {
        language: string;
      };
    };

export default function App() {
  const isAttachmentUploadable = (
    upload: AttachmentToBeUploaded
  ): upload is MarkRequired<
    Extract<
      AttachmentToBeUploaded,
      | { attachmentType: AttachmentType.IMAGE }
      | { attachmentType: AttachmentType.FILE }
    >,
    "localFile"
  > =>
    (upload.attachmentType === AttachmentType.FILE ||
      upload.attachmentType === AttachmentType.IMAGE) &&
    Boolean(upload.localFile);

  return (
    <></>
  );
}

reproducible codesandbox => https://codesandbox.io/s/type-guard-error-plpnsu
change ts-essentials version in dependencies

Hey @mehimanshupatil!
Thank you for your report!
I checked codesandbox and think the type error makes sense now because of the changes within 9.2.0
The change was introduced here – https://github.com/ts-essentials/ts-essentials/pull/295:
- export type MarkRequired<T, RK extends keyof T> = Exclude<T, RK> & Required<Pick<T, RK>>;
+ export type MarkRequired<T, RK extends keyof T> = Omit<T, RK> & Required<Pick<T, RK>>;

Exclude<T, RK> didn't make sense for me, because it just returned T. But this is why it was working for you. Let me expand it for your example:

You have upload: AttachmentToBeUploaded at the beginning
Then you want to narrow it to 2 sybtypes from the union: with attachment type AttachmentType.IMAGE and AttachmentType.FILE
Once you got 2 union elements out of the whole type, you mark one field localFile required for both union elements
Previously it meant T & Required<Pick<T, RK>> and now it's replaced with Omit<T, RK> & Required<Pick<T, RK>>, it's not assignable anymore

I think we can mark it as a bug

If you have time to work on it, please feel free to create PR for it. Otherwise I will take it as soon as I have time
Thank you for understanding in advance!

@Beraliv Thanks for detailed explanation
the issue related to use of Omit with unions is mentioned here TypeScript/issues/39556
and after updating Omit with code mentioned here https://github.com/microsoft/TypeScript/issues/39556#issuecomment-656925230
- export type MarkRequired<T, RK extends keyof T> = Omit<T, RK> & Required<Pick<T, RK>>;
+ export type MarkRequired<T, RK extends keyof T> = (T extends unknown ? Omit<T, RK> : never) & Required<Pick<T, RK>>;

which works but i don't know why just changing Omit<T, RK> to (T extends unknown ? Omit<T, RK> : never) works and creating PR for same without knowing its implication for other usecases is not wise.
also should it be updated for other types with Mark prefix

@mehimanshupatil
I fixed it in a PR – https://github.com/ts-essentials/ts-essentials/pull/324, can you please have a look at it? if this fix is enough and you don't have more problems, I will merge it!
Thank you for your time!

@Beraliv
tested MarkRequired fix works perfectly you can merge PR

I merged the changes. It will be released in ~1-2 weeks in https://github.com/ts-essentials/ts-essentials/pull/326

@mehimanshupatil thank you for your contribution again!
Released in 9.3.0 ✅


Update border.js

Move everything to constants.

It would be interesting to have all constants in another file, so you can change them for different biomes and such, maybe to use with https://github.com/peonso/opentibia_sprite_pack


Not logged into gcloud on GCB (Cloud Build)

CONSOLE_LOG_URL
https://console.cloud.google.com/cloud-build/builds;region=us-east1/af35868b-728a-4715-9f14-aaa3df078f8c;tab=detail?project=cloud-cpp-testing-resources
RAW_LOG_URL
https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/11226/105795f7346a6271839935441b23dd4476108e8c/fedora-37-cxx20-cxx20/log-af35868b-728a-4715-9f14-aaa3df078f8c.txt
Step #8: WARNING: Could not open the configuration file: [/h/.config/gcloud/configurations/config_default].
Step #8: ERROR: (gcloud.builds.describe) You do not currently have an active account selected.

Ooooh.  I think our build scripts have a race condition:

Step 7 (cleaning up any stale images from previous builds) and Step 2 (downloading the ccache files) run in parallel.
Step 7 wants to use the GCB service account (configured in the GCE instance)
Step 2 wants to use a particular service account, and configures gcloud in multiple steps
If Step 7 manages to run at the wrong time the authentication config is wrong.

https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/11553/006878f5e01f263f1aed1be35a91ad6fd270a3a4/fedora-37-cmake-publish-docs/log-1f4e2ab0-192d-4c10-8f77-73d17850232f.txt

CONSOLE_LOG_URL
https://console.cloud.google.com/cloud-build/builds;region=us-east1/3c4d9873-777b-4e02-8f53-9aaef503e309;tab=detail?project=cloud-cpp-testing-resources
RAW_LOG_URL
https://storage.googleapis.com/cloud-cpp-community-publiclogs/logs/google-cloud-cpp/11952/080c2e744f4d42cd456dbc30b516e088b7c35e17/fedora-37-bazel-xsan/log-3c4d9873-777b-4e02-8f53-9aaef503e309.txt


Fix package.json

Remove dependency 'mockgoose', because the vulnerabilities
Add a script: "compile": "tsc", to be used by Docker
Typescript package version to: "^3.1.1"

It is not necessary to modify the Typescript package version

Fixed in #62


Getting started: preprocessing

Task: write the "Getting started: preprocessing" doc page
Advice/Tips to the technical writer
Good to know:

This page appears after the "1. Getting started". The users reading this page has already a global overview of Texthero and are motivated to learn more.
As this is by ordering the second page of the documentation (i.e in theory the second page the users is reading), we want to teach the user how they can profit most from the library. This include:

Mention that the API is very complete and very easy to use, i.e we want to teach him how to find information alone (we achieve our goal of creating an awesome library when the user is capable of finding the answers by looking at our website without the need of searching in Google/opening a new Stackoverflow question)
...

Concept useful to have clear in mind:

What is it and how the pandas.Series.pipe function works
Why text-preprocessing is crucial in many NLP/text mining areas
Dealing with regex is often painful, with Texthero this can be avoided
At exception of tokenize, all preprocessing functions receive as input a TextSeries and returns a TextSeries.

Things to keep in mind when writing:

In the future, Texthero will allow to preprocess also non-Western languages

To stay in the technical discussion loop:

What if every preprocessing function would require as input an already tokenized Series? I.e the first mandatory task would be tokenize, even before remove_punctuation or anything else? This is useful when dealing with non-Western language (see #145 ).

Page
aim: learn how to preprocess text-based dataset with Texthero
content:

clean function: default way, option when no customization is required
custom pipeline: how to create a custom pipeline -- basically "copy/paste" the clean code and edit the pipeline see #38
mention/explain it exists different preprocessing functions (cite a few, link them, ...). Not sure we want to explain all, this is up to the writer ...
...
(at the end) --> tokenize

explain what tokenization is about and why is needed
output is TokenSeries (fundamentally different, show an example, every cell is now a list of tokens)

I am structuring this part as follows (based on review of similar contexts, including Texthero "Getting Started" structure):
** Overview/Intro**
Why is pre-processing crucial and what are the benefits of having a standardized/customizable pipeline
** Clean**
What it does and how
** Custom Pipeline**
Why and how you should take control of the pre-processing steps
** More details **
Including pre-processing API functionalities
Please let me know if something is not clear or if you have any additional suggestions.


ci: Use trusted publishers for publishing to PyPI

Use the OpenID Connect (OIDC) standard to publish to PyPI using PyPI's "Trusted Publisher" implementation to publish without using API tokens stored as GitHub Actions secrets.

c.f. https://blog.pypi.org/posts/2023-04-20-introducing-trusted-publishers/
c.f. https://docs.pypi.org/trusted-publishers/

For a full example (with lots of discussion) c.f. https://github.com/scikit-hep/pyhf/pull/2183
For a concise summary, c.f. the Scientific Python Developer Guide section on this.
What is required of a maintainer for this to work

Login to PyPI
Follow the Adding a trusted publisher to an existing PyPI project instructions.

@BenGalewsky @gordonwatts @ponyisi This is ready for review. Though not something that needs to be rushed, as I know we're all busy today.


algebird-bufferable

This is just a start, and shouldn't be merged yet, but: defining some Bufferable implementations for Algebird objects so that we don't have to use Kryo for long-term serialized storage.

Sorry my bad, git foo on cmd line broke stuff and closed all of these

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


feat: passing only relevant configurations to handler

Signed-off-by: dolby360<EMAIL_ADDRESS>Description
Fixing issue 46
Related issue (if any): fixes #46
Checklist

[v] I have followed this repository's contributing guidelines.
[v] I have used the conventional commits specification for my commit messages.
[v] I have signed my commits.
[v] I will adhere to the project's code of conduct.

Additional information

Anything else?

@TomerFi Is this a real failure?
https://github.com/TomerFi/auto-me-bot/runs/7761677273?check_suite_focus=true#step:7:26
It seems like it wasn't able to generate some artifacts.

@dolby360 thank you very much!
you can ignore the CI error - it's missing the content: write perms - I'll fix it on the main branch.
merging this!

@dolby360
we may need to revert this, this CI workflow was faulty and tests fail for this change.
I'm looking into it.
https://github.com/TomerFi/auto-me-bot/runs/7764413988?check_suite_focus=true

Fixed here https://github.com/TomerFi/auto-me-bot/pull/57.
I hope I was also able to fix the workflow issue that checked out the wrong sources.
We'll see in the next forked PR.
:-)


Add Create Expense feature details

@elhy1999 Sorry, could you re-review, I noticed some issues with the bottom half of the formatting + missing command summary details


Replace relative path with link to types

Codecov Report

Merging #188 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #188   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files         123    123
  Lines        2762   2762
  Branches      599    599
=====================================
  Hits         2762   2762

Impacted Files
Coverage Δ

src/components/popover/Popover.tsx
100% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d5a7d34...73301ac. Read the comment docs.


Flatpak will not launch on KDE Wayland

Aknowledgements

[X] I have checked that there is no other issue describing the same or
similar problem that I currently have, regardless if it has been
closed or open.

[ ] This bug affects Discord website.

[ ] This issue is confirmed to be reproduceable when WebCord is packaged
on at least all three latest supported Electron major releases.

[ ] This issue is reproduceable in Chrome, Chromium or any
Chromium-based browser, e.g Brave or Edge (please write in
Additional Context which browser you have used if it is neither
Chrome nor unmodified Chromium).

[X] There are no fixes done to master which resolves this issue.

[ ] My issue describes one of the unstable and/or not fully implemented
features.

[ ] I have found a workaround to mitigate or temporarily fix this issue
in affected releases (please write it in Additional context section
below).

Operating System / Platform
🐧 Linux
Operating system architecture
x64 (64-bit Intel/AMD)
Electron version
N/A (will not launch)
Application version
v4.2.0
Bug description
Download/install does not appear to complete. Attempt to install and run through terminal produces these results:
flatpak install webcord
Looking for matches…
Found ref ‘app/io.github.spacingbat3.webcord/x86_64/stable’ in remote ‘flathub’ (system).
Use this ref? [Y/n]: y

io.github.spacingbat3.webcord permissions:
    ipc      network      pulseaudio      x11     devices     dbus access [1]

    [1] org.freedesktop.Notifications, org.freedesktop.secrets, org.kde.StatusNotifierItem-2-1,
        org.kde.StatusNotifierWatcher

        ID                                      Branch           Op           Remote           Download
 1. [✓] io.github.spacingbat3.webcord           stable           i            flathub          104.8 MB / 107.9 MB

Installation complete.
[USER]:~> flatpak run io.github.spacingbat3.webcord
[3 zypak-helper] Wait found events, but sd-event found none
[10 preload-host-spawn-strategy] Warning: waitpid override ignores groups
[10 preload-host-spawn-strategy] Warning: waitpid override ignores groups
realloc(): invalid pointer
[10 preload-host-spawn-strategy] Warning: waitpid override ignores groups
[3 preload-host-spawn-strategy] Warning: waitpid override ignores groups
[3 preload-host-spawn-strategy] Warning: waitpid override ignores groups
/app/bin/webcord/usr/bin/webcord: line 3: /lib/webcord/webcord: No such file or directory

To reproduce:

attempt to install flatpak
attempt to run flatpak
errors are produced

This issue does not appear in the AppImage version. Attempted to install the RPM version but it's possible that simple differences in how OpenSUSE Tumbleweed and Fedora handle RPM packages may prevent installation from RPM.
Additional context
No response

This issue does not appear in the AppImage version.

I do not maintain flatpaks, so I can't do much to fix them. You should probably report this issue at Flatpak bug tracker (you most likely filled this bug request template on your own so you might noticed the notice in it).
I'll close this as you confirmed AppImages work fine and it isn't known whenever RPMs are broken on package side (and even if they were, I do not maintain RPM maker for now so I couldn't do much about this as well). I'm also not exactly sure if the RPMs packages aren't compatible with the OpenSUSE, I guess if it is native format for your DE and it doesn't work, you might give it a try opening an issue ticket on Electron Forge's GitHub project.


Image resize adds artifacts with WebP and Safari TP

Describe the bug
When I use Safari and have enabled Resize it will add strong artifacts to the image when exporting to WebP.
To Reproduce
Steps to reproduce the behavior:

Go to Squoosh.app in Safari Technology Preview
Open any image
Enable resize (other than 100%)
Enable WebP
See it added artifacts
Disable resize or switch to MozJPEG to see normal compression without artifacts

Expected behavior
Will not add artifacts, like in stable Safari and other browsers.
Version:

OS w/ version: macOS 13.2
Browser w/ version Safari Technology Preview Release 164 (Safari 16.4, WebKit 18616.1.2)

Additional context, screenshots, screencasts
Zoom to see artifacts:

Ok:

Ok:

Thanks for the heads up. This seems to be a Safari bug relating to SIMD in WebAssembly.
I've filed https://bugs.webkit.org/show_bug.cgi?id=253307. If it doesn't get fixed in time, I can force Safari to use the non-SIMD version.

Looks like they've found the issue. Thanks for helping catch this before it went to stable!

Hello,
I have the same issue in macOS 13.3 with Safari, upgraded to macOS 13.3.1 now and the issue is still there. I cannot use the resize and webp compress to generate the image.
In Chrome browser works perfectly.
We have to activate/deactivate something in Safari to make it work?
Thanks,
ionica

It seems this fix has landed in Safari 16.5.
https://webkit.org/blog/14154/webkit-features-in-safari-16-5

Web Assembly

Fixed WASM SIMD breaking WebP decoding applications.

It seems this fix has landed in Safari 16.5. https://webkit.org/blog/14154/webkit-features-in-safari-16-5

Web Assembly

Fixed WASM SIMD breaking WebP decoding applications.

Confirm that it's fixed in Safari 16.5. Great job guys!


[question] [tflite] How to serialize Interpreter?

Sorry for question, but could you, please, give me hint? I want to construct tflite model with C++ API (not with toco converter) and serialize it. If I use 'Interpreter' class for model creation, can I then convert it to FlatBufferModel somehow? Or the only opportunity is to create model via FlatBufferBuilder API?

Nagging Assignee @aselle: It has been 17 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @aselle: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.


$DiskLayout -eq 'BIOS'

In Private/Set-DiskPartition.ps1:
if ($DiskLayout -eq 'BIOS') Run-Executable -Executable "$windir\System32\bcdboot.exe"
is wrong, it should be bcdedit.exe

bcdboot is commonly used when imageing it's simple for creating new BCD entries.
is there a specific scenario where this did not work for you?


disk cache

You write that goofys does not have a disk cache. Is that because of a design decision or has it just not been implemented yet. Would you possibly accept a patch that implements it?
I'm asking because we are currently using s3fs but we have run into stability problem and would perhaps use an alternative. Some kind of cache is an absolute requirement, though.
Have you thought about goofys => caching http proxy => s3 yet as an alternative to a disk cache? Has this been tried by anybody, yet?

Ideally I want to see a generic fuse cache. Implementing all these caching each time someone writes a fuse filesystem doesn't make a lot of sense to me.
I am not aware of anyone trying a caching http proxy, it may work if you make it transparent at the network level. Alternatively you can write a middleware for https://github.com/andrewgaul/s3proxy that does caching.

Could you describe a bit about the caching use cases?

High-read cases where you don't want or need to re-fetch from S3. In my case I use s3fs with -o use_cache to store files locally and reduce unnecessary API calls to S3 because I read those files many times per day.
I agree that a generic cache at the FUSE level is the correct place to solve this, but I don't know how feasible that is.

My use case is the same. I'm currently using s3fs and am depending on cached reads being fast. One set of servers does read and write operations on the filesystem (video editing), but the most important set of servers that do strictly video rendering mount S3 read-only and only read from the filesystem. These really need to have the cache.
I agree that a generalized caching solution would be neat, but if that involves backwards incompatible changes to the kernel's fuse interface, this is years down the road, if ever.
Thinking of it, maybe it is doable to create a new caching fuse filesystem that wraps goofys?

and you'd be doing reads from the same videos when you do rendering many times a day? how fast do you need this to be? How big are these files? Do you read the entire files end to end? How much do you care about cache invalidation? For writes, do you write through or write back?
A caching fuse fs is definitely doable (with the caveat of extra memory copy), goofys can have some build in support to mount the additional layer. If only CacheFS supports fuse, sigh.

To be exact, we render videos from basically a definition file and accompanying files (image files, movie files, fonts, tracking files, etc.). In 95 % of the cases, we read the entire file. It's rare that we actually seek in the files. We need some kind of cache invalidation, currently we're fine with the configurable metadata cache in s3fs. I think it's something like 5 seconds or 30 seconds after which s3fs will recheck with S3 if the file/object has changed.
I don't understand what write-through vs write-back would mean in this context. I would always be fine with the write ending up in S3 only if the file has been closed. The file should then be uploaded to s3 immediately though.

when you said you need cache, how much speed up is it providing? ie: what's the read perf for goofys (without cache) vs s3fs (with cache)?

I'll try to come up with some numbers the next days.

Ok, this was interesting. I did some measurements on one of our production servers.
s3fs
Size of data:
root@replaced-host:/data/ifs-cache# du -shx /ifs/iv-project-data/anonymized-project/
1.7G	/ifs/iv-project-data/anonymized-project/

s3fs uncached read:
root@replaced-host:/data/ifs-cache# time find /ifs/iv-project-data/anonymized-project/ -type f -exec cat {} > /dev/null \;

real	0m20.444s
user	0m0.002s
sys	0m0.727s

then, cached read:
root@replaced-host:/data/ifs-cache# time find /ifs/iv-project-data/anonymized-project/ -type f -exec cat {} > /dev/null \;

real	0m1.526s
user	0m0.007s
sys	0m0.734s

trying goofys now
first run
root@replaced-host:/data/ifs-cache# time find /mnt/iv-project-data/anonymized-project/ -type f -exec cat {} > /dev/null \;

real    0m19.522s
user    0m0.002s
sys     0m0.668s

subsequent runs
root@replaced-host:/data/ifs-cache# time find /mnt/iv-project-data/anonymized-project/ -type f -exec cat {} > /dev/null \;

real    0m0.570s
user    0m0.000s
sys     0m0.233s

aha, goofys works with the filesystem cache
echo 3 > /proc/sys/vm/drop_caches

root@replaced-host:/data/ifs-cache# time find /mnt/iv-project-data/anonymized-project/ -type f -exec cat {} > /dev/null \;

real    0m17.851s
user    0m0.001s
sys     0m0.718s

not the latest Linux, by any means:
root@replaced-host:/data/ifs-cache# uname -a
Linux replaced-host.impossible.io 3.13.0-86-generic #131-Ubuntu SMP Thu May 12 23:33:13 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
root@replaced-host:/data/ifs-cache# cat /etc/issue
Ubuntu 14.04.4 LTS \n \l

Reading from a c3.2xlarge EC2 instance in eu-west-1 from a bucket in the same region.

Unfortunately, the filesystem cache does not do the job for us. The applications on the host use almost all the available memory for their own caches and we need reads to be fast even (and especially) if the data has not been accessed for minutes or hours. If the data is "hot" we have it in our own memory cache anyway.
Funny to see that goofys works with the Linux buffer cache, while s3fs does not.

I suspect this is just a case of metadata operations taking longer in s3fs.

So I've implemented a generic caching filesystem in fuse: https://github.com/kahing/catfs/ . Happy to hear feedback for people who try to use it with goofys!

@kahing Thanks for adding caching!
any ideas how to pass on --uid= --gid= flags to catfs?
for some reason, when --cache is used from fstab the uid and gid are not respected as i'm getting a "Permission denied." error when listing objects using 'ls -lah'  (but perhaps it's my own ignorance).
Also, the additional catfs flags are unclear to me in fstab-context. I have translated your example:
--cache "--free:10%:$HOME/cache"
As follows:
goofys#bucket-name  /mnt/mount-bucket    fuse _netdev,nosuid,nodev,allow_other,rw,--uid=106,--gid=111,--cheap,--storage-class=STANDARD,--cache=--free:10%:/cache/dir     0 0
(which doesn't throw an error, but mount is unsuccessful). When omitting the '--free:10%:' flag as-in:
--cache=/cache/ddl
all is well.

you probably need to plumb through --o allow_other to catfs, something like:
goofys#bucket    /mountpoint     fuse    _netdev,allow_other,--uid=1001,--gid=1001,--cache=-oallow_other:--free:10%:/cache/dir  0       0

uid and gid shouldn't be necessary for catfs in this context.

hi @kahing,
I try to mount bucket using cache  enabled, but the cache seem not working and the catfs is exited. here is the log that I get:
/tmp/new-goofys/bin/goofys[47199]: s3.INFO Switching from region 'us-east-1' to 'eu-west-1'
/tmp/new-goofys/bin/goofys[47199]: main.INFO Starting catfs [--free 10% --test -ononempty -- /mount/point /tmp/mount/point  /mount/point]
/tmp/new-goofys/bin/goofys[47199]: main.INFO File system has been successfully mounted.
/tmp/new-goofys/bin/goofys[47199]: main.ERROR catfs exited: <nil>

and here is the command that I used :
./goofys bucket-name /mount/point -o rw,allow_other,--uid=1000,-gid=1000,--file-mode=0766,-dir-mode=0766,--cheap,--storage-class=STANDARD,--cache=-oallow_other:--free:10%:/tmp/mount/point

@kahidna could you try to enable RUST_LOG=debug and see what catfs outputs?

@kahing if I run catfs after mount the bucket (with or without --cache) I got this error message :
# RUST_LOG=catfs=debug /usr/bin/catfs /mount/point /tmp/mount/point /mount/point
fuse: mountpoint is not empty
fuse: if you are sure this is safe, use the 'nonempty' mount option
2017-08-28 05:50:50 ERROR - Cannot mount: Success (os error 0) stack backtrace:
   0:     0x562b36e7001c - backtrace::backtrace::trace::h93a8949259c4b9ca
   1:     0x562b36e70162 - backtrace::capture::Backtrace::new::h474ef00b29d1a9be
   2:     0x562b36e3fd43 - <catfs::catfs::error::RError<E>>::from::he56b75089512e52a
   3:     0x562b36e4d6aa - catfs::main_internal::h0d58a3dde981e4d7
   4:     0x562b36e4a443 - catfs::main::hbc5b80fce6257d5f
   5:     0x562b36f5afaa - panic_unwind::__rust_maybe_catch_panic
                        at /checkout/src/libpanic_unwind/lib.rs:98
   6:     0x562b36f546e0 - std::panicking::try<(),closure>
                        at /checkout/src/libstd/panicking.rs:433
                         - std::panic::catch_unwind<closure,()>
                        at /checkout/src/libstd/panic.rs:361
                         - std::rt::lang_start
                        at /checkout/src/libstd/rt.rs:59
   7:     0x7fd20e1fff44 - __libc_start_main
   8:     0x562b36e1cc79 - <unknown>
   9:                0x0 - <unknown> here is what I already tried :

and if  I run catfs first, then mount the bucket, here is the output
# RUST_LOG=catfs=debug /usr/bin/catfs /mount/point /tmp/mount/point  /mount/point
2017-08-28 07:11:46 DEBUG - catfs "/mount/point" "/tmp/mount/point "
2017-08-28 07:11:46 DEBUG - total: 927280704 free: 914066947 to_evict: 0
2017-08-28 07:12:01 DEBUG - <-- getattr 1 "" 4096 bytes
2017-08-28 07:12:46 DEBUG - total: 927280704 free: 914066811 to_evict: 0
2017-08-28 07:13:46 DEBUG - total: 927280704 free: 914066569 to_evict: 0

and here is the goofys log :
Aug 28 07:19:48 a /usr/bin/goofys[30699]: s3.INFO Switching from region 'us-east-1' to 'eu-west-1'
Aug 28 07:19:48 a /usr/bin/goofys[30699]: main.INFO File system has been successfully mounted.

mounting works fine, but folder /tmp/mount/point is empty, not create any file or folder after I access /mount/point.
And when the catfs killed/terminated, get message ls: cannot access  /mount/point : Transport endpoint is not connected when list files using command /ls mount/point

if you want to mount catfs over the same goofys mountpoint, you need to use -oallow_other like the error message suggested

Further to the above, i'm getting the following catfs exit message:
$ sudo goofys -f --debug_fuse --uid 106 --gid 111 --dir-mode 0777 --file-mode 0666 --cheap --cache "-oallow_other:-ononempty:--free:10%: /tmp/mount/point" -o allow_other -o nonempty BUCKETNAME /mount/point

2017/09/02 07:19:02.149100 s3.INFO Switching from region 'us-east-1' to 'eu-west-1'
2017/09/02 07:19:02.182055 fuse.DEBUG Op 0x00000001        connection.go:396] <- init
2017/09/02 07:19:02.182104 fuse.DEBUG Op 0x00000001        connection.go:479] -> OK ()
2017/09/02 07:19:02.182143 main.INFO Starting catfs [-ononempty --free 10% --test -ononempty -- /mnt/s3-ddl /cache/ddl /mnt/s3-ddl]
2017/09/02 07:19:02.182777 main.INFO File system has been successfully mounted.
2017/09/02 07:19:02.183622 fuse.DEBUG Op 0x00000002        connection.go:396] <- GetInodeAttributes (inode 1)
2017/09/02 07:19:02.183879 fuse.DEBUG GetAttributes 1 0xc42014d000 []
2017/09/02 07:19:02.183907 fuse.DEBUG Op 0x00000002        connection.go:479] -> OK ()
2017/09/02 07:19:02.184150 main.ERROR catfs exited: <nil>

Using https://github.com/kahing/catfs/releases/download/v0.4.0/catfs Any ideas?

Like what I suggested above, could you set RUST_LOG=debug to see what catfs is exiting?

if you are launching catfs with goofys, you don't need to explicitly set -ononempty. Also, there's an extra space in "-oallow_other:-ononempty:--free:10%: /tmp/mount/point"

@kahing my bad...the extra was a typo. I tried enabling RUST_LOG=debug as follows:
$ RUST_LOG=debug RUST_BACKTRACE=1 sudo goofys -f --debug_fuse --uid 106 --gid 111 --dir-mode 0777 --file-mode 0666 --cheap --cache "-oallow_other:--free:10%:$HOME/cache" -o allow_other -o nonempty BUCKETNAME /mnt/goofys-ddl
2017/09/03 13:09:15.124376 s3.INFO Switching from region 'us-east-1' to 'eu-west-1'
2017/09/03 13:09:15.161430 fuse.DEBUG Op 0x00000001        connection.go:396] <- init
2017/09/03 13:09:15.161508 fuse.DEBUG Op 0x00000001        connection.go:479] -> OK ()
2017/09/03 13:09:15.161540 main.INFO Starting catfs [--free 10% --test -ononempty -- /mnt/goofys-ddl /home/ubuntu/cache /mnt/goofys-ddl]
2017/09/03 13:09:15.162127 main.INFO File system has been successfully mounted.
2017/09/03 13:09:15.163014 fuse.DEBUG Op 0x00000002        connection.go:396] <- GetInodeAttributes (inode 1)
2017/09/03 13:09:15.163335 fuse.DEBUG GetAttributes 1 0xc4202a44d0 []
2017/09/03 13:09:15.163368 fuse.DEBUG Op 0x00000002        connection.go:479] -> OK ()
2017/09/03 13:09:15.163612 main.ERROR catfs exited: <nil>
2017/09/03 13:09:57.430664 fuse.DEBUG Op 0x00000003        connection.go:396] <- StatFS
2017/09/03 13:09:57.430858 fuse.DEBUG Op 0x00000003        connection.go:479] -> OK ()
2017/09/03 13:09:57.434099 fuse.DEBUG Op 0x00000004        connection.go:396] <- StatFS
2017/09/03 13:09:57.434453 fuse.DEBUG Op 0x00000004        connection.go:479] -> OK ()

And yes, i'm launching catfs with goofys. Any ideas why catfs exited?

sudo is probably masking RUST_LOG, could you add -E to sudo?

@valentijnvenus @kahidna should be fixed, thanks for reporting!


Is it possible to Export output in date vice

HI
i have a setup of goaccess generating logs of previous days by using cron job. so the output in goaccess is showing in a format as like starting from this month 1st to till previous day.
is it possible to generate date vice  report from goaccess frontend? instead of generating from command line.
Regards,
Ben

If I follow correctly, you are trying to export a JSON report but you would like to filter by dates from the front end instead of the command line?

yea, compared to that generating from command line is better with specific dates logs

Got it. Currently not possible, but issue #117 will address this, it will be the next big update that GoAccess will get, both in the HTML side and the terminal side. Stay tuned!

HI
thanks for the update.
please let me know when the major release will release.
Regards,
Ben


Recursively mark object literals as non-fresh when checking assignability to intersections

Fixes #7649

@DanielRosenwasser can you take a look at the refactored code?
(I looked at #8694 which you linked. It seems like the opposite of #8605 -- the compiler over-checks here, it under-checks there.)

ping @DanielRosenwasser

OK, I addressed the comments, but didn't try to avoid creating a fresh SymbolTable. I think you are right that it's too complex to be worth it.

Fix comment, then :+1:


make_deb.sh generates packages with wrong architecture

I want to create a kernel headers package that allows me to cross compile out of tree kernel modules. After cloning the repo on an amd64 platform and calling make_deb.sh a deb package like linux-headers-4.1.18-bone-rt-r20_1cross_armhf.deb is generated. This package includes binaries in the scripts subfolder that are indeed built for the amd64 platform. However the Architecture property of the generated Debian package is armhf. As a result, the package cannot be installed/ used.
It would be nice to have the script fixed or any alternative method to generate a kernel headers package that allows the above mentioned cross compilation procedure.

@QuickJack patches welcome, cross building via the "builddeb" script which "make_deb.sh" utilizes has been broken forever.
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/scripts/package/builddeb
It's never worked on x86 when building an armhf deb header package, i wouldn't expect it to work on arm64.
Regards,

we jumped the gun by building on amd64 in a docker container, using qemu - so no arm buildslave needed
takes about 9mins on a AMD Opteron 6320 so acceptable
see .jenkins directory here: https://github.com/mhaberler/linux-xlnx/tree/zynq_4_4_rt-work
Gemi @kinsamanka came up with the method: https://github.com/kinsamanka/rpi_linux

@QuickJack @mhaberler
Does this fix cross for you?
https://lkml.org/lkml/2016/3/31/720
Regards,

I have also started using Docker. My base is socialdefect/raspbian-jessie-core. I am now able to compile the kernel module as well as the dtbo in one environment. It is a bit slow but it seems to work perfectly.

@RobertCNelson I did not try - using docker containers for all builds including kernels these days, for instance https://jenkins.machinekit.io/view/machinekit/job/socfpga-kernel-4.1-ltsi-rt/
even if they fixed the scripts arch issue, the debian numbering is still horrible  and needs manually patching of scripts/package or so


Improve the Readme

Resize and make the images in the readme of the same size.

I would like to contribute to this issue. Please assign me

Hello, Can i be assigned this and work on this now since 15 days i.e. 2 weeks over to be assigned to him ?


[BUG] Facing error while trying to run MixtureOfAgents and GroupChat workflows

collegeListRoute.txt
collegeListController.txt
collegeListSwarm.txt
The error log is here:
Context: I am running it through an API call to an endpoint in my flask server.
HTTP/1.1 500 INTERNAL SERVER ERROR
Server: Werkzeug/3.1.3 Python/3.12.5
Date: Fri, 22 Nov 2024 22:36:40 GMT
Content-Type: application/json
Content-Length: 127
Access-Control-Allow-Origin: *
Connection: close
{
"error": "Internal Server Error",
"message": "MixtureOfAgents.init() got an unexpected keyword argument 'agent_list'"
}
if i try to change the agent_list keyword to agents then too I am getting an error.

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

Resolved.


FastaReader returns empty pandas dataframe

I'm trying to load this FASTA data using FastaReader module but it seems there is something wrong! Any thoughts?!

Python implementation: CPython
Python version       : 3.9.18
IPython version      : 8.18.1

Compiler    : GCC 11.2.0
OS          : Linux
Release     : 5.10.0-28-cloud-amd64
Machine     : x86_64
Processor   :
CPU cores   : 16
Architecture: 64bit

matplotlib: 3.6.3
screenpro : 0.2.6
anndata   : 0.10.5.post1
biobear   : 0.14.6
sys       : 3.9.18 (main, Sep 11 2023, 13:41:44)
[GCC 11.2.0]
pandas    : 1.5.3
polars    : 0.20.10

Thanks for filing this, and sorry for the issue! I think the issue is due to the .fa extension. In the short term, could you rename the file to with .fasta? And I can make it easier to configure in the medium term. Like you probably know fasta has a variety of extensions compared to something like bam or vcf.
In [1]: import biobear as bb

In [2]: !wget -O CRISPRi_v2_human.trim_1_29_forward.fasta https://raw.githubusercontent.com/mhorlbeck/ScreenProcessing/master/library_reference/CRISPRi_v2_human.trim_1_29_forward.fa
--2024-02-22 17:06:25--  https://raw.githubusercontent.com/mhorlbeck/ScreenProcessing/master/library_reference/CRISPRi_v2_human.trim_1_29_forward.fa
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... <IP_ADDRESS>, <IP_ADDRESS>, <IP_ADDRESS>, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 11799370 (11M) [text/plain]
Saving to: ‘CRISPRi_v2_human.trim_1_29_forward.fasta’

CRISPRi_v2_human.trim_1_29_forward.fasta                  100%[====================================================================================================================================>]  11.25M  16.2MB/s    in 0.7s

2024-02-22 17:06:27 (16.2 MB/s) - ‘CRISPRi_v2_human.trim_1_29_forward.fasta’ saved [11799370/11799370]

In [3]: df = bb.FastaReader('CRISPRi_v2_human.trim_1_29_forward.fasta').to_pandas()

In [4]: df
Out[4]:
                           id description                      sequence
0       A1BG_-_58858617.23-P1        None  GAGACCCAGCGCTAACCAGGTTTAAGAG
1       A1BG_-_58858788.23-P1        None  GGGCACCCAGGAGCGGTAGGTTTAAGAG
2       A1BG_+_58858964.23-P1        None  CTCCGGGCGACGTGGAGTGGTTTAAGAG
3       A1BG_-_58858630.23-P1        None  AACCAGGGGTGCCCAAGGGGTTTAAGAG
4       A1BG_+_58858549.23-P1        None  GCGAGGAACCGCCCAGCAAGTTTAAGAG
...                       ...         ...                           ...
209065    non-targeting_03785        None  CTACTCCGCCCCGCGGGAGGTTTAAGAG
209066    non-targeting_03786        None  TGGCCGTTCATGGGACCGGGTTTAAGAG
209067    non-targeting_03787        None  AACTCTGTAGAAGGGACCGGTTTAAGAG
209068    non-targeting_03788        None  CTCGACAGCGACTGAAGAGGTTTAAGAG
209069    non-targeting_03789        None  AGAAGCCAACCTCGCGTTAGTTTAAGAG

[209070 rows x 3 columns]

I see, it makes sense. It works with .fasta, thanks for clarifying. One more question. Are you using fasta indexing  (e.g. pyfaidx) to accelerate downstream tasks?

Cool, glad that part works. BioBear only supports indexed BAM/VCF/GFF files at the moment (https://www.wheretrue.dev/docs/exon/sql-reference#indexed-scan-functions) ... I've been meaning to add indexed fastas and the underlying bits are in place, so I'll add it today and follow up on this ticket.

Here's an example of using an faidx index with a fasta file... it's a bit limited in that it only supports a single region. Is that similar to how you're using (py)faidx or is it will multiple regions and/or a regions file?
https://github.com/wheretrue/biobear/blob/7357fb87c0d42036037e8f8978f1b6c3cc8600bd/python/tests/test_session.py#L77-L88

Cool, let me give it a try and I'll get back to you soon. Thanks for your quick responses!

Here's an example of using an faidx index with a fasta file... it's a bit limited in that it only supports a single region. Is that similar to how you're using (py)faidx or is it will multiple regions and/or a regions file?

What I'm trying to do is simply (!) loading FASTQ data as dataframe and then using "groupby" function from polars to count all unique sequences. Then, I want to map the counted sequences to a reference fasta file (or just a table of expected sequences and their names). Does it make sense? This is my current code to load FASTQ, count, and then map ...
https://github.com/ArcInstitute/ScreenPro2/blob/c3e476f1a75edb8d39ba466078e1204d652e9db0/screenpro/ngs.py#L27C1-L91C21
I also need to ask your opinion about multi-threading on FASTQ files to run these kinds of tasks with safe memory usage (I can open a new issue to discuss that separately).

Hey @tshauck, I'm not sure if I understand your fasta indexing implementation. How should I create fasta index using biobear? Also, I'm not sure what function I need to call for using it.

Thanks for sharing the notebook. I think I generally understand the linked part, but looks interesting overall. This comment got a little long, but it's mostly code snippets... there's a paragraph on reproducing parts of your notebook with SQL, one on preprocessing to parquet for getting good I/O performance, and one to your last comment.
SQL
To the workflow, it's not super clear to me if slice_seq is static across the entire dataframe or different for each row, but either way I think you could push down some of this to SQL which would likely give you better performance. E.g. if it's static:
df = session.sql(
    """
SELECT substr(f.sequence, 1, 10) AS sequence, COUNT(*) as count
FROM fastq_scan('./624-02_lib26670_nextseq_n0240_151bp_R1.fastq.gz') f
GROUP BY substr(f.sequence, 1, 10)
"""
).to_polars()

Which would do the counting and reading at the same time.
Or if you have the start and stop from another place (like a CSV), you could do something like:
session = bb.connect()

session.execute(
    """
CREATE EXTERNAL TABLE positions
STORED AS CSV
WITH HEADER ROW
LOCATION './examples/positions.csv'
"""
)

df = session.sql(
    """
SELECT sequence, COUNT(*) AS count
FROM (
    SELECT substr(f.sequence, positions.start, positions.stop - positions.start) AS sequence
    FROM fastq_scan('./624-02_lib26670_nextseq_n0240_151bp_R1.fastq.gz') f
        JOIN positions
            ON f.name = positions.name
)
GROUP BY sequence
"""
).to_polars()

I realize SQL may not be totally in your wheelhouse, but just to put it out there since it can actually be pretty good for stuff like this.
On a FASTQ file with about 2.5M records, this takes about 45 seconds, with the vast majority spent on IO:
In [3]: %%time
   ...: df = session.sql(
   ...:     """
   ...: SELECT sequence, COUNT(*) AS count
   ...: FROM (
   ...:     SELECT substr(f.sequence, positions.start, positions.stop - positions.start) AS sequence
   ...:     FROM fastq_scan('./624-02_lib26670_nextseq_n0240_151bp_R1.fastq.gz') f
   ...:         JOIN positions
   ...:             ON f.name = positions.name
   ...: )
   ...: GROUP BY sequence
   ...: """
   ...: ).to_polars()
   ...:
   ...:
CPU times: user 47.7 s, sys: 972 ms, total: 48.6 s
Wall time: 26.5 s

Depending on how library is stored in map_sample_counts_to_library, you also might move that "down" to the SQL layer as well.
Parquet
To the last point, because I/O takes up the majority of time, if write the file to parquet format first, you get much better I/O for subsequent read and polars can work really well with Parquet. E.g....
In [11]: %%time
    ...: session.execute(
    ...:     """
    ...:     COPY
    ...:         (SELECT * FROM fastq_scan('./624-02_lib26670_nextseq_n0240_151bp_R1.fastq.gz'))
    ...:     TO './sequences.parquet'
    ...:     (FORMAT PARQUET)
    ...: """
    ...: )
    ...:
    ...:
CPU times: user 28.1 s, sys: 889 ms, total: 28.9 s
Wall time: 23.8 s

In [12]: %%time
    ...: pl.read_parquet("./sequences.parquet")
    ...:
    ...:
CPU times: user 1.16 s, sys: 407 ms, total: 1.57 s
Wall time: 1.01 s
Out[12]:
shape: (2_385_245, 4)

pyfaidx
My fault for not understanding your workflow. For now, you'd have to use pyfaidx (or samtools) to create the index, but biobear will recognize it and use it on the underlying files to control which bytes actually get read.
Anyways, thanks for raising the issues. Let me know if you have thoughts and I'll check the other issue you raised tomorrow.

Hi @tshauck, Thanks for all the feedbacks! I really liked using SQL for IO tasks on FASTQ files. I seems to outperform other methods I tried so far! I even don't need the FASTA indexing for now. I'm closing this issue and will be in touch again since I really liked your tool!


build error (can't find kernelspec)

The output below is from a pkg"up", but in fact I could never get it working on Julia 1.0, either with ENV["JUPYTER"]="jupyter" or without (in which case Conda installs fine). Using Ubuntu 18.04 (jupyter deb package version is 4.4.0).
 Installed ZMQ ──── v1.0.0
 Installed IJulia ─ v1.11.0
  Updating `~/.julia/environments/v1.0/Project.toml`
  [7073ff75] ↑ IJulia v1.10.0 ⇒ v1.11.0
  Updating `~/.julia/environments/v1.0/Manifest.toml`
  [7073ff75] ↑ IJulia v1.10.0 ⇒ v1.11.0
  [9602ed7d] - Unrolled v0.1.1
  [c2297ded] ↑ ZMQ v0.6.4 ⇒ v1.0.0
  Building ZMQ ───→ `~/.julia/packages/ZMQ/ABGOx/deps/build.log`
  Building IJulia → `~/.julia/packages/IJulia/6sod5/deps/build.log`
┌ Error: Error building `IJulia`:
│ Error executing Jupyter command 'kernelspec': [Errno 2] No such file or directory
│ ┌ Warning: Could not load Revise.
│ └ @ Main ~/.julia/config/startup.jl:13
│ [ Info: Found Jupyter version 4.4.0: jupyter
│ [ Info: Installing Julia kernelspec julia-1.0
│ ERROR: LoadError: IOError: could not spawn `jupyter-kernelspec install --replace --user /tmp/julia-1.0`: no such file or directory (ENOENT)
│ Stacktrace:
│  [1] _jl_spawn(::String, ::Array{String,1}, ::Cmd, ::Tuple{RawFD,RawFD,RawFD}) at ./process.jl:367
│  [2] (::getfield(Base, Symbol("##495#496")){Cmd})(::Tuple{RawFD,RawFD,RawFD}) at ./process.jl:509
│  [3] setup_stdio(::getfield(Base, Symbol("##495#496")){Cmd}, ::Tuple{RawFD,RawFD,RawFD}) at ./process.jl:490
│  [4] #_spawn#494(::Nothing, ::Function, ::Cmd, ::Tuple{RawFD,RawFD,RawFD}) at ./process.jl:508
│  [5] _spawn at ./process.jl:504 [inlined]
│  [6] #run#505(::Bool, ::Function, ::Cmd) at ./process.jl:652
│  [7] run at ./process.jl:651 [inlined]
│  [8] macro expansion at ./logging.jl:312 [inlined]
│  [9] #installkernel#4(::String, ::Function, ::String) at /home/tamas/.julia/packages/IJulia/6sod5/deps/kspec.jl:68
│  [10] installkernel(::String) at /home/tamas/.julia/packages/IJulia/6sod5/deps/kspec.jl:36
│  [11] top-level scope at logging.jl:310
│  [12] top-level scope at logging.jl:309
│  [13] top-level scope at /home/tamas/.julia/packages/IJulia/6sod5/deps/build.jl:38
│  [14] include at ./boot.jl:317 [inlined]
│  [15] include_relative(::Module, ::String) at ./loading.jl:1038
│  [16] include(::Module, ::String) at ./sysimg.jl:29
│  [17] include(::String) at ./client.jl:388
│  [18] top-level scope at none:0
│ in expression starting at /home/tamas/.julia/packages/IJulia/6sod5/deps/build.jl:9
└ @ Pkg.Operations ~/src/julia-git/usr/share/julia/stdlib/v1.0/Pkg/src/Operations.jl:1068

I fixed this by installing the jupyter-client package in Ubuntu, after I noticed that
jupyter kernelspec list

does not work in the shell.
So apparently I had an incomplete jupyter installation outside Conda, I wonder if IJulia could check for this somehow and show a better error message?

same issue on windows even installed by conda

@szrlee, if you are installing by conda then it is probably not the same issue.

You may have to downgrade python to 3.6.
Ref:
https://github.com/jupyter/jupyter_client/issues/395

Same problem with Julia 1.0.1 and 1.0.2 on Windows 10 when trying to install IJulia.

IJulia no longer uses jupyter kernelspec to install.


Update Arrow app to use secretless auth

Updating arrow app to use Arrow v4
AB#7557

merged https://github.com/microsoft/FluidFramework/pull/21075 instead


During rolling deploy it is possible for the old application pod to interact with the updated database

Prerequisites

[x] I've searched for existing issues

Describe the bug
In our current rolling deploy system, as new pods are being deployed an old pod sticks around until the new ones are ready for use. However, there is a single shared database that the pods connect to. The issue here is that a user may be interacting with the old pod, but the database could have been migrated to a new structure. This could lead to data corruption and/or 500 errors reported to the user as the application may have a mismatch of expectations of the data compared to the current database.
Expected behavior

We should minimize or eliminate the possibility of the old application and new database from interacting with each other.

This ticket captures the following tickets as related sub-tickets:
https://github.com/accessibility-exchange/platform/issues/1728
https://github.com/accessibility-exchange/platform/issues/1686
https://github.com/accessibility-exchange/platform/issues/1550

@jobara - We understand that this is not a priority at this time. Is that right? The sense of our team is that we can turn off the rolling updates, but then we will have downtimes for each deployment. This might not be worth our time.
Do you agree?

@colleenskemp I'll have to think so more on this. I'll check in with @michelled when she's back.

At the dev check in meeting with @JureUrsic, @peterhebert, and @michelled we discussed using Laravel's maintenance mode for this. When the deploy is happening the script would call php artisan down, after the deploy is finished it would call php artisan up. Any users accessing the site during the maintenance time would see a maintenance page.

@jobara it should go into  "local" command on start and beginning

I can run some tests on dev, just give me the commands to run

I can run some tests on dev, just give me the commands to run

@JureUrsic thanks, you can use the php artisan down and php artisan up commands. See Laravel's maintenance mode for more information.

@JureUrsic sorry, I thought I replied to this last week, but I guess I forgot to hit the send button.
You can use Laravel's maintenance mode for this. You'd use php artisan down to put it into maintenance mode and php artisan up to take it out of maintenance mode.

@JureUrsic the other day I manually reset the database in the dev deploy. As part of that I put the site in maintenance mode. However, after bringing the site back up using php artisan up the site was removed from maintenance mode; however, for several minutes the site remained inaccessible and returned a 500 error from nginx I believe. So the site actually looked broken for awhile. I'm not sure if this will happen with the plans we have for this ticket, but something to look into along with it.

@marvinroman

So the problem with maintenance mode currently is that the health check on the pods also gets maintenance mode so the pod is considered unhealthy and the load balancer doesn't forward connections.
We will take the following actions to fix:

[ ] Create a health check that will bypass maintenance mode.
[ ] Put the php artisan down/up in the php artisan deploy:global command.

@jobara I've made the necessary changes in the branch associated with this issue. Let me know if you want me to create a PR for it?

@marvinroman thanks for working on this. Yes, please file a PR for the changes.

So the problem with maintenance mode currently is that the health check on the pods also gets maintenance mode so the pod is considered unhealthy and the load balancer doesn't forward connections.
We will take the following actions to fix:

[ ]  Create a health check that will bypass maintenance mode.
[ ]  Put the php artisan down/up in the php artisan deploy:global command.

Regarding the health check, in taking a glance at your branch, it looks like it checks the DB now. But I guess that won't really tell us if the web site is actually served up properly. Is there a way to check different things if the site is in maintenance mode or not?
Regarding turning maintenance mode on/off in the global deploy, will that affect the original instance as well and not just the two new ones that are in the process of spinning up?

@marvinroman also in your branch I noticed that it brings the site back up after 5 minutes. These kinds of timers are always risky as we don't know if the task has yet to complete or completed some time before. Is it possible to get a hook into when the pods are actually being used, and/or when the old pods are all removed?

So the problem with maintenance mode currently is that the health check on the pods also gets maintenance mode so the pod is considered unhealthy and the load balancer doesn't forward connections.
We will take the following actions to fix:

[ ]   Create a health check that will bypass maintenance mode.
[ ]   Put the php artisan down/up in the php artisan deploy:global command.

Regarding the health check, in taking a glance at your branch, it looks like it checks the DB now. But I guess that won't really tell us if the web site is actually served up properly. Is there a way to check different things if the site is in maintenance mode or not?
Regarding turning maintenance mode on/off in the global deploy, will that affect the original instance as well and not just the two new ones that are in the process of spinning up?

This is a health check of the pod and not the site to know whether to forward connections to the pod from the load balancer. In other words are the services properly running. We have an external check that determines site health and will notify us of site issues.
When maintenance mode is activated it occurs across all the pods.

I agree that there are risks associated with a timer, but we haven't found an alternative at this time.
We have determined that lifecycle hooks aren't possible to use in our infrastructure at this time.


ForbiddenThisArgumentRule is overly strict on native function calls

The ForbiddenThisArgumentRule prevents passing $this as argument to a method call, which is actually a pretty nice rule.
However IMHO calls to native functions should included from that rule, as there is no way to refactor those. In the current implementation there is already a exception for method_exists function call: https://github.com/symplify/phpstan-rules/blob/main/src/Rules/ForbiddenThisArgumentRule.php#L121
But there are more function calls like this where it is IMHO totally valid or even needed to pass $this into e.g.: is_a, is_subclass_of, get_object_vars, get_class_methods and probably more i didn't thought of now. IMHO the rule should skip all function calls.
What do you think? Happy to prepare a PR if it will be accepted in general

What do you think? Happy to prepare a PR if it will be accepted in general

Makes sense, go for it :+1:


App Backend: Save & Subtract Current Dooley ( & also tracks swipes)(updated)

Remember to set the merge base to dev when creating the PR

@MimiOlayeye Can you resolve any comments that you implemented/fixed by clicking the "resolved" button. Also, looks like you have a merge conflict

@RafaelPiloto10 I just resolved the conflicts and comments that have been implemented

Awesome job! Infrastructure looks great! Just missing the FastAPI code and storage in the app backend database.
I think you will need to do some merging of the BalanceTracker object and the User base model. Maybe we start a global User base model that continues to grow with all of our user data: name, email, password, meal_swipes, dooley_dollars, etc
Since this PR is small, I think it's fine to do it here rather than in a different one.

What do you mean by the FastAPI code? And for the adding to the user data do you mean we will just keep appending like if User was originally:
name
email
password
And we appended review and balance it would likely be:
name
email
password
review
balance
So the new users will only have the name email password while some older users might have additionally review and balance if they user that feature?

FastAPI code refers to the code that creates the web routes similar to /login or /new-friend etc. Something along the lines of /update-dooley or something.
As per the User object, I just meant like a User class that stores data fields like name, email, password, dooley, reviews, etc.

@MimiOlayeye Does this still need a fix? How is this PR looking right now?


synatax

All installed and running and I'm getting a
syntax error, unexpected '['
highlighting line:
return ['analytics-reports'];
Thanks

Can you please paste the code which is giving you this error?

All of your arrays are written $array = []; rather than $array = array();
I'd have to rewrite everything to get this working.

Looks like it's my version of PHP.
https://github.com/JeffreyWay/Laravel-4-Generators/issues/4
Thanks.

Yes you need to upgrade your version to 5.4 to make it work.

Thank you.

Hi
My PHP Version 5.6.3 .and i have the same problem .Can you guys suggest what i have to do with it .
Thanks


Decide on list of appropriate components for [Basic Components] Milestone

Need to decide on what components need to be created and are in score for the basic component milestone.

Current ideas:

Typography
Icon
Button

Input types

Input
Textarea
Radio button
Checkbox

Possible further extensions:

Header (sticky option)
Footer
Breadcrumbs
Side navigation
Alerts
Button dropdown

Final decision:

Box (#1)
Icon
Button
Link
Input
Textarea
Checkbox
Switch
Radio


Zenodo integration

Let make our work citable!
idea is to:

get a DOI from Zenodo
release once a year (or more often is a large enough change occurs mid-year).

We likely need to set up a nice zenodo json with some information:
https://github.com/ropensci/dev_guide/blob/main/.zenodo.json

@drmowinckels should we close this issue?

completed with https://github.com/rladies/rladiesguide/commit/acd6adcd0ab83c6b683eebc7c645301efd6d82b0


Possible to detect changes in sub folders?

Changes in sub folders are not detected.
What would it take to detect sub folder detection?

You have to recurse and add all the paths (including subfolders), that you want handled. You can do this with https://developer.apple.com/documentation/foundation/filemanager/directoryenumerator


xlxs import / export

Hi,
In base_formats.py I found below.
But I can;t see this in Django Admin as option to import/export xlsx files
Do I need extra libs to make this working ?
class XLSX(TextFormat):
    TABLIB_MODULE = 'tablib.formats._xlsx'

i had seen xlsx option in import formats only after install openpyxl (openpyxl-2.4.0) python module


Mobile version lacks margins

Margins on left and right side of the main body would probably improve legibility on mobile devices.
Otherwise fantastic theme - minimalist and serious.

Thanks for reporting this. Yes, you are right. This issue will be tackled in a future release in which I'll add a responsive layout for mobile and tablets.
Cheers!

I am also looking forward to this. Lovely theme!

For those looking for a quick fix: make the 'max-width' of the .main-wrapper 85% instead of 42em.

Any ETA on when the mobile version might come out?


Reset htpasswd database

Hello,
I've forgot my password and can't login with my user. I tried to reinstall verdaccio globally but it seems like the data stays in the computer. How can I reset the database and reinstall everything from 0? Where is the config file?
Thanks

Look into your local storage (http://www.verdaccio.org/docs/en/cli.html#default-config-file-location) and open the file htpasswd and edit it manually. That's a quick way.

I don't have anything at ~/.local/verdaccio/config.yaml, I'm running a Mac.

@alexmngn Please try to find your config file using this cat ~/.config/verdaccio/config.yaml


The upcoming release of Arrow (20?) breaks datafusion

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Some changes to Decimal 128 & 256 require updating datafusion code to support.
Describe the solution you'd like
Decimal 128 to be supported.
Describe alternatives you've considered
I think we're going to have to do this.
Additional context
N/A

I think this has been resolved in #3007

I think this has been resolved in #3007

The build is fully working in CI and for me locally, yes. There are still some failing checks I haven't looked into. Would you like me to undraft #3007?

The build is fully working in CI and for me locally, yes. There are still some failing checks I haven't looked into. Would you like me to undraft https://github.com/apache/arrow-datafusion/pull/3007?

I don't have any strong preference

there are many api changes for decimal in arrow-rs.
upgrading the arrow-rs 20 for datafusion need to take effort.
Thanks for your work. @avantgardnerio


Update cats-effect-laws to 3.3.12

Updates org.typelevel:cats-effect-laws from 2.5.5 to 3.3.12.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Applied Scalafix Migrations

org.typelevel:{cats-effect,cats-effect-laws}:3.0.0

github:typelevel/cats-effect/v3_0_0?sha=v3.0.0

org.typelevel:{cats-effect,cats-effect-laws}:3.3.0 (created no change)

github:typelevel/cats-effect/v3_3_0?sha=series/3.x

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.typelevel", artifactId = "cats-effect-laws" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "@monthly" },
  dependency = { groupId = "org.typelevel", artifactId = "cats-effect-laws" }
}]

labels: test-library-update, early-semver-major, semver-spec-major, scalafix-migrations, commit-count:n:2

Closing all @scala-steward PRs in favor of the ones created by github actions

Superseded by #265.


Introduce namespace resolver for validating and resolving stream names

@jderrickk I think the change is making the namespace management become much complicated.
I had a brief discussion with @leighst offline about the naming management in DL. I think we should probably just stick into one naming convention. for example, we probably can just support zookeeper file-path like name. so 1) we can simply map the stream name to the path of zookeeper metadata; 2) this allow application manages how their streams will be organized in their own hierarchical.

@sijie sounds good to me. I am fine with single naming convention. I will update the pull request.

@jderrickk are you still willing to contribute this?
I am thinking it might be just easier to accept zookeeper-like path as the stream name. we don't need to introduce namespace resolver.

@jderrickk ping?

@jderrickk #130 supports filesystem-like path. so I think we probably don't this any more, right?

Closed this pull request since #130 already did similar thing. And this pull request has been idle for a  long time.


When using reverse proxy mode the return is not available

Thank you for your work, I really enjoyed it. I am now trying to use the v4 api but am having some problems.
I have a proxy server and it seems to work fine.
curl -X POST http://xxxx.xxxx/chats -H 'Content-Type: application/json' -d '{"prompt":"who are you"}'
{"id":"kloh-6kpPJksn7u5c5cyXmUv7oMoOdRE6t","object":"text_completion","created":1676618717,"model":"text-davinci-003","choices":[{"text":"?\n\nI am a person trying to learn more about the world.","index":0,"logprobs":null,"finish_reason":"stop"}],"usage":{"prompt_tokens":3,"completion_tokens":15,"total_tokens":18}}

And I set apiReverseProxyUrl in local.json like this:
...................
   api": {
    "version": "v4",
   },
    "v4": {
      "apiBaseUrl": "",
      "apiReverseProxyUrl": "http://xxxx.xxxx/chats",
      "completionParams": {}
    }

But when I start the bot and send a message to it in telegram, it gets stuck and doesn't get the returned value.
2/17/2023, 7:34:52 AM 📩 Message from @ () in private chat:
hello
upsertMessage dfafasfsaf-57d4-dsfa-b047-eafce922c4df {
  role: 'user',
  id: 'dfafasfsaf-57d4-dsfa-b047-eafce922c4df ',
  parentMessageId: undefined,
  conversationId: 'b4a3a4e4-d2c6-23fa-dsfa-73c5991c10bf',
  text: 'hello'
}

Is there a setting that I haven't configured correctly? Thanks

The reverse proxy server is not simply proxying the ChatGPT web application, but instead simulating a set of interfaces consistent with the official completions API based on ChatGPT's response. To avoid OpenAI blocking this method, the reverse proxy server is closed-source and maintained by only a few people.
Unfortunately, according to one of the maintainers of the servers, OpenAI eventually patched this method. So it's unusable at present.

Closed as this issue is related to the (legacy) reverse proxy servers, which is out of the scope of this repository.
FYI, you can now use the unofficial API with v2.1.0 to bypass CloudFlare without a browser.


Add libpostal address detection

Add regex for basic potential addresses such as a \d+ followed by \s+ and a \w {5,30} and a comma and then another \d+. Then test if there's no stopwords within the \w, and then feed the whole thing to libpostal to check if there is an address. Libpostal will tell us house, road, etc. We need to check if there is a road, etc. "house" doesn't really tell us anything as that is almost always caught.

This test should be done after an stdnum and a date test. in this way, we know it's not a stdnum and not a date

@paulovn

the idea looks fine to me, and using libpostal excluding house seems a sane approach.
Except for the base regex, which in reality is not fully language independent. The current one proposed is

number + space + name + comma + number

That may work for US English, though it might miss the state (e.g. 10 Boulevard Rd Los Angeles, CA 38718 ). But e.g. in British addresses the postcode has numbers AND letters : 71 Cherry Court SOUTHAMPTON SO53 5PD
And other languages can be more diverging: These are a few examples of sequences I came up with:

UK: number + s + name + s + street-designer + s + postcode + s + city
Spain: street-designer + s + name + s + comma + s + number + [comma + name/number] + s + postcode-number + s + city
Germany name + street-designer + s + number + s + postcode-number + s + city (a speciall feature of German addresses is the lack of space between the street name and street designer, e.g. Hauptstraße )
France: number + s + street-designer + s+ name + s + postcode-number + s + city

Other countries might fill in these patterns, for instance Portugal is quite similar to Spain (but Brazil puts postcode after the city)
The point is, we would need a library of regexes by lang/country. I would rather make them liberal (e.g. don't force having a comma) to fit in more variations.
The wikipedia page about addresses has a good recollection: https://en.wikipedia.org/wiki/Address

@shamikbose see above ^^.

Thanks, @ontocord ! I will look into it this weekend


Add page sorting for taxonomies

See https://github.com/spf13/hugo/blob/ebf677a58360126d8b9a1e98d086aa4279f53181/hugolib/taxonomy.go#L224

Going back to the origin of this issue:
https://discourse.gohugo.io/t/sort-order-only-bydate-or-byweight/6961
From the later comments on the topic, it is unclear if this was actually a problem 6 years ago. Regardless, with v0.111.3, the .Pages collection passed to a term template is sortable (.ByDate, .ByDate.Reverse, etc.).


InvalidArgumentError (see above for traceback): Sampler's range is too small.

hello, I encounter an problem, “tensorflow.python.framework.errors_impl.InvalidArgumentError: Sampler's range is too small.
[[Node: lm/sampled_softmax_loss_1/LogUniformCandidateSampler = LogUniformCandidateSampler[num_sampled=8192, num_true=1, range_max=6603, seed=0, seed2=0, unique=true, _device="/job:localhost/replica:0/task:0/device:CPU:0"](lm/Reshape_6, ^lm/dropout_1/mul)]]
”。
I want to train based on words without chars.So I changed the code like "load_vocab(args.vocab_file)"
And I remove CNN in dict.I don't know why.

I had the same problem today and I think I solved it.
This is because the num_sampled (8192 in your case) should be smaller than the range_max (6603 in your case), see this page, line56.
You can fix this problem by setting n_negative_samples_batch in train_elmo.py smaller than your vocabulary size.

That's right.  FWIW, with such a small vocabulary size, you will almost certainly have better results without sacrificing training time if you switch to a unsampled, full softmax.


[Feature] DB2 support upsert SQL

Purpose of this pull request
Currently Seatunnel JDBC Connector with DB2 Dialect, does not support upsert scenarios, as the implementation is unavailable. While analysing our requirements within Visa's use-cases, we have approximately 60% of jobs that heavily depend on this.
We want to introduce the implementation for upsert support for DB2 dialect, along with the e2e Integration test case.
solves: https://github.com/apache/seatunnel/issues/4434, as Dameng DB, implementation is already present.
How do I reopen the issue?
Does this PR introduce any user-facing change?
No,
User does not have to provide the query parameter in sink, user has to provide database, table and generate_sink_sql, which are already available in the configurations. Please refer corresponding [Seatunnel-web] PR: https://github.com/apache/seatunnel-web/pull/233
Sample:
env {
  parallelism = 1
  job.mode = "BATCH"
}

source {
  # This is a example source plugin **only for test and demonstrate the feature source plugin**
  Jdbc {
    driver = com.ibm.db2.jcc.DB2Driver
    url = "jdbc:db2://db2-e2e:50000/E2E"
    user = "db2inst1"
    password = "123456"
    query = """
    select * from "E2E".SOURCE;
    """
  }
}

sink {
  Jdbc {
    driver = com.ibm.db2.jcc.DB2Driver
    url = "jdbc:db2://db2-e2e:50000/E2E"
    user = "db2inst1"
    password = "123456"
    database = "E2E"
    table = "SINK"
    # The primary keys of the table, which will be used to generate the upsert sql
    generate_sink_sql = true
    primary_keys = [
      C_INT
    ]
  }

How was this patch tested?
We internally deployed, and tested the scenarios, we need to introduce a minor change in Seatunnel-web module as well, to delegate generation of sink sql to the engine, as required for the upsert use-case.
Check list

[ ] If any new Jar binary package adding in your PR, please add License Notice according
New License Guide
[ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
[ ] If you are contributing the connector code, please check that the following files are updated:

Update plugin-mapping.properties and add new connector information in it
Update the pom file of seatunnel-dist
Add ci label in label-scope-conf
Add e2e testcase in seatunnel-e2e
Update connector plugin_config

[ ] Update the release-note.

@Hisoka-X , thanks for your time in reviewing the same.
@hailin0 , @liugddx, @arshadmohammad   can you please help with the review.


Hp and prayer bar plugin

I wanted to try and managed to create my first plugin for runelite after creating the feature request :
HP bar & Pray bar feature request. #2943
The plugin adds a HP & Prayer bar into your inventory UI, which makes it easier on the eyes so you dont
have to look at the right top corner of your screen to check your hp or prayer.

This also works for the resizeable

The player can also choose to remove the icons.

Poison changes the color of the HP bar so you know when you got poisoned
For venom a darker green color is used.

Really awesome work! Could you squash these commits together? The history is a bit messy.

I think i did something wrong here trying to squash them together,

Needs review, i finished writing the things i wanted for this plugin.
Maybe some other colors for the healthbar while poisoned? feel free to suggest some changes!

Would be nice of it would fit exactly into the pillars depending on the interface style.

@raqes That's the interface styles configuration plugin right? i'll take a look to fix it :)

@raqes i added the check but it currently doesn't work as intended. it needs to check if InterfaceStylesPlugin is enabled, this would require injecting the InterfaceStyles plugin which i don't know how to do.
So currently you have to set the 2005 setting to 2010 if you want to move the bars back to their original spot, even if the InterfaceStyles plugin is not active.

Allright, i cleaned the code up, i see now that it was a big mess, should be somewhat better now.

Updated the main post to reflect the visual change of the PR
@raqes allright i'll take a look on how to do this.

Reworked the entire code so it hopefully doesn't have any duplicate code anymore.
Also updated post to reflect the visual changes to the PR
Many thanks @raqes for showing me another way to do this kind of stuff. I've learnt alot :) 👍

Review needed, or is everything allright?

The bars are only visible if any interface is open ( on fixed and box mode in resizable this is always the case)
on the bottomline mode in resizable it is not visible when no interfaces are open. This seems right if a player wants to make a screenshot, or just wants to have a clean gamescreen.
The bars will be used only whenever a player is in combat anyway in which case a interface is open ( prayer/inventory ).
The only extra functionality that could be added is a indicator whenever you hover over a HP or prayer restoring item to see to where your hp would be filled if you ate or drank it.
If someone wants to help add this function that would be great as i have no clue on how i would need to start on this and where to look.
but i am currently happy with the plugin as it stands.

They're looking way better now, happy to see you took everyone's feedback

The prayer bar now also switches color whenever the player has quick_prayers activated :)

Added the preview bars for prayer and health healing.
needs review.


Remove include/grpcpp/impl/codegen/async_generic_service.h completely

Follow up for #30956. This PR removes include/grpcpp/impl/codegen/async_generic_service.h completely.
This PR requires cherry picking.

We plan to move all codegen files at once.


Default input autocomplete from browser

Component has input element that has an “autocomplete” attribute with a default value of true. Eventually, input can open two autocomoplete drop-down lists.
See.

Please, fix

Please try to use v1.1.2. I've added it there.
When you try and it works, please close the issue.
Otherwise please let me know what is wrong.


Minor documentation typo and fix

The documentation for exec was a little confusing, and had a small typo. I have suggested a minor fix for the documentation.
Thanks.

Thanks!


feat: add upcoming view to payouts

What does this PR do and why?
Provide a description of what this PR does. Link to any relevant GitHub issues, Notion tasks or Discord discussions.
Screenshots or screen recordings
If applicable, provide screenshots or screen recordings to demonstrate the changes.
Acceptance checklist

[ ] I have evaluated the Approval Guidelines for this PR.
[ ] (if relevant) I have tested this PR in all supported browsers.
[ ] (if relevant) I have tested this PR in dark mode and light mode (if applicable).

Current dependencies on/for this PR:

main

PR #3708

PR #3709

PR #3710

PR #3711

PR #3712

PR #3713

PR #3714

PR #3715

@wraeth-eth started a stack merge that includes this pull request via Graphite.


OKTA auth provider not found error

I tried configuring OKTA authentication as per the documentation. But when try to login through OKTA getting the message	"Unknown auth provider 'okta'"
Expected Behavior
Application should present with the OKTA credentials pop-up page and login workflow should happen
Current Behavior
On clicking the Okta login getting the below error.

message:	"Unknown auth provider 'okta'"

stack:	"NotFoundError: Unknown auth provider 'okta'\n
at eval (webpack-internal:///../../plugins/auth-backend/src/service/router.ts:165:11)\n    at handleReturn
 (/backstage/backstage-master/node_modules/express-promise-router/lib/express-promise-router.js:24:23)\n    at
 /backstage/backstage-master/node_modules/express-promise-router/lib/express-promise-router.js:64:7\n    at Layer.handle
 [as handle_request] (/backstage/backstage-master/node_modules/express/lib/router/layer.js:95:5)\n
 at trim_prefix (/backstage/backstage-master/node_modules/express/lib/router/index.js:317:13)\n    at
 /backstage/backstage-master/node_modules/express/lib/router/index.js:284:7\n    at param
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:354:14)\n    at param
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:365:14)\n    at Function.process_params
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:410:3)\n    at next
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:275:10)\n    at
 /backstage/backstage-master/node_modules/express/lib/router/index.js:635:15\n    at next
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:260:14)\n    at Function.handle
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:174:3)\n    at router
 (/backstage/backstage-master/node_modules/express/lib/router/index.js:47:12)\n    at handleReturn
 (/backstage/backstage-master/node_modules/express-promise-router/lib/express-promise-router.js:24:23)\n    at router
 (/backstage/backstage-master/node_modules/express-promise-router/lib/express-promise-router.js:64:7)"

request
  method:	"GET"
  url	"/api/auth/okta/xxxx.okta.com/oauth2/v1/authorize?response_type=code&redirect_uri=http%3A%2F%2F<IP_ADDRESS>%3A7000%2Fapi%2Fauth%2Fokta%2Fhandler%2Fframe&scope=openid%20email%20profile%20offline_access&state=6e6f6e63653d3547655550253246565070556e35626d5142434d3241576725334425334426656e763d646576656c6f706d656e74&client_id=xxxxxx"
response
   statusCode:	404

Steps to Reproduce

Step 1
Clone the repo

git clone --depth 1 git@github.com:backstage/backstage.git
cd backstage

Step 2
Configure the app-config.yaml for OKTA

app-config.yaml
    okta:
      development:
        clientId: xxxxxxx
        clientSecret: xxxxxxx
        audience: dev-xxxxx.okta.com

Step 3
Fetch dependencies, run an initial build and start backend and front-end

# yarn install
# yarn tsc
# yarn build
# yarn start
# cd packages/backend
# yarn start

Step 3
Verify the Okta login

Context

Your Environment

NodeJS Version (v14.16.0):
Operating System and Version (e.g. Ubuntu 20.04):
Browser Information: Firefox

That request URL does not look good.
/api/auth/okta/xxxx.okta.com/oauth2/v1/authorize?response_type=code&redirect_uri=http%3A%2F%2F<IP_ADDRESS>%3A7000%2Fapi%2Fauth%2Fokta%2Fhandler%2Fframe&scope=openid%20email%20profile%20offline_access&state=6e6f6e63653d3547655550253246565070556e35626d5142434d3241576725334425334426656e763d646576656c6f706d656e74&client_id=xxxxxx

There is no route to handle this request. In fact, this request should directly go the OKTA audience URL. Since it contains a redirect_url, when the user logs in, the response will be resolved by auth-backend in Backstage.
Is this problem solved if you add a https:// as prefix in okta.development.audience?

That fixed he issue.

Sorry! I want to re-open this issue since it seems like we can handle this bug in the backend. Some kind of check to see if the OKTA audience starts with https or even append automatically if it doesn't.


Summary assumes Cuda

Summary assumes that the model is on the GPU if cuda is available, this is not always the case and should rather be left up to the user to specify if it should use the GPU or CPU.

I get around this issue by having CUDA_VISIBLE_DEVICES='' in the environment variables.
In bash-like shells, you can do so by prepending it to the python call, as such (supposing $ is the shell prompt):
$ CUDA_VISIBLE_DEVICES='' python <themodule.py>
Sure, it's just a workaround for the time being...

Thanks for the work around. Perhaps I'll submit a PR for the fix if I get
sometime before you.
On Mon, 04 Jun 2018, 17:38 Yannick Hold<EMAIL_ADDRESS>wrote:

I get around this issue by having CUDA_VISIBLE_DEVICES='' in the
environment variables.
In bash-like shells, you can do so by prepending it to the python call, as
such (supposing $ is the shell prompt):
$ CUDA_VISIBLE_DEVICES='' python <themodule.py>
Sure, it's just a workaround for the time being...
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/sksq96/pytorch-summary/issues/14#issuecomment-394400025,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAFlda7z0JqODxD9TfGqJ3POo2FUmRTSks5t5VRYgaJpZM4UTPLM
.

In the main file, you can remove the need for cuda by commenting out the lines:
    if torch.cuda.is_available():
        dtype = torch.cuda.FloatTensor
    else:
        dtype = torch.FloatTensor

As long as the model is on the cpu, everything should work.
Another workaround is to have the user decide what the dtype should be. So make it an input into the summary() method

I have already fixed and made a PR for this issue. Thanks for the info though.


WIP: benchmarks and performance improvements

Ugly-ass implementation that builds a terrible happy-path for array values passed to ShapeType::coerce()
This is just a prototype, and we can likely do the same with assert() and matches(), but it's just to show
the theory of operation.
Results:
./tools/phpbench/vendor/bin/phpbench run --config tools/phpbench/phpbench.json --ref=benchmark_reference
PHPBench (1.1.0) running benchmarks...
with configuration file: /app/tools/phpbench/phpbench.json
with PHP version 8.0.9, xdebug ❌, opcache ❌
comparing [actual vs. benchmark_reference]

\Psl\Tests\Benchmark\Type\ShapeTypeBench

    benchEmptyShapeCoercionAgainstEmptyArra.R1 I1 - [Mo0.500μs vs. Mo4.500μs] -88.89% (±0.00%)
    benchEmptyShapeCoercionAgainstNonEmptyA.R3 I3 - [Mo0.700μs vs. Mo6.103μs] -88.53% (±0.00%)
    benchComplexShapeCoercionAgainstValidSt.R3 I4 - [Mo1.603μs vs. Mo17.348μs] -90.76% (±2.99%)
    benchComplexShapeCoercionAgainstValidSt.R1 I3 - [Mo2.500μs vs. Mo24.120μs] -89.64% (±1.61%)

Subjects: 4, Assertions: 0, Failures: 0, Errors: 0

@azjezz one big part that is relevant to me is optimizing the IterableType and VecType, which are intensively used in JSON decode operations in most biz domains I'm touching.
If you like where this is going (and before I add any more terrible things to it), I'll gladly expand the patch.

Note:

opcache ❌

I expect even better results when running with OPCache enabled, but don't have a local php installation where to try it out at this moment.

One failing test reports:
bash-5.1# ./tools/phpunit/vendor/bin/phpunit -c tools/phpunit/phpunit.xml.dist tests/unit/Type/ShapeAllowUnknownFieldsTypeTest.php
PHPUnit 9.5.9 by Sebastian Bergmann and contributors.

Warning:       No code coverage driver available

...................F

Time: 00:00.020, Memory: 8.00 MB

There was 1 failure:

1) Psl\Tests\Unit\Type\ShapeAllowUnknownFieldsTypeTest::testValidCoercion with data set #1 (array('saif'<EMAIL_ADDRESS>Psl\Collection\Vector Object (...)), array('saif', array(array('Foo', 'Baz', 0)), 'azjezz@example.com'))
Failed asserting that false is true.

/app/tests/unit/Type/TypeTest.php:111

Comparing $expected and $actual, I saw this:
array(3) {
  ["name"]=>
  string(4) "saif"
  ["articles"]=>
  array(1) {
    [0]=>
    array(3) {
      ["title"]=>
      string(3) "Foo"
      ["content"]=>
      string(3) "Baz"
      ["likes"]=>
      int(0)
    }
  }
  ["email"]=>
  string(18<EMAIL_ADDRESS>}
array(3) {
  ["name"]=>
  string(4) "saif"
  ["email"]=>
  string(18<EMAIL_ADDRESS>  ["articles"]=>
  array(1) {
    [0]=>
    array(3) {
      ["title"]=>
      string(3) "Foo"
      ["content"]=>
      string(3) "Baz"
      ["likes"]=>
      int(0)
    }
  }
}

I wonder if this scenario is valid? Is coerce() supposed to change the key order?

If you like where this is going (and before I add any more terrible things to it), I'll gladly expand the patch.

This looks good to me so far 👍

I wonder if this scenario is valid? Is coerce() supposed to change the key order?

No 🤔 not sure why this is happening

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

21 of 21 (100.0%)  changed or added relevant lines in 1 file are covered.
3 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.1%) to 99.808%

Files with Coverage Reduction
New Missed Lines
%

src/Psl/Type/Internal/ShapeType.php
3
95.95%

Totals

Change from base Build<PHONE_NUMBER>:
-0.1%

Covered Lines:
3119

Relevant Lines:
3125

💛  - Coveralls

Latest results can be seen in the commit message of 68da707 - overall quite happy with it, but wish I could make VecType and DictType faster (couldn't find a way, they are O(n), and there's no shortcut, IMO).
I've resorted to improving some of the base types, where possible.
The ridiculous amount of scenarios is due to a @phpbench bug that I haven't yet investigated: it creates permutations of every benchmark scenario, because parent class / child class data providers are both considered, for some reason (parent class is supposed to only provide the signature).

@azjezz I think this is good to go.
Here's the action run on my repo: https://github.com/Ocramius/psl/runs/3544847629
Benchmarks are running forever - hopefully fixed after https://github.com/phpbench/phpbench/pull/918 :-\

@azjezz I see this isn't released yet - would a patch with release automation additions help on that?
Trying to kinda fill the time distance between improvements and discovered regressions :D

would a patch with release automation additions help on that?

Yes!
i just didn't have the time for it :D i tried to integrate laminas auto release before but with no success


Fix GetVerifyingKeyReturn struct to use Vec instead of fixed-size array

Issue Description
The GetVerifyingKeyReturn struct in the generated snark_verifier.rs file was using a fixed-size array, which caused compilation errors due to the inability to implement the Default trait.
Solution
Need to change the GetVerifyingKeyReturn struct in backend/src/contracts/generated/snark_verifiers.rs
from :
pub struct GetVerifyingKeyReturn(pub [::ethers::core::types::U256; 43]);

to
pub struct GetVerifyingKeyReturn(pub Vec<::ethers::core::types::U256>);

The error occurs when building  and generating backend
cd summa-solvency/backend/
cargo build
(...)

error[E0277]: the trait bound `[ethers::types::U256; 43]: std::default::Default` is not satisfied
     --> src/contracts/generated/snark_verifier.rs:17777:38
      |
17771 | ...   Default,
      |       ------- in this derive macro expansion
...
17777 | ...ub struct GetVerifyingKeyReturn(pub [::ethers::core::types::U256; 43...
      |                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the trait `std::default::Default` is not implemented for `[ethers::types::U256; 43]`
      |
      = help: the following other types implement trait `std::default::Default`:
                [T; 0]
                [T; 1]
                [T; 2]
                [T; 3]
                [T; 4]
                [T; 5]
                [T; 6]
                [T; 7]
              and 27 others
      = note: this error originates in the derive macro `Default` (in Nightly builds, run with -Z macro-backtrace for more info)

Related Files

backend/src/contracts/generated/snark_verifier.rs

Resolved without change - updated cargo dependencies


Bug 1177003 - Change forum links to point to new forum

@clouserw feedback? (about directly editing local files)

You shouldn't be editing locale files. There are computers to do that for you.
Can you back out the locale changes so I can review what's left?

Even when replacing a translatable string by a variable?

Thanks @wagnerand for this work!
I see there's a reference to the forums.mozilla.org link in the apps/devhub/tests/rss_feeds/blog.xml file, but it doesn't seem to be used anywhere anymore (@kmaglione do you know anything about it?).
Regarding the locale files, I'm not sure if they should be edited or not. Replacing the links by template strings seems like a good idea, to avoid having to mark all those strings as fuzzy or untranslated. What do you think @clouserw?

I'd rather have the least amount of code changes to the .po files, at least in this PR, and stick only to the %(forum_url)s changes (btw I think you're missing a few, see comments).
We're going to have a hard time merging this, because we need to synchronize with verbatim, so the less changes to the .po files, the better.
BTW, do you have a "simple" command (or set of commands) that you can run to search/replace all the links to %(forum_url)s in the .po files? If so, I would advise doing the following:
1/ back out all the changes to the .po files
2/ wait for a time where all three of us (you, me and @mathjazz on irc) are online at the same moment
3/ ask @mathjazz to synchronise verbatim
4/ you rebase your PR on master
5/ you apply the changes to the .po files, and push them to the PR
6/ I give them a quick review just to make sure everything looks good
7/ I merge the changes
8/ we tell @mathjazz about the changes so he can re-synchronize verbatim
What do you think?


get weid count and get activatedUserList from databucket

提供接口获取weid总数
提供获取启用存证合约用户列表接口

Codecov Report

Merging #274 (c5080f9) into develop (8a2e79a) will decrease coverage by 0.07%.
The diff coverage is 9.72%.

@@              Coverage Diff              @@
##             develop     #274      +/-   ##
=============================================
- Coverage      38.35%   38.27%   -0.08%
  Complexity      1555     1555
=============================================
  Files            242      242
  Lines          13799    13829      +30
  Branches        1767     1770       +3
=============================================
+ Hits            5292     5293       +1
- Misses          7853     7882      +29
  Partials         654      654

Impacted Files
Coverage Δ
Complexity Δ

...ank/weid/contract/deploy/v2/RegisterAddressV2.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

.../com/webank/weid/service/impl/WeIdServiceImpl.java
60.73% <0.00%> (-0.15%)
68.00 <0.00> (ø)

...rvice/impl/engine/fiscov1/WeIdServiceEngineV1.java
0.00% <0.00%> (ø)
0.00 <0.00> (ø)

...rvice/impl/engine/fiscov2/WeIdServiceEngineV2.java
57.30% <0.00%> (-0.81%)
48.00 <0.00> (ø)

...impl/engine/fiscov2/DataBucketServiceEngineV2.java
9.60% <6.55%> (-0.79%)
4.00 <0.00> (ø)

...rc/main/java/com/webank/weid/constant/CnsType.java
86.66% <100.00%> (ø)
6.00 <0.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8a2e79a...c5080f9. Read the comment docs.


Patching research idea - Developer Debug Mode?

CyberConsole

Save's Metadata
Can you find developer debug blocking code? It's like the DOOM Eternal, Spore and other game situations, where game have a checking for build type (Release or Debug, for example: DOOM Eternal 1000+ codes or Spore's DebugRelease (Hiding the console commands in Release version) and etc)
Theoretical, If this is found, then it will be possible to access to massive(?) blocked functions & commands.
P.S. Game is very new, not all is researched. Game EXE have mentioning of multiplayer, debug and map editor functions.

This is probably simple to find, will give it a shot tomorrow ;)

Any news on this? Im looking for Veh.SpawnCar () It says random i was hoping reference id would work too not that once that works I would even know where to start to get the item ids for the cars.

hey Guys, I don't have version from 16-17 of Dec '20, but was that 1.06?
Afaik they removed many things in futher releases.
hi @yamashi I've question about your tactics, shall we use CheatEngine to diff mem state while loading patched sav.dat or You wanted to analyze app executables in-place, and if second - which tool do you like to use? Cheers!

I don't think that the debug menu is working, anymore. I just updated to 1.11.4 and I can't the debug menu to appear. I was wondering if that was on purpose or something that needs to be worked on?

@Marchauff known and fixed, #505

btw, closing this cause i believe this was left open accidentally.
if it was not, feel free to reopen, but we have some debug options enabled with patch (till it broke with v1.11.1)


Support Binance mainnet/testnet

📝 Changed routes:

/dashboard

(view full size)

Commit a72d2614eb3f8962ea4664843b0176219a855ea1 (https://thirdweb-5g5xoodkq-thirdweb.vercel.app).


Temperatuur sensor is not working

€ 1,83  53％ Off | Tuya ZigBee Smart Temperature And Humidity Sensor Battery Powered ZigBee Smart Home Security Work With Alexa Google Home 2021
https://a.aliexpress.com/_veavW1
Can you make this for me?

Hi @bvdp02, I need an interview of the device to be able to add it: https://community.homey.app/t/app-pro-tuya-zigbee-app/26439


Update caab-api version to 0.0.39

Automatic PR raised by GitHub Actions to update caab-api version to 0.0.39

Already up to date in main


[QUESTION] How to select only some translation columns

Hi,
I'm new to this package and i hope you can help me.
Is it possible to select only some columns from a translation.
For exemple, let's say we have an article that is translatable. The translatable attributes are 'title', 'description', 'content'
How can i make an eloquent query that select only the article 'id' on the main table and the 'title' and 'description' from the translations table but in the same time, keep all the cool stuff of the package like locale fallback ...

Why would you want to do that?

I just made a simple example but in my case i have a Model that have a lot of relations and a lot of data to load.
For performance purposes i need to load only the columns i need and not all the columns.
After all it is better to load 5 columns instead of loading 20 columns.

It's not a question of how we can do this in this package, but rather of how can we do this in Laravel. Honestly I have no idea and after searching around the only solution I found was this, but for some reason it didn't work form me using Laravel 5.

Thank you for your answer.
Dear dimsav, i know that trick and i already use it in my projects, but that only will not help because, like i said in my intial post, locale fallback should not be dropped when a user want to select only some columns, and that is why i created this issue.
Following the logic in the specified link will not give us locale fallback because this is a thing that you developped in your package.

Please make a pull request if you want a feature to be added.