Create MySQL Arrow Data types round-trip test

There is not a round-trip test for Arrow data types. We should create one.

Already completed. Additional types I thought were missing are in fact not supported by MySQL (struct, list)


ci: setup GitHub Actions

@justinfagnani can you help review this or indicate who might be able to?


[CLI]: Wandb syncs different local runs to the same web app run

Describe the bug

I have a python code that, by using CPU only, creates an augmented training dataset. After this code is executed and completed, another python code starts a regular training on GPUs using the augmented dataset. wandb.init() is called in this last code, not in the augmentation one.
I also have a bash script that runs the augmentation script followed by the training script and I'm running a sweep on this bash script to tune the hyperparameters of the dataset augmentation (I have parameters like brightness, contrast, blur etc. that I want to tune).
Wandb web app perfectly detects the run since the augmentation phase, even if I'm not using wandb.init in that phase, but it happens that those runs are considered as "crashed" by the wandb web app after a while even if they're still going on and they didn't crash locally.
Then, when the training starts, the run is recovered by wandb web app and it appears as running in the web app, however wandb syncs those local runs to previous web app runs, overwriting them.
For example, if I have 36 possible combinations of hyper parameters, what I'll have at the end of the sweep is 36 local runs (with their 36 local folders) but I'll have less than half web app runs, because wandb syncs multiple local runs to the same remote (web app) runs. I can confirm the overwriting because by looking at the logs of these runs, I'll see that all of them have been synced to the same remote run, thus all will have the same remote id and the same wandb web app link.
The number of runs that is synced together is kinda random, in most of the cases is every two runs but sometimes is also happening every three or four.
What can I do to fix this? I cannot move wandb.init from the training script to the augmentation script for many reasons, moreover this didn't happen until 5/6 days ago, runs were still reported as crashed (very rarely though) and they were not overwritten but only considered as crashed.
The command that I use for the sweep is the following (we use slurm to launch jobs on our servers):
sbatch -c 12 --mem=16G --gpus=0 --time=7-00:00:00 --array=1-50%4 wandb agent --count 1 project/sweep_id
For all these runs, there's no error in the logs and the runs finish successfully locally, it's just a weird sync problem.
Additional Files
No response
Environment
WandB version: 0.12.16
OS: Ubuntu 20.04.4 LTS
Python version: 3.9.12
Additional Context
No response

Hey @pierclgr how are you calling wandb.init?  The only way I can think of runs being overwritten in the web app is if you're specifying an id.  The id must be unique for every run.  If any jobs shared the same id they would overwrite eachother.

The id is also set by the sweep agent in the WANDB_RUN_ID environment variable.  If your single agent is actually doing multiple runs you might need to unset the environment before spawning in new processes.  Here's a simple helper function to do that.
def reset_env():
    for key in os.environ.keys():
        if key.startswith("WANDB_"):
            del os.environ[key]

I'm not specifying an id in wandb.init(). I'm trying to use the helper function that you gave to me, I'll keep you updated. Thanks :)

Hi @pierclgr,
Reaching back out regarding this support request, do you have any updates or require further assistance?

Hi @pierclgr ,
As we have not heard back from you, we are going to close this request. If you would like to re-open the conversation, please let us know!

Hi, I have a similar problem. I have opened this issue https://github.com/wandb/wandb/issues/4653.
From what I have understood, this problem happens if you call wandb.init() after wandb.agent(), for example, to create a new run after the sweep is ended.
For some reason, wandb detects the newly created run as an alias of the last run of the sweep. In fact, they share the same ID. I get the same log info too. It is not possible to change the run id when a sweep is running. But at that point in the code, the sweep should be finished. I think that one way to solve this issue is to have a command after wandb.agent() to say to wandb that the sweep has to be finished at that point of the program. In other words, there should be a way to clean the wandb session and start another run. I did not find how to do that for the moment. The only way for the moment is to have wandb.agent() and wandb.init() in different wandb sessions. I honestly do not know why they do not work in the same session.

close as duplicate


expose tokio::net::tcp_listener?

In https://github.com/rust-clique/clap-port-flag/pull/11 we're adding an example of how to use this crate with the Hyper HTTP server. To get it to work, some glue is required:
  let args = Cli::from_args();
  let listener = args.port.bind()?;
  let handle = tokio::reactor::Handle::current();
  let listener = tokio::net::TcpListener::from_std(listener, &handle)?;

This seems like boilerplate that would probably be copy-pasted from between projects, which makes it seem like a prime candidate to create a method for.
I was thinking something like this:
  let args = Cli::from_args();
  let listener = args.port.bind_tokio()?;

The name here could probably use some work (cc/ @killercup, suggestions?) but I reckon the result would be really useful.
Setting up a complete HTTP server would then only require the following:

#[derive(Debug, StructOpt)]
struct Cli {
  #[structopt(flatten)]
  port: Port,
}

fn main() -> Result<(), Box<std::error::Error>> {
  let args = Cli::from_args();
  let listener = args.port.bind_tokio()?;

  let server = Server::builder(listener.incoming())
    .serve(|| service_fn_ok(|_| Response::new(Body::from("Hello World"))))
    .map_err(|e| eprintln!("server error: {}", e));

  tokio::run(server);
  Ok(())
}

Which I think is starting to become short enough that people can memorize it!
Drawbacks
This would add tokio as a dependency which adds a bit of overhead during compilation. But given that all major frameworks depend on it, it's probably safe to say it won't introduce any new dependencies for production systems.

Hm. Not sure I agree with this. I can see how this might come in handy, but I have two questions:

How many crates will use hyper directly and would you also want to support other libraries?
How many people would expect a crate called clap-port-flag to have tokio-specific code? (Similar to my comment in https://github.com/rust-clique/clap-verbosity-flag/issues/5, I wouldn't)

I think my main issue with this is that it is very specific to Hyper. If it where easier in hyper to use an existing socket, we wouldn't need this. In actix-web, e.g., you can pretty much to server.listen(args.port.bind()?) IIRC

If it where easier in hyper to use an existing socket, we wouldn't need this.

Yeah I actually agree with this. Good point.

Server::from_tcp() just landed in Hyper! https://github.com/hyperium/hyper/pull/1624


Task disappears in the week planner when moved to a daily note that hasn't been created yet

Describe the bug
When moving a task from the week planner to a daily note that hasn't been created yet, the task disappears from the week planner and does not appear in the daily note.
To Reproduce
Go to the week planner.
Select a task and move it to a daily note that doesn't exist yet.
Check both the week planner and the newly created daily note.
See that the task has disappeared from the week planner and is not present in the daily note.
Expected behavior
The task should remain visible in the week planner and the Daily Note should be created, and then it should appear in the daily note without disappearing.
Additional context
This issue occurs only when the daily note has not been previously created. It may be related to how the application handles the creation of a new Daily Note in this context.

Hello @marco7m, when this happens, do you see any errors in the console? Can you send the files that you used? I can't reproduce the issue.

I experienced the same issue and found the reason for it is the "Templater" plugin.
My daily note template contains some Templater Code.
Moving a task to a future date triggers the creation of a daily note, which then triggers the Templater Code.
In the "Weekly Plan" I first see the moved item on the day, then it disappears and is also not in the created daily note.

I experienced the same issue and found the reason for it is the "Templater" plugin. If I turn it off, it works fine.
If Templater is turned on, I first see the moved item on the day in the Weekly Planner View, and then it disappears and is also not in the created daily note.

Please update and re-check.


Panics with 'attempt to shift right with overflow'

I've been using a python script that utilises the faker and mdgen libraries to generate markdown posts to test out my SSG project, but pulldown_cmark panics with the following on the first post:
    Finished dev [unoptimized + debuginfo] target(s) in 0.03s
     Running `target\debug\reproduce_pulldown_cmark_bug.exe`
thread 'main' panicked at 'attempt to shift right with overflow', C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:1815:21
stack backtrace:
   0: std::panicking::begin_panic_handler
             at /rustc/84c898d65adf2f39a5a98507f1fe0ce10a2b8dbc/library\std\src\panicking.rs:579
   1: core::panicking::panic_fmt
             at /rustc/84c898d65adf2f39a5a98507f1fe0ce10a2b8dbc/library\core\src\panicking.rs:64
   2: core::panicking::panic
             at /rustc/84c898d65adf2f39a5a98507f1fe0ce10a2b8dbc/library\core\src\panicking.rs:114
   3: pulldown_cmark::firstpass::simd::process_mask<pulldown_cmark::firstpass::impl$0::parse_line::closure_env$0,pulldown_cmark::parse::Item>
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:1815
   4: pulldown_cmark::firstpass::simd::simd_iterate_special_bytes<pulldown_cmark::firstpass::impl$0::parse_line::closure_env$0,pulldown_cmark::parse::Item>
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:1841
   5: pulldown_cmark::firstpass::simd::iterate_special_bytes<pulldown_cmark::firstpass::impl$0::parse_line::closure_env$0,pulldown_cmark::parse::Item>
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:1790
   6: pulldown_cmark::firstpass::iterate_special_bytes<pulldown_cmark::firstpass::impl$0::parse_line::closure_env$0,pulldown_cmark::parse::Item>
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:1539
   7: pulldown_cmark::firstpass::FirstPass::parse_line
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:461
   8: pulldown_cmark::firstpass::FirstPass::parse_paragraph
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:328
   9: pulldown_cmark::firstpass::FirstPass::parse_block
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:202
  10: pulldown_cmark::firstpass::FirstPass::run
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:53
  11: pulldown_cmark::firstpass::run_first_pass
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\firstpass.rs:35
  12: pulldown_cmark::parse::Parser::new_with_broken_link_callback
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\parse.rs:182
  13: pulldown_cmark::parse::Parser::new_ext
             at C:\Users\jawad\.cargo\registry\src\github.com-1ecc6299db9ec823\pulldown-cmark-0.9.3\src\parse.rs:169
  14: reproduce_pulldown_cmark_bug::main
             at .\src\main.rs:8
  15: core::ops::function::FnOnce::call_once<void (*)(),tuple$<> >
             at /rustc/84c898d65adf2f39a5a98507f1fe0ce10a2b8dbc\library\core\src\ops\function.rs:250
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
error: process didn't exit successfully: `target\debug\reproduce_pulldown_cmark_bug.exe` (exit code: 101)

I managed to put together a somewhat minimal reproducible example of the bug at https://github.com/jawadcode/reproduce_pulldown_cmark_bug, apologies for not being able to condense it further.

i have reproduced it with simd

I have tried in a build with all features and it has 0% CPU usage without crashing. Maybe this panic does not happen in Linux?

@Martin1887 I have tried it in Windows 10 (OS build 19045.2965) and WSL (openSUSE Tumbleweed, version ID 20230519) and have found that with "simd" in pulldown-cmark.features it panics on both, and that with the default features it runs successfully and outputs what looks like the correct HTML.

OK, I have noticed that the binary was expecting input as stdin and this is the reason it was doing nothing, my fault.
However, I have tried both, the binary from the issue repository and the current master branch, and they work with simd feature in release mode. Nevertheless, in debug mode both fail with the panic of the issue.
I will investigate it further.

Wrapping (release mode behaviour) is the intended behaviour, so using wrapping_shr instead of >>= solves the issue.
A pull request with this change is being opened.

@Martin1887 ah my bad, I should've added that both tests were in debug mode


Remove light version of the font

The Frutiger light font was only being referenced in the header
autocomplete dropdown, so we've decided to remove it and save a request
to get it.
Description
Checklist

[ ] SCSS
[ ] Nunjucks macro
[ ] A standalone example
[ ] README/Documentation with HTML snippet
[ ] Tested against our testing policy (Resolution, Browser & Accessibility)
[ ] Visual tests (BackstopJS)
[ ] Print stylesheet considered
[x] CHANGELOG entry

Wary of doing a breaking change - are we able to set $nhsuk-font-light to 400 instead of removing it all together? If its a breaking change the first number needs to change so it will be 3.0.0


Update to netty 4.0.32

See http://netty.io/news/2015/09/30/4-0-32-Final.html
It notably includes EpollChannelOption.TCP_FASTOPEN

It looks like Netty 4.0.33 is the latest version, I guess we may as well update to that?

@richdougherty just updated the changes

LGTM. @jroper would you mind merging this? I don't have write access. (Feel free to grant me write access if you want.)

@jroper do you plan to release a 1.0.1 version with this change?

There's no point, Netty 4.0.33 should be binary compatible with 4.0.29, meaning the binaries for this release of netty reactive streams will be identical to 1.0.0. If you want to use Netty 4.0.33 in your own project, you can simply add an explicit dependency on that version.

@mchv, Given @jroper's comment I guess we need to directly upgrade Play's dependencies to use Netty 4.0.33 instead of expecting the new version to be pulled in by netty-reactive-streams.

Play upgraded to use 4.0.33 in https://github.com/playframework/playframework/pull/5325


Porting to Crystal

Hi,
Your project is really cool, I used it to quickly test hypothesis of ideas and quick checks, but I think it can be more then that.
If you will like the idea of porting to Crystal https://crystal-lang.org/ , I think the network can be much much quicker and can be use for production needs.
Crystal is really similar to Ruby in syntax, so the need for changes should be minimal , if you like that idea and want a helping hand ping me :)

hey @bararchy, Thank you for looking this over and taking the time to bring up your suggestion, I somehow never got notified of this issue so apologies for the (very) late response!
Like I mentioned in the README I only used this as an excuse to experiment and play around with the bare fundamentals of neural networks and it has served it's purpose well in that regard. As a result however I don't foresee spending more time on this (as interesting as it'd be to port it over), so unfortunately can't be of much help here.
If someone decides to take this up and fork cerebrum, I'd be more than happy to walk them through it (it's relatively unintimidating, intentionally so).


Offsets from pdb

added new project that will be used to generate offsets file which will be used by KDMapper .
new functions were added to KDMapper project to handle the Offsets File, original method was not discarded Devs/Users can still use the original method of getting the kernel functions and tables addresses .
there was the inclusion of a bunch of Microsoft dll and exe files the were needed to get the pdb files from the Microsoft server,
if for some reasons those files are not allowed to be included, Devs/Users has to be notified that they are important.
Included files:

dbghelp.dll
SymbolCheck.dll
symchk.exe
symsrv.dll

KDMapper should behave the same.

While the idea is fine and can be nice for usage in lab environments, the implementation could look a bit rusty, please make the following modifications:
Convert "SYM_INFO_ARRAY" into a vector of SYM_INFO
Use std::string for the SymbolName in SYM_INFO
Avoid malloc and free, use smart pointers
Maybe you should use GetPrivateProfileString or other marshalling method
When GetSymbolsInfoFromFile is called, try to check if offsets file exists before execute SymbolsFromPDB every time
Don't try to execute SymbolsFromPDB by default, add some parameter for this like --download-symbols
Undefine PDB_OFFSETS by default
Add a comment in the README under 'Features' explaining this new feature using PDB_OFFSETS and what is the "SymbolsFromPDB" project for etc...
Could be interesting if offset file path can be added as an input in kdmapper

this project was initially written in C, i can switch to std::vector to get rid of malloc/free entirely.
"SymbolsFromPDB" has to be called first to check for new updates to pdb files (in case a windows update), if new version were found then offsets file has to be rewritten.
GetSymbolsInfoFromFile function does check for file by default using "CreateFileA".
PDB_OFFSETS macro can be set to undefined by commenting the define line, i will add that to instructions next time.
maybe i should add a build version that will include the definition of PDB_OFFSETS  and the build of SymbolsFromPDB project.
i will try to do what u recommended as soon as i can, im sure that i will introduce new bugs since i will have to change some functions behaviors, so more test/debugging need to be done.


[examples/remix-with-typescript] Problem using @mui/icons-material

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example:
https://github.com/mui/material-ui/compare/master...tschaub:material-ui:remix-issue
Steps:

Start with the existing example
npm install @mui/icons-material
Use an icon button in the index route and a box component in the about route

Current behavior 😯
When you npm run dev the example, the server rendered content looks right, but hydration fails on the client due to a problem trying to import createTheme.
style.js:13 Uncaught TypeError: createTheme_default is not a function
    at style.js:13:22

Expected behavior 🤔
It should be possible to use @mui/icons-material with Remix.
Context 🔦
I also updated the example to use hydrateRoot from React 18, but the problem remains.
I also updated the example to use exports from '@remix-run/react' instead of remix, but the problem remains.
Your environment 🌎

npx @mui/envinfo
  System:
    OS: macOS 12.6.1
  Binaries:
    Node: 18.4.0 - ~/.nvm/versions/node/v18.4.0/bin/node
    Yarn: Not Found
    npm: 8.18.0 - ~/.nvm/versions/node/v18.4.0/bin/npm
  Browsers:
    Chrome: 107.0.5304.110 (<-- using this browser)
    Edge: Not Found
    Firefox: Not Found
    Safari: 16.1
  npmPackages:
    @emotion/react: latest => 11.10.5
    @emotion/styled: latest => 11.10.5
    @mui/base:  5.0.0-alpha.105
    @mui/core-downloads-tracker:  5.10.13
    @mui/icons-material: ^5.10.9 => 5.10.9
    @mui/material: latest => 5.10.13
    @mui/private-theming:  5.10.9
    @mui/styled-engine:  5.10.8
    @mui/system:  5.10.13
    @mui/types:  7.2.0
    @mui/utils:  5.10.9
    @types/react: latest => 18.0.25
    react: latest => 18.2.0
    react-dom: latest => 18.2.0
    typescript: latest => 4.8.4

Duplicate of https://github.com/mui/material-ui/issues/31835


Hide background webviews by floating the current tab over the top.

Fixes #93.

Coverage remained the same at 42.564% when pulling 7ea8ef5f71f7d3773f5645aad5e2bcac7afa70fd on mossop/nohide into 09da7ce35ea7bbbebb2e93ea255d4641e97a40c8 on master.

Note: this prevents the flicker of webview size that happens when switching between tabs.

Coverage remained the same at 42.564% when pulling 7ea8ef5f71f7d3773f5645aad5e2bcac7afa70fd on mossop/nohide into 09da7ce35ea7bbbebb2e93ea255d4641e97a40c8 on master.

lgtm


Thunderstore list of upgrades is out-of-date

Hi, thanks for this fun mod.
The list of items and upgrades on the Thunderstore page is missing some items. https://thunderstore.io/c/lethal-company/p/malco/Lategame_Upgrades/
At least the following are missing:

Helmet
Wheelbarrow
Drop Pod Thrusters
Sick Beats
Shutter Batteries

3.4.0 release has the README updated. I will be closing this but feel free to open a new one when any forgetfulness happens again.


coOncoPlot: showing sample names has no effect

It only adds white space for them but doesn't print them.

I doubt it. I made a dummy maf with sample names made up of numeric values and it prints them. Any chance you can share a reproducible file? Also does oncoplot displays sample names with these mafs ?

My guess is that again we're dealing with sample names that are made up of only numbers.

Same situation with @lbeltrame
Try showSampleNames= TRUE with all kinds of SampleNamefont, and it only adds white space for them but doesn't print them.

@PoisonAlien  You can rerun your code for test data in latest commit and no print sample name
#Primary APL MAF
primary.apl = system.file("extdata", "APL_primary.maf.gz", package = "maftools")
primary.apl = read.maf(maf = primary.apl)
#Relapse APL MAF
relapse.apl = system.file("extdata", "APL_relapse.maf.gz", package = "maftools")
relapse.apl = read.maf(maf = relapse.apl)
genes = c("PML", "RARA", "RUNX1", "ARID1B", "FLT3")
#Shows sample name
coOncoplot(m1 = primary.apl, m2 = relapse.apl, m1Name = 'PrimaryAPL', m2Name = 'RelapseAPL', genes = genes, removeNonMutated = TRUE, showSampleNames = TRUE)

The bug is still there

Hello @wangdatou2009 ,
I tested several tcga datasets and still I can't reproduce the issue. It seems to be working. Could you provide me with a reproducible example?

I'm also noting this issue unfortunately, with the example data set you kindly provided.
I'm working on a MacBook Pro (OS Version 10.14.6).

Hi @vnrajapakse ,
Thanks for pointing it out. I checked it and for some reason it does not print the names in the first attempt. But re-running the command seems to work. Could you please try this and let me know if this is the same for you?

Hello @PoisonAlien ,
Thank you for your response (and super helpful package)! I tried re-running the command, but this didn't work for me. I put some debug statements inside the if(showBarcodes) { .. } blocks at lines 237 and 245 of print_mat.R. The sample names are properly captured in the rownames of the nm matrix object (as expected). The reasonable looking text() call strangely isn't having an effect. I was wondering about a Mac/RStudio-version specific issue, but I can't yet pin it down to this.
This bit of toy code outputs labels in the plot on my laptop.
plot.new()
nm <- matrix(1:20, nrow = 10)
rownames(nm) <- paste0("row", seq_len(nrow(nm)))
barcode_size <- 0.5
image(nm)
text(x = 0:nrow(nm)/nrow(nm), y = 0,
           labels = rownames(nm), srt = 90, font = 1,
           cex = barcode_size, adj = 1)

Okay, I changed from text to mtext. It seems to be working fine now. Could you check it once and let me know? You will have to install from GitHub.
BiocManager::install(pkgs = "poisonalien/maftools")

Yes - the labels appear now. Thanks so much!


Connector: SQLite [Source/Destination]

Resource name
SQLite
Resource link
https://www.sqlite.org/
Connector type
Source
Expected connector behavior
It should be able to read and write structured data from / to an sqlite file.
SQLite has very rough limitations for the destination connector, as only one single writer is allowed when writing to it. We can however retry the operation a few times and document this behaviour, add retry count parameters, etc.
It's an interesting connector. Apart from the typical RDB connector usecases, it might be useful to have a way to quickly write structured data from any source into a file, and then be able to query it. For that to happen we should support somehow creating tables from the connector schema, which I have never done yet.
My usecase for my pet projects is to have SQLite as a source, and #2004 as a destination, so that I have a better alternative than using the fts5 extension.

FYI I've added this (and other connector requests) to our internal connectors' project where we prioritize all connector requests. We'll let you know once we figure when we're going to work on this.


API - Is it possible to retrieve story by context?

Issue details
I'm working on an addon (based of the info addon) and wondering if its possible to retrieve a story (the react element, from storyFn?) from a story's context (for eg. {kind: "Components/Tabs", story: "Basic"}). I'm trying to do this from within the panel.
Something like: api.getStory(context) I've had a look at the documentation but couldn't find anything to that affect.
I tried emitting the story object (react element) but the story.type property never makes it to my addon (and I need it to retrieve docgen info)
Any help/direction would be appreciated.
Thank you
Please specify which version of Storybook and optionally any affected addons that you're running

@storybook/react 3.3.14

Hi, can you add some code? I am trying to understand how you'd imagine this working. Do you mean you will have a story component (from storyFn()) let's say like this.
class Story extends Component {
  render() {
    return (
      <div>
        <Child />
      </div>
    }
  }
}

And you want to be able to dive into the component and retrieve <Child />?


Duplicate Detection when using SessionId

When the SessionId is specified, then, based on my testing, the SessionId + MessageId are being used for duplicate detection. This seems like an important information that should be incorporated into this documentation. It should be incorporated somewhere close to the para starting with "Enabling duplicate detection helps keep track of the application-controlled......."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bbf60076-6bfe-9efd-f956-69f2cfa5bd45
Version Independent ID: b8e8ddd3-a8dc-4ff5-5c75-c4cf5d1e509f
Content: Azure Service Bus duplicate message detection
Content Source: articles/service-bus-messaging/duplicate-detection.md
Service: service-bus-messaging
GitHub Login: @clemensv
Microsoft Alias: spelluru

Hi @rajrao Thank you for your feedback! We have assigned this issue to the author to review further and take the right course of action.

@rajrao Are you sure?  The same message can be submitted to a topic due to retry's creating different SessionId's however as long as you have a common message id they will be marked as duplicate.

I tested with this code and even though my messages have the exact same message id, but different session ids, I get 2 messages in my subscription:
async Task Main()
{
	string connectionString = "Endpoint=sb://xxxxxxx.servicebus.windows.net/;SharedAccessKeyName=iamgod;SharedAccessKey=xxxxxxxx;";

	var topicName = "helloworld";
	var subscriptionName = "dummySubscription";
	ManagementClient managementClient = new ManagementClient(connectionString);
	if (await managementClient.TopicExistsAsync(topicName))
	{
		Console.WriteLine($"Deleting topic {topicName}...");
		await managementClient.DeleteTopicAsync(topicName);
	}

	var topicDescription = new TopicDescription(topicName)
	{
		EnablePartitioning = true,
		RequiresDuplicateDetection = true,
		EnableBatchedOperations = true,
		DuplicateDetectionHistoryTimeWindow = TimeSpan.FromMinutes(1)
	};

	Console.WriteLine($"Creating topic {topicName}...");
	await managementClient.CreateTopicAsync(topicDescription);

	SubscriptionDescription subscriptionDescription = new SubscriptionDescription(topicName, subscriptionName){
		RequiresSession = true
	};
	Console.WriteLine($"Creating subscription {subscriptionName}...");
	await managementClient.CreateSubscriptionAsync(subscriptionDescription);

	TopicClient topicClient = new TopicClient(connectionString, topicName);

	//send 2 messages with same messageid, but different session ids
	//if duplicate detection is based only on messageid, then one would expect only 1 message
	//to hit the subscriber, otherwise 2.

	var body = Encoding.UTF8.GetBytes($"Hello World @ {DateTime.Now}");
	Message messageToSend = new Message(body);
	messageToSend.SessionId = "AAAA";
	messageToSend.MessageId = "BBBB";
	Console.WriteLine($"Sending message 1 SessionId: {messageToSend.SessionId} MessageId: {messageToSend.MessageId} ...");
	await topicClient.SendAsync(messageToSend);

	body = Encoding.UTF8.GetBytes($"Hello World @ {DateTime.Now}");
	messageToSend = new Message(body);
	messageToSend.SessionId = "ZZZZ";
	messageToSend.MessageId = "BBBB";
	Console.WriteLine($"Sending message 2 SessionId: {messageToSend.SessionId} MessageId: {messageToSend.MessageId} ...");
	await topicClient.SendAsync(messageToSend);

	await topicClient.CloseAsync();

	Console.WriteLine("Checking subscription message count...");
	var subscriptionRuntimeInfo = await managementClient.GetSubscriptionRuntimeInfoAsync(topicName,subscriptionName);

	Debug.Assert(subscriptionRuntimeInfo.MessageCount == 1, $"Expected message count is 1, actual message count is {subscriptionRuntimeInfo.MessageCount}");

	Console.WriteLine("Done!");
}

Output:

Deleting topic helloworld...
Creating topic helloworld...
Creating subscription dummySubscription...
Sending message 1 SessionId: AAAA MessageId: BBBB ...
Sending message 2 SessionId: ZZZZ MessageId: BBBB ...
Checking subscription message count...
Fail: Expected message count is 1, actual message count is 2
Done!

@rajrao - I tried the code and I happen to get a single message in my subscription.
Also, tried sending 2 messages to 2 different message ids, and then I see 2 messages on my subscription.
If you still see this issue, please feel free to open a support ticket and the support team can investigate your namepace.
cc: @spelluru

@axisc I tested the code against multiple ServiceBus instances and in each case I got 2 messages in the subscription.

@axisc  - I worked with MSFT support and they informed me that the behavior was because of partitioning being enabled. Based on that, I think this documentation should reflect this detail:

When Partitioning is enabled: MessageId+SessionId is used to determine uniqueness.
When Partitioning is disabled: Only MessageId is used to determine uniqueness.

As a general rule, because of this difference and the fact that Premium ASB does not support partitioning, one should not rely on uniqueness being provided by the combination of MessageId+SessionId and should be designed to just use MessageId.
Thanks

And so in the code above, if one changes the topic creation to this:
var topicDescription = new TopicDescription(topicName)
{
EnablePartitioning = false, // <<--- this line determines if dup detection will use just MessageId (False) or SessionId+MessageId (True)
RequiresDuplicateDetection = true,
EnableBatchedOperations = true,
DuplicateDetectionHistoryTimeWindow = TimeSpan.FromMinutes(1)
};

Worked with @axisc to finalize the text and added it as important notes:
https://docs.microsoft.com/en-us/azure/service-bus-messaging/duplicate-detection#how-it-works
#please-close

Worked with @axisc to finalize the text and added it as important notes:
https://docs.microsoft.com/en-us/azure/service-bus-messaging/duplicate-detection#how-it-works
#please-close


[Fix #11026] Fix an error occurred for Style/SymbolArray and Style/WordArray when empty percent array

Fixes #11026.
This PR fixed an error with an empty percent array.
The original issue #11026 was reported for Style/SymbolArray, but it was also occurring for Style/WordArray,
so it has been corrected.

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[x] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

👍


Stop preloading the buffer pool when it is full.

This PR addressed issue #51.
When the database is larger than the buffer pool, a message is printed, and the preloading is stopped saving unnessary IOs.
Also, the time to preload the buffer pool is now printed.
Since this is a feature that is largely used for performance testing, no tests are added. To test this feature, create a database that has more than 10 blocks, and try the following:
./quickstep_cli_shell -preload_buffer_pool=true and
./quickstep_cli_shell -preload_buffer_pool=true -buffer_pool_slots=10

LGTM!


Add method to check if MMKV instance with given ID exists

Description:
Currently, there's no straightforward way to check if an MMKV instance with a specific ID already exists. This functionality would be useful for managing multiple MMKV instances and avoiding conflicts or unnecessary instance creation.
Feature request:
Add a static method to the MMKV class that allows checking for the existence of an instance with a given ID.
Proposed usage:
import { MMKV } from 'react-native-mmkv'

const instanceExists = MMKV.exists('some-id')
console.log(instanceExists) // Should return true or false

Benefits:

Simplifies instance management in apps using multiple MMKV stores
Helps prevent accidental overwriting of existing instances

Well you can just load the MMKV instance and check if there are any keys in it, no?
const instance = new MMKV({ id: 'some-id' })
const instanceExists = instance.keys.length > 0
console.log(instanceExists) // Should return true or false

Or maybe instance.size > 0, this is size in bytes

I have encrypted instance, I need to check if instance exists before encrypting it. Initializing without encryption key will erase all data.

Initializing without encryption key will erase all data.

This is also a bit weird imo - that should throw an error instead of erasing all data..


OC: grabbed zero system-id for SB, this is not allowed. Halting on critical error.

OC: grabbed zero system-id for SB, this is not allowed. Halting on critical error.
Haltino on critical error

Secure Boot is disabled

Have you tried this in your config.plist?
Misc -> Security -> SecureBootModel
to Disabled
Make sure you are following the Dortania guide this error was mentioned in the troubleshooting section: https://dortania.github.io/OpenCore-Install-Guide/troubleshooting/extended/opencore-issues.html#oc-failed-to-find-sb-model-disable-halting-on-critical-error

Set "SecureBootModel" to "Disabled" in your config.plist.


Convertion error from gif to webp

EDIT: Alright I've added that functionality to this module please merge project with my fork
Hi, I've tried to convert .gif image to web webp but I get this error, and I don't know what to do, may you help me to figure this out? Here is my code and error. I'm using Ubuntu 16.04
webp.dwebp(req.files.gif.path, req.files.gif.path.replace(/.gif/,"")+'.webp',  function (status) {         //if conversion successfull status will be 'converted successfully'         console.log(req.files.gif.path+'.webp');         console.log(status);     });
{ [Error: Command failed: /home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/dwebp /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif -o /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.webp
Decoding of /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif failed.
Status: 3(BITSTREAM_ERROR)
]
killed: false,
code: 255,
signal: null,
cmd: '/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/dwebp /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif -o /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.webp' }
I've also tried with cwebp
webp.cwebp(req.files.gif.path, req.files.gif.path.replace(/.gif/,"")+'.webp','100',  function (status) {         //if conversion successfull status will be 'converted successfully'         console.log(req.files.gif.path+'.webp');         console.log(status);     });
{ [Error: Command failed: /home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/cwebp -q 100 /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif -o /tmp/WeQrD2mjGrG0lG--yzum4WX9.webp
Error! Could not process file /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif
Error! Cannot read input picture file '/tmp/WeQrD2mjGrG0lG--yzum4WX9.gif'
]
killed: false,
code: 255,
signal: null,
cmd: '/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/cwebp -q 100 /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif -o /tmp/WeQrD2mjGrG0lG--yzum4WX9.webp' }

Hi Melik,i have solved the issue by adding gif2webp.
Please check out the usage in the webp-converter npm package .
https://www.npmjs.com/package/webp-converter
Thank you.
On Tue, Jul 19, 2016 at 5:34 PM, Melik<EMAIL_ADDRESS>wrote:

Hi, I've tried to convert .gif image to web webp but I get this error, and
I don't know what to do, may you help me to figure this out? Here is my
code and error
webp.dwebp(req.files.gif.path,
req.files.gif.path.replace(/.gif/,"")+'.webp', function (status) {
//if conversion successfull status will be 'converted successfully'
console.log(req.files.gif.path+'.webp');
console.log(status);
});
{ [Error: Command failed:
/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/dwebp
/tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif -o /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.webp
Decoding of /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif failed.
Status: 3(BITSTREAM_ERROR)
]
killed: false,
code: 255,
signal: null,
cmd:
'/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/dwebp
/tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.gif -o /tmp/vNhNhgJ_hJjGczZ5BIUQSPKf.webp' }
I've also tried with cwebp
webp.cwebp(req.files.gif.path,
req.files.gif.path.replace(/.gif/,"")+'.webp','100', function (status) {
//if conversion successfull status will be 'converted successfully'
console.log(req.files.gif.path+'.webp');
console.log(status);
});
{ [Error: Command failed:
/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/cwebp
-q 100 /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif -o
/tmp/WeQrD2mjGrG0lG--yzum4WX9.webp
Error! Could not process file /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif
Error! Cannot read input picture file '/tmp/WeQrD2mjGrG0lG--yzum4WX9.gif'
]
killed: false,
code: 255,
signal: null,
cmd:
'/home/melontron/Projects/dhol/node_modules/webp-converter/lib/libwebp_linux/bin/cwebp
-q 100 /tmp/WeQrD2mjGrG0lG--yzum4WX9.gif -o
/tmp/WeQrD2mjGrG0lG--yzum4WX9.webp' }
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/scionoftech/webp-converter/issues/2, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AMRkghJtAOI0KGMdAEwrM_hNcX9giR74ks5qXL1KgaJpZM4JPp-8
.


DB in use error when one process finishes if multiple processes are open

If I use more than one PixivUtil2 process to download from Pixiv and one process finishes it's task. The other processes get a DB in use error. The finished process seems to lock the database file, preventing anything else from being downloaded.
EDIT: It does not seem to always happen.

It is not supported by sqlite, as it doesn't support concurrent DB write operation from different process.

I have been able to do multiple processes and they error but then continue when they get access. The issue is that when a process finishes and is asking me for input, it locks the DB for the other processes.

can you try to append -x on the command?
anyway, running multiple instance from the same folder is not supported

It runs so well from the same folder so well except for this one issue. The only thing I had to do was to increase the amount of retries when it errors out.
Where do you want me to add the -x command?

you can use it if you are not running the application in interactive mode (e.g. from command line)
refer to https://github.com/Nandaka/PixivUtil2/blob/master/readme.txt#L178


draft readme

Here's a first draft of the readme.
Let me know if anything is incorrect.
I'd like to:

Add a basic feature listing
Add additional badges and have them link to their respective services
Update the installation step once the package is available on NPM

@robjweiss sorry this was my fault, fixed the links :+1:

Thanks for the feedback. I tried to address some of those concerns and created two new issues:

https://github.com/openrm/hato/issues/24
https://github.com/openrm/hato/issues/25


Vscode is not updating on windows shutdown/reboot

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.77.3
OS Version: Windows 11 (happens on 10 too)

Steps to Reproduce:

Have windows 11/10
Install older vscode version.
Wait for vscode to download update.
Initiate reboot/shutdown.
You will see "Vscode is updating" (don't remember exact text).
After rebooting you will still that vscode is not updated (probably windows kills it faster than vscode can update).

#52855

@joaomoreno it's not duplicate, my vscode is not LOST, it's just not updated.

@soredake Yes, I agree. But the fix is the same: we must have VS Code participate in the Windows shutdown lifecycle phase and prevent it from shutting down while an update is pending.

@joaomoreno can at least https://github.com/microsoft/vscode/issues/52855 title be rename to something more general like "Vscode updating problems on windows shutdown (lost/not updated)"?

https://github.com/microsoft/vscode/issues/181762


Docstring update

Adjust docstring markup and wording
Apply Black formatting to code samples
Remove deprecated init() method
Update docs links

LGTM!


Update keras.saving for legacy

Update keras.saving for the packages having moved to legacy

Should we pin a minimum version to make sure that this doesn't break with older versions that don't include this change?

Indeed as @ihnorton pointed out Keras is a dependency of tensorflow which we do not bound. We need to trackdown when did Keras moved these to legacy and which TF version and above introduces this Keras release so we can either require a higher TF version in our setup or restrict it.


Add cy tests

Summary of the PR:
Upgrade cypress version,
Add tests for recover wallet, and for send funds feature
(Were using a existing account on testnet you can see in enums, because of 3 reasons

The time it would take to get test coins would slow down the tests alot.
To check that recover wallet works
Getting test coins can be flaky)

Added some commands for better readability, and reformatted the code

so the test wallet is gonna run out of coins at some point?


Unable to complete install

I'm on Linux Mint (Ubuntu 22.04-LTS based) and the pip install commands do not work to install the dependencies you mentioned.  It sounds like pip is disabled due to it frequently breaking apt and other system critical components.
Is there an alternative method to manually download and place whatever dependencies, or a different package name thru the normal apt package managers?
$ pip3 install bluepy
Traceback (most recent call last):
  File "/home/user/.local/bin/pip3", line 7, in <module>
    from pip._internal import main
ModuleNotFoundError: No module named 'pip'
$ sudo pip3 install bluepy
[sudo] password for user:
sudo: pip3: command not found

You could do sudo apt-get install python3-packagenamehere instead and see if that works for you.

You could do sudo apt-get install python3-packagenamehere instead and see if that works for you. However, that may not work due to not being available in the default Ubuntu/MInt repositories. If no module is found the only way I could think of is installing through the git itself.
git clone https://github.com/IanHarvey/bluepy.git
cd bluepy
sudo pip3 install .

I have tried looking for a python3-bluepy but haven't found anywhere that suggests what it is named if such a thing exists.
Trying to clone and then do a pip3 install it fails sudo: pip3: command not found even though pip/pip3 exists as a normal user.

I also had a friend who is better than I am at Python try and he suggested using a venv, which I after running the venv I can do a pip3 install successfully, but WallOfFlippers still claims its not installed even though it is.

I also had a friend who is better than I am at Python try and he suggested using a venv, which I after running the venv I can do a pip3 install successfully, but WallOfFlippers still claims its not installed even though it is.

Is venv being used with sudo or not?
Wall of Flippers requires sudo to run due to the BLE python package (bluepy).
If the command venv command wasn't initially ran in sudo, I could see WoF not recognize the packages required as it's trying to import the packages but fails with the exception of not being able to import said package.

I also had a friend who is better than I am at Python try and he suggested using a venv, which I after running the venv I can do a pip3 install successfully, but WallOfFlippers still claims its not installed even though it is.

Is venv being used with sudo or not? Wall of Flippers requires sudo to run due to the BLE python package (bluepy). If the command venv command wasn't initially ran in sudo, I could see WoF not recognize the packages required as it's trying to import the packages but fails with the exception of not being able to import said package.

The venv wasn't, but yes I was running the script with sudo as indicated.

Hmmm, let me figuring something out real quick.

I'm going to see if moving to venv will be a better idea instead of using pip. Let me do more testing to see if this switch would be optimal

I also had a friend who is better than I am at Python try and he suggested using a venv, which I after running the venv I can do a pip3 install successfully, but WallOfFlippers still claims its not installed even though it is.

Is venv being used with sudo or not? Wall of Flippers requires sudo to run due to the BLE python package (bluepy). If the command venv command wasn't initially ran in sudo, I could see WoF not recognize the packages required as it's trying to import the packages but fails with the exception of not being able to import said package.

The venv wasn't, but yes I was running the script with sudo as indicated.

Decided to switch to virtual env. Seems a lot cooler and well managed. Just have to add a few things like a shell script to automatically activate the env and start wof at the same time
Something like:
wof.sh
source .venv/bin/activate
python3 WallofFlippers.py

Try running the latest commit. This fully supports the use of .venv as it's now required. Documentation has also been updated with changes with .venv. If you would like, you can run Wall-of-Flippers.py once and it will auto install the .venv folder and files included. Additionally, you will need to run the installer in the python script (selection 4) if you want the easy method after implementing .venv

I did get farther now - and using "sudo bash wof.sh" it correctly finds the venv and detects all the dependencies now.
Note that it does NOT work with sudo python3 WallOfFlippers.py rather it seems I must use sudo bash wof.sh
With the venv now detected running sudo bash wof.sh:
    | |     / /___ _/ / /  ____  / __/  / ____/ (_)___  ____  ___  __________
    | | /| / / __ `/ / /  / __ \/ /_   / /_  / / / __ \/ __ \/ _ \/ ___/ ___/
    | |/ |/ / /_/ / / /  / /_/ / __/  / __/ / / / /_/ / /_/ /  __/ /  (__  )
    |__/|__/\__,_/_/_/   \____/_/    /_/   /_/_/ .___/ .___/\___/_/  /____/
                                              /_/   /_/                    v3.0.0
[ ] Bleak is installed
[X] Bluepy is installed
[X] Requests is installed
[X] Bluetooth is installed

[#]	[ACTION]			  [DESCRIPTION]
-------------------------------------------------------------------------------------------------
1       Wall of Flippers                  Wall of Flippers (Default)
2       Capture the Flippers (IN DEV)     Can you capture the most flippers and top the leaderboard? This is still in development. Hosting is not available right now.
3       Advertise Bluetooth Packets       Advertise Bluetooth Packets (Linux Support Only)
4       Auto-Install                      Install dependencies for Wall of Flippers (Windows / (APT) Debian Linux)
5       Exit                              ....

[?] Wall of Flippers >>

And then I can detect things now! - interesting it claims some things I think are normal, I believe might be the Govee thermometers around the house.
Latest Forbidden Advertisements..: 1
Latest Advertisements............: 423
Most Common Advertisement........: 0000ec88-0000-1000-8000-00805f9b34fb (54 packets) (6 unique addresses)

[!] Wall of Flippers >> These packets may not be related to the Flipper Zero.

[NAME]					[ADDR]		   [PACKET]
-----------------------------------------------------------------------------------------------
BLE_WINDOWS_SWIFT_PAIR_SHORT		10:dc:b6:eb:ca:3e<PHONE_NUMBER>
SUSPICIOUS_ADVERTISEMENT		6 Unique Addresses  0000ec88-0000-1000-8000-00805f9b34fb

Total Online.....................: 0
Total Offline....................: 0

[FLIPPER]        [ADDR]        		[FIRST]        [LAST]	        [RSSI]        	[Detection]
----------------------------------------------------------------------------------------------------
                                        No devices detected

Interesting trivia also, while it does correctly identify a Flipper (including its "name"), it does not seem to identify the source of an Android app BLE spam generator (shows suspicious packets, but not the source).  I'm guessing that may be a work in progress thing (or maybe its not possible to get a source MAC to triangulate in on if its being randomized?)
[!] Wall of Flippers >> These packets may not be related to the Flipper Zero.

[NAME]					[ADDR]		   [PACKET]
-----------------------------------------------------------------------------------------------
BLE_WINDOWS_SWIFT_PAIR_SHORT		10:dc:b6:eb:ca:3e<PHONE_NUMBER>
BLE_ANDROID_DEVICE_CONNECT		79:78:e4:81:3b:ee  2cfee4e457
BLE_ANDROID_DEVICE_CONNECT		4a:a2:e0:eb:3d:bc  2cfe8c4236
BLE_ANDROID_DEVICE_CONNECT		6e:2c:04:34:c4:87  2cfe0b0000
BLE_ANDROID_DEVICE_CONNECT		5c:eb:b1:14:62:49  2cfe0c0000
BLE_ANDROID_DEVICE_CONNECT		55:f7:11:bc:f0:3f  2cfe00000c
BLE_ANDROID_DEVICE_CONNECT		57:55:15:46:54:c1  2cfe000006
BLE_ANDROID_DEVICE_CONNECT		43:da:44:7e:43:56  2cfe060000
BLE_ANDROID_DEVICE_CONNECT		41:13:cf:fb:96:eb  2cfedad3a6
BLE_ANDROID_DEVICE_CONNECT		63:0c:7f:67:be:d5  2cfe00aa48
------------------ Bluetooth Low Energy (BLE) Attacks Detected (27 Advertisements) --------------------


Automatically update bg w/o need to refresh

@caseyWebb I'll get to your merge requests after today, sorry I wasn't able to get to it yesterday

🍻
This is my new favorite "what can I make a little bit better today" project; thanks for merging so promptly!


qa_crowbarsetup: add explicit timeout to nova boot

to avoid failures like
https://ci.suse.de/view/Cloud/view/Builds/job/openstack-mkcloud/15357/console
where it ended with
Build timed out (after 60 minutes)
and did not collect supportconfigs = issue #728

:+1: makes sense, mabye even needed at several other places too

+1


Single parameter global sensitivity analysis

It would be great to have a function that given a particular protein interaction network and a particular parameter set, returns the period and amplitude values for a single parameter change. This will be used to replicate the results in Tsai et al. 2008, Figure 3. We can start from a known point in parameter set that oscillates and from there, span both directions to find the critical points where oscillations stop. Once we have both critical points, we can simulate parameters in-between to obtain the behavior of period and amplitude as a function of the changed parameter.
Functions that will be needed:

find_critical_point(model, parameter_set, selected_parameter_name, direction; hyperparameters=DEFAULT_BISECTION_HYPERPARAMETERS)
simulate_pin_from_parameter_sets(model, parameter_sets; hyperparameters=DEFAULT_PIN_HYPERPARAMETERS)
pin_single_parameter_variation(model, parameter_set, parameter_name; hyperparameters=DEFAULT_PIN_HYPERPARAMETERS)

We will also need a function that simulates a given model for a particular parameter set:
-simulate_model(model, parameter_set, hyperparameters)
In the future, this function can be used to eliminate duplicated code in our codebase

Another option is to use BifurcationKit.jl to get a bifurcation diagram and from there get the information we want. I'm currently trying to write up a minimal example of this to see if we could wrap BifurcationKit.jl nicely to provide an easy way for users to get a single parameter scan for a protein interaction network


Installation tutorial

Î already flashed the ESP via ESPHome and watched many youtube tutorial videos.
But how can i upload the Setting under "installation" to my ESP?
i am struggling here, can anyone help me or maybe link me to a suitable tutorial?
Via Python program and docker, or is there an easier way?
Sorry for all the noob questions.
Thank you.

Do you have access to a linux machine?

Do you have access to a linux machine?

Windows and Linux both are available.

Please watch this short terminal session recording:

In words:

Make sure python3 is installed
Make sure the python package manager is available
Use the package manager (pip3) to install ESPHome
Use the installed CLI tool to build the example configuration and additional file called secrets.yaml is required.
Create the secrets.yaml containing your WiFi network details
Execute esphome run example.yaml to build and flash the setup

Please try to replicate these steps and ping me if something doesn't work as expected / recorded.

Please watch this short terminal session recording:

In words:

Make sure python3 is installed
Make sure the python package manager is available
Use the package manager (pip3) to install ESPHome
Use the installed CLI tool to build the example configuration and additional file called secrets.yaml is required.
Create the secrets.yaml containing your WiFi network details
Execute esphome run example.yaml to build and flash the setup

Awesome thank you very much for your great support.
Now two questions are left.
Do i need additional settings for the "esp8266-example-multiple-battery-banks.yaml"?
Because i have 2 seplos battery banks?
And is this RS485 to TTL also supported?
https://www.amazon.de/DollaTek-MAX485-RS485-RS-485-Entwicklungsboard/dp/B07DK4QG6H/ref=sr_1_4?__mk_de_DE=%C3%85M%C3%85%C5%BD%C3%95%C3%91&crid=1G2C9SV8GI721&keywords=rs485+ttl&qid=1660051166&sprefix=rs485+ttl%2Caps%2C95&sr=8-4

You can use the esp8266-example-multiple-battery-banks.yaml if your battery banks without changes if your battery banks addresses are setup properly:
https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L40
https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L43
https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L46
If there are other addresses assigned please change there values before executing esphome run config.yaml.
I cannot recommend the mentioned RS485 modules. They require flow control. I prefer the modules without flow control. They look like this: https://raw.githubusercontent.com/syssi/esphome-jnge-mppt-controller/main/images/circuit_thumbnail.jpg

Awesome i ordered the RS485 modules.
One last question:
How is the communication with Home assistant in your JKBMS Reposirory it is done via mqtt and how is this handled here in the Seplos Rep?

You can use the esp8266-example-multiple-battery-banks.yaml with your battery banks without changes if your battery banks addresses are setup properly:
https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L40 https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L43 https://github.com/syssi/esphome-seplos-bms/blob/main/esp8266-example-multiple-battery-banks.yaml#L46
If there are other addresses assigned please change there values before executing esphome run config.yaml.
I cannot recommend the mentioned RS485 modules. They require flow control. I prefer the modules without flow control. They look like this: https://raw.githubusercontent.com/syssi/esphome-jnge-mppt-controller/main/images/circuit_thumbnail.jpg

Sensors are created automatically but how do they interact and why did you add mqtt at JK Repo?

If you use Home Assistant please use the api component to connect your node. If you use another Home Automation Software there is no native integration and you should use a generic approach like mqtt.


Specify fp species in ini file

Adding the ability to specify fp_species, so that you can retrieve footprints from a store that contains inert footprints and species-specific footprints.
This addresses issue #113

Good idea - I'll add that to the .ini file now

[like]  Helene De Longueville reacted to your message:

From: Joe Pitt @.>
Sent: Thursday, May 9, 2024 2:50:29 PM
To: openghg/openghg_inversions @.>
Cc: Helene De Longueville @.>; Review requested @.>
Subject: Re: [openghg/openghg_inversions] Specify fp species in ini file (PR #114)
Good idea - I'll add that to the .ini file now
—
Reply to this email directly, view it on GitHubhttps://github.com/openghg/openghg_inversions/pull/114#issuecomment-2102815794, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BFGCD4AOERKT4JW7PDGTQPLZBOELLAVCNFSM6AAAAABHNITASWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBSHAYTKNZZGQ.
You are receiving this because your review was requested.Message ID: @.***>


SLING-5599 Testing Git Pull request build, this will break the build, do not merge

Do not merge this pull request, see
https://issues.apache.org/jira/browse/SLING-5599
for details.

Re-opening to trigger builds.

With the upcoming migration to git this repository will be deleted. If the pull request contains data that should be re-submitted I suggest that you save the changes locally and resubmit them after the migration, which will likely happen on Monday the 9th of October.


v1.0.28 of pipeline plugin

pull plugin change for https://github.com/openshift/jenkins-plugin/issues/101 into jenkins images @bparees

Lgtm

test passed ... merging


create default database for new user creation

inside server/Accounts new users will automatically have a database generated issue is pushed to main


Support for BSR sparse matrix

Hi,
Is there any intend to support the Block Sparse Row matrix format in the future? This is “simply” an extension of the CSR which is already being developed, and further described here in scipy's doc. This could help in cases where the matrices are sparse but contiguously defined in line, but I have no clue about how moving from float operation as in CSR to local vector operation would be hard to handle in JAX.

I've been experimenting with a general block sparse format on this branch: https://github.com/google/jax/compare/main...jakevdp:jax:block-bcoo
On the lower level, we've been experimenting with some efficient block-sparse matmul operations via jax-triton: https://github.com/jax-ml/jax-triton/blob/7a1c0d00cbfa80f8207b2d5e021d693a68a8138b/examples/pallas/blocksparse_matmul.py#L33
I have no definite plans to land it in jax.experimental.sparse, but if there are compelling use-cases I could be encouraged to finish the implementation

Well, I'm not very much into ML architectures so I don't have use cases in mind for this specific field. However in my field (astrophysics) we require to do a lot of Matrix.Vector reductions using matrices which are well-defined in the BSR format
I'll take a look at this in the meantime, ty for answering so quickly !

I'm going to close this, as BSR and other matrix formats are not currently on our roadmap.


Include port in BackupDatabaseCommand.php

When attempting to run the backup:db command with MAMP for my local development, I get the error:
Export failed with message: `Connecting to database failed with message: SQLSTATE[HY000] [1045] Access denied for user 'user'@'localhost' (using password: YES)`.
  Please make sure that the provided target exists.

However, if I include the port in BackupDatabaseCommand.php, it works without issue:
$dump
        ->file($target . $filename)
        ->dsn("mysql:dbname={$database};host={$host};port={$port}")
        ->user($user)
        ->pass($pass)
        ->tmp(getcwd() . 'site/assets/tmp');

The port is now included :)


Add scope types "trailing" / "leading"

Main use case being  "chuck trailing" / "chuck leading" /  "clear trailing" / "clear leading".
Need this in order to merge in the "move air after bat" branch

[ ] Also look for tests that have a single target with non-null position to see if they should change to using trailing / leading instead.  Esp tests introduced in #340

I'm not clear on what these scope types are meant to represent. Leading/trailing whitespace?


feat: update events

Note that tests are not running in CI, but sometimes you get a green tick anyway.


user description field

I thought a user description field is a default feature to show under all posts. Especially for multiuser blogs.
I was a bit surprised that bludit doesn't contain such field in user profile.
Shouldn't user profile be improved to offer such function?

You can use last name like temporal solution

Hi,
yes I need to improve the user profiles in Bludit.

How about an entire author info box, with avatar and short description

@abdulhalim check user profile page.
All needed options are there, despite a textarea for author description.
At the meantime I'm using firstName field as a user description.

@Joduai my blog is not multi-author, so I add author box in the page.php file but this way is not fancy, because it shows in all pages

@abdulhalim  anyway you would need to show user field with conditional statements, so that they are shown on for example blog posts, not on static pages.
You can also prepare different template files and include them with conditionalss based on page type.
Plenty solutions, but none of them are out of box if you want a custom features.

the field could be description or about ?

Hmm, after you asked I started to wonder if having both fields wouldn't be a bad idea?
First one a raw textarea for a short description purpose - about author shown under every post.
Second for a longer text like résumé. This one could have a wysiwyg/markdown editor based on what type of editor plugin is enabled.
But what would be the advantages of having second field? As for now I would see this option usable only for websites/blogs containing multiple users. But who might predict whatfor somebody might use it?

This is a great idea. But what is the prediction for? I guess s its better
if the admin can make own decisions of seeing this field or not
Joduai<EMAIL_ADDRESS>schrieb am Mi., 13. März 2019, 23:22:

Hmm, after you asked I started to wonder if having both fields wouldn't be
a bad idea?
First one a raw textarea for a short description purpose - about author
shown under every post.
Second for a longer text like résumé. This one could have a
wysiwyg/markdown editor based on what type of editor plugin is enabled.
But what would be the advantages of having second field? As for now I
would see this option usable only for websites/blogs containing multiple
users. But who might predict whatfor somebody might use it?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/bludit/bludit/issues/963#issuecomment-472629409, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AXwE12HkQQuXj0AVfVZeeJaFbLakGBFJks5vWXo2gaJpZM4bIBzM
.

I'm thinking a field for an small text, like an small description about the author.
I don't want to add two fields, just 1 is ok, but not sure about the name of the field.


Explain Cache Requirements for New Videos

Using (hallelujah) v2.0....

[ ] Mac model: Mac Mini (2018)
[ ] macOS version: 1.15.6
[ ] Monitor setup: HP Z27

I tried to load the Magic Window videos, and got a pop-up that my cache is full. Cache is currently 5gb. I tried raising it to 10gb and tried again, and was told, again, that my cache was full.
I guess I could keep guessing, but it would be more efficient if Aerial could explain, on that "Cache Full" pop-up, how much more is required for the videos I'm trying to download...and, perhaps, brief instructions for newbies about where to go to make that adjustment.

@Jimmbo so it should still start. What the current size of your cache ? Cause if you had a large cache before, Aerial will not trim it right away, only in a week (if you picked the weekly rotation).
You can see the current cache size here :

This may not be super intuitive for users upgrading like you, I may need to rework this a bit !

I answered that above (did I use the wrong terminology?). I currently have cache limited to 5gb. I tried increasing to 10gb, but it still told me cache was full.

I mean, not how much is your limit, check what I circled, it tells you your current cache size. You probably had a very large cache from before, and Aerial didn't delete your videos right away.

Does 2.0 not allow videos to be streamed anymore?

Yes, that's the settings pane I've been referring to. I'm not sure what you thought I meant.
It was at 5GB, and I increased to 10GB.

That’s the limit you set you are talking about. Check the part I circled, I’m not talking about that, at the right of where you set the limit, it says (currently x GB), that’s the current real size of your cache.

Sorry. My English is not as good as yours, obviously.
Currently at 31.39GB.

@Jimmbo no worries, I was a bit tired too yesterday after all the work on release so I probably wasn't super clear.
So right now if you want new videos to download, you need to move the slider above 32 GB so it will pick new videos. I'll make a fix in next version so it asks you instead if you want to trim your cache to make some room, and make that UI a bit more clear.
@dscos no sorry, it was not really supported previously, there are many issues with streaming with Apple servers (technical and ethical) so I'm no longer allowing that. With a small size cache you should still get a decent solution.

Just to organize thoughts....
Any time a user chooses to download videos, creating cache problems, one of these responses is necessary, in descending order of preference:

"These videos will take up space on your hard drive, so Aerial will need to increase its cache (disk space allocation) to XX. Is that ok?"

or

"These videos will take up space on your hard drive, so you will need to increase Aerial's cache (disk space allocation) to XX. Press "ok" to open your Desktop&Screensaver control panel, then choose "Aerial/Screen Saver Options/Cache" and move the slider to XX or higher."

or

"These videos will take up space on your hard drive, so you will need to increase Aerial's cache (disk space allocation) to XX. Please go to "System Preferences/Desktop&Screensaver/Aerial/Screen Saver Options/Cache and move the slider to XX or higher."

Simply complaining about cache is insufficient.

Thanks a lot for the recap, I'm currently fixing a few things including this, I haven't replied to all your posts but I see them and will when I get a sec but agreed on this.

Don't worry, there's no rush. But maybe for v3, have me beta test :)

You are very welcome ;) Make sure you set the companion app to give you beta updates so you don't miss it next time !

"These videos will take up space on your hard drive, so you will need to increase Aerial's cache (disk space allocation) to XX. Please go to "System Preferences/Desktop&Screensaver/Aerial/Screen Saver Options/Cache and move the slider to XX or higher."

To be clear, are you saying that you got the warning when the screen saver settings were closed ? I'm confused here, you should only get that warning when you do an action manually in the screen saver settings.

I'm still on the same issue I raised in opening this thread:

I tried to load the Magic Window videos, and got a pop-up that my cache is full. Cache is currently 5gb. I tried raising it to 10gb and tried again, and was told, again, that my cache was full.
I guess I could keep guessing, but it would be more efficient if Aerial could explain, on that "Cache Full" pop-up, how much more is required for the videos I'm trying to download...and, perhaps, brief instructions for newbies about where to go to make that adjustment.

Your solution was to send me to adjust my cache. I think it should either happen transparently, or assisted, or at least better instructed.

I understand your suggestion. Some of it is not possible, for example I don't know how large the files are before starting the download. But I'll figure something.
My question was about whether you saw the alert message when the screensaver was running full screen, but I think you didn't.

Correct, that didn't happen.
If you can't make it transparent, at least offer explanation. Explanation is the lowest form of programming!  :)
I'm happy to help write stuff. I love the project, glad to help.

Also,

I don't know how large the files are before starting the download.

This is eventually going to be a headache for you, I think.
For example, Magic Window's "Complete Aerial Expansion Bundle" consists of 150 4K videos (20-60 secs in length). Magic Window is not advertising the size of that bundle (it must be enormous), and it sounds like Aerial won't detect it, either.
If Magic Window's stuff catches on, or if users start adding lots of other video, cache management and file size will require more thorough and clever control. I don't have suggestions, I just see a problem. I predict that Aerial will need better visibility/management of disk space, file size, and cache size, if only as a consequence to the (wonderful) Magic Window association.
If I'm misunderstanding the tech, just ignore me.

It's a bit more complex than that, short answer, no those packs are not enormous at all, the videos are well compressed and high quality. Can't go into details right now sorry, need to push my build.

Ordering now then. Thanks.

Great, I pushed my build to notarization, so to clarify things a bit, the problem you experienced is because you had a large cache, then enabled the cache limit, and I didn't purge your cache of the excess of videos at that time. So despite having a limit set to 10 GB, you already had, from a previous version of Aerial, 31 GB of videos. Does that part make sense so far ?
What I should have done, is that after you play with the slider, I purge your cache of the excess of videos. I'll implement this later on.
A second thing I'll try, is to increase the cache after the downloads are done if you pick download anyway.
For now, 2.0.1, I clarified a bit the error message but I'll revisit this :

About the packs, they are stored in a separate folder and not in the cache directory, and since you paid for the content, I won't delete it independently of what you set for the cache size. I will however improve at some point the cache UI to more clearly show how much space is currently used, and by what.

All sounds good to me.

Does 2.0 not allow videos to be streamed anymore?

I am still used the pre 2.0 version because of the forced cache usage things (i really don't want to cache theese videos, because i am almos always online and if i am not, the black screen are perfect for me), but now i made a new fork of the last 1.9.x version. It now contains the tvOS15 videos and i have a lot's of plan to remove lot's of things because i really need nothing more, than a simple screensaver that works very similary to the Apple's own version in tvOS.

Does 2.0 not allow videos to be streamed anymore?

@dscos: I am still used the pre 2.0 version because of the forced cache usage things (i really don't want to cache theese videos, because i am almos always online and if i am not, the black screen are perfect for me), but now i made a new fork of the last 1.9.x version. It now contains the tvOS15 videos and i have a lot's of plan to remove lot's of things because i really need nothing more, than a simple screensaver that works very similary to the Apple's own version in tvOS.


Unable to change Integration Parameters

When trying to change integration parameters, clicking submit simply results in an error message stating 'User Input Malformed .....

.
Even if nothing is changed the error persists.
Not possible to change anything !!

Seems you have to input something in the field “custom thumbnail path”. Try / and then submit


Unable to find last irreversible block to write, hard fail

Given a network of 4 or more producers are running and producer n is only connected through one connection.  When this connection is killed, and producer n is allowed to continue on his own fork for at least two rounds (it appears this is the case), then when reconnecting to another producer via cleos, syncing fails.  It syncs some blocks but fails before done with unable to find last irreversible block to write.
ATC:
After chain controller refactoring the unit test block_tests/last_irreversible_update_bug should fail as the assertion should not be thrown.
Verify that the new chain controller will pick the fork with the most recent irreversible block and that if these tie then pick the longest valid fork.

This bug, should be resolved with Dan's chain controller refactoring.

@larryk85 Hi Bucky, the unit_test block_tests/last_irreversible_update_bug_test is not failing, is it supposed to be failing by the latest master?

No those changes are not it master yet, Dan is still working on those.  So let's keep this is QA until those come in.  I don't think there is an issue for the refactoring, so I will just keep track of when those changes are merged and either message you or just ensure that the test fails.

Got it. Thanks!


error while executing gtmodel during  enrico_sed operation

I was running enrico_sed to generate flux points and I ran into the following error. Prior to gtmodel all the other steps were executed successfully by enrico.
Error report
time -p gtmodel srcmaps=/home/parth/SINP/1ES1218+304/1ES1218+304_LAT_Analysis_PowerLaw2_srcMap.fits srcmdl=/home/parth/SINP/1ES1218+304/1ES1218+304_PowerLaw2_LAT_Analysis_out.xml outfile=/home/parth/SINP/1ES1218+304/1ES1218+304_LAT_Analysis_PowerLaw2_ModelMap.fits irfs="P8R3_SOURCE_V2" evtype=3 expcube=/home/parth/SINP/1ES1218+304/1ES1218+304_LAT_Analysis_ltCube.fits bexpmap=/home/parth/SINP/1ES1218+304/1ES1218+304_LAT_Analysis_BinnedMap.fits convol=yes resample=yes rfactor=2 outtype="CMAP" psfcorr=yes edisp=no chatter=2 clobber=yes debug=no gui=no mode="ql"
WARNING: version mismatch between CFITSIO header (v3.43) and linked library (v3.41).
Using evtype=3 (i.e., FRONT/BACK irfs)
real 61.48
user 59.56
sys 0.77
Traceback (most recent call last):
File "/home/parth/SINP/enrico/bin/enrico_sed", line 53, in
sed(config,infile)
File "/home/parth/SINP/enrico/bin/enrico_sed", line 13, in sed
run(infile)
File "/home/parth/SINP/enrico/enrico/RunGTlike.py", line 196, in run
FitRunner.ModelMap(outXml)
File "/home/parth/SINP/enrico/enrico/fitmaker.py", line 473, in ModelMap
self.obs.ModelMaps(xml)
File "/home/parth/SINP/enrico/enrico/gtfunction.py", line 424, in ModelMaps
utils.SubtractFits(self.cmapfile,self.ModelMap,self.Configuration)
File "/home/parth/SINP/enrico/enrico/utils.py", line 120, in SubtractFits
fits.writeto(abs_diff_file, data1 - data2, head)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
return function(*args, **kwargs)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/io/fits/convenience.py", line 433, in writeto
checksum=checksum)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
return function(*args, **kwargs)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/io/fits/hdu/base.py", line 377, in writeto
checksum=checksum)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/utils/decorators.py", line 508, in wrapper
return function(*args, **kwargs)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/io/fits/hdu/hdulist.py", line 872, in writeto
self.verify(option=output_verify)
File "/home/parth/anaconda2/envs/fermi/lib/python2.7/site-packages/astropy/io/fits/verify.py", line 121, in verify
raise VerifyError('\n' + '\n'.join(messages))
astropy.io.fits.verify.VerifyError:
Verification reported errors:
HDU 0:
NAXISj keyword out of range ('NAXIS3' when NAXIS == 2)
Note: astropy.io.fits uses zero-based indexing.

Hi
I am aware of this and I have no solution yet
cheers

Is this already fixed? I see a head.remove('NAXIS3') statement in the code and I have never encountered this issue.


Cryptominer still planned?

Is the cryptominer mentioned in https://vigem.org/2018/04/01/vigem-goes-crypto/ still planned for being added in? Will the option exist to opt-out for the user? Please remove if this is the incorrect place to inquire.

@sylveon it’s only a couple days old, what’s your point?

April 1st

HA! Got me good if that was the intent!


[Suggestion] FlexGen support

This works brilliantly with webui, however with my limited computational resources I could not get some of the heavier model to work.
So I would really appreciate it if there's any implementation to use FlexGen with this webui. Sorry if there's already any ways to to this.
Thank you!

I'll give it a try once my final exams are over! Thanks for your valuable input!


Documents: check if document exists when indexing

Ensure application raises error when a field that should be available isn't.

sorry, I find the commit message a bit confusing, because no error is raised in your code, so instead
Indexer: Handle errors when indexing a deleted document.
* ensure application raises error when a field that should be available isn't.

I would propose
documents: check if document exists when indexing

I would suggest only to remove or edit the commit message (the detailed description, not the title) since the description mentions raising an error, what does not happen in this PR


AbstractDocument is fairly restrictive

Hi I'm playing around with the master branch (please release 1.4! :p) and in particular the new overridable custom document model.
Thus far I've found it to be fairly restrictive. For example, I want to remove tags from it, however this then breaks because popular_tags(cls) no longer exists (I removed TagSearchable). It would be nice if this could be relaxed a little more, in much the same way that the Django AbstractUser and AbstractBaseUser provide minimal and easily overridable implementations.

Thanks for pointing this out. I added the code the allow abstract documents, which was based on the code for abstract images. So if there's any restrictions here it may make sense to also explore them for images.
It may also make sense to let each of these modules share some code (#2035)

After playing around with this some more I think the current implementation is actually pretty good, tagging would be the only thing I'm not sure about. Going to close this for now :)


openpyxl 보다 더 최신의 라이브러리로 교체하기.

/usr/lib/python2.7/site-packages/openpyxl/xml/init.py:15: UserWarning: The installed version of lxml is too old to be used with openpyxl
warnings.warn("The installed version of lxml is too old to be used with openpyxl")
에러 없애는 방법.

pip install --user --upgrade lxml


Update hapi_middleware.js

Use the hapi request object as the basis for this middleware.  Allows multiple middlewares to be used with swagger-hapi
As per issue #99

Nope.  It's more complex than just this. I now realize the parameter bodyParser require the raw req. I'll submit another PR later.


exec: "git": executable file not found in $PATH

whereis git
git: /usr/local/git
输入git
git version 2.7.0
path
/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/go/bin:/usr/local/nginx/sbin:/usr/local/mongodb/bin:/usr/local/git/bin:/root/bin:/usr/local/go/bin:/usr/local/nginx/sbin:/usr/local/git/bin:/usr/local/mongodb/bin:/usr/local/go/bin:/usr/local/nginx/sbin:/usr/local/git/bin:/usr/local/mongodb/bin:/usr/local/go/bin:/usr/local/nginx/sbin:/usr/local/git/bin/:/usr/local/mongodb/bin

Hi, if you start with script, you need to add git path to your PATH as well.
Close by

We DO NOT take questions or config/deploy problems on GitHub, please use our forum: https://discuss.gogs.io

start with  sudo ./gogs web  then....

sudo does not guarantee have git in PATH.

but  login with user git
echo path
show /usr/local/go/bin:/usr/local/nginx/sbin:/usr/local/git/bin/:/usr/local/mongodb/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin

I don't understand why you use sudo.
sudo does not guarantee have git in PATH.

start ./gogs web
install
Connect to database: Fail to create directories: mkdir data: permission denied

Give the permission to git user then.

http://stackoverflow.com/questions/12996397/command-not-found-when-using-sudo

thanks


feature/fix-cross-env - Fixing the cross env to run de app

Fixing the cross env to run de app

valeuuu!


License not specified

Can you provide a license for your code?
Under what license can I use a derived work?

d03d6a282ded0c2494924a90cd93150ab9f59170


How load llvm module?

Hello
I just want to know how load llvm module ?
Loading /opt/cuda-flux/module/cuda_flux
  ERROR: /opt/cuda-flux/module/cuda_flux cannot be loaded due to missing prereq.
    HINT: the following module must be loaded first: llvm/11.0

llvm and cuda-flux were built without any error in the same way was described in Readme.md and all environment variables exported.
My ubuntu bashrc file:
export CC=/home/mhy/DEVELOP/llvm-project/build/bin/clang
export CXX=/home/mhy/DEVELOP/llvm-project/build/bin/clang++
export C_INCLUDE_PATH=/usr/local/cuda/include:/home/mhy/DEVELOP/llvm-project/build/include
export CPLUS_INCLUDE_PATH=/usr/local/cuda/include:/home/mhy/DEVELOP/llvm-project/build/include
export CUDA_PATH=/usr/local/cuda
export LIBRARY_PATH=/usr/local/cuda/lib64:/home/mhy/DEVELOP/llvm-project/build/lib
export LLVM_DIR=/home/mhy/DEVELOP/llvm-project/build/lib/cmake/llvm

export PATH=/usr/local/cuda/bin:/home/mhy/DEVELOP/llvm-project/build/bin:/opt/cuda-flux/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:/home/mhy/DEVELOP/llvm-project/build/lib

If i compiling cuda program without loading modules,
mhy@ubuntu:~/DEVELOP/cuda-flux/test$ clang_cf++ --cuda-gpu-arch=sm_35 -std=c++11 -lcudart saxpy.cu -o saxpy
Then get this error:
+ clang++ -Xclang -load -Xclang /opt/cuda-flux/lib/libcuda_flux_pass.so -finline-functions --cuda-gpu-arch=sm_35 -std=c++11 -lcudart saxpy.cu -o saxpy
error: unable to load plugin '/opt/cuda-flux/lib/libcuda_flux_pass.so': '/opt/cuda-flux/lib/libcuda_flux_pass.so: undefined symbol: _ZN4llvm24DisableABIBreakingChecksE'

llvm-config --version output: 11.1.0

Hi Mohammad,
if you have no environment module for llvm you can edit the module file of cuda flux to remove the dependency to a llvm module. It will still work if your environment is setup correctly. Did you install llvm in in your build directory? Its not in the readme but you should install llvm somewhere. (e.g. /opt/llvm-11.1 or ~/opt/llvm-11.1). I am also not entirely sure if this is a Ubuntu or a problem that comes with llvm 11.1 (i am still using 11.0). So it could be worth a try to use a slightly older llvm version.
Best Regards
Lorenz

Yes i used instructions in readme for build llvm but i not installed it with cmake --build . --target install ,for this reason it not installed in /opt/llvm-11.1. also i cloned llvm source using git clone --branch release/11.x https://github.com/llvm/llvm-project.git, this command cloned llvm-11.1 .
however i downloaded  llvm-11.0 source and built it and also installed it in /opt/llvm-11.0 and commented out dependency to llvm and cuda in module file of cuda-flux.
now cuda-flux working perfectly.
Thank you so much.


chore(package): update @types/chai to version 4.2.0

https://github.com/DefinitelyTyped/DefinitelyTyped/pull/37451#issuecomment-519927934
https://github.com/s-panferov/awesome-typescript-loader/issues/639

Pull Request Test Coverage Report for Build 511

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 95.652%

Totals

Change from base Build 509:
0.0%

Covered Lines:
56

Relevant Lines:
58

💛  - Coveralls


:toctitle: is not honoured

I have setup a custom toctitle but it does not reflect in the PDF export.
For example:
= Contenus & collaboration
:toc:
:toctitle: Sommaire
:hide-uri-scheme:
:idprefix:
:icons: font
:revnumber: v1.0
:revdate: 26 mars 2017

Displays the following:

$ asciidoctor-pdf -v
Asciidoctor PDF 1.5.0.alpha.14 using Asciidoctor 1.5.5 [http://asciidoctor.org]
Runtime Environment (ruby 2.4.0p0 (2016-12-24 revision 57164) [x86_64-darwin16]) (lc:UTF-8 fs:UTF-8 in:- ex:UTF-8)

The correct name of the attribute is toc-title, not toctitle. If you fix the name, you should find that it works.
See http://asciidoctor.org/docs/user-manual/#user-toc-title

Ah, I got confused by the attribute mentioned on this section of the doc: http://asciidoctor.org/docs/user-manual/#special-characters
I will double check this afternoon and will reopen it it needed :-)
Thanks a lot for the blazing fast support 👍

Thanks for catching that, @oncletom! I fixed it.


datepicker: NativeDateAdapter setlocale not work

Bug, feature request, or proposal:
bug
What is the expected behavior?
i want to set locale = 'en-ca'. and the date format will be yyyy-mm-dd
What is the current behavior?
in ie/edge when my navigator.language is 'zh-cn', the display contains 年月日 ,and the date string also contains 年月日 like '2017年6月15日'
What are the steps to reproduce?
Providing a Plunker (or similar) is the best way to get the team to see your issue.
Plunker template: https://goo.gl/DlHd6U
https://plnkr.co/edit/ulSNTMTMZmORzvkVTvch?p=preview
What is the use-case or motivation for changing an existing behavior?
use the datepicker with locale='en-ca'  and the navigator.language is 'zh-cn'
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
angular 4.1.3
material<EMAIL_ADDRESS>win10
typescript 2.3.1
chrome 58.0.3029.110 (64-bit)
firefox 53.0.3
ie 11.296
Microsoft Edge 40.15063.0.0 Microsoft EdgeHTML 15.15063
Is there anything else we should know?
in chrome and ff  works

i also find that ,if the datepicker have date value when init, i select the same date the calendar will not colse

i solved this problem by write mydateadapter,  mydateadapter is the same with nativeadapter exclude this.locale change to 'en-ca'.   so i can belive the nativeadapter setlocale is not work

please close this,thanks


Support bitbucket

Add full support for bitbucket.
The access token will expire after 1 hour, so just refresh it every time we need.

          1 Warning

:warning:
manifest is not changed, forget to bump version?

  Generated by :no_entry_sign: Danger

          1 Warning

:warning:
Big PR, try to keep changes smaller if you can

  Generated by :no_entry_sign: Danger


Double Layout

Hello Bro, for some reason it's loading me two Layouts instead of one , I configured as you mentioned but it continues appearing.

To help debug, what version of Next.js are you using?
I can see you've got two _layout.tsx files; they will be nested within each other, so ensure you haven't accidentally duplicated the layout across them.


scheduler: add monitor to detect scheduling deadlock

Ⅰ. Describe what this PR does
feat: Add SchedulerMonitor for tracking pod scheduling timeouts
A new SchedulerMonitor component has been introduced to track the time taken to schedule pods and log warnings if the scheduling time exceeds a predefined threshold. This enhancement includes a mechanism to update metrics upon timeout, improving observability and aiding in debugging scheduling delays.

Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how to verify it
Ⅳ. Special notes for reviews
V. Checklist

[ ] I have written necessary docs and comments
[ ] I have added necessary unit tests and integration tests
[ ] All checks passed in make test

/approve


Add quickstart to README with link to latest

Inspired by @toddmowen adding a link to the version in the userguide, I think it's also useful to link it from the readme.

Agree that README is the first place I'd look for the link.
But why are the instructions different to what's in USERGUIDE?
Maybe we should put the sbt instructions in README, and just link to them from USERGUIDE.

@toddmowen Good point. Now that scalding depends on tools to write the metadata with the features to the sinks, it's sufficient to just depend on scalding. I've changed the USERGUIDE to refer to the README, which has been updated. I've also split out the plugin configuration to a new section in the USERGUIDE that explains how to use it to generate metadata. Ready for review again.

I've also piggy-backed a USERGUIDE correction onto this PR (relating to how aggregation is actually done now).

:+1: apart from typo
Good call moving the plugin to the Advanced section. It's not something that newbies need to try and contend with.


Feature request: bulk subscribers with user-defined context

Hi! First of all, this project is amazing! Thank you. And I really like the upcoming features!
I have a question. Is it possible to have events like beforeBulkCreate, beforeBulkDelete, beforeBulkUpdate, etc in the EventSubscriber? Like in this pull request.
I think this feature will be very useful for access control logic. For example:
@Subscriber()
export class ProductSubscriber implements EventSubscriber {
  // not the best way to implement this check, just a simple example
  async beforeBulkCreate({ em, entities, ctx }: BulkEventArgs<Product>): Promise<void> {
    const projectIds = entities.map(entity => entity.projectId);
    const projects = await em.find(Project, { id: { $in: projectIds } });
    const isAllowed = projects.every(project => project.userId === ctx.user.id); // ctx is user-defined context
    if (!isAllowed) {
        throw new ForbiddenException();
    }
  }
}

You could use flush events for this:
@Subscriber()
export class ProductSubscriber implements EventSubscriber {

  async onFlush(args: FlushEventArgs): Promise<void> {
    const changeSets = args.uow.getChangeSets().filter(cs => cs.type === ChangeSetType.CREATE && cs.name === 'Product');
    const projectIds = changeSets.map(cs => cs.entity.projectId);
    const projects = await em.find(Project, { id: { $in: projectIds } });
    const isAllowed = projects.every(project => project.userId === ctx.user.id); // ctx is user-defined context
    if (!isAllowed) {
        throw new ForbiddenException();
    }
  }

}

Btw for this kind of things it's much better to use global filters, setting the user id in some middleware.
https://github.com/mikro-orm/mikro-orm/pull/663

You could use flush events for this:
@Subscriber()
export class ProductSubscriber implements EventSubscriber {

  async onFlush(args: FlushEventArgs): Promise<void> {
    const changeSets = args.uow.getChangeSets().filter(cs => cs.type === ChangeSetType.CREATE && cs.name === 'Product');
    const projects = changeSets.map(cs => cs.entity);
    const isAllowed = projects.every(project => project.userId === ctx.user.id); // ctx is user-defined context
    if (!isAllowed) {
        throw new ForbiddenException();
    }
  }

}

#642

It's great! But how can I get a user-defined context?

Btw for this kind of things it's much better to use global filters, setting the user id in some middleware.
#663

Sorry, but I don't see how I can use global filters to control create/update/delete access. I think filters can only control read access. Can you please explain this?

It's great! But how can I get a user-defined context?

You could use the global filter params on the EM. Currently there is no getter, but I can add one, no problem with that.
em.setFilterParams('ctx', { user: 123 }); // this is already there
em.getFilterParams('get'); // would return `{ user: 123 }`

// currently you could read it from the private var
// @ts-ignore
const ctx = em.filterParams.ctx;

Sorry, but I don't see how I can use global filters to control create/update/delete access. I think filters can only control read access. Can you please explain this?

Right, they cannot be used for creating stuff... But they are applied for updates done via em.nativeUpdate() as well as deletes via em.nativeDelete(), and in general, if you filter things you read, you won't be able to read the thing that would be then updated/deleted (so the filter will block the possibility of UoW issueing update/delete queries on such entities, as they will never be loaded).

I think getFilterParams would be useful in some cases, thank you.
As I understand it, filters will control read/update/delete access, but only if I use the entity manager (not the query builder).
Also I need access control for create (insert) in addition to filters.
Am I right?

Btw for this kind of things it's much better to use global filters, setting the user id in some middleware.
#663

About "setting the user id in some middleware". Do you mean using async_hooks or alternatives?

Am I right?

Yes.

About "setting the user id in some middleware". Do you mean using async_hooks or alternatives?

Nope, I mean regular (express) middleware, if you are using RequestContext helper, you can obtain the EM fork created for that request from that:
app.use((req, res, next) => {
  const em = RequestContext.getEntityManager()!; // can be undefined, if the context was not started yet
});

Got it, thanks for your help!


[BUG, Android, GoodID] The app crashed after navigating to the claim screen

[BUG, Android, GoodID] The app crashed after navigating to the claim screen
Reproduced on PROD
Steps:

login into the wallet
click on the Claim button
observe the result

Actual result: The app crashed after navigating to the claim screen
Expected result: The app should work without issues
Environment: PROD Version 2.50.2 (5390)
Device: Redmi 9, Android 10
Attachments:
CrashGoodID.txt
Private Zenhub Video

fixed here: https://github.com/GoodDollar/GoodDAPP/commit/da253447b0bd516385ff22bb174b95cb12ad4f07

verified on prod apk


Improve circles examples

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Files
Coverage Δ

src/startorch/example/circles.py
100.00% <100.00%> (+2.04%)
:arrow_up:

:loudspeaker: Thoughts on this report? Let us know!.