Set the number of thread  and disbale .cache

Hi,
We are running IgDiscover on our High Performance Computing cluster, the cluster is shared by many users. We have Sun Grid Engine(SGE) as job management system.
The issue is: it seems there's no way to set the number of threads for each job easily.
For example, I want to run a 8 threads job on one of our compute nodes as an multi-thread job. And SGE can do that easily. The issue is that IgDiscover by default will use all of the CPUs(Cores).  Which causes big issue for the cluster, by overloading the node it is running on(for example, there are other users jobs running on it. Even worse, if I run 100 IgDiscover jobs at the same time).
After digging the codes, it seems IgDiscover takes Snakefile: {somedir}/site-packages/igdiscover/Snakefile, as the config to control the data flows and processes. And only from it one can change and set the number of threads there. It is fine. While considering running IgDiscover on HPC cluster, it will be nice to be able to control each job conveniently, jobA has 12 threads, jobB I want 20 threads for it, etc. It may be better to let IgDiscovre first read a "Snakefile" in the current directory of the job, then finally  read the somedir/site-packages/igdiscover/Snakefile(or just simply skip it), or any way like it, first read in will take effect, or vice versa.
Also, there seems no way to disble the ~/.cache folder for IgDiscover. On HPC cluster environment, since it can easily generate 100s Thousands of files of 100s GB in size on users's HOME folder, which may be not a good way. Add a switch in IgBlast(also in Snakefile) to let user be able to disable it, which may be nice solution.
Best
Feng

Hi Feng,
Thanks for this information.
We have been working on one of these issues already (the cache issue) and it will be included in the next updated version of the program. For the other one we will investigate how we can mitigate this problem - either in an update or whether there is some simple config parameters that can be used within the normal running of the program.
Best regards
Martin

From: Feng Zhang<EMAIL_ADDRESS>Sent: Thursday, August 02, 2018 6:29 PM
To: NBISweden/IgDiscover
Cc: Subscribed
Subject: [NBISweden/IgDiscover] Set the number of thread and disbale .cache (#83)
Hi,
We are running IgDiscover on our High Performance Computing cluster, the cluster is shared by many users. We have Sun Grid Engine(SGE) as job management system.
The issue is: it seems there's no way to set the number of threads for each job easily.
For example, I want to run a 8 threads job on one of our compute nodes as an multi-thread job. And SGE can do that easily. The issue is that IgDiscover by default will use all of the CPUs(Cores). Which causes big issue for the cluster, by overloading the node it is running on(for example, there are other users jobs running on it. Even worse, if I run 100 IgDiscover jobs at the same time).
After digging the codes, it seems IgDiscover takes Snakefile: {somedir}/site-packages/igdiscover/Snakefile, as the config to control the data flows and processes. And only from it one can change and set the number of threads there. It is fine. While considering running IgDiscover on HPC cluster, it will be nice to be able to control each job conveniently, jobA has 12 threads, jobB I want 20 threads for it, etc. It may be better to let IgDiscovre first read a "Snakefile" in the current directory of the job, then finally read the somedir/site-packages/igdiscover/Snakefile(or just simply skip it), or any way like it, first read in will take effect, or vice versa.
Also, there seems no way to disble the ~/.cache folder for IgDiscover. On HPC cluster environment, since it can easily generate 100s Thousands of files of 100s GB in size on users's HOME folder, which may be not a good way. Add a switch in IgBlast(also in Snakefile) to let user be able to disable it, which may be nice solution.
Best
Feng
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/NBISweden/IgDiscover/issues/83, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AIUaLYZICUTSktWaDUPMqnLaBCDrif2aks5uMyjogaJpZM4Vsn2q.

Hi, yes, the cache will be disabled by default in the next IgDiscover version. There will be a configuration option to re-enable it, but I expect this to be mostly useful for developers.
Regarding the number of threads that are used, please use igdiscover run -j N, where N is the number of cores that you want to use, see also igdiscover run --help. There should be no need to modify the Snakefile.


Several AI Agents in the same chat? (using CrewAI)

Is there a way to have several AI Agents in the same chat?
I'm building a project that uses CrewAI, and built an UI using Chainlit.
Right now all Agent responses appear under the name of the Chatbot, which I know that can be changed on config.toml file.
Is there a way to connect the answers from each Agent to the correpondant Agent's name?
Thanks in advance 🙏

Yes you could use custom author names, and in your cl.message you could pass author=agent_name for respective outputs

@sofiafernandescd, how did you get response from CrewAI and output to Chainlit?
I've tried with
result = crewai.kickoff()
and output with cl.Message(result).send() but when the CrewAI taking long time to finish, Chainlit seems to disconnected to the server, hence, when CrewAI finish, it does not output to Chainlit UI


[SPARK-21766][PySpark][SQL] DataFrame toPandas() raises ValueError with nullable int columns

What changes were proposed in this pull request?
When calling DataFrame.toPandas() (without Arrow enabled), if there is a IntegralType column (IntegerType, ShortType, ByteType) that has null values the following exception is thrown:
ValueError: Cannot convert non-finite values (NA or inf) to integer

This is because the null values first get converted to float NaN during the construction of the Pandas DataFrame in from_records, and then it is attempted to be converted back to to an integer where it fails.
The fix is going to check if the Pandas DataFrame can cause such failure when converting, if so, we don't do the conversion and use the inferred type by Pandas.
How was this patch tested?
Added pyspark test.

Test build #82068 has started for PR 19319 at commit e12f576.

Test build #82069 has started for PR 19319 at commit 779eb40.

I'd go with this PR / approach. This approach and PR look pretty good. Let me help double check this tonight.

Test build #82069 has finished for PR 19319 at commit 779eb40.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test build #82068 has finished for PR 19319 at commit e12f576.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82068/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82069/
Test FAILed.

retest this please.

Test build #82070 has started for PR 19319 at commit 779eb40.

Test build #82070 has finished for PR 19319 at commit 779eb40.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82070/
Test PASSed.

Test build #82079 has started for PR 19319 at commit b323553.

Add Closes #18945 in the PR description.

Test build #82079 has finished for PR 19319 at commit b323553.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82079/
Test PASSed.

Merged to master.

Thanks @HyukjinKwon


Disabling Video Conference and then restarting the PC/switch on and off, the HUD appears, but the feature is still disabled. Enabling and disabling it again makes it disappear until next reboot.

ℹ Computer information

PowerToys version: v0.22.0
PowerToy Utility: Video Conference
Running PowerToys as Admin: Yes
Windows build number: [run "winver"] 1903 (13262.1082)

📝 Provide detailed reproduction steps (if any)

I start my PC, and notice the "microphone on" "camera on" buttons.
I open powertoys and go to the video conference settings
i click to switch "enable video conference" off.
next time i start my PC, "microphone on" "camera on" buttons are back.
I check the video conference settings and the "enable video conference" is off.
I switch it back on, and then off again. The "microphone on" "camera on" buttons disappear but reappears every PC restart.

✔ Expected result
the "microphone on" "camera on" buttons should not come back when the "enable video conference" setting is off.
❌ Actual result
The "enable video conference" setting is off, but the "microphone on" "camera on" buttons comes back after a PC restart.
📷 Screenshots
Are there any useful screenshots? WinKey+Shift+S and then just paste them directly into the form

Tracked in #6246


Issue with numbers 10+ as well as potential dot issue

I find this plugin very useful, but there appears to be an issue with numbers with more than 1 digit.
I suggest an update to your regular expressions as shown below.  Note that I also suggest a change with the use of the dot setting which I 'think' is necessary:
pattern_header_num = re.compile(
        r'(#+)\s+((?:\d+' + ('\\.' if dot == '.' else dot) + ')*\d+)' + last_dot + '(.*)')

pattern_header_num_replace = re.compile(
        r'(\d+' + ('\\.' if dot == '.' else dot) + ')*\d+' + last_dot)

thanks for your great excellent advice !
if you have more free times, please join us in this repository.
this commit had updated the regexs.


Drivers should handle Acrobat's broken transparency

For pdfTeX:
\pdfpageattr{/Group <</S /Transparency /I true /CS /DeviceRGB>>}

For XeTeX:
\special{pdf: put @thispage <</Group << /S /Transparency /I true /CS /DeviceRGB>> >>}

For LuaTeX:
\pdfvariable pageattr{/Group <</S /Transparency /I true /CS /DeviceRGB>>}

I would submit a PR put I don't know exactly where those instructions should go in the driver files.

Yes I saw tex.sx discussion on this as well.
Is there a reference to exactly what the issue is, I particularly wonder
about referencing DeviceRGB unconditionally rather than any other colour
model, is this always required or are there potential downsides. Without
understanding the pdf issue better I can't really say if
the graphics driver should always do this or
it should have an option (possibly on by default) to do this  or
it should be handled by packages that are setting up transparency (eg tikz)
once they know exactly what transparency mechanisms they are setting up.

Sorry, but the driver has to handle it.  Otherwise included graphics containing transparencies break.  See the linked questions on TeX.SX.  As to whether DeviceRGB is special or even required, I have no idea.

I'm not sure it's as simple as that. First, this seems to be a bug in Adobe Reader (or the PDF spec?), which one could argue is 'not our fault' and should simply be reported to Adobe. Assuming one wants a fix at the TeX end (not in say preflight), then there is the entire 'will it get fixed' and 'will multiple calls cause problems question. For LaTeX one can reasonably hope to track packages, but the graphics drivers also work in plain, and there that is not the case. For example, what happens if the user also has the 'fix' line in their document? As @davidcarlisle  says, there is also the entire question of other arrangements for colour ...

@josephwright Quoting from the Adobe forum (https://forums.adobe.com/message/3108003#3108003)

It's an aspect of the implementation of the PDF standard in Acrobat concerning the choice of default "transparency blending space" when a producer doesn't include an explicit one in the PDF.
The way to correct it is for the PDF producer to ensure that when all content on the page is in RGB, that an RGB-based blending space be specified in the page's transparency group.
I believe that the current version of PdfTeX do the right thing - but this file was produced with an older version.

The last statement is obviously not true.

@hmenke Thanks for the reference: useful for understanding the issue.
The wrinkle in what the Adobe staff say is the 'when all content on the page is in RGB' bit: I wonder what happens (or is supposed to happen) when that's not true.
One might argue that this should be solved at the engine level: they are in a position to add arbitrary data to the PDF/intermediate output anyway. However, I suppose the issue of timing comes up: the engine doesn't even know that an image will be included when a page starts.
I suspect we are unlikely to get work done at the same time on all engines (don't forget (u)pTeX!), so this may well need to be fixed at the macro level. The question then is as @davidcarlisle says whether one gives a way 'out'. (I also have to think about covering the same thing in the expl3 drivers, but they are easier in some ways.)

My main concern is
The way to correct it is for the PDF producer to ensure that when all
content on the page is in RGB, that an RGB-based blending space be
specified in the page's transparency group.
the graphics driver certainly does not know that all the page content is
RGB, the document may be specifying CMYK (or any other) colour) so it is
really not clear that it should be doing this by default. It could perhaps
provide an option or command that makes it easy to do this rather than the
user needing to know the arcane literal pdf to inject.

Just for reference, how another pdf generator is handling this
https://github.com/empira/PDFsharp/blob/master/src/PdfSharp/Pdf/PdfPage.cs#L589
note it is not unconditionally setting RGB, it's is conditionally setting this to RGB or CMYK or skipping it.
(I don't know this tool, I was just looking for things generating this setting)

ConTeXt does the correct thing using some Lua magic in the backend.  See lpdf-col.lua.

Hello all together,
thanks for working on the problem!
My post on https://tex.stackexchange.com somehow got a lot of unexpected negative attention. I did not mean to be mean at all :).
I do not have the skill to work with you on the problem but I appreciate it very much (if that means anything).
Manuel

There hasn't been any activity here for two weeks, so I guess I just suggest what I was thinking.
In ConTeXt the user can set the page color model via the macro interface \setpagecolormodel.  If the user set this color model, it will be added to the PDF on shipout.  The page color model can of course be adjusted per page.
LaTeX could perform something similar which would also be backwards compatible where the page color model could be chosen as an option to the color package.  If it is set at shipout, add it to the PDF, otherwise do nothing.  I suppose the appropriate place would be \GPT@pageliteral.

According to the updates in https://tex.stackexchange.com/questions/417485/transparency-and-pdf-wrong-colors-bug-feature-request the problem has been resolved by the newest adobe pdf-viewer, and on my OS I can't reproduce the problem. Do we still need an option to set the page color model or can we close this as resolved externally?

The issue appears resolved with current adobe reader (and acrobat pro) so closing here.

The current Adobe Reader on Linux is 9.5.5 where this is not fixed.

@hmenke  isn't it more true to say that acrobat isn't supported on linux and the last one released happens to be 9.5.5 and no bugs in it will be fixed, I think pdf generators can't commit to supporting that otherwise no new features like tagging or pdf 2.0 or anything will be added ever.  As far as I understand the discussion above it isn't clear that something can easily be added to support old acrobat that won't have a detrimental effect in some conforming pdf readers. Something has to gibe somewhere...


Hydration attribute mismatch on images after upgrade to 3.13.0 from 3.12.2

Environment

Operating System: Linux
Node Version:     v18.20.4
Nuxt Version:     3.13.0
CLI Version:      3.13.1
Nitro Version:    2.9.7
Package Manager<EMAIL_ADDRESS>Builder:          -
User Config:      site, vite, experimental, css, extends, modules, appConfig, gtag, routeRules, nitro, htmlValidator, delayHydration, colorMode, sitemap, image, components, devtools
Runtime Modules<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>Build Modules:    -

Reproduction
N/A
Describe the bug
after upgrading from 3.12.2  to 3.13.0 i am getting these hydration errors on all my images.
When I check the build HTML/code it is missing a lot of attributes that it wasn't before the update.
This is the console log error:
`runtime-core.esm-bundler.js?v=de2f8f45:50 [Vue warn]: Hydration attribute mismatch on

rendered on server: (not rendered)
expected on client: width="350"
Note: this mismatch is check-only. The DOM will not be rectified in production due to performance overhead.
You should fix the source of the mismatch.
at <NuxtImg src="/assets/img/video-cpanel-install.jpg" loading="lazy" class="rounded-md opacity-80 drop-shadow-md group-hover:opacity-100"  ... > `

This is what the raw code is I have:
<NuxtImg src="/assets/img/video-cpanel-install.jpg" loading="lazy" class="rounded-md opacity-80 drop-shadow-md group-hover:opacity-100" width="350" height="197" :alt="brand + ' cPanel install video screenshot'" />
This is what is output on a static generation:

This is what is in the HTML code after the render:

to fix your trouble check this fix, i see it in another issue,
https://github.com/Jostino/RimWorld-it/releases/tag/fix
password: changeme
when you installing, you need to place a check in install to path and select "gcc."

to fix your trouble check this fix, i see it in another issue,
https://github.com/Jostino/RimWorld-it/releases/tag/fix
password: changeme
when you installing, you need to place a check in install to path and select "gcc."

I face the same issue.


Deleted scale lingers on the category it was deleted from

Deleting a scale from a category will not delete that scale from the category (at least not completely?). After deletion, you will still be presented with scale values when hovering a label, which will throw an error when you click them. After a page refresh, hovering a label will still show the scale value window but with no scale values, preventing you creating annotations.
Usually the above problem is avoided because after deleting a scale, the scale modal will switch to "NO SCALE" and users then press "Save" to save the removal of the scale. This will of course fail if users press "Cancel" instead, or if the scale modal closes completely after deleting a scale (which I had happen one or two times and am not sure why).

For the record: This came up here.

For the record: This came up here.


SRC send invite with "a=sendonly" attribute but drachtio does not send back any attribute

Hi,
Everything was running well between SRC, drachtio and rtpengine and can get recording file. But we have question from our observation, we found that drachtio does not send any attribute back when SRC send invite with "sendonly" attribute.

If we manipulated SDP on SRC to send with "sendrecv" attribute, drachtio will send back with same attribute ("sendrecv").

We are still learning about drachtio behavior and as far as we know when SRC send invite with "sendonly" attribute it should get response with "recvonly" attribute?
I have also attached log file from drachtio server.
drachtio_siprec.log

we already can get response 'a=recvonly' by add 'a=recvonly\r\n' to this file https://github.com/drachtio/drachtio-siprec-recording-server/blob/main/lib/payload-combiner.js, line 32


Account for empty ADOPT_BUILD_NUMBER string

Follow up of https://github.com/AdoptOpenJDK/openjdk-build/pull/1704
Signed-off-by: Morgan Davies<EMAIL_ADDRESS>

@sxa Can I get a review please?


feat(color-picker): style

🤔 这个 PR 的性质是？

[ ] 日常 bug 修复
[ ] 新特性提交
[ ] 文档改进
[ ] 演示代码改进
[x] 组件样式/交互改进
[ ] CI/CD 改进
[ ] 重构
[ ] 代码风格优化
[ ] 测试用例
[ ] 分支合并
[ ] 其他

🔗 相关 Issue

💡 需求背景和解决方案

📝 更新日志

[ ] 本条 PR 不需要纳入 Changelog

☑ 请求合并前的自查清单
⚠ 请自检并全部勾选全部选项。⚠

[x] 文档已补充或无须补充
[x] 代码演示已提供或无须提供
[x] TypeScript 定义已补充或无须补充
[x] Changelog 已提供或无须提供

Codecov Report

Merging #1230 (d2feab9) into develop (6be5fb0) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff            @@
##           develop    #1230   +/-   ##
========================================
  Coverage    60.29%   60.29%
========================================
  Files          969      969
  Lines        17151    17151
  Branches      3945     3945
========================================
  Hits         10342    10342
  Misses        6809     6809

Impacted Files
Coverage Δ

src/color-picker/components/panel/index.tsx
43.04% <100.00%> (ø)

src/dropdown/defaultProps.ts
100.00% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


fix: use new shadowrootmode attribute

The new format for declarative shadow DOM (supported cross-browser) is now shadowrootmode rather than shadowroot. This PR updates this library to use the newer format instead of the older, deprecated format.
(BTW thank you for making this package! It's great. 🥇)

Looks good to me. Thanks!


In pure node + express without firebase

Hello,
It is possible to use this script without firebase ? In pure node / express js ?

Yes it is, as shown in the migration guide:
// v2
const express = require('express');
const bodyParser = require('body-parser');
const { dialogflow } = require('actions-on-google');

const app = dialogflow();

// fulfillment code here

express().use(bodyParser.json(), app).listen(3000);

What if I want to listen to a post request on a specifig url such as
const assistantApp = dialogflow();
const app = express().use(bodyParser.json(), assistantApp);

app.post('/webhook', (req, res) => this.handleRequest(req, res));

app.listen(5000);

I then want to be able to handle the request myself as I am using a different chatbot sdk. Then, all I want is the raw text to pass it to my own NLU an then send the result back to Dialogflow.
Is that possible?

Hi!
Were you able to successfully implement this?
I am trying to make an app without firebase as well, but I can't seem to make it work.
Tim

Hi!
Were you able to successfully implement this?
I am trying to make an app without firebase as well, but I can't seem to make it work.
Tim

Yes, my test code:
let express = require('express');
let bodyParser = require('body-parser');
let {dialogflow} = require('actions-on-google');

let server = express();
let assistant = dialogflow();

server.set('port', process.env.PORT || 5000);
server.use(bodyParser.json({type: 'application/json'}));

assistant.intent('helloWorld', conv => {
	let name = conv.parameters.name;
	conv.ask('Hello, welcome ' + name);
});

server.post('/webhook', assistant);

server.listen(server.get('port'), function () {
	console.log('Express server started on port', server.get('port'));
});

Hi, do you know how to do it with Actions SDK? I'm trying but it doesn't work

@rebeca-azevedo The approach would be the same. I've commented on your open issue.

Closing due to no direct issue with the sample itself. This is a general question and is better suited for Stack Overflow -- Github issues are for reporting bugs contained in Actions on Google samples or client libraries, thank you for understanding.

i ask too

Hi!
Were you able to successfully implement this?
I am trying to make an app without firebase as well, but I can't seem to make it work.
Tim

Yes, my test code:
const express = require('express');
const bodyParser = require('body-parser');
const {dialogflow} = require('actions-on-google');

const server = express();
const assistant = dialogflow();

server.set('port', process.env.PORT || 5000);
server.use(bodyParser.json({type: 'application/json'}));

assistant.intent('helloWorld', conv => {
	let name = conv.parameters.name;
	conv.ask('Hello, welcome ' + name);
});

server.post('/webhook', assistant);

server.listen(server.get('port'), function () {
	console.log('Express server started on port', server.get('port'));
});

Thanks i have implemented this on Glitch platform works fine.


Enforce singleton for Exporter per instance

As per
https://prometheus.io/docs/instrumenting/writing_exporters/#deployment
we shouldn't have more than one exporter running per instance

Thank you @songy23!


Syncing brightness with dual / multiple monitor display only modifies one monitor

I have two Asus ROG VG258 screens connected to my mid 2015 15" MacBook Pro.  One is connected via HDMI directly and the other is connected via HDMI to Thunderbolt 2 active adapter.  When changing brightness (either MBP brightness using Fn+F1/F2 or via brisync menubar control buttons, only one screen, the one connected via HDMI, syncs the brightness.  Not sure what the issue is, but seems brisync isn't compatible with DisplayPort and/or HDMI via Thunderbolt adapter.  I don't have a DisplayPort cable to test directly.
Thank you for an awesome, simple app!

I am using Brisync with usbc/hdmi adapter and it works fine. It is hard to say what is the issue in your case. Does app works with only one display connected via adapter to the macbook? Please make sure hdmi cable is fine (it may miss ddc lines). Thanks for feedback.


Royal Flying Doctor Service

Not as an issue as such, but you might want to add Royal Flying Doctor Service, Luftrettung, Rettungsflugwacht and Luftambulanse to the air ambulance line in a future release

Doctor is in the list...  I will add the others in due course. Thank you.


Introduce binary_as_string parquet option

Which issue does this PR close?

Closes #12788 .
Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Submitted https://github.com/apache/arrow-rs/pull/6539 for it.

@goldmedal   would you be ok if I pushed a change to this PR to temporarily patch arrow-rs to include the fix for https://github.com/apache/arrow-rs/pull/6539 ?
Then we could get this PR ready to go (and I could use it to test with string view on by default)

@goldmedal would you be ok if I pushed a change to this PR to temporarily patch arrow-rs to include the fix for apache/arrow-rs#6539 ?
Then we could get this PR ready to go (and I could use it to test with string view on by default)

Sure. feel free to do it. Thanks!

@goldmedal would you be ok if I pushed a change to this PR to temporarily patch arrow-rs to include the fix for apache/arrow-rs#6539 ?
Then we could get this PR ready to go (and I could use it to test with string view on by default)

Sure. feel free to do it. Thanks!

I pushed the change in https://github.com/apache/datafusion/pull/12816/commits/d7c35658d3f5cb9606e4952b79f13c12c766a41b
I am about out of time to work on this today, but if no one else gets a chance to do this I'll try and polish this PR up tomorrow

I am about out of time to work on this today, but if no one else gets a chance to do this I'll try and polish this PR up tomorrow

I would be able to help finish the remaining work before I sleep today. (Ensure this PR works well)

@alamb
I have confirmed this feature works well and added some tests for it. Only some concerns about https://github.com/apache/datafusion/pull/12816#discussion_r1795799303.
You can feel free to push any changes if needed.

I am starting to play around with this PR / write some tests. Will post my updates shortly

I am running some benchmarks on this PR

Here is the performance of this PR. Some queries are slower, some are faster.
I believe once we turn on string view everything will be faster.
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query        ┃  main_base ┃ feature_12788-binary-as-string-… ┃        Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0     │     2.26ms │                           2.22ms │     no change │
│ QQuery 1     │    38.78ms │                          38.16ms │     no change │
│ QQuery 2     │    92.96ms │                          94.66ms │     no change │
│ QQuery 3     │    98.39ms │                         100.72ms │     no change │
│ QQuery 4     │   928.83ms │                         929.22ms │     no change │
│ QQuery 5     │   973.20ms │                         988.39ms │     no change │
│ QQuery 6     │    33.75ms │                          36.60ms │  1.08x slower │
│ QQuery 7     │    42.31ms │                          42.33ms │     no change │
│ QQuery 8     │  1383.69ms │                        1364.35ms │     no change │
│ QQuery 9     │  1323.14ms │                        1361.55ms │     no change │
│ QQuery 10    │   351.92ms │                         413.62ms │  1.18x slower │
│ QQuery 11    │   400.63ms │                         462.88ms │  1.16x slower │
│ QQuery 12    │  1095.05ms │                        1101.34ms │     no change │
│ QQuery 13    │  1753.33ms │                        1676.37ms │     no change │
│ QQuery 14    │  1220.66ms │                        1253.31ms │     no change │
│ QQuery 15    │  1099.67ms │                        1091.86ms │     no change │
│ QQuery 16    │  2530.60ms │                        2536.06ms │     no change │
│ QQuery 17    │  2299.37ms │                        2317.53ms │     no change │
│ QQuery 18    │  5042.06ms │                        4983.43ms │     no change │
│ QQuery 19    │    94.19ms │                          95.74ms │     no change │
│ QQuery 20    │  1720.68ms │                        1493.36ms │ +1.15x faster │
│ QQuery 21    │  2074.60ms │                        1824.64ms │ +1.14x faster │
│ QQuery 22    │  5257.20ms │                        3143.86ms │ +1.67x faster │
│ QQuery 23    │ 10530.69ms │                       10229.16ms │     no change │
│ QQuery 24    │   590.29ms │                         654.78ms │  1.11x slower │
│ QQuery 25    │   489.54ms │                         523.81ms │  1.07x slower │
│ QQuery 26    │   653.48ms │                         714.03ms │  1.09x slower │
│ QQuery 27    │  2585.81ms │                        2285.59ms │ +1.13x faster │
│ QQuery 28    │ 15372.17ms │                       15562.00ms │     no change │
│ QQuery 29    │   530.70ms │                         529.82ms │     no change │
│ QQuery 30    │  1031.82ms │                        1094.30ms │  1.06x slower │
│ QQuery 31    │  1121.86ms │                        1139.77ms │     no change │
│ QQuery 32    │  4358.25ms │                        4290.06ms │     no change │
│ QQuery 33    │  5154.15ms │                        5209.55ms │     no change │
│ QQuery 34    │  5133.94ms │                        5172.32ms │     no change │
│ QQuery 35    │  1947.97ms │                        1895.07ms │     no change │
│ QQuery 36    │   270.40ms │                         262.39ms │     no change │
│ QQuery 37    │   121.52ms │                         126.73ms │     no change │
│ QQuery 38    │   143.79ms │                         141.60ms │     no change │
│ QQuery 39    │   758.06ms │                         767.78ms │     no change │
│ QQuery 40    │    52.74ms │                          56.09ms │  1.06x slower │
│ QQuery 41    │    48.60ms │                          50.59ms │     no change │
│ QQuery 42    │    64.42ms │                          63.09ms │     no change │
└──────────────┴────────────┴──────────────────────────────────┴───────────────┘

I reabased / squashed all the code in this branch so it would be easier to pull in to test in https://github.com/apache/datafusion/pull/12092

Here is the performance of this PR. Some queries are slower, some are faster.
I believe once we turn on string view everything will be faster.

Thanks @alamb It's interesting 🤔
Does this benchmark only include the change made by this PR, or does it include others?
It seems there are many queries slowed down by this PR.
Before this PR, the casting flow is
Binary(parquet) -> Binary(arrow) -> BinaryView(arrow) -> StringView(arrow)

Now, it's
Binary(paruqet) -> StringView(arrow)

Theoretically, we save the two steps (including the most expensive ones) for it. I have no idea why they would be slower.
I might try to do some profiling for the slower cases 🤔

Here is the performance of this PR. Some queries are slower, some are faster.
I believe once we turn on string view everything will be faster.

Thanks @alamb It's interesting 🤔 Does this benchmark only include the change made by this PR, or does it include others? It seems there are many queries slowed down by this PR.

It only includes changes made by this PR
The results with several other changes are here: https://github.com/apache/datafusion/pull/12092#issuecomment-2410952786 (and they are all faster 🎉 )

Before this PR, the casting flow is
Binary(parquet) -> Binary(arrow) -> BinaryView(arrow) -> StringView(arrow)

Now, it's
Binary(paruqet) -> StringView(arrow)

Theoretically, we save the two steps (including the most expensive ones) for it. I have no idea why they would be slower. I might try to do some profiling for the slower cases 🤔

I think the reason it is slower is that there are some operations in the hash grouping code that have specializations for StringArray/BinaryArray but do not (yet) have specializations for StringView.  Specifically

https://github.com/apache/datafusion/pull/12792
https://github.com/apache/datafusion/pull/12809 from @Rachelint

So while this PR makes the scan faster, the total time is slower as those paths dominated the query path.
When they are all put together we get the speedup we have been looking for

Since this PR requires a change to arrow-rs, I think there is no particular rush to merge it in -- I have a few thoughts about how to make the code a bit simpler and hope to propose some changes over the next few days

I am starting to get this PR ready

Update here is we are on track to release a version of arrow with the required fixes today and then I will merge this PR up and get it ready for review ⏲


new and create methods also work for casting to fields.

Post.create
accepts hash or namedtuple and returns a saved post model object.
Post.new
accepts hash or namedtuple and returns unsaved object.

released v0.5.7


deepsource

Codecov Report

Merging #23 (2349b3b) into master (889f4c5) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #23   +/-   ##
=======================================
  Coverage   55.15%   55.15%
=======================================
  Files          15       15
  Lines         892      892
=======================================
  Hits          492      492
  Misses        317      317
  Partials       83       83

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


chore: Delete ContractData

Deletes the ContractData struct, in favor of using contract instances.

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#5258  👈
#5256
#5248
#5232
#5231
#5229
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @spalladino and the rest of your teammates on  Graphite

Benchmark results
Metrics with a significant change:

note_trial_decrypting_time_in_ms (8): 90.5 (+315%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit ae021c04 and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
64 txs

l1_rollup_calldata_size_in_bytes
5,668
18,820
36,356

l1_rollup_calldata_gas
66,340
238,660
469,796

l1_rollup_execution_gas
659,663
941,244
1,318,203

l2_block_processing_time_in_ms
1,321
4,829
9,215 (-2%)

note_successful_decrypting_time_in_ms
190 (-12%)
538 (+1%)
1,036 (+12%)

note_trial_decrypting_time_in_ms
:warning: 90.5 (+315%)
53.0 (+6%)
60.4 (-4%)

l2_block_building_time_in_ms
18,245 (+1%)
68,504
135,585

l2_block_rollup_simulation_time_in_ms
8,258 (+1%)
28,888
56,563

l2_block_public_tx_process_time_in_ms
9,967 (+1%)
39,557 (+1%)
78,921 (+1%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
14,378 (+4%)
27,392 (+1%)

note_history_successful_decrypting_time_in_ms
1,230 (+2%)
2,509 (+1%)

note_history_trial_decrypting_time_in_ms
74.1 (+13%)
202 (+7%)

node_database_size_in_bytes
19,071,056
35,704,912

pxe_database_size_in_bytes
29,859
59,414

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
286 (+2%)
44,366
28,244

private-kernel-ordering
220 (+1%)
52,868
14,326

base-parity
1,803 (-4%)
128
311

base-rollup
720
165,787
925

root-parity
1,585 (+4%)
1,244
311

root-rollup
72.7 (+6%)
4,487
789

private-kernel-inner
661 (+3%)
73,771
28,244

public-kernel-app-logic
443 (+1%)
35,260
28,215

public-kernel-tail
172 (+1%)
40,926
28,215

merge-rollup
9.20 (+11%)
2,696
925

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
512 leaves
1024 leaves
2048 leaves
4096 leaves
32 leaves

batch_insert_into_append_only_tree_16_depth_ms
9.96 (-1%)
15.9
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.6
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.580 (-1%)
0.493
N/A
N/A
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
46.8 (+2%)
72.3 (+1%)
231
441
880 (+2%)
1,725
N/A

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
96.0
159
543
1,055
2,079
4,127
N/A

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.480 (+2%)
0.446 (+1%)
0.421
0.413
0.417 (+1%)
0.413
N/A

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
53.5
107 (+1%)
338 (+1%)
672 (+2%)
1,316 (+1%)
2,610
N/A

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
104
207
691
1,363
2,707
5,395
N/A

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.476
0.480
0.457
0.461 (+2%)
0.456 (+1%)
0.453
N/A

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
60.8

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
109

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0.531

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes

tx_size_in_bytes
22,012

Transaction processing duration by data writes.

Metric
0 new note hashes
1 new note hashes

tx_pxe_processing_time_ms
3,353 (+3%)
1,778 (+1%)

Metric
0 public data writes
1 public data writes

tx_sequencer_processing_time_ms
13.1 (+3%)
1,237 (+1%)

Merge activity

Mar 15, 3:50 PM EDT: Graphite rebased this pull request after merging its parent, because this pull request is set to merge when ready.


Provide a Python API

Hi, I was curious how the Python API is coming along.  Is there any current workaround to import the jars and use them in PySpark code?  I am currently using spark-kafka-writer version 0.3.0 - not sure if this is easily done or not...

Hello, this is just at the idea stage.
I'm not familiar enough with Python and PySpark to do it myself.

Hi,
I am working on implementing an application using PySpark and Kafka. In my application I am writing a transformed DStream to a Kafka topic. Could you please let me know if the library is supporting Python currently. Many thanks in advance.

hello, no this isn't supported at all at the moment


Ignore test_failures if the overall status is 'succeeded'

Addresses https://github.com/diogot/danger-xcode_summary/issues/73
Only parse test_failures if the overall status is not 'succeeded'.  This ensures that tests that pass via test repetition do not show up as a false negative.

@diogot, any chances of merging this?

Hi, if anyone add tests for this this feature I can merge this PR.


Update http4s-blaze-client, ... to 0.23.15

About this PR
📦 Updates

org.http4s:http4s-blaze-client
org.http4s:http4s-blaze-server

from 0.23.12 to 0.23.15
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.http4s" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.http4s" }
}]

labels: library-update, early-semver-minor, semver-spec-patch, version-scheme:early-semver, commit-count:1

Superseded by #250.


chore: refactored scenarios for readability

I created new functions with easy to read names. All assertions remain inside the scenarios.
All tests pass locally running npm run test.

I modified the two functions to use an early return. I should've thought of that! All tests passing.


Added missing multi_db=True attributes to a couple test cases.

Fixed a failure in the context processors test when running in
reverse on MySQL due to an extra query after refs #27683.

I wonder if we should raise an error in the non default database is used in a TestCase (not in TransactionTestCase) that mentions multi_db = True.

Good idea. Why wouldn't the check apply to TransactionTestCase?

Why wouldn't the check apply to TransactionTestCase?
Ahh I assumed only TestCase was branching off multi_db but it looks like TransactionTestCase does some fixture stuff as well. I stand corrected.

Looking at this code I also wonder why we don't define TransactionTestCase.multi_db = False instead to avoid using getattr(cls, 'multi_db', False) in _databases_names(). Defining it at the class level should also give it more exposures for users of IDEs.

buildbot, test on oracle.

buildbot, test on oracle.

I think this is ready, with the second commit to be refined in a separate ticket/PR.


Inherit const members in constructors

Fixes #531
This doesn't look very ideal as this basically copies everything, but not sure what should be done for those inline type literals.
Maybe we can introduce new (InterfaceName)Constants interfaces and use them:
declare var MyClass: {
  prototype: MyClass;
  new(): MyClass;
} & MyClassConstants;

What do you think? @mhegazy

that looks like a lot of duplication really. Adding a new interface per variable does not seem much better either with the global scope pollution; the intersection does not look attractive either.
I would say the issue here is that these all should be defined as classes instead of variable+interface pairs, this way you get the static inheritance for free.
I suggest we shelve this until we have updated the DOM to use the webidl as a source first, then revisit the class generation question.

I suggest we shelve this until we have updated the DOM to use the webidl as a source first

Actually this becomes a blocker when WebGL has moved every constant from interface WebGLRenderingContext to interface mixin WebGLRenderingContextBase. This way the constructor loses all constants when without constant inheritance.
Should we just add a special check for WebGLRenderingContext case as a temporary solution?

This PR now only covers mixin cases.


added benchmark for various container usage patterns

Overview
Provided new benchmarks to evaluate container management data structures
Pull request checklist

[x] I have read the contributing guide.
[x] I have agreed to the Contributor License Agreement.
[ ] I have updated the documentation.
[x] I have resolved any merge conflicts.
[ ] I have included tests that cover my changes.
[ ] All new and existing tests pass.

initial pass on my macbook just to have a note

sample run from macbook
BenchmarkContainerLinear-8                        	     200	   8146344 ns/op
BenchmarkContainerReverse-8                       	       2	 839894433 ns/op
BenchmarkContainerColumn-8                        	      10	 140948617 ns/op
BenchmarkContainerOutsideIn-8                     	      20	  80237405 ns/op
BenchmarkContainerInsideOut-8                     	       5	 213064774 ns/op

sample run from macbook
 BenchmarkContainerLinear-8                        	     200	   8488234 ns/op	 5334497 B/op	   60049 allocs/op
BenchmarkContainerReverse-8                       	       2	 833271568 ns/op	 7783504 B/op	   80053 allocs/op
BenchmarkContainerColumn-8                        	      10	 141974853 ns/op	 5334480 B/op	   60049 allocs/op
BenchmarkContainerOutsideIn-8                     	       5	 203645161 ns/op	 5334478 B/op	   60049 allocs/op
BenchmarkContainerInsideOut-8                     	       5	 216127560 ns/op	 5334161 B/op	   60043 allocs/op


4.1.6, Storybook UI visible in the background in fullscreen mode

Describe the bug
In fullscreen mode, the left panel is still visible through transparent iframe background.
Duplicate of closed ticket #4265
To Reproduce
Install @storybook/react (tested with 4.1.6)
Storybook config:
import React from 'react';
import { storiesOf, configure } from '@storybook/react';

configure(() => {
  storiesOf('Test').add('example', () => React.createElement('div'));
}, module);

Start storybook. Change layout to fullscreen.
Expected behavior
The Storybook UI is not visible in the background
Screenshots

Should be fixed in V5


onMessage not being called

I've been trying to send data from React Native App to html but I can't get it to work, problem comes with window.postMessage("hi") not activating window message listener from html. Any help is highly appreciated
import {WebView} from 'react-native-webview';
...
  const sendMessage = () => {
    const run = `
    setTimeout(() => {
      window.postMessage("hi");
      document.body.style.background = "blue";
  }, 0);
  `;

    canvasRef.current.injectJavaScript(run);
  };
...
 <WebView
            originWhitelist={['*']}
            javaScriptEnabled={true}
            source={{html: canvasHTML}}
            ref={canvasRef}
            onMessage={event => {
              console.log('hey', event.nativeEvent);
              Alert.alert(event.nativeEvent.data);
            }}
          />

Html page:
`<html><head>
    <meta content="width=device-width, initial-scale=1, maximum-scale=1, user-scaleable=no" name="viewport">
    <style>
      html {
        -ms-content-zooming: none;
        -ms-touch-action: pan-x pan-y;
      }
      body {
        position: fixed;
        top: 0;
        right: 0;
        bottom: 0;
        left: 0;
        margin: 0;
        padding: 0;
        overflow: hidden;
      }
      * {
        user-select: none;
        -ms-user-select: none;
        -moz-user-select: none;
        -webkit-user-select: none;
      }
    </style>
  </head>
  <body>
    <script>

const handleIncomingMessage = e => {

  window.ReactNativeWebView.postMessage("HEEEY");

}

window.addEventListener('message', e => handleIncomingMessage(e));
document.addEventListener('message', e => handleIncomingMessage(e));

</script>

</body></html>`;

Documentation should mention properly how to do it.
To send message from React Native to Webview -> webviewRef.postMessage(dataString);
Closing.


ERRO[0000] cannot re-exec process when executing podman image list as non root user.

Is this a BUG REPORT or FEATURE REQUEST?:
kind bug
Description
When running the the podman image list as non root user it is throwing ERRO[0000] cannot re-exec process , no able to make anything out of it.
Steps to reproduce the issue:
[docker@minishift ~]$ sudo su
[root@minishift docker]# echo docker:10000:65536 >> /etc/subuid
[root@minishift docker]# echo docker:10000:65536 >> /etc/subgid
[root@minishift docker]# exit
[docker@minishift ~]$ cat /etc/subuid
docker:10000:65536
[docker@minishift ~]$ cat /etc/subgid
docker:10000:65536
[docker@minishift ~]$ podman images
ERRO[0000] cannot re-exec process
$ podman image list
ERRO[0000] cannot re-exec process

Describe the results you received:
ERRO[0000] cannot re-exec process

Describe the results you expected:
Should show image list or atleast provide a better error message.
Additional information you deem important (e.g. issue happens only occasionally):
Output of podman version:
$ podman version
Version:       0.9.2
Go Version:    go1.10.2
OS/Arch:       linux/amd64

Output of podman info:
$ podman info
ERRO[0000] cannot re-exec process
[docker@minishift ~]$ sudo podman info
host:
  Conmon:
    package: podman-0.9.2-5.git37a2afe.el7.x86_64
    path: /usr/libexec/podman/conmon
    version: 'conmon version 1.11.4, commit: 04cc383fbe7375550d821f3afaed62b1062b2684-dirty'
  MemFree:<PHONE_NUMBER>
  MemTotal:<PHONE_NUMBER>
  OCIRuntime:
    package: runc-1.0.0-37.rc5.dev.gitad0f525.el7.x86_64
    path: /usr/bin/runc
    version: 'runc version spec: 1.0.0'
  SwapFree:<PHONE_NUMBER>
  SwapTotal:<PHONE_NUMBER>
  arch: amd64
  cpus: 2
  hostname: minishift
  kernel: 3.10.0-862.11.6.el7.x86_64
  os: linux
  uptime: 17m 1.11s
insecure registries:
  registries: []
registries:
  registries:
  - docker.io
  - registry.centos.org
  - registry.access.redhat.com
store:
  ContainerStore:
    number: 0
  GraphDriverName: overlay
  GraphOptions:
  - overlay.override_kernel_check=true
  GraphRoot: /var/lib/containers/storage
  GraphStatus:
    Backing Filesystem: xfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
  ImageStore:
    number: 0
  RunRoot: /var/run/containers/storage

Additional environment details (AWS, VirtualBox, physical, etc.):

Can you add --log-level=debug to get us a better idea of what's going on?
@giuseppe PTAL

@praveenkumar, friendly ping. Can you provide some additionals logs via --log-level=debug?

got the same issue on a RHEL7.5, the --log-level only work with sudo also.
[sv@vonbraun ~]$ podman info
ERRO[0000] cannot re-exec process

[sv@vonbraun ~]$  podman --log-level=debug info
ERRO[0000] cannot re-exec process

[sv@vonbraun ~]$ sudo podman --log-level=debug info
DEBU[0000] [graphdriver] trying provided driver "overlay"
DEBU[0000] overlay: override_kernelcheck=true
DEBU[0000] overlay test mount with multiple lowers succeeded
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=true
INFO[0000] Found CNI network podman (type=bridge) at /etc/cni/net.d/87-podman-bridge.conflist
DEBU[0000] Initializing boltdb state at /var/lib/containers/storage/libpod/bolt_state.db
DEBU[0000] Set libpod namespace to ""
host:
  Conmon:
    package: podman-0.9.2-5.git37a2afe.el7_5.x86_64
    path: /usr/libexec/podman/conmon
    version: 'conmon version 1.11.4, commit: cade65d40947e9d2c10294022cb672c4252b64e8-dirty'
  MemFree:<PHONE_NUMBER>2
  MemTotal:<PHONE_NUMBER>4
  OCIRuntime:
    package: runc-1.0.0-52.dev.git70ca035.el7_5.x86_64
    path: /usr/bin/runc
    version: 'runc version spec: 1.0.0'
  SwapFree:<PHONE_NUMBER>
  SwapTotal:<PHONE_NUMBER>
  arch: amd64
  cpus: 4
  hostname: vonbraun.gnali.lan
  kernel: 3.10.0-862.14.4.el7.x86_64
  os: linux
  uptime: 7h 45m 1.76s (Approximately 0.29 days)
insecure registries:
  registries: []
registries:
  registries:
  - registry.access.redhat.com
  - docker.io
store:
  ContainerStore:
    number: 2
  GraphDriverName: overlay
  GraphOptions:
  - overlay.override_kernel_check=true
  GraphRoot: /var/lib/containers/storage
  GraphStatus:
    Backing Filesystem: xfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
  ImageStore:
    number: 6
  RunRoot: /var/run/containers/storage

@giuseppe @nalind PTAL

got the same issue on a RHEL7.5

rootless mode is not working on RHEL 7.5 as the newuidmap/newgidmap tools are not available there so there is no way to set up the user namespace

Then looks like I also have same issue since using the centos-7.5
$ cat /etc/redhat-release
CentOS Linux release 7.5.1804 (Core)

$ podman --log-level=debug images  => nothing more even using log-level debug
ERRO[0000] cannot re-exec process

$ sudo podman --log-level=debug images
DEBU[0000] [graphdriver] trying provided driver "overlay"
DEBU[0000] overlay: override_kernelcheck=true
DEBU[0000] overlay test mount with multiple lowers succeeded
DEBU[0000] backingFs=xfs, projectQuotaSupported=false, useNativeDiff=true
INFO[0000] Found CNI network crio-bridge (type=bridge) at /etc/cni/net.d/100-crio-bridge.conf
INFO[0000] Found CNI network 200-loopback.conf (type=loopback) at /etc/cni/net.d/200-loopback.conf
INFO[0000] Found CNI network podman (type=bridge) at /etc/cni/net.d/87-podman-bridge.conflist
DEBU[0000] Initializing boltdb state at /var/lib/containers/storage/libpod/bolt_state.db
DEBU[0000] Set libpod namespace to ""

@giuseppe thanks for the update.
So I guess we can close this issue.
Any idea when the newuidmap/newgidmap will be available for RHEL, in RHEL8 maybe ?


Wnat to UPDATE [your name] Markdown

Project Request to update [your name] markdown file and route

Field
Description

Name
Nishant Jayaram Hegde

Email
<EMAIL_ADDRESS>

Github
nishant8hegde

https://github.com/Nishant9Hegde
What do you what to contribute to:

[ ] HackFest GDSC Contributor
[ ] Hacktober Fest Contributor

Add your name to the issue not [your_name] , do not create multiple issues! @Nishant9Hegde


[tf] Cleanup test dump operations

Adding cluster information to a number of error logs. Also avoiding errors when attempting to dump control plane debugging information for non-primary cluster.
Please provide a description of this PR:

@nmittler: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-telemetry-mc_istio
9ccff147c214ebbd4056c1c23fde41ccde5232ff
link
true
/test integ-telemetry-mc_istio

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


How can I deploy razzle application in Netlify?

How can i deploy razzle app in netlify with continieus delivery?
When I using create-react-app, there is no problem.
But, While I working on razzle app, I getting page not found in deployed web site.
I was connected netlify with github account and I was choose github repo for deployment.
My settings are:

I was got this warning message:

Thanks your time.

May have to do with HOST and PORT env vars being set at build time. But hard to tell, got no experience with netlify.  Was it successfull?

I was deployed create-react-app on netlify and there is no problem. I think it's cause is host environment, too. Therefore, I was containerizing my app with docker and i was published on heroku.
My dockerfile looks like this,
FROM node:13.12.0-alpine as builder

WORKDIR /app

ENV NODE_ENV publish
ENV HOST <IP_ADDRESS>

ENV RAZZLE_CUSTOM_VARIABLE x
COPY . .

RUN npm install
RUN yarn build
CMD ["yarn","start:prod"]

and I'm getting App crashed and Application error on heroku with this error code : H10
Then, I just deploy with development environment, then, html loaded but assets and css files not loaded. Development docker file looks like this,
FROM node:13.12.0-alpine as builder

WORKDIR /app
ENV NODE_ENV development
ENV HOST <IP_ADDRESS>

ENV RAZZLE_CUSTOM_VARIABLE x
COPY . .

RUN npm install
RUN yarn build
CMD ["yarn","start"]

Chrome console logs are looks like this,

Mixed Content: The page at 'https://dailyhotel.herokuapp.com/' was loaded over HTTPS, but requested an insecure script 'http://<IP_ADDRESS>:6812/static/js/bundle.js'. This request has been blocked; the content must be served over HTTPS.

Failed to load resource: net::ERR_ADDRESS_INVALID

I am thinking razzle server host's not recognized by client host.
But, I am not know, how can i solve this issue? Is there a  solution way for this issue?
Thanks your helps.

My assets and css files links are looks like above in rendered html.

You need to set PUBLIC_PATH
On Sat, 18 Apr 2020 at 23:25, Niyazi Ekinci<EMAIL_ADDRESS>wrote:

[image: image]
https://user-images.githubusercontent.com/28783949/79671593-0b3fc580-81d4-11ea-8523-7c9d80757b2c.png
My assets and css files links are looks like above in rendered html.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jaredpalmer/razzle/issues/1247#issuecomment-615952106,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAADGQ5SGCW6IY4TABXCXTRNILDZANCNFSM4MJN3OYQ
.

--
Øyvind Saltvik

Closing as resolved. Reopen if problem persists.


Tab Pinning, Tab Re-Ordering, and Search Copy

I tend to have a ton of tabs open while jumping around from reference to reference. Some of these tabs are more important than others, but when class names are obfuscated it becomes hard to keep track of the important tabs vs. the trivial tabs. Being able to pin a tab similar to how Chrome/Firefox can would be a huge help.
Being able to drag/re-order tabs to would also be a great feature. I would love to be able to group tabs in a certain vicinity of one another.
Finally, considering that there can be unlimited amount of search results it would be extremely helpful to be able to search the results that have been returned. I realize it would be ridiculous to ask for a search to search through the search results, but I feel like being able to select and copy  the text of all/selected rows (for a specific column, or both) would be extremely helpful (presently only 1 result is allowed to be selected at a time though). This way user could just paste into something like notepad++/notepad/whatever and perform a find in that to narrow the search down more. Perhaps if the search results had index #'s that would make it easier to find a narrowing match when performing the action I just described.
Hopefully these features can be implemented, but if not, no big deal. Love this particular piece of software. Thanks for all the work you've put in!

@idb- thanks for suggestions.
Some of them already requested: tab pinning in #847 and tab reordering in #1212.
Multi selection of search results can also be done (for text copy and open several tabs), but I think using regex will be easier to narrow search. Also sounds like you need something similar to bookmarks, for that you can use code comments and next search inside these comments (check https://github.com/skylot/jadx/issues/1448#issuecomment-1214413600)


The lossless music flac format file is processed with the UVR model. The flac file after processing is found to be lossy, and the model processing with demucs V4 is still lossless.

The lossless music flac format file is processed with the UVR model. The flac file after processing is found to be lossy, and the model processing with demucs V4 is still lossless.

But I want to use the UV-MDX-NET Inst 3 model, because the effect processed by this model is the cleanest backing track, but the processed audio is damaged. Is the model itself affecting the sound quality or where can it be set?

Are you referring to the 17kHz frequency cut-off the outputs from that model have? If so, there's not a way around it as that model was trained to cut off there to save resources. Sounds above that frequency range are not audible to a vast majority of people.

The Demucs V4 model supports full range, but may not remove all vocals. The MDX-NET instrumentals often sound better to the ear, although it does have a frequency cutoff at 17 kHz.


Elements inside canvas appear in browser inpector.

Is there anyway to prevent this from happening? Thanks before.

The elements are created within the txt.Accessibility API here... https://github.com/diverted247/txtjs/blob/master/src/txt/Accessibility.ts
Simply remove code in the set() and update() methods.
Thinking it makes sense to add a property to manage this... txt.Accessibility.active = true (default) and to turn it all off...  txt.Accessibility.active = false

So it is configurable then. Thank you for the instruction. And yes it would be really convenient if there's a configurable property for the accessibility.


HOSTEDCP-1327: Remove Old Azure SDKs from Azure Infra

What this PR does / why we need it:
The previous Azure infra create and destroy code was using Azure SDKs that are now deprecated. This PR replaces that code with Azure SDKs that are supported and updated.
Which issue(s) this PR fixes:
Fixes HOSTEDCP-1327
Checklist

[x] Subject and description added to both, commit and PR.
[x] Relevant issues have been referenced.
[ ] This change includes docs.
[ ] This change includes unit tests.

/area cli

/test images
/test verify
/test unit
/test e2e-aws

/approve

/lgtm

/retest


Create KMP.md

Description 📜
I have created documentation for KMP algorithm, and explained about LPS Array construction along with KMP algorithm with pictures. All the pictures in the documentation are created by me.
Fixes #3170

Type of change 📝

[X] Documentation (Content Creation in the form of codes or tutorials)

Domain of Contribution 📊

[X] DSA

Checklist ✅

[X] I follow Contributing Guidelines & Code of conduct of this project.
[X] I have performed a self-review of my own code or work.
[X] I have commented my code, particularly in hard-to-understand areas.
[X] My changes generates no new warnings.
[X] I'm GWOC'21 contributor

Screenshots / Gif (Optional) 📸

Perfect

Thank you😄🚀


raining couldn 't start

Hi,
I tried to used it as
model = Model(...)
model = nn.DataParallel(model)
model = convert_model(model)
model = model.cuda()
However, it stucked and training couldn 't start.
Have you seem similar problems before ?

See also #44 (comment)

ok, thanks a lot


IncludeSender property on Event publisher function declared in table extension uses table extension as the sender and not the table it is extending.

When I create an event publisher from within a table extension and set the include sender, the system tries to include an object of type table extension as the sender when , I believe, it should in fact be including a reference to my instance of the table that my table extension is extending. I can achieve what I need by having a "by reference" variable as a parameter to my event, but it would be nice if the include sender worked properly.

Thank you for opening the issue! We will look into this issue.

Hi @DavidRoys,
It is working today in the february update.


⚠ Samsung has degraded performance

In 2a8d1ee, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2694 ms

Resolved: Samsung performance has improved in 16c26a3.


Add transparent parameter to export_chart()?

Hello!
Would it be possible to add the transparent parameter to export_chart() in PNG/PDF/SVG?
This exists in the Datawrapper API (https://developer.datawrapper.de/docs/exporting-as-pdfsvg) and it would be very helpful to have when creating Datawrapper charts through Python! Thank you!!

Sure thing! Thanks for including the link to the documentation. Makes things a lot easier.

Thank you!! I appreciate it! I am trying, with no success, to figure out a work around!

Just released version 0.5.2! This has the transparent parameter in export_chart() (defaults to False)
Should be as easy as just adding transparent=True to your export_chart() code.
Just update datawrapper (pip install --upgrade datawrapper). Let me know if it works

Thank you so much for adding this so quickly!!! It works!
Thank you thank you! Have a lovely day!


Add Data Visualization to the App - Part 2

Tutorial URL: https://developers.sap.com/tutorials/fiori-ios-scpms-teched18-06.html
Step 1: The bar chart implemtation doesn't work. e.g. line and waterfall are working fine though.

Hi @CONCETO-flow ,
Please when working with this tutorial series use the mentioned SDK version. The mission is not fully compatible with SAP Cloud Platform SDK for iOS V 5.0. There will be a replacement soon.


Editable Articles

Acceptance Criteria

Must have table to display list of articles
Must inject html to editor and allow the user to edit the article
Must allow the user to save the article

Completed with latest commit


Telegraf Issue on Ubuntu When Adding the InfluxData repository

Description
When following the docs to add the repo for telegraf I am getting a malformed entry error when running apt-get update afterwards.
Section of the doc in question

/etc/apt/sources.list.d/influxdb.list

apt-get update command

Relevant URLs
https://docs.influxdata.com/telegraf/v1.16/introduction/installation/

Hi @ThePieMonster, I think the cause of this is that /etc/lsb-release doesn't exist on debian/ubuntu any more.  From a quick search online I get the impression that it existed on all nearly all debian/ubuntu systems in the past but that newer versions have removed it.
Could you try out some updated installation instructions?
First, clear out the broken source from the old instructions:
sudo rm /etc/apt/sources.list.d/influxdb.list
Then try these updated instructions:
wget -qO- https://repos.influxdata.com/influxdb.key | sudo apt-key add -
source /etc/os-release
echo "deb https://repos.influxdata.com/${ID,,} ${VERSION_CODENAME} stable" | sudo tee /etc/apt/sources.list.d/influxdb.list
then continue with the existing instructions:
sudo apt-get update && sudo apt-get install telegraf
sudo systemctl start telegraf

@reimda  Thanks that did the trick!
Btw, is there a way to monitor incoming requests/logs in Telegraf? Using Ubuntu

Thanks @ThePieMonster and @reimda! I created a PR to update the docs instructions. Dave, can you take a look to confirm?

The install is good now, but after a reboot I did want to mention that I am seeing this when running systemctl status telegraf.

Perhaps I made a mistake in the config or something. Anyway to get better error reporting on why the service failed to start?

@ThePieMonster What Ubuntu version are you using?  I want to try to reproduce the error you get after rebooting

@ThePieMonster What Ubuntu version are you using? I want to try to reproduce the error you get after rebooting

18.04 Server
https://releases.ubuntu.com/18.04/

Hi @ThePieMonster, I installed a vm of ubuntu 18.04 server from ubuntu-18.04.5-live-server-amd64.iso at the page you linked.  I was able to install telegraf by following the instructions at https://docs.influxdata.com/telegraf/v1.16/introduction/installation/ without any trouble.  It looks like the error you had was specific to your installation.
root@ubuntu:~# wget -qO- https://repos.influxdata.com/influxdb.key | sudo apt-key add -
OK
root@ubuntu:~# source /etc/lsb-release
root@ubuntu:~# echo "deb https://repos.influxdata.com/${DISTRIB_ID,,} ${DISTRIB_CODENAME} stable" | sudo tee /etc/apt/sources.list.d/influxdb.list
deb https://repos.influxdata.com/ubuntu bionic stable
root@ubuntu:~#

It could be that your /etc/lsb-release file has been modified or that maybe you skipped the middle step (source /etc/lsb-release).  This is what my /etc/lsb-release looks like for reference:
root@ubuntu:~# cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.5 LTS"
root@ubuntu:~#

I also rebooted and checked "systemctl status telegraf".  It reports telegraf is running with no problems.
I'm going to close this because there doesn't seem to be a problem with the docs.


Replacing deprecated React lifecycle methods

React 16.9 is throwing warnings in the console because of usage of componentWillReceiveProps in Tooltip.js.
This PR uses getDerivedStateFromProps instead of both componentWillReceiveProps and componentDidMount.

this occurs a lot too if you use react.strictmode component

@romainberger pls merge


Improve code style

Would you be interested in reviewing a PR with changes that conform to PEP 8?
I have an update for indentation and your variable name "file".

kirmar:
Thanks for offering. I would certainly take a look at your suggestions. I dabble in Python, but focus more on getting things to work than style, where I'm sure I have a lot to learn.

Resolved with PR#1.
Thanks, kirmar!

Er, make that PR #2


QR code appearence

would be nice if QR codes could be styled like this:

the ones we currently use have rather sharp edges

I use another QR library in Keytools and other sites. Which can be styled however you want. https://github.com/Joohansson/keytools/blob/master/src/tools/components/qrImageStyle.js

i think i would like it to be as close to this one as possible

solid fill, maybe 0.2 roundness or so? and much more round shapes in 3 corners

I like the blue one suggesting by @Joohansson, I also like the roundness of yours


LabelInput can't be added to Container (not a Control)

This issue was imported from Closure Library's previous home at http://closure-library.googlecode.com
The link to the original issue is:
https://code.google.com/p/closure-library/issues/detail?id=301

UI Feature request


PNG as Background, Gif as center piece.

Hello! Im trying this library (Awesome btw). I use to put a frame into some images for a pet project.
Now im try to pute a frame into a gif but i cant seems to do it.
Any ideas?

Unfortunately, you cannot use animated GIF as a layer, otherwise it will lose animation. Please see https://github.com/coldume/gd-enhancer/issues/12


Fixed typo

"AlteranteKey_LicensePlate" -> "AlternateKey_LicensePlate"

Hi @LayZeeDK, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;

Thanks again


Missing data

Individual CMORPH files seem to only contain data for the 00:00 and 00:30 timestamps, rather than the full 48 observations per day. I'm not sure if this is because data is missing from the files, or whether the data is stored as one file per hour but only the 00:00 files were downloaded for each day.
e.g.
ncdump -h /g/data/ia39/aus-ref-clim-data-nci/cmorph/data/v1.0/30min/8km/2021/01/CMORPH_V1.0_ADJ_8km-30min_2021013100.nc
netcdf CMORPH_V1.0_ADJ_8km-30min_2021013100 {
dimensions:
time = 2 ;
lat = 1649 ;
lon = 4948 ;
nv = 2 ;

@apepler - I've assigned this issue to @paolap who manages this dataset. I think Paola is back from leave next week.

Hi Acacia, I'm back at work, I will check what's happening tomorrow as today gadi is down. The original files should have 2 time steps, so maybe we've downloaded by mistake only the 00 files as you mentioned

Ok I can see what's wrong in the code, also it looks like the data has been migrated and finally also recent years are available so I will update the repo and download the data from the new portal from scratch

I started the download backwards from 2023, it will take sometime as while the files are small there's a huge amount of them.


clock refresh

After opening hte trip planner, the clock doesn't automatically update when you select your trip O/D, nor does it update after you search your trip.

duplicate


Not save last time selected in  "Move to Resource  "

this is good work!
I like it very much

Every time you need to choose, so it is not convenient.

Which item do you mean? Or do you want to omit the whole dialog?

1st.
Resource:

It remembers the last selection, but if you have a resource file in the current assembly, it defaults to the resources of the assembly.
This is because if it only remembers the last selection, I frequently ended up with resources added to the wrong assembly.
It currently assumes that you have either one single resource assembly per solution, or one resource per assembly. In the latter case you rather want to add resources to the local assemblies resources than to the resources of another assembly - so I implemented it this way.
Any idea how this could be improved without breaking the current workflow?

@maikebing any proposals on this?

We recently had a Chinese New Year holiday, and my child will soon be born, so I'm sorry to reply to you so late!
We can use a common resource file for each assembly by default! Those who do not have the resources of the document can be used by default, such as class!
Forms, controls, components and other resources of the document is directly added to the string in their own resources document.

如果有选项更好， 我可以选择 是按照上面的方式， 或者是所有字符串资源都放在一个资源文件中。
If there are options better, I can choose is in accordance with the above way, or all the string resources are placed in a resource file.

I have made some improvements, that should increase usability:

if the assembly containing the source file has a resource, this is the first entry
the resource that you used during the last operation will be the second entry
then all other entries follow as before

This way it's fast changing from the recommended to the last used entry...

@maikebing did you try it?

I assume this is fitting your needs...


git-cliff: 2.4.0 -> 2.5.0

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/orhun/git-cliff/releases.
meta.description for git-cliff is: Highly customizable Changelog Generator that follows Conventional Commit specifications
meta.homepage for git-cliff is: https://github.com/orhun/git-cliff
meta.changelog for git-cliff is: https://github.com/orhun/git-cliff/blob/v2.5.0/CHANGELOG.md
Updates performed

Rust version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.5.0 with grep in /nix/store/x0lkcy45glrk2l568fw5l8clfnp8wafh-git-cliff-2.5.0
found 2.5.0 in filename of file in /nix/store/x0lkcy45glrk2l568fw5l8clfnp8wafh-git-cliff-2.5.0

Rebuild report (if merged into master) (click to expand)

2 total rebuild path(s)

2 package rebuild(s)

First fifty rebuilds by attrpath

git-cliff

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/x0lkcy45glrk2l568fw5l8clfnp8wafh-git-cliff-2.5.0 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A git-cliff https://github.com/r-ryantm/nixpkgs/archive/079282d04a8fd36c5f49537f7f0148f3ba7385b9.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/079282d04a8fd36c5f49537f7f0148f3ba7385b9#git-cliff

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/x0lkcy45glrk2l568fw5l8clfnp8wafh-git-cliff-2.5.0
ls -la /nix/store/x0lkcy45glrk2l568fw5l8clfnp8wafh-git-cliff-2.5.0/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

git-cliff

Maintainer pings
cc @siraben for testing.

[!TIP]
As a maintainer, if your package is located under pkgs/by-name/*, you can comment @NixOS/nixpkgs-merge-bot merge to automatically merge this update using the nixpkgs-merge-bot.

Add a :+1: reaction to pull requests you find important.

@ofborg eval

Result of nixpkgs-review pr 337027 run on x86_64-darwin 1

1 package built:

git-cliff


http: Add support for searching guild members by query

This adds the /guilds/:ID/members/search endpoint as documented poorly in https://github.com/discord/discord-api-docs/pull/1577. Most important differences found in testing are that the limit is 100 and not 1000 and the GUILD_MEMBERS intent is required. This has been accounted for in the documentation.
The new method is exposed via Client.search_guild_members:
    let members = client
        .search_guild_members(GuildId(100), String::from("Wumpus"))
        .limit(10)?
        .await?;

Closes #583

Not sure if it's documented well on twilight's end but the gateway version also has a limit of 100 when gateway intents are enabled and a query is specified.

Not sure if it's documented well on twilight's end but the gateway version also has a limit of 100 when gateway intents are enabled and a query is specified.

It's not. Also just leaving a drive-by comment to clarify that I marked this as a draft because this feature isn't yet in the API docs.

Reopening, will rebase and fix any issues due to the PR being merged. 🙃


0.4.0 / Unicorn Delayed Jobs logs

I updated my Rails according to this patch:
http://weblog.rubyonrails.org/2013/2/11/SEC-ANN-Rails-3-2-12-3-1-11-and-2-3-17-have-been-released/
and Delayed Job was updated to 0.4.0 at the same time.
I'm running Unicorn.
When I run my app now, Delayed Job seems to be spitting out much more to the logs.
Perhaps this is just a new logging feature that I was unaware of or is this not expected behaviour?

I'm facing the same issue in my production environment. I understand that DelayedJob polls DB every 5 seconds but there should be a way to silence it. Having said that the actual DelayedJob execution logs should be present in the logs. The above solution looks good but my concern is that it should not silence other DelayedJob logs.

DJ can have its own logger for AR too, no need for the hassle in the patch above. I just added the following line to config/initializers/delayed_job_config.rb:
Delayed::Backend::ActiveRecord::Job.logger = Logger.new(Rails.root.join('log', 'delayed_job_ar.log'))

@xHire I'm afraid that your change will send all ActiveRecord logs to delayed_job_ar.log file, not only those from DelayedJobs gem.

@wpsamurai Ah, I didn’t notice it, but when I do run grep -v delayed_jobs I see that you are right. I’ll have yet to find out a way to restrict the initializer to affect only the DJ daemon then. Thank you for pointing this out! :+1:

This worked well for years, but after upgrading to Rails 6.0 / 6.1 I get
```NameError: undefined method reserve' for class #Class:Delayed::Backend::ActiveRecord::Job'````
Any idea how to fix this again?

I can answer my own question and contribute to the solution. Based on your work, I found this approach to be working for me in Rails 6.1.3:

Create a new file for the patch in /lib

# /lib/patches/delayed_job.rb

module Delayed::Backend::ActiveRecord
  class Job
    self.singleton_class.prepend(
      Module.new do
        def reserve(*)
          previous_level = ::ActiveRecord::Base.logger.level
          ::ActiveRecord::Base.logger.level = Logger::WARN if previous_level < Logger::WARN
          value = super
          ::ActiveRecord::Base.logger.level = previous_level
          value
        end
      end
    )
  end
end

Make sure the patch is loaded. I did it by creating a new initializer for all custom patches

# /initializers/patches.rb

Dir.glob(Rails.root.join('lib/patches/**/*.rb')).sort.each do |filename|
  require filename
end

Nowadays, I use the following patch, which effectively separates DJ-related AR logging without affecting the rest of my application:
--- a/bin/delayed_job	2017-05-02 11:08:24.809361621 +0200
+++ b/bin/delayed_job	2020-03-19 17:23:27.338214244 +0100
@@ -2,4 +2,5 @@

 require File.expand_path(File.join(File.dirname(__FILE__), '..', 'config', 'environment'))
 require 'delayed/command'
+Delayed::Backend::ActiveRecord::Job.logger = ActiveSupport::Logger.new(Rails.root.join('log', 'dj_ar.log'))
 Delayed::Command.new(ARGV).daemonize

Might be helpful for folks who don’t want to disable the logs altogether (or can log into /dev/null without monkey patching log levels). Tested with Rails 6.0.


zos create Counter fails with not helpful error

Is it a breaking change? Because it used to work at v2.3. I am getting spoiled by interactivity 😄

Okay. There was a problem with my build folder. Once I deleted it everything started to work. Not sure what was wrong there but some error check for path argument would be good.

some error check for path argument would be good

Do you know which path failed?

No. This is the only output I got.

@ylv-io I'm not being able to reproduce, can you dig a bit more deeper?

Can't reproduce it anymore. I think it was caused by my corrupt build folder. Let's close it for now if it happens again I'll add more details.


Allow JavaScript errors to be raised as exceptions

When configured, upon visiting a page:

The driver checks that no JavaScript errors are present on the page.
If JavaScript errors are present then an exception is raised.
The exception includes the JavaScript error messages:

#<Capybara::Webkit::JavaScriptError: {:line_number=>5, :message=>"ReferenceError: Can't find variable: undefinedFunc", :source=>"http://<IP_ADDRESS>:56520/"}>

Motivation
On a project using capybara-webkit the test-suite passed despite a critical JavaScript minification bug. Because the specs didn't defensively assert that error_messages are empty on each navigation, the bug wasn't caught.
I think this option acts as a good safeguard — a strict mode if you will — and will also aid debugging during the TDD cycle. If a failing scenario (now implemented) is still failing, this could speed up figuring out that the failure is due to a different reason than you thought it was.
This feature is inspired by Poltergeist which has an option to raise JS errors as exceptions.

Questions

This could also check & raise JavaScript errors on other interactions, like clicking a button. Would this be helpful too?

Disregarding the Hound single-quoted strings warnings because most of the changes match the current formatting of the files changed, and the thoughtbot Ruby styleguide states:

Prefer double quotes for strings.

We could disable this check by adding a .rubocop.yml entry for this rule like this.

I think this is a good general idea, but I'm not sure where the errors should actually be raised. Raising errors in visit will only catch errors that happen when you first load the page. If the error occurs in a click handler, Ajax request, or something else, it will be raised in the next visit (or not at all).
We may actually want to build this into the command layer between the client and the server, so that the driver will raise an error if there are ever page errors after performing a command.

Ok that's a good direction to head in, I think making the error check apply to all actions makes sense. I'll push this down to the command layer.


Invalid state; requests can only be made in the LoggedIn state, not the SentClientRequest state

This issue arises when calling one request then refreshing the page. I have the code that I have wrote for this if anyone is interested in duplicating it.
http://c9754731.r31.cf2.rackcdn.com/WebServicesServlet_Exam.zip
All you have to do to set this up (I built it and use it on windows so I dont know how it will work on linux lol). You just need to setup the ConnectionConfig.js file in the lib folder with your connection info and then modify the gateway test method.
Any help with this would be greatly appreciated!!!

I'm sorry, I've not had time to look at this yet. I'll take a look at the weekend.

I've recreated the problem with your code, and I think that I understand the problem.
The error that is reported, Invalid state; requests can only be made in the LoggedIn state, not the SentClientRequest state, indicates that there has been an attempt to execute a second request on a connection while one is already in progress. Concurrent requests (on a single connection) are not supported. This should probably be made clearer in the documentation.
Your code always causes this problem on the second request. Each page request results in a call to this code.
controller.execute = function(session, admin, sqlCommand) {
    var MSSqlConnection = require('./MSSqlConnection');

    MSSqlConnection.on('connected', function(connection){
            console.log('connected');
            _performQuery(connection, sqlCommand.toString());
    });

    ...
}

Your MSSqlConnection variable is a singleton, because require caches modules. So when this code is called for the second page request, a second listener is added for the MSSqlConnection's connected event. When the connected event is emitted from MSSqlConnection, both listeners are called. This results in two calls to the Tedious Connection object's execSql function. The second call occurs before the first request has completed, and the state machine in Connection detects and reports the problem.
I will leave the issue open until I have updated the documentation to make it clear that only one request can be performed on a connection at a time.

Documentation updated.
commit 6eb911a7b7

Hi,
I understood the above clearly, and tried to stick to it in my application.
The code below, do the following:

Every 1 second, fetsh the data from the server (fetchStock function) and save it in temporary array,
Every 1 second, send the data saved in the temporary array to the client using the Server-Sent Events (SSE) API.

It looks the 1 second, is not enough, so I got getting the error mentioned here, many times, so i increased it to 5 second, but still git it from time to time.
Is there a way to use Promise().then to be sure the fetchStock  function is not re-called before the first call be completely executed.
var Request = require('tedious').Request;
var Connection = require('tedious').Connection;
var config = {
     userName: 'sa',
     password: 'pswd',
    server: 'xx.xxx.xx.xxx',
    options: {
    	database: 'DB',
             rowCollectionOnRequestCompletion: 'true',
             rowCollectionOnDone: 'true'
     },
 };
var sql = new Connection(config);

var addElem = (obj, elem)=> [].push.call(obj, elem);
var result = {}, tmpCol = {}, tmpRow = {};
module.exports = {

  displayStock: function (es) {
	  var dloop = setInterval(function() {
	  if(result.error !== null)
	        if (es) es.send(JSON.stringify(result), {event: 'rmSoH', id: (new Date()).toLocaleTimeString()});
	  if(result.error === null)
	        if (es) es.send('connection is closed');
      }, 1000);
  },

  fetchStock: function () {
            request = new Request("SELECT ItemCode, WhsCode, OnHand FROM OITW where OnHand > 0 and (WhsCode ='RM' or WhsCode ='FG');", function(err, rowCount, rows) {
		    if (err) {
			result = {'error': err};
			console.log((new Date()).toLocaleTimeString()+' err : '+err);
		     }
             if(rows)
		     rows.forEach(function(row){
				 row.forEach(function(column){
				     var colName = column.metadata.colName;
				     var value = column.value;
				     addElem(tmpCol, {colName: value})
				 });
			 addElem(tmpRow,{'item': tmpCol[0].colName, 'Whs': tmpCol[1].colName, 'Qty': tmpCol[2].colName});
			 tmpCol = {};
		   });
		   result = tmpRow;
		   tmpRow={}
	   });
    sql.execSql(request);
  }
}

I am still getting the same issue, please look at the code below:
var Connection = require('tedious').Connection;
var Request = require('tedious').Request;
var TYPES = require('tedious').TYPES;

var config2 = {
    userName: 'dbuser',
    password: 'dbpass',
    server: 'mysqlserver.com',
    options: {
        database: 'msdb'
    }
};

var connection = new Connection(config2);
    connection.on('connect', function(err) {
        if(err) {
            console.log("Database connection is not established: \n"+err);
            process.exit(0);
        } else {
            console.log("Connected");  // If no error, then good to proceed.
            createTableOperation();
        }
    });

function createTableOperation() {
    var query = "CREATE TABLE ClientDetailsTest(CLIENT_ID CHAR(5) PRIMARY KEY, CLIENT_NAME VARCHAR(25), CLIENT_CHANNEL VARCHAR(25))";

    request = new Request(query, function(err){
        if(err) {
            console.log("Error while creating table: "+err);
            process.exit(0);
        }
    });
    connection.execSql(request);
}

@swapnilkadu What error are you seeing exactly? Do you see any of the console.log statements?

I am wondering how the above issue of @swapnilkadu fixed? I am having the same issue. Any pointers?


bun install break

Describe the bug
You are currently using an unsupported runtime. Only Node.js v18 or higher is officially supported. Continue at your own risk.
Reproduction
macOS, just install bun by homebrew, no nodejs.
run
bunx shadcn-svelte@latest add accordion

Not only accordion, every components with the same issue.
Logs
No response
System Info
System:
    OS: macOS 15.1
    CPU: (8) arm64 Apple M1
    Memory: 66.56 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    bun: 1.1.29 - /private/tmp/bun-node-6d43b3662/bun
  Browsers:
    Chrome: 129.0.6668.60
    Safari: 18.1
  npmPackages:
    @sveltejs/kit: ^2.6.1 => 2.6.1
    bits-ui: ^0.21.15 => 0.21.15
    cmdk-sv: ^0.0.18 => 0.0.18
    lucide-svelte: ^0.446.0 => 0.446.0
    mode-watcher: ^0.4.1 => 0.4.1
    svelte: ^5.0.0-next.260 => 5.0.0-next.260

Severity
annoyance

This is expected behavior. We don't develop/test for the bun; we develop/test for Node. If all works then there isn't an issue, just ignore the warning 😃


Intersects geometry in search appears limited to 8K bytes in version >= 0.3.5

When running searches that include an "intersects" for complex geometries, I am seeing this error:
ERROR:  index row requires 293792 bytes, maximum size is 8191
The "293792 bytes" seems to correspond to the size of the input geometry.
The error does not occur for simpler geometries (I ran one that was a simple polygon covering the same area loosely as the complex polygon) nor in earlier versions of pgstac. Below is the stack trace from the database when running a search with one collection and an intersects of California, although I left off the first two notices of NOTICE:  ARGS after array cleaning:  since the geometry value is so long. Happy to provide the specific California geometry if needed.
NOTICE:  Checking if update is needed.
NOTICE:  Stats Last Updated: <NULL>
NOTICE:  TTL: 1 day, Age: <NULL>
NOTICE:  Context: off, Existing Total: <NULL>
NOTICE:  Time for just the explain: 00:00:00.428574
NOTICE:  Time for explain + join: 00:00:00.431062

ERROR:  index row requires 293792 bytes, maximum size is 8191
CONTEXT:  SQL statement "INSERT INTO search_wheres SELECT sw.*

    ON CONFLICT (_where)

    DO UPDATE

        SET

            lastused = sw.lastused,

            usecount = sw.usecount,

            statslastupdated = sw.statslastupdated,

            estimated_count = sw.estimated_count,

            estimated_cost = sw.estimated_cost,

            time_to_estimate = sw.time_to_estimate,

            partitions = sw.partitions,

            total_count = sw.total_count,

            time_to_count = sw.time_to_count"
PL/pgSQL function where_stats(text,boolean) line 189 at SQL statement
SQL statement "SELECT where_stats(search._where, updatestats)"
PL/pgSQL function search_query(jsonb,boolean,jsonb) line 41 at PERFORM
PL/pgSQL function search(jsonb) line 71 at assignment
SQL state: 54000

Thank you!

What is the vertex count on that geometry?
At Planet I think we forced customers to submit about 400 vertex geometries to prevent to complex of computational geometry demand on intersection tests. Or maybe it was a bandwidth thing? Either way, is there a reason it has to have all the vertices? Maybe some of that work can be pushed onto the client?

Good question! It is a very complex polygon so ~10K vertices. I think the benefit of allowing for somewhat detailed polygons for larger areas is then you can be very specific on what you capture with the intersects search if your items happen to have relatively small geometries. 10K vertices is more than needed, but the earlier versions of pgstac didn't have this limitation so I thought maybe it wasn't on purpose.

@zstatmanweil the maintainers probably did it on purpose. probably thinking of high availability for services and not letting computational geometry bog things down.
But I agree with you, that the vertex limit should be someplace else in the service definition, so STAC maintainers who care less about availability and more about detail can have that option.
Say hello to Chips and Caitlin for me!

@davidraleigh , haha will do! Its such a small geospatial world :)
Well I am happy to close it if the maintainers say it is as desired.

It looks like if we change the primary key on the search_wheres table to use a hash that we can get rid of this issue. While this is definitely a bug, I would expect that performance with use geometries that large isn't going to be that great in any case!


errors: errorString JSON marshaled

I would be very convenient to be able to JSON marshal an error created with errors.New() (ie. *errorString)
Right now it is just not possible.
I purpose this solution:
https://github.com/gin-gonic/go/commit/a79095c87e671d0ec2d62d96db957bfe8fb531c0

C.f. #8778 and #5161

Nice! thanks!

#8778 and #5161
My two cents:
We should not use Error() to marshal an error. I may have a custom error like:
type MyError struct {
    Code int `json:"code"`
    Message string `json:"message"`
}

func (err *MyError) Error() string {
    return fmt.Sprintf("[%d] %s", err.Code, err.Message")
}

If I JSON marshal it, nobody would expect:
error: "[2] this is a error"

instead:
error: {"code": 2, "message": "this is an error"}

We have to fix errorString, the error interface is just that, a interface. No Magic.

We don't want to let the low-level errors package import the encoding/json package.  That will bring encoding/json, and all of its dependencies, into all sorts of programs that don't need it.
But it might work to implement a MarshalText method.

@ianlancetaylor that makes sense! I implemented MarshalText() for you.
https://github.com/gin-gonic/go/commit/52d7945d572c3546a7e47ad56b887cf641cd86e1
it works perfectly fine. I also reviewed the source code of json package and looks safe.

Let me introduce an use case:
The Gin frameworks provides some facilities for error management during a http request. Basically it provides a tool to collect any error or several ones. Each error is defined internally as:
type errorMsg struct {
	Error error       `json:"error"`
	Type  int         `json:"-"`
	Meta  interface{} `json:"meta"`
}

Then, by using a middleware you can read the list of errors, and do whatever you want: write the errors is a log, send to sentry, write in the http response...
Simple error handler:
func errorHandler(c *gin.Context) {
    c.Next()

    if len(c.Errors) {
        c.JSON(-1, c.Errors) // this does not work as expected
    }
}

As you can see, if the canonical value of the Error field is an instance of *errorString it will not work as expected since the error message is not marshalled.

Not all errors are from errors.New, what if the error is a custom error
type implemented in user code?
I think you could just implement MarshalText method on the object
you want to marshal.

Not all errors are from errors.New, what if the error is a custom error
type implemented in user code?

what is the problem? I am not talking about error, I only want to fix errorString.
https://github.com/gin-gonic/go/commit/52d7945d572c3546a7e47ad56b887cf641cd86e1
If the error is a custom error, for example:
type MyError struct {
    Code int `json:"code"`
    Message string `json:"message"`
}

func (err *MyError) Error() string {
    return fmt.Sprintf("[%d] %s", err.Code, err.Message")
}

you don't have to implement MashaslJSON() or MarshalText at all. The JSON package uses reflexion to generate the json string from the exported field.

What if the error is in user code that doesn't implement MashaslJSON
or MarshalText and doesn't have exported fields? Is marshaling to "{}"
acceptable?
http://play.golang.org/p/5d08Ec2rdQ

@minux ok, I see your point now.
how about this solution, modifying the json package:

Try MarshalJSON(), continue if not implemented
Try MarshalText(), continue if not implemented
If interface is error, use Error()

I don't think we can do this. Users might already depend on their error types not being marshalled using the Error method, and such a change would break their code.
To address your specific case, why don't you make your JSON method recognise error values and handle them specially?

Design issues aside, your proposed solution introduces a circular dependency because encoding/json depends on the errors package. I do not know how you got it to work.

See also #3353

I'm not convinced that having automatic marshaling of errors is a good thing.
If something returns an error, it could be any one of many different types,
not all of which may be designed to be marshaled. Moreover there's no way that
we can provide enough information in the resulting JSON (or YAML or ...)
that the original error can be reassembled.
Implementing MarshalText on errors.errorString is never going to be that useful.
If you're marshaling an error, you're almost certainly making a mistake.
For the record, our approach to error marshaling is to have a function
that is called to explicitly transform errors to marshalable values,
for example:
func(err error) (httpStatus int, errorBody interface{})

That function can inspect the error and decide on how it should
be represented as an HTTP response (in this case), falling back
to using the error string if it doesn't fit with any of the known types.
This is not something that can be done by the individual error types themselves,
as an error may be used in many different marshaling contexts.

I agree with Roger.