What am I doing wrong?

Hi, I followed the example, and nothing is happening. Libraries are loaded OK, but images (jpg for example) are not reducing its size.
Is there a way to check if I am doing everything right?
My code is:
error_reporting(E_ALL);
ini_set('display_errors', 1);
$loader = require DIR.'/../vendor/autoload.php';
$loader->addPsr4('ImageOptimizer\', DIR.'/ImageOptimizer');
$factory = new \ImageOptimizer\OptimizerFactory(array('ignore_errors' => false));
$optimizer = $factory->get();
$filepath = 'imagen.jpg';
$optimizer->optimize($filepath);
//optimized file overwrites original one
Then, I get the following error: "Fatal error: Uncaught exception 'ImageOptimizer\Exception\Exception' with message 'All optimizers failed to optimize the file: imagen.jpg' "
Thanks in advance!

Is there a way to check if I am doing everything right?

I have the same question, I did everything as it is written in the example but nothing happens can the author still deign to answer this question? And then I myself spent half a day to understand what the trouble is and did not find the answer

@franciscoortiz16 @Jlomaka see https://github.com/psliwa/image-optimizer/issues/30, It is possible you are experiencing the same problem. (For me it worked locally, in production nothing happened, debugging got me to this problem)

same

same issue

I think it is best to debug the actual command sent to execute the optimization, and try to run it manually on the server/machine. You will probably see a more verbose output to identify your problems.

I added new section to the README that answers this question: https://github.com/psliwa/image-optimizer#i-got-all-optimizers-failed-to-optimize-the-file


User-customizable skin colors

Added the ability for a user to customize the colors of a skin.

Fixes #53


fix a race condition with debugger startup

fix a race condition when starting the debugger (using an isolate before it was registered) - fix https://github.com/dart-atom/dartlang/issues/1044
regen the analysis server protocol

@danrubel

LGTM


PDO::SQLSRV_ATTR_QUERY_TIMEOUT not work.

.+Please check the FAQ (frequently-asked questions) first. If you have other questions or something to report, please address the following:
+## PHP Driver version or file name
+5.2.0
+## SQL Server version
+2012
+## Client operating system
+ubuntu 16.04
+## PHP version
+7.0
+## Microsoft ODBC Driver version
+17
+## Table schema
+
+## Problem description
+PDO::SQLSRV_ATTR_QUERY_TIMEOUT not work.
+## Expected behavior and actual behavior
+$db->query() should return after 1 second but 270 seconds
+## Repro code or steps to reproduce
+$dbh = new PDO(..., [PDO::SQLSRV_ATTR_QUERY_TIMEOUT => 1]); // success
+sleep(10); // while it sleep, I disable the network interface
+$dh->query() // this will block about 270 second

@hzw-the-programmer I can't seem to reproduce this. How long did you disable the network interface for? Before the sleep was over or longer?
Also, please give this a try:
$t0 = microtime(true);
$stmt = $conn->query("WAITFOR DELAY '00:00:10'; $your_query");
var_dump($conn->errorInfo());
$t1 = microtime(true);
echo "Time elapsed: " . ($t1 - $t0) . " sec\n";

I tried the above by disabling the network for less than 10 seconds, and I got this
array(3) {
  [0]=>
  string(5) "HYT00"
  [1]=>
  int(0)
  [2]=>
  string(63) "[Microsoft][ODBC Driver 17 for SQL Server]Query timeout expired"
}
Time elapsed: 13.885461091995 sec

Thanks. I tried, but not work.
I disabled the network interface (ifconfig enp0s3 down) before the execution of the query until it throws exception.
I want to simulate this: after connection success, do some query, then network broke, query again.
and at this query, I want to get error or exception quick not block for a long time.
Here is my code and comment:
`
 PDO::ERRMODE_EXCEPTION,
    PDO::SQLSRV_ATTR_QUERY_TIMEOUT => 2 // this does not work as I expected.
]);

echo "before sleep\n"; // after this display, I disable the network interface: ifconfig enp0s3 down.
sleep(10);
echo "after sleep\n"; // when this display, network interface is already down.

$start = microtime(true);
try {
    echo "before query\n"; // this will display.
    $dbh->query("WAITFOR DELAY '00:00:10'; SELECT 1"); // it blocks here for about 242 seconds.
} catch (PDOException $e) {
    print_r($e->errorInfo); // this will run after about 242 seconds, not as I expected 1 second.
}
echo "cost: " . (microtime(true) - $start) . PHP_EOL;
`
Here is the output:
`
before sleep
after sleep
before query
Array
(
    [0] => HYT00
    [1] => 0
    [2] => [Microsoft][ODBC Driver 17 for SQL Server]Query timeout expired
)
cost:<PHONE_NUMBER>3932
`

@yitam Thanks. I tried, but not work.
I disabled the network interface (ifconfig enp0s3 down) before the execution of the query until it throws exception.
I want to simulate this: after connection success, do some query, then network broke, query again.
and at this query, I want to get error or exception quick not block for a long time.
Here is my code and comment:
<?php
$server = '<IP_ADDRESS>'; //$argv[1];
$user = 'sa'; //$argv[2];
$passwd = '123456'; //$argv[3];

$dsn = "sqlsrv:Server=$server;Database=test;LoginTimeout=5";

$dbh = new PDO($dsn, $user, $passwd, [
    PDO::ATTR_ERRMODE => PDO::ERRMODE_EXCEPTION,
    PDO::SQLSRV_ATTR_QUERY_TIMEOUT => 2 // this does not work as I expected.
]);

echo "before sleep\n"; // after this display, I disable the network interface: ifconfig enp0s3 down.
sleep(10);
echo "after sleep\n"; // when this display, network interface is already down.

$start = microtime(true);
try {
    echo "before query\n"; // this will display.
    $dbh->query("WAITFOR DELAY '00:00:10'; SELECT 1"); // it blocks here for about 242 seconds.
} catch (PDOException $e) {
    print_r($e->errorInfo); // this will run after about 242 seconds, not as I expected 1 second.
}
echo "cost: " . (microtime(true) - $start) . PHP_EOL;

Here is the output:
before sleep
after sleep
before query
Array
(
    [0] => HYT00
    [1] => 0
    [2] => [Microsoft][ODBC Driver 17 for SQL Server]Query timeout expired
)
cost:<PHONE_NUMBER>3932

@yitam Sorry, I misunderstand the use of PDO::SQLSRV_ATTR_QUERY_TIMEOUT.
But why query() blocks when network is broken?
How to prevent this? Is there another configuration for this (detect network errors.)?

hello @hzw-the-programmer
When the network is down, I'm not even sure if communication from the server to the client driver is possible. Also, based on your more detailed script above, when did you re-enable the network interface?
Nonetheless, it should have failed sooner with some error message like broken connection or something like that.
What ODBC driver and unixODBC versions are you using? With ODBC 17.2, the latest PHP drivers (5.3.0) supports connection resiliency, which attempts to reconnect when the connection is broken.
Are you using connection pooling by any chance?

@yitam Thanks. I miss understand the use of PDO::SQLSRV_ATTR_QUERY_TIMEOUT.

Ok @hzw-the-programmer
Let us know if you have other questions. If we don't hear from you we will close this issue. Thanks!

Closing this issue @hzw-the-programmer. Please feel free to reopen if you have any other questions.


Eget: Add version 1.0.1

Eget is the best way to easily get pre-built binaries for your favorite tools. It downloads and extracts pre-built binaries from releases on GitHub.

This is what it does. More information can be found on https://github.com/zyedidia/eget
It is licensed under MIT License.
Its FAQ page is https://github.com/zyedidia/eget#faq

Closes #8521

[X] I have read the Contributing Guide.

/verify

Done @rashil2000

/verify

First 64bit, then 32bit
#/dl.7z is not required

Done. Anything else?


⚠ Bofrost.be has degraded performance

In bcc37bc, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1149 ms

Resolved: Bofrost.be performance has improved in aed0112 after 13 minutes.


Doesn't work at all just times out

Hi,
Trying to translate from 'en' to 'hu' but it does not work at all. I tried it on Windows and Ubuntu and the same thing happened. See:
# python3 -m srt_deepl -i en -o hu -v -vv /t/srt
Traceback (most recent call last):
  File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.8/dist-packages/srt_deepl/__main__.py", line 112, in <module>
    translate(
  File "/usr/local/lib/python3.8/dist-packages/srt_deepl/main.py", line 84, in translate
    proxies = get_proxies()
  File "/usr/local/lib/python3.8/dist-packages/srt_deepl/utils.py", line 10, in get_proxies
    table_rows = Text(driver, "XPATH", "//tr[@role='row']", multiple=True).text
  File "/usr/local/lib/python3.8/dist-packages/srt_deepl/elements.py", line 10, in __init__
    WebDriverWait(driver, 100).until(lambda driver: find_element(*locator))
  File "/usr/local/lib/python3.8/dist-packages/selenium/webdriver/support/wait.py", line 80, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:

I get the exact same error message on Windows.
Please advise what to do. Thanks!

@sinedie Hey, thanks for the quick reply! I managed to make it work however a totally different way. I am using tor service now. Here is what I did:
First, I tried to use what you have under examples/tor_driver.py however that did not work at all under Windows. I ran into this issue: https://stackoverflow.com/questions/56052021/which-is-the-valid-firefox-binary-path-for-python-tbselenium and it is stated there that Windows is not supported. I also have a Linux box (Ubuntu) but that is a headless server with no GUI just CLI, and I didn't want to mess up my Linux server by experimenting there... Instead, as suggested in the above link, now I run the tor service on port 9050 on my Windows PC. Instructions on how to do this can be found here:
https://deepdarkweb.github.io/how-to-install-tor-on-windows-without-the-tor-browser-running-tutorial/
Once the tor service (not the tor browser!) is up and running in the background, I can use that service with your program like this:
from selenium import webdriver
from srt_deepl import translate

profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.socks", "<IP_ADDRESS>")
profile.set_preference("network.proxy.socks_port", 9050)
profile.set_preference("network.proxy.socks_version", 5)
profile.update_preferences()
driver = webdriver.Firefox(firefox_profile=profile)

translate(
    "D:\\srt", # directory where the srt files are
    "en", # original language
    "hu", # desired language
    wrap_limit=50,
    delete_old=False,
    driver=driver,
)

This works.
However, since the translated text has UTF8 characters in it, your script as it is could not save the translated srt file! To fix this bug I had to patch your srt_parser.py file and change a line (near the very bottom of the file) from this:
with open(f"{file_name}_{lang_to}.srt", "w") as file_out:
to this:
with open(f"{file_name}_{lang_to}.srt", "w", encoding="utf-8") as file_out:
(This solution was suggested here: https://stackoverflow.com/questions/27092833/unicodeencodeerror-charmap-codec-cant-encode-characters )
This is a must when using Python 3 in Windows at least when the resulted translation have one or more UTF8 characters.

Thats beautiful, I'm glad it worked. I will make those changes (at least the utf-8 issue) as soon as possible. Also, feel free to PR if u want. Thanks for notice this :D

Yeah, I won't create a PR. I leave the patching to you. ;)
But I think this needs to be added to open_srt function too:
with open(file_path, "r", encoding="utf-8", errors="ignore") as srt_file:

otherwise if the original srt file has some UTF8 characters in it (or a BOM at the beginning of the file!) then it won't open.

In PR #22, getting the proxies is improved, pls wait till test come and can merge... Any way you solved with tor (ty for that)
In the next days im comming back to mantain this.
Also, as an enhance, you will be able use any traslator you want (not only deepl and even apis if u want). Keep watching for new features

@sinedie Hey, thanks for the quick reply! I managed to make it work however a totally different way. I am using tor service now. Here is what I did: First, I tried to use what you have under examples/tor_driver.py however that did not work at all under Windows. I ran into this issue: https://stackoverflow.com/questions/56052021/which-is-the-valid-firefox-binary-path-for-python-tbselenium and it is stated there that Windows is not supported. I also have a Linux box (Ubuntu) but that is a headless server with no GUI just CLI, and I didn't want to mess up my Linux server by experimenting there... Instead, as suggested in the above link, now I run the tor service on port 9050 on my Windows PC. Instructions on how to do this can be found here: https://deepdarkweb.github.io/how-to-install-tor-on-windows-without-the-tor-browser-running-tutorial/ Once the tor service (not the tor browser!) is up and running in the background, I can use that service with your program like this:
from selenium import webdriver
from srt_deepl import translate

profile = webdriver.FirefoxProfile()
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.socks", "<IP_ADDRESS>")
profile.set_preference("network.proxy.socks_port", 9050)
profile.set_preference("network.proxy.socks_version", 5)
profile.update_preferences()
driver = webdriver.Firefox(firefox_profile=profile)

translate(
    "D:\\srt", # directory where the srt files are
    "en", # original language
    "hu", # desired language
    wrap_limit=50,
    delete_old=False,
    driver=driver,
)

This works. However, since the translated text has UTF8 characters in it, your script as it is could not save the translated srt file! To fix this bug I had to patch your srt_parser.py file and change a line (near the very bottom of the file) from this: with open(f"{file_name}_{lang_to}.srt", "w") as file_out: to this: with open(f"{file_name}_{lang_to}.srt", "w", encoding="utf-8") as file_out: (This solution was suggested here: https://stackoverflow.com/questions/27092833/unicodeencodeerror-charmap-codec-cant-encode-characters ) This is a must when using Python 3 in Windows at least when the resulted translation have one or more UTF8 characters.

I had the exact same issues. Thanks a lot for your sharing your excellent solution 🙏


Linting

close: https://github.com/QuantStack/ipycytoscape/issues/65

Added linting plus styling with eslint and prettier

pretty much copied all the lint/prettier settings from jupyterlab-git minus the react stuff in that repo

I gave the typescript version a fairly large bump to get eslint run without complaining (to 3.7.1)
ran npm run lint to apply linting changes

Some of the changes are definitely subjective choices that can clash with the previously used style. But this way there will be easily enforced consistency from all contributors. If anything is particularly troublesome I'll bet we could find a way to change the rules to fix it.

I didn't add this as a check to be run on PRs because there are some errors regarding the use of require that I don't feel qualified to deal with. Specifically:
><EMAIL_ADDRESS>lint /home/ian/Documents/jupyter/ipycytoscape
> eslint . --ext .ts --fix

/home/ian/Documents/jupyter/ipycytoscape/src/extension.ts
  12:3  warning  Forbidden non-null assertion  @typescript-eslint/no-non-null-assertion

/home/ian/Documents/jupyter/ipycytoscape/src/version.ts
  4:14  error  Require statement not part of import statement  @typescript-eslint/no-var-requires

/home/ian/Documents/jupyter/ipycytoscape/src/widget.ts
   12:17  error    Require statement not part of import statement  @typescript-eslint/no-var-requires
  344:33  error    Expected '!==' and instead saw '!='             eqeqeq
  383:15  warning  Forbidden non-null assertion                    @typescript-eslint/no-non-null-assertion
  383:15  warning  Forbidden non-null assertion                    @typescript-eslint/no-non-null-assertion

✖ 6 problems (3 errors, 3 warnings)

npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>lint: `eslint . --ext .ts --fix`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>lint script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/ian/.npm/_logs/2020-05-07T00_04_32_624Z-debug.log

note that the no-var-requires can be ignored with a rule

One of the builds got weirdly stuck. Don't know whats up with that, but there is also a passing build in those details.
I avoided the remaining lint errors by adding two single line ignore the rule statements:
// eslint-disable-next-line @typescript-eslint/no-var-requires

then there were no remaining lint errors so I added npm run lint-check to .travis.yml
The two new commands in package.json are:
npm run lint which will try to automatically fix errors
and npm run lint-check which will not fix the errors.
It is also set up so that when you run git add the staged files are checked for lint errors.

Hey @ianhi
Apparently it's some problem with the linter. I'm not familiar with it, but I'll try to give a look on it later.
/home/travis/build/QuantStack/ipycytoscape/src/extension.ts

  12:3  warning  Forbidden non-null assertion  @typescript-eslint/no-non-null-assertion

/home/travis/build/QuantStack/ipycytoscape/src/widget.ts

  388:15  warning  Forbidden non-null assertion  @typescript-eslint/no-non-null-assertion

  388:15  warning  Forbidden non-null assertion  @typescript-eslint/no-non-nul

Thank you very much for the PR :)

now warning free™
reading this link helped me figure out what was going on: https://palantir.github.io/tslint/rules/no-non-null-assertion/

ran npm run lint to apply linting changes

I think I'm doing something wrong?
When I run npm run lint it doesn't happen anything. Just this:
><EMAIL_ADDRESS>lint /Users/mariana/Development/jupyter-ecosystem/test/ipycytoscape
> eslint . --ext .ts --fix

I installed it with npm. Is there some extra step?
According to your comments, not all is linted, right?
Thanks a lot :)

I ended up fixing everything it complained about after I learned a little more about what the errors meant and consequently decreased my fear of breaking things.
I get the same output as well now. Try editing widget.ts to muck up the indentation and then runnpm run lint-check and it should tell you the error. After that if you run npm run lint then the error will be fixed in the file.

Oh wow! :D
Thanks a lot <3
I will and if it's all working will merge it right away, thank you very much for your work here.

Did you try to run any example with your changes?
It broke for me, but it might be because of some other stuff going on in my local env. It's a bit late today, but I'll keep looking tomorrow :)
Thanks again!

Oh dang. All the examples I test behaved as I expected, which ones broke for you? It's definitely possible they were broken in ways I didn't realize.

It's a bit late today, but I'll keep looking tomorrow :)

Sure thing, I'm in no rush. Better to get it right than just get it done.

Just retested everything in a clean env. and I was wrong.
This works perfectly.
Thank you very much for your work @ianhi! :)


Ensure that SELECT fields are aggregated or included in the GROUP BY.

Ensure that SELECT fields are aggregated or included in the GROUP BY, this sounds simple but we support grouping by scalar expressions.

Comple with release 0.27.0


Differentiate vsphere and photon-controller in salt configuration

Kube-up uses salt to configure the Kubernetes VMs. Previously, we
"cheated" and used exactly the same salt configuration that vsphere
usess. In fact, salt thought we were vsphere. This separates us from
vsphere. Specifically:

Copied the script templates from vsphere to photon-controller. These
are unchanged in functionality, except for the line that change our
identification from 'vsphere' to 'photon-controller'.

Changed util.sh to use the templates in their new location.

Changed the salt configuration to know about photon-controller. As
of this commit, we treat it identically to vsphere. That is, we are
different in name only: this change does not affect our
functionality.

Looks good.


Making this cookbook reproducible

Related to my pre-publication review (#5), I'm noting here that in its current state this cookbook does not reproduce itself. Currently we have execute_notebooks: off in the config file, so the cookbook is deploying a pre-executed notebook which has been checked into the repository with output.
Now that the environment file is fixed up (#7), I am able to execute the notebook and reproduce the results locally on a laptop. I was also able to run the notebook manually on the Pythia binder.
I opened #9 to see if we can automate the execution on the binder.

My impression is that the execution speed of the notebook is limited by network bandwidth, not computing power. It looks like a good candidate for accelerating with a dask-based parallelization of the data subsetting.


Changing port

This may be a feature request; i'm not sure.
We're using remote browsers for browser-compatibility tests -- and iOS and OSX browsers do not like the standard 1338 port. With testcafe, I can set the port on which to connect to the browsers via the ports parameter, like this:
testcafe 'browserstack:iPad<EMAIL_ADDRESS>--ports 9000,9100 <tests>
However, we're not sure how to set that with testcafe-cucumber. Could someone give us some pointers on how to go about this? Thanks in advance!

Hi @kenf128
You can change the port in the hooks.js file. Just change the 1338 and 1339 to whatever ports you'd like to use.

function runTest(iteration, browser) {
    createTestCafe('localhost', 1338 + iteration, 1339 + iteration)
        .then(function(tc) {
            cafeRunner = tc;

Let me know if you need any additional help.

thank you so much!! that worked like a champ.

Hi @kenf128
You can change the port in the hooks.js file. Just change the 1338 and 1339 to whatever ports you'd like to use.
function runTest(iteration, browser) {
    createTestCafe('localhost', 1338 + iteration, 1339 + iteration)
        .then(function(tc) {
            cafeRunner = tc;

Let me know if you need any additional help.

Currently I'm running parallel executions but the issue is test cafe starts on 1338 and its not allowing to run the second script simultaneously as fetches the below error. Do we have any option where we can mention it as random so that another test cafe execution picks different port?
Any help is much appreciated. Thank you


Fix RBI definition for Thread#backtrace

Fix sig for Thread#backtrace method. It used to define T::Array[T.untyped] type for return value, while nil can be returned there too.
The documentation, e.g https://docs.ruby-lang.org/en/2.7.0/Thread.html#method-i-backtrace, does state

backtrace → array

but it seems incorrect.
The method can return nil, e.g. for a terminated thread:
[19] pry(main)> RUBY_VERSION
=> "2.7.8"
[20] pry(main)> t = Thread.new { puts "done" }; nil
=> done
nil
[21] pry(main)> t.status
=> false
[22] pry(main)> t.backtrace
=> nil

From the source code https://github.com/ruby/ruby/blob/v2_7_8/vm_backtrace.c#L953-L954:
static VALUE
thread_backtrace_to_ary(int argc, const VALUE *argv, VALUE thval, int to_str)
{
    rb_thread_t *target_th = rb_thread_ptr(thval);

    if (target_th->to_kill || target_th->status == THREAD_KILLED)
      return Qnil;

    return ec_backtrace_to_ary(target_th->ec, argc, argv, 0, 0, to_str);
}

In https://docs.ruby-lang.org/en/3.0/Thread.html#method-i-backtrace (Ruby 3.0), the documentation was fixed:

backtrace → array or nil

Motivation

Fix an incorrect RBI-definition for Thread#backtrace from Ruby core lib.
Test plan

See included automated tests.

We have a policy of testing changes to Sorbet against Stripe's codebase before
merging them. I've kicked off a test run for the current PR.  When the build
finishes, I'll share with you whether or how it failed. Thanks!
Stripe employees can see the build results here:
→ https://go/builds/bui_OcqJvXFpCoeEnW
→ https://go/builds/bui_OcqJiMlmTq9n9Q
→ https://go/builds/bui_OcqJuWwweZN6Uf


Update README.md

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@da9dcb7). Click here to learn what that means.
The diff coverage is n/a.

:exclamation: Current head 35d07e4 differs from pull request most recent head e78c5c2. Consider uploading reports for the commit e78c5c2 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@           Coverage Diff            @@
##             main        #7   +/-   ##
========================================
  Coverage        ?   100.00%
========================================
  Files           ?         8
  Lines           ?       293
  Branches        ?         0
========================================
  Hits            ?       293
  Misses          ?         0
  Partials        ?         0

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Excel

Saving cells' state in a tree manner in an excel sheet, similar to the input data.
I think if xlsxwriter works, this should be ready, but it still doesn't recognize this package.

Thank you. I will remove the lines where I set the random seed.
I'll try to compare different runs and see what I can understand. If we keep getting different results from run to run, it will be difficult to write interpretations in the manuscript.


refactor: add open graph profile entry point

What PR title says
Also now main entry point is dummy one with nothing exported ({})

Current dependencies on/for this PR:

main

PR #8

PR #9   👈

This stack of pull requests is managed by Graphite.


Add a new .spec.serviceNameRef

This is a more generic form of .spec.serviceName that will allow VpcEndpoint resources to be templated out. If were were designing this API from scratch again, .spec.serviceName would be removed, but we cannot make a breaking change at this point. The VPC Endpoint Service Name will instead be stored in .status.vpcEndpointServiceName instead.
This is pre-work to allow VpcEndpoints to be templated out for the new VpcEndpointTemplate CRD in OSD-15666

/lgtm

Codecov Report

Merging #171 (2359012) into main (8f82309) will decrease coverage by 0.72%.
The diff coverage is 3.12%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #171      +/-   ##
==========================================
- Coverage   45.31%   44.59%   -0.72%
==========================================
  Files          28       28
  Lines        1600     1628      +28
==========================================
+ Hits          725      726       +1
- Misses        791      817      +26
- Partials       84       85       +1

Impacted Files
Coverage Δ

api/v1alpha2/vpcendpoint_types.go
100.00% <ø> (ø)

controllers/vpcendpoint/helpers.go
41.86% <0.00%> (-1.96%)
:arrow_down:

controllers/vpcendpoint/validation.go
16.53% <16.66%> (+<0.01%)
:arrow_up:


Double deletion on newer versions of windows with certain anti viruses

Hi there,
We're using Janel for a couple of our Java applications and seem to be running into an issue
The problem relates to the cleanup that occurs after calling CreateJavaVM from void JVMLauncher::launch() when _UNICODE is defined.
here is the two problematic snippets
		// from void JVMLauncher::launch()

		// setup options
		JavaVMInitArgs jvmInitArgs;
		setupJavaVMInitArgs(jvmInitArgs);

		result = CreateJavaVM(&pJvm,(void**)&pJniEnvironment,&jvmInitArgs);

		teardownJavaVMInitArgs(jvmInitArgs);

void JVMLauncher::teardownJavaVMInitArgs( JavaVMInitArgs& jvmInitArgs )
{
#ifdef _UNICODE
	jsize count = jvmInitArgs.nOptions;
	for (jsize index = 0; index < count; index++) {
		delete [] jvmInitArgs.options[index].optionString;
	}
#endif

}

The problem occurs when an active anti-virus has its own Java dll that it uses to monitor the application as in our case we have Sentinel One and it tries add itself as the agent by injecting the following arg.
-agentpath:C:\Program Files\SentinelOne\Sentinel Agent <IP_ADDRESS>2\SentinelJava64.dll

As a result the jvmInitArgs has its jvmInitArgs.nOptions increase by one which occurs after calling CreateJavaVM and so when it comes time to clean up the memory it tries to delete the last arg which has already been deallocated resulting in the following error.
FAILURE_BUCKET_ID:  HEAP_CORRUPTION_ACTIONABLE_BlockNotBusy_DOUBLE_FREE_80000003_ntdll.dll!RtlpFreeHeapInternal

There are a few possible solutions that I can think of such as recording the number of options before CreateJavaVM and resetting them after it as follows.
		// from void JVMLauncher::launch()

		// setup options
		JavaVMInitArgs jvmInitArgs;
		setupJavaVMInitArgs(jvmInitArgs);

		jsize allocatedNOptions = jvmInitArgs.nOptions;

		result = CreateJavaVM(&pJvm,(void**)&pJniEnvironment,&jvmInitArgs);

		jvmInitArgs.nOptions = allocatedNOptions;

		teardownJavaVMInitArgs(jvmInitArgs);

however this does result in a loss of information which could be used in the future although we could modify teardownJavaVMInitArgs to take in the number of args to clean up instead of relying on nOptions
Alternatively, we could record the memory addresses of the allocated strings and delete them to not be dependant on the jvmInitArgs as it can be unpredictable as to the state it will be left in after being passed to CreateJavaVM
Let me know what you think
Cheers

We have exactly the same issue, also using Sentinel One. It has been a real headache for many people in the past 3 weeks and your report @moose10141 made us save a lot of debugging, thanks a lot for that.
Hopefully a fix such as those that you propose will be implemented to prevent lowering Sentinel One rules as it is not a viable solution for clients.

This issue should be fixed with https://github.com/michaelknigge/janel/releases/tag/v<IP_ADDRESS>
Sorry that it took that long to fix...


handle empty comment listing

Issue #:
https://github.com/bcgov/met-public/issues/1022
Description of changes:
Changes to pop up a message to inform public user that there are no approved comments on the engagement.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the met-public license (Apache 2.0).

Codecov Report

Merging #1148 (983459c) into main (864378e) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1148   +/-   ##
=======================================
  Coverage   74.61%   74.61%
=======================================
  Files         266      266
  Lines        7405     7405
  Branches      489      489
=======================================
  Hits         5525     5525
  Misses       1808     1808
  Partials       72       72

Flag
Coverage Δ

metweb
69.43% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


[spark] SparkHilbertUDF hilbertCurvePosBytes classnotfound fix

SparkHilbertUDF hilbertCurvePosBytes classnotfound fix，due to this changes https://github.com/apache/paimon/pull/3251

Linked issue: https://github.com/apache/paimon/issues/3416
before fix

after fix

API and Format

Documentation

thanks @xuzifu666 , can you also remove dependency in paimon-spark-common/pom.xml.

OK，no problem. @JingsongLi


The first argument is required and must be an  or  element.

I'm getting "The first argument is required and must be an  or <canvas> element."

Provide a sample how you're using it. You can also check the example project.

I'm using vue typescript in nuxt.js. cropper ref is not recognized. I couldn't find the proper type for it. I'm not sure if it's the only problem. I'm using the same setup in another project and it works fine. But the version is 4.1.0 in that project. I could try downgrading the package but I don't prefer to do it.
    <input
      ref="fileInput"
      accept=".jpg, .jpeg, .png"
      style="display: none"
      type="file"
      @input="onFileSelect"
    />
    <Dialog
      id="upload-profile-photo-dialog"
      :visible.sync="imageCropperPopupActive"
      :style="{ width: '50vw' }"
      :modal="true"
      class="popup-dialog"
    >
      <template #header>

Upload Profile Photo

      </template>

test

        <vue-cropper
          v-show="imageCropperActive"
          ref="cropper"
          :src="selectedFile"
          alt="Source Image"
        ></vue-cropper>

    </Dialog>
    ...
    interface $refs {
       cropper: CropperData
       fileInput: HTMLImageElement
	}
    ...
    data(){
      imageCropperPopupActive: false as boolean,
      imageCropperActive: false as boolean,
      selectedFile: '' as string,
    }
    ...
    methods:{
      onFileSelect(e) {
        const file = e.target.files[0]
        this.mime_type = file.type
        if (typeof FileReader === 'function') {
          this.imageCropperPopupActive = true
          const reader = new FileReader()
          reader.onload = (event) => {
            // @ts-ignore
            this.selectedFile = event.target.result
            this.$refs.cropper.replace(this.selectedFile)
          }
          reader.readAsDataURL(file)
          this.imageCropperActive = true
          e.target.value = ''
        } else {
          alert('Sorry, FileReader API not supported')
        }
      },
    }

I found the problem. I'm using the wrong version. Since nuxt.js is still based on vue2 I should be using 4.2.0 version of this package.

I'm on version 5, and getting this error

необходимо понизить версию плагина

необходимо понизить версию плагина

this worked for me!

I found the problem. I'm using the wrong version. Since nuxt.js is still based on vue2 I should be using 4.2.0 version of this package.

this worked for me!!

I found the problem. I'm using the wrong version. Since nuxt.js is still based on vue2 I should be using 4.2.0 version of this package.

This worked for me. Thanks!


pull request for e2e test at 12/04/2016 13:56:03

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Add page number

Hi, could you please tell me how to add page number at the bottom? Nothing happened when I tried to add \pagestyle{plain}. Thanks in advance.

Ok, it actually works. I suppressed showing the page number somewhere.


Respect Cloud Run max response size of 32MB

https://cloud.google.com/run/quotas lists the maximum response size as 32MB.
I spotted a bug where attempting to download a database file larger than that from a Cloud Run deployment (in this case it was https://github-to-sqlite.dogsheep.net/github.db after I accidentally increased the size of that database) returned a 500 error because of this.

Proposed solution: on Cloud Run don't show the "download database" link if the database file is larger than 32MB.
I can do this with a new config setting, max_db_mb, which is automatically set by the publish cloudrun command.
This is consistent with the existing max_csv_mb setting: https://datasette.readthedocs.io/en/stable/config.html#max-csv-mb
I should set max_csv_mb to 32MB on Cloud Run deploys as well.

https://cloud.google.com/blog/products/serverless/cloud-run-now-supports-http-grpc-server-streaming indicates this limit should no longer apply:

With this addition, Cloud Run can now ... Send responses larger than the previous 32 MB limit

But I'm still getting errors from Cloud Run attempting to download .db files larger than 32 MB.
I filed a question in their issue tracker about that here: https://issuetracker.google.com/issues/173038375

I asked about this on Twitter - https://twitter.com/steren/status/1334281184965140483

You simply need to send the Transfer-Encoding: chunked header.

This works!
/tmp % wget 'https://covid-19.datasettes.com/covid.db'
--2020-12-02 16:28:02--  https://covid-19.datasettes.com/covid.db
Resolving covid-19.datasettes.com (covid-19.datasettes.com)... <IP_ADDRESS>
Connecting to covid-19.datasettes.com (covid-19.datasettes.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/octet-stream]
Saving to: ‘covid.db’

covid.db                [              <=>   ] 306.42M  3.27MB/s    in 98s

2020-12-02 16:29:40 (3.13 MB/s) - ‘covid.db’ saved [321306624]


Blog fixes

Added blog post meta (thumb, thumb alt, and summary) for most recent posts.

@mateoclarke you'd started looking at this at our core team huddle, did you still want to review before I merge?


Functionality to allow students to select confidence ranges from histogram and report % of data points in different ranges

This plan has the guidelines at markers con_int2 and con_int2c in mind, but we will likely use at least some of this functionality elsewhere also (or instead).
We still need to think about how we will report all this information without it being overwhelming for the user, but if we build the functionality, we can figure out a way to lay it out on the screen.

[x] Student clicks histogram bin that they think is the "most likely" value
[ ] Selected bin is highlighted in a subset color
[ ] The age of that bin is autofilled into the guideline
[ ] The guideline reports what % of the data are in that bin
[x] Student clicks on the high and low bounds of their confidence range
[ ] The full selected range is a new subset of 1 color (including the "most likely" value bin)
[ ] Guideline reports % of data that is within the whole confidence interval (all bins between low and high markers)

- [ ] The range of bins between the marker and the "most likely" bin are highlighted as the "low" subset, and the high values are a different-colored subset. (Or maybe we want those to be the same color - will have to try it and see if different colors looks too chaotic.)
- [ ] The low and high values are autofilled into the guideline
- [ ] The guideline reports % of data in the low subset, in the high subset, and totally enclosed between the low & high markers (including the "most likely" bin).

We re-spec'ed how to handle the stats and percentage ranges. That functionality is implemented in https://github.com/cosmicds/cosmicds/pull/243 and #269 and #271. Closing this.


Document that EVP_get_cipherbyname() does not work for some new algorithm names.

These algorithms were added to providers but have no const EVP_CIPHER*
mapping. Ciphers for SIV and CTS were previously only available via low level
function calls that are deprecated.
Reported by @reaperhulk.

Checklist

[x] documentation is added or updated
[ ] tests are added or updated

Does  the same apply to any digests available via EVP_get_digestbyname()?

Does the same apply to any digests available via EVP_get_digestbyname()?

There are the keccak-kmac digests available in the default provider. But these are not that useful outside of KMAC.

Does the same apply to any digests available via EVP_get_digestbyname()?

The question did cross my mind. Maybe the keccak ones - but they are kind of internal for KMAC anyway..

If a third party provider adds new digests then it won't work for them either, so perhaps its worth a mention anyway?

rebased

To be merged before the 3.0 branch.

Merged to master. Thank you for your contribution.


fix/nullability-of-fields-not-extracted

Fix for #58
Do not presume nullability when creating an instance of FieldInfo.

rebased, there were no warnings to fix.


⚠ GitLab Server has degraded performance

In f50a53a, GitLab Server (https://gitlab01.its-telekom.eu) experienced degraded performance:

HTTP code: 200
Response time: 6041 ms

Resolved: GitLab Server performance has improved in 399a8e6.


updating to maintained libs & minor adjustments

(foxriver76) updating code to es6
(foxriver76) using maintained harmony libs for discover and client
(foxriver76) possibility to only add whitelisted hubs
(foxriver76) MAX_CLIENTS = 6 error fixed
(foxriver76) enhanced logging
(foxriver76) changes for new libs

is this tested and ready to be published to npm?

It is tested with several forum users and should be ready for npm. But I wouldn‘t declare it as stable yet.
Von meinem iPhone gesendet

Am 06.10.2018 um 13:10 schrieb Pmant<EMAIL_ADDRESS>is this tested and ready to be published to npm?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Unset task?

So if Im fx using the symfony recipe, and there is 1 task I dont want to be executed, is there any method to "unset" this task?
Actually it is the assetic task I dont want to run (I dont use assetic), so this task
task('deploy:assetic:dump', function () {

    run('php {{release_path}}/' . trim(get('bin_dir'), '/') . '/console assetic:dump --env={{env}} --no-debug');

})->desc('Dump assets');

I want to not run.
Ofcourse I could copy the whole symfony recipe and then removing this 1 task and use that instead - but it seems like over doing it.

Hi Martin,
May be I'm wrong, but I don't think it's possible to remove a task.
However, you can override it with an empty function. For example:
task('deploy:assetic:dump', function () {});
This line must be set after 'require 'recipe/symfony.php'
++

Current deployer not support removing a task, but you can override a task as @tmarly 's comment.
task('deploy:assetic:dump', function () {})->setPrivate();

This is good idea! We need API for removing  tasks.

2020 and still not done lol

@patwebrussell 2020 and some people not contributing, lol.

It does not help that the topic was closed anyway hehe

I can disagree. Clearing issues is really helping me with prioritizing work. If somebody still interesting in this feature - open a discussion or send a PR.

I my opinion we could probably do somathing like
task('deploy:assetic:dump')->unsetTask();
What's your toughts?

Maybe disable()?

Any progress on this? Currently wanting to disable some tasks from the laravel recipe as they are not available for lumen - as there is no lumen recipe

I've found a dirty way: task('artisan:config:cache')->onStage(null); -> just set a filter with value null disables the task


ci(publish): update dockerhub publication action

:tada: This PR is included in version 1.8.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


cgroup skb must return 0 or 1

as in #124:
--- FAIL: TestModuleLoadELF (0.01s)
	bpf_test.go:472: error while loading "cgroup/skb" (invalid argument):
		0: (b7) r0 = 123
		1: (95) exit
		At program exit the register R0 has value (0x7b; 0x0) should have been 0 or 1

dup of # #116


Update index.mdx

Edited "diff" to "different".
Reasoning:

using "diff" here might be a cultural limitation to people unfamiliar with English slang. Wanted to provide further clarity to be as inclusive as possible.

Pre-flight checklist

[x] I have read the Contributing Guidelines on pull requests.
[x] If this is a code change: I have written unit tests and/or added dogfooding pages to fully verify the new behavior.
[x] If this is a new API or substantial change: the PR has an accompanying issue (closes #0000) and the maintainers have approved on my working plan.

Motivation

Test Plan

Test links

Deploy preview: https://deploy-preview-_____--docusaurus-2.netlify.app/
Related issues/PRs

Ah! I learned something today! Thank you!


ciao-down: Fix docker version to 1.12.6

The latest version of docker seems to break the ceph/demo container.
This commit fixes the docker version at 1.12.6 which is known to
work well with ciao.
Signed-off-by: Mark Ryan<EMAIL_ADDRESS>

Coverage increased (+0.005%) to 66.749% when pulling 548a15aa686274b0ba3eef34ab398309b2ec2ff7 on markdryan:fix-ceph-in-ciao-down into 0423d82376ac08f1d90aca770d3bb7079b077c7d on 01org:master.

@markdryan before we downgrade can we perform one check with docker 1.13
In the VM on bootup in the cloud-init set
sysctl -w net.ipv4.ip_forward=1
Also make this permanent
echo "net.ipv4.ip_forward=1" | sudo tee -a /etc/sysctl.conf
This will eliminate some of the docker iptables issues.

@mcastelino Yes, I'll try this on Monday.  If this works I'll update the PR to fix the docker release to 1.13.0.

@markdryan if that works, we probably need to add more iptable rules in single VM to allow the traffic flows we need. But I will take care of that outside of this PR. I assume this issue does not impact a real cluster.

Okay, so it might be easier just to merge this now, while we work on a proper fix.  Otherwise ciao-down/singlevm won't work for people in the meantime.

@markdryan yes.. Let us downgrade for now

Okay, so I just created a new ciao-down VM with docker 1.13.0 and this time the tests passed.

Here's the error I was getting
F0203 16:05:42.164590   16393 instance.go:510] ciao-cli FATAL: HTTP Error [500] for [POST https://singlevm:8774/v2.1/f7df638e2a204cb5bbe80bdc352cccd1/servers]: {"error":{"code":500,"name":"Internal Server Error","message":"Error when running: [rbd --id ciao clone 73a86d7e-93c0-480e-9c41-ab42f69b7799@ciao-image 1dff1d9b-1977-4595-babc-9d9e39a07629]: exit status 22: 2017-02-03 16:05:42.148107 7fcbfe790100 -1 librbd: couldn't set parent: (22) Invalid argument\nrbd: clone error: (22) Invalid argument\n"}}
null

Seeing as how the tests are passing with docker 1.13.0, fixing at 1.12.6 is probably not the right thing to do.

@markdryan did you want to close this PR then?

@kaccardi I'm going to upgrade the PR to fix the version to 1.13.1 which works well.  I should probably also update it to fix ansible installed docker at the same version.

@markdryan will you be fixing the version to 1.13.1

@mcastelino Actually, the version numbers and the repos seem to have changed (#1221).  I'll probably try the latest version of the new CE repos and if that works fix on that.  How does that sound?

@markdryan makes sense.to switch to the CE repos. I need to fix the version to 1.12.1 for clear containers too.

This PR is no longer valid.  Abandoning.


Upload OpenJDK 11.0.5 to ev3dev repository

The 11.0.5 release is out and it is necessary to build it and upload it to the ev3dev repository.

Creating release builds:
https://ci.adoptopenjdk.net/job/eljbuild/job/stretch-11/16/
https://ci.adoptopenjdk.net/job/eljbuild/job/buster-11/15/

Stretch version tested on EV3.
Buster version tested on Odroid-XU4.
Testing procedure: run java -version and run the template project.

New version uploaded successfully for both distros.


Class attributes and Class Instances autocompletion

Issue Type: Feature Request
Hi Team VSCode,
  Just a feature request regarding Python (extension).

  When we write the init(self, blah) method in a class, I want the attributes of the class (self.blah) to be automatically detected using the given parameters from the init function. A small request but might be more time-saving for people like me.

  When I used Java, when creating object of a class (maybe imported or user-defined), I automatically get the suggestion to make the name of the object, being the first letter in lower case and rest like that of the class name. I want such feature in Python. I really liked that feature in the RedHat Java extension (thank you Team RedHat) and I would like the same in Python too.

Extension version: 2021.12.0
VS Code version: Code 1.61.2 (6cba118ac49a1b88332f312a8f67186f7f3c1643, 2021-10-19T14:58:13.605Z)
OS version: Linux x64 5.7.0-kali1-amd64
Restricted Mode: No

Thanks for the request, will add this to our list of requested enhancements.

Moving this issue to discussion as an enhancement request for comments and upvotes.


Add document for plugin handle and soul dict management

solved by https://gitee.com/shuaiqiyu/website/pulls/45


feat/googleauth-added

Issue Title: Google Auth on login page
resolve issue: #103
Type of change ☑
What sort of change have you made:

[x] New feature (non-breaking change which adds functionality)

Checklist: ☑

[x] My code follows the guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly wherever it was hard to understand.

Screenshot of the changes made in your work (if applicable):

How Has This Been Tested? ⚙
click on continue with google it shows an dialog box where you can verify the google account

merge under gssoc'24 @ashutoshgithubs


feat: Hot fix for 3.2

Added a flag to skip portal interaction API
Improvement in portal interaction error log

Not required


Pass the interceptor to cast and checked mode helpers

This issue was originally filed by<EMAIL_ADDRESS>
By doing so, we can share the same interceptor in a method and avoid calling it multiple times.

This is still something we should implement.


Add file upload button to voy tools form

If large text content copy/paste is impossible on the user device, this file upload can be used instead.

Can I suggest moving the upload button to its own line with some added instruction? I took inspiration from what you wrote on your retriever code: To circumvent the long text copy limitations on mobile devices, download your player data to your device, then click the 'Upload data file' button.
This is what I'm thinking:

Note that topmenu.tsx would also need to be updated, as it's currently hiding the Player tools link on mobile devices by default.

I've made the suggested changes., thanks for the reminder about the top menu @ussjohnjay !


Question about visualization platform of xpp

Xpp is really a rare and profound work which means a lot for legged robot locomotion. But I still have some doubt that why use rviz, as I know that rviz can only do the visualization work, but other platform, like gazebo,v-rep, can also achieve dynamic simlation, and all of above can communicate with ROS, so I can't fix out the advantage of rviz in xpp. Maybe the state of robot is feedback in realtime and then just to plot it through rviz?
@awinkler

Yes, you are absolutely right that xpp is intended as pure visualization. There are many good libraries for simulation out there as you mentioned, but they introduce many more dependencies and the need for dynamic parameters. The goal is to keep xpp lightweight, minimal dependency, to e.g. visualize the current state of the robot, or the motion plan before sending it to the robot.

Firstly thanks for your reply!
I read your newest paper(Gait and Trajectory Optimization for Legged Systems through Phase-based End-Effector Parameterization) and notice that your other repository towr shows the screenshot which demonstrates the robot is under contact with the environment like walls and stairs. So under such circumstances, I guess only rviz can't satisfy the need, there should be physical engine to simulate the collision, am I right?

Well, the newest paper proposes a way to design the motion AND the physically correct contact forces simultaneously. There is still no physics engine, but simply me sending the robot state AND the value of the contact forces to xpp, which then visualizes it with the red arrows. Xpp doesn't care what I send and would even plot a red force arrow in the air if I send that in the xpp message.

I got you.
Xpp act as a plotter.
Because the contact forces need to be calculated, the optimizer towr acts like a physical engine but more lightweight.
The problem is that there is no feedback in the simulation using an open loop control under ideal situation.


Retina image count must match non-retina

I'm running into the following error:
Fatal error: Retina settings detected but 2 retina images were found. We have 0 normal images
and expect these numbers to line up. Please double check `retinaSrcFilter`.

I understand why this check might be in place, but it assumes you always have/want a retina & non-retina version of an image, where I don't in my case.
Any thoughts?

Can you explain your use case further? I am not sure I follow

[Edited original issue for clarity & wrong data.]
I have several assets (icons) designed @1x, but have others (logos) that were designed at @1x & @2x.

Ah, that case makes more sense. grunt-spritesmith supports running different tasks with their own set of options. We recommend 1 task for generating a 1x spritesheet/CSS and another task for 1x and 2x spritesheets/CSS (with retina media queries).
{
  icons: {
    src: 'icons/*.png',
    dest: 'icons-spritesheet.png',
    destCss: 'icons-sprites.css'
  },
  logos: {
    src: 'logos/*.png',
    retinaSrcFilter: 'logos/*-2x.png',
    dest: 'logos-spritesheet-1x.png',
    retinaDest: 'logos-spritesheet-2x.png',
    destCss: 'logos-sprites.css'
  }
}

If you would like to combine the generated CSS, then we suggest using another task (e.g. grunt-contrib-copy):
https://github.com/gruntjs/grunt-contrib-copy

:+1: I'd tried something similar before, but without using separate directories, which caused issues. Thanks for the example code…working well now.


[Feature request] easy way to access RestResponse cookies

It would be a lot easier for clients to have some sort of collection of cookies encapsulated by RestResponse than of having to fish them out of the HTTPURLResponse headers on their own.

Yes I don't see any problem with adding such a feature.

This was merged in #68 and is tagged in 2.2.0


Show all the events from the selected month

Hi Edlyn and thanks for your work!
How can I display on the event list all the events from the month I'm selecting?
Thanks!

Hello ,also i am looking for same feature.
Have you got any clue?


Http tunnel tests fail in python 3.5

The ssl transport object has changed in python 3.5, the problem may be caused by the use of internal attributes no longer supported.

replaced by #190


Typed parameters

We should have the option to explicitly type parameters (if none specified, default to string). This way we can display dropdowns/selectors/etc on the workflow submission page.

Supported as of 86f5875


Remove use of before parameter in streams

TODO:

[ ] Fix tests once confirmed that this PR actually improves the streams accuracy.

Update:
Unfortunately I'm running into problems removing before as demonstrated below:
In [88]: redditor = next(reddit.redditors.stream(params={})); print(f"{redditor.created_utc} {redditor.name} {redditor.display_name}")
1558888357.0 t5_121ali u_French-guy1603

In [89]: redditor = next(reddit.redditors.stream(params={"before": "t5_121ali"})); print(f"{redditor.created_utc} {redditor.name} {redditor.display_name}")
1558888358.0 t5_121alj u_3rd3m

In [90]: redditor = next(reddit.redditors.stream(params={})); print(f"{redditor.created_utc} {redditor.name} {redditor.display_name}")
1558888357.0 t5_121ali u_French-guy1603

In [91]: redditor = next(reddit.redditors.stream(params={})); print(f"{redditor.created_utc} {redditor.name} {redditor.display_name}")
1558888357.0 t5_121ali u_French-guy1603

Without passing in before I get a stale listing. This is likely why I added before in the first-place. I've tried sending other parameters to "bust" the cache, but nothing else appears to work.

Is it possible that your shell is somehow doing some sort of automatic caching on requests? What happens if you use the regular CPython interactive shell? It works fine for me there. If it’s just an interactive thing we shouldn’t need to account for it.
Rather than “selectively including” it, excluding it from r/all would be better since before adjusting is probably favourable for all other listings. I still have PR #1045 ready to go if needed.
After some glitter talk I’ve determined that removing before adjusting, while an improvement, it doesn’t solve all the problems for those wanting to stream r/all. Namely, there continues to be noticeable accuracy problems with the stream, and that’s an issue that’s rooted in its implementation. The current streaming implementation just isn’t designed to handle r/all, and so I‘m not seeing much of a gain in removing just the before adjusting in order to solve #1043. Those who aren’t streaming r/all will be slightly worse off, and those who want to stream r/all still probably won’t want to switch away from their custom streaming solution since PRAW’s stream generator still isn’t going to be on par with a script looping on .comments(limit=1000).
If a PRAW6 user wants to stream r/all then I reckon they should just create their own streaming solution for now.
On a positive note, it seems that it should definitely be possible to create a perfectly accurate and efficient streaming implementation by looking at more than 100 items for fast listings like r/all comments.

After trying to do make things simpler, I think reopening #1045 is a good idea, since the simpler solution doesn't seem feasible. I'm going to close this PR.


⚠ Bofrost.be has degraded performance

In 8b59931, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 956 ms

Resolved: Bofrost.be performance has improved in c49674a after 6 minutes.


calling CPPM.read at a high rate creates problems

When I first used the library to build my CPPM switcher, I was getting very erratic results. The sync boolean and the channels values were invalid. During troubleshooting, I found that my program would work fine so long as I didn't perform my processing loop (and call CPPM.read) faster than every 40-50 ms (50 was perfect, 40 had a few errors per minute, lower numbers had tons of errors).
I removed the "no interrupts/interrupts" statements around the CPPM.read function. This resolved the problem (at the cost of making the mapping of the channel values non-atomic). After doing this, I changed my program to do the CPPM.read once per millisecond and all was good.
My supposition is that disabling interrupts for a high percentage of the time led to missing some of the timer reads.
I don't need a fix since the two values I want do not need to come from the same frame. But, I thought it would be good to share the issue to aid others who may encounter it.
Thanks for sharing the library. It was very helpful and I appreciate its elegant brevity/simplicity.

Thanks for the feedback, I'm glad you found it useful! I haven't looked at in years but I suspect you're right, if you're reading frequently then disabling interrupts probably is not the way to go.


chore(release): bump version to 1.5.4

chore(release): bump version to 1.5.4

@outsinre Be ware of semantic versioning next time, this should be 1.6.0


x/pkgsite: package removal request for github.com/lca1/lattigo

What is the path of the package that you would like to have removed?
github.com/lca1/lattigo
Are you the owner of this package?
Yes.
What is the reason that you could not retract this package instead?
The GitHub organization name has changed and the repository URL is not under our control anymore.

https://github.com/lca1/lattigo currently redirects to https://github.com/tuneinsight/lattigo, and I believe that redirect will be followed by the module proxy.
You should be able to retract the versions for the prior path by publishing them in the go.mod file in the github.com/tuneinsight/lattigo repo.


Database connection fails if password includes '?'

I think this is an undesired behavior: I modified the password for loraserver_as postgresql user into: '278wbHH?o1'
After this, app-server will not startup properly with message in the log:
giu 01 14:43:47 iotdev2809 lora-app-server[5354]: time="2018-06-01T14:43:47+02:00" level=error msg="ping database error, will retry in 2s: dial tcp: address tcp/278wbHH: unknown port"
It took some time to understand. After changing '?' into a plain character, app-server would start OK.
It is not obvious that '?' is not accepted, should be accepted or docs should inform not to use it.
I am using version 1.0.1

Maybe this could be extra documented, but as you can see in the example it splits the URL from the sslmode argument:

postgres://user:password@hostname/database?sslmode=disable

If you think this could be documented better, feel free to create a pull-request :-)

Ok, I will think about how to improve the docs and contribute.
Still I believe that this is a weakness in code.
By looking into the line in the log file generated: "address tcp/278wbHH: unknown port", it can be seen that the '?' in my password has caused wrong DSN parsing.

The string itself is handled by the https://github.com/lib/pq driver. When you think it is a weakness in the code, I recommend creating a ticket there :-)

Fair enough. Thanks.


Signalr port foreach network

This PR adds a different default SignalR port for each network. This allows us to run multiple Wallets at the same time with SignalR

Why not use the API port? what is the logic behind exposing two self host servers on the FN can SingalR not live along side the API?

SignalR is a separate feature that can run independently of the API and RPC, so we shouldn't couple it with API hosted service. It is a first-class citizen unless I misunderstood the concern

That is a good argumet, but I don't agree so much.
Consider though It can be a separate feature and still relay (or have a dependecny) on the api host.
Is there realistically ever a case where SignalR is used and api is not needed?
The api feature does not carry business logic most of the logic is put in the dedicated features and controllers are discoverale
The SignalR feature seems to me to have cross feature logic (wallet, mining etc...) when such logic should be probably implemented in the appropirate features and the SignalR freamork would go in the api feature. Basically what I am saying is the design is not modular (you cannot ship signalr without a wallet, but you can ship api as standalone)
API feature should probably be called ServerFeature and it allow web api and SignalR freaworks the business logic would be then contained to the features (WalletController lives in wallet feature so SignalR wallet event should as well)
Also how it is implemented in the program.cs file is not the best, the logic should be hiddenin the feture itself (ideally)

you cannot ship signalr without a wallet

I do not agree with this. You can have signalr without the wallet or any other features. It can relay any messages from the node, doesn’t have to be wallet specific message. It can be used by any type of the client app. One good example could be a dashboard app that you may want to show some stats from the node. Basically instead of polling nodes API, you could just subscribe to signalr events. It can easily subscribe to node events from ISignals bus we have.

I do not agree with this. You can have signalr without the wallet or any other features like API.

This looks to me like a hard dependency on the wallet feature
https://github.com/stratisproject/StratisBitcoinFullNode/pull/3901/files?file-filters[]=.csproj#diff-fe051c296d9510ad7e513a360ef65184R14
And it seems to me you are one of the approvers not making what you claim even possible without a refactor of SignalR
https://github.com/stratisproject/StratisBitcoinFullNode/pull/3901#pullrequestreview-278137970
The rest I agree though you would have to implement what I described above to achive it.

This looks to me like a hard dependency on the wallet feature

Sure, atm it has a dependency, but we can change this in the future once we have a requirement to make it available to other types of clients. My main point is that SignalR is a standalone feature that should be defined as a "Feature". Similar to how RPC is a feature and has a dependency on "Consensus" feature or like PoA feature that has a dependency on "Consensus" and "Miner" features.
Currently, it makes it possible for us to still run SignalR feature without having a dependency on API or RPC and have various types of client apps, that do not need to query node and only listen to events.

In my view SignalR should just relay event-bus events to the outside world, it doesn't need to know any specific message, so it doesn't need any reference to any specific feature
why did we have hard dependency actually?
FullNode shouldn't have a known concept of SignalR , just the concept of event bus, and signalr is just a way to relay a subset of these events to interested parties
consider it like hooking into fullnode process to collect information and push them outside (in an async way so that it doesn't impact on fullnode performance)

I see why we had the Wallet referenced, because we were doing something like
public class StakingInfoClientEvent : GetStakingInfoModel, IClientEvent
If we want SignalR to be just a relay of events, we should handle events in json or something like that, not defining a type for every kind of events we want to send with SignalR

Sure, atm it has a dependency, but we can change this in the future once we have a requirement

You will never have a requirement for modularity on the contrary you will just build more stuff in to the signalr feature and it will become almost impossible to refactor it later, you have to build the feature form the start without dependencies.

Similar to how RPC is a feature and has a dependency on "Consensus"

RPC is a very bad example and I would not compare to RPC, that is a bit special because we just wanted to support Bitcoin Cores (or StratisX) RPC, better compare to API where there is only a dependency to Stratis.Bitcoin.

SignalR is another medium for communicating with the server-side, like API and RPC, why would we want to couple it?

Come to think about it API is a bad name to the current API feaure, perhaps it sould be called WebServer feature and it would be enabled such
 nodeBuilder
 .UsePowConsensus()
 .UseWallet()
 .EnableWebServer()

EnabledWebServer() will create a self host server and discover controllers (and maybe also signalr evetns)


Updating Azure Peering Service Documentation

Hi @gthareja - This pull request was opened in the public repository. New content and substantial updates to existing articles should be submitted in the private repo. Would you create a new PR in the private repo? We'll close this PR. Thanks.


Marcopremier add single log entry for computation failure

Unified StateTransitionMeasurementLogEntry and DuchyMeasurementLogEntry in the same MeasurementLogEntry when computation participant fails
deprecated Measurement.Failure proto fields since now failures are set in log messages

This change is


Feature engineering / preprocessing suggestions

Really interesting library so far and seems like great work from the maintainers.
Personally I am interested in having more feature engineering / preprocessing functions available, and the potential for polars to greatly speedup time series feature engineering.
I have included a basic sketch of some time series feature engineering methods which could be implemented. More ideas could come from the Hyndman forecasting works and other papers /  libraries.

add_fourier_coefs - Fourier Coefficients to capture seasonality
detrend_ols - Linear Detrending
add_changes - Differencing (raw difference, percentage change, log-change etc.) by lags
add_fractional_differences - Fractional Differencing

Closing in favor of ff3e1a04b4c57943ad3e4cd57f9e7da2da1e1131 and b3d65254fe6cadb005660c56b31e03524afea6d5


Added packaging capability

After a few suggestions on the Issues forum (#12) I decided to add the missing packaging functionality together with sample icons for mac and windows

I do not have an index.js

@mmick66 Sorry, I obviously meant the newly introduced start.js.

I followed the recipe from #12 of the discussion forum. It is for the packager to start with babel-rc having already been imported (I guess)


encode iso-8859-1 not work on firefox

Image with error
    var EncodingPlugin = require('webpack-encoding-plugin')
    ...
    plugins: [new EncodingPlugin({
        encoding: 'iso-8859-1'
    })],

@RuanHerculano please retry with the new version. a a lot has been changed.


Fix the insert grammar and add tests.

Fixed the table_name and column_name completions in INSERT statement.

amazing!


[PURIS] KIT Release 24.08

Description
The Kit Release 2408 feature encompasses three distinct work packages aimed at enhancing the capabilities and visibility of PURIS and associated standards.
Overall Impact
Collectively, these three work packages provide added value by ensuring that potential users and stakeholders gain a comprehensive understanding of PURIS and its associated benefits. They will learn how PURIS functions, how to implement it, and how to operate it effectively, thereby maximizing the utility of the platform within their respective domains.
New KIT for Supply Chain Disruption Notification

Demand and Capacity KIT might want to link to it.
Same for PURIS overall KIT.

Additional Information
Work Package 1: Extension of PURIS Kit with Days of Supply Standard
This work package involves expanding the existing PURIS Kit to incorporate the Days of Supply standard. This includes adjustments to both the Adoption View and Development View of the current PURIS Kit to seamlessly integrate the Days of Supply standard.
Work Package 2: Upgrade of PURIS Kit
The second work package focuses on upgrading the PURIS Kit by developing and releasing additional content to enhance understanding for target audiences. This may include creating a User Journey or calculating a Business Case to estimate the financial benefits of using PURIS.
Work Package 3: Creation of Supply Chain Disruption Notification Kit
The third work package entails the creation of a completely new kit, the Supply Chain Disruption Notification Kit. This kit will feature the standard "Supply Chain Disruption Notification", scheduled for release 2405, in collaboration with Team DCM. The aim is to make the standard accessible and understandable to a wide audience. The creation of the Adoption View, Development View, and Operations View will be carried out by the PURIS team. Team DCM, which collaborated with PURIS in creating the standard, will review the kit and provide feedback for incorporation by PURIS.
Acceptance Criteria:

[ ] Days of Supply Standard is implemented in PURIS KIT
[ ] PURIS KIT is updated with regards to a described scenario, user journey, business case
[ ] Supply Chain DIsruption Notification KIT is created

Committer in charge: @tom-rm-meyer-ISST

Was presented in open planning ⇾ contributors and committer are involved.

Hello @MercedesG-8020 , @tom-rm-meyer-ISST  @PhillipNalesny ,
Since the feature is a 24.08 feature and the development phase is coming to an end, we need a status on the feature.

[ ] Currently you are assigned (Responsible) → Is this correct? If not, please assign the correct contact person
[ ] Please check whether the status (backlog, work in progress ...) is set correctly
[ ] Please check whether there is an assignment to a committee or expert group (supported-by) to be found on the board
[ ] Please comment on the current status of the feature
[ ] Are all SubTasks (issues from other repositories that deal with the feature) linked? → The easiest way is to mention the feature here in the issue (via the ID) so we can see which teams/repositories are involved.

If you need any clarification, please get in touch, thank you very much.
Stephan

Thanks @stephanbcbauer , Feature in progress, Here is our planning board on it https://github.com/orgs/eclipse-tractusx/projects/58/views/1

Hello @PhillipNalesny
In a few weeks, we want to publish Tractus-X Release 24.08. For this, we need a clear status about the features (which will be included in the release and which will be cancelled or postponed to the next release).
Currently, the feature is still in status Work in progress. Please update the status by 09.07.24 eob.
If the feature is not ready for release 24.08, or it is possibly not planned at all, please set the status to Not in release. Please remember that in this case, any dependent components must be informed.
Thank you and best regards.

@stephanbcbauer the KITs are on track. We're currently finishing them and will create the initial pull request via a supporter of ours :)

This will be solved by #787 and #784

PURIS KIT pr is closed!

Solved with https://github.com/eclipse-tractusx/eclipse-tractusx.github.io/pull/986


Some shortcuts not working

I found that when you try to add the Icue shortcut from corsair you get an error and the app throws an exception after

I have found a workaround to that. We can directly point to the executable instead of the shortcut links.


adding gujarati vocabulry dec 4

here i am adding the gujarati vocabulary

@sarjil77 Take a look here should be enough to copy paste these changes: https://github.com/mindee/doctr/compare/main...felixdittrich92:doctr:gujarati-vocab-test
Tested with your "full" vocab i can completely reproduce it so all chars are added and a string can be encoded char by char :)
Before you should pull the latest changes from main and rebase your branch :)

@felixdittrich92 The gujarati letters you provided in your commits contains the significant portion of Gujarati alphabets but is not entirely complete you are missing 2 major vowels and 3 consonants so total 5 letters are missing. And i would strongly recommend to keep vowels and consonants separate, it will be better for traceability and in future it may help to trace.

@felixdittrich92 The gujarati letters you provided in your commits contains the significant portion of Gujarati alphabets but is not entirely complete you are missing 2 major vowels and 3 consonants so total 5 letters are missing. based on diacritcs which i have provided before you are right, but this 5 letters are additional ones and doesnt have diacritics so i missed them (sorry) but they are also frequently used so we cant ignore them. And i would strongly recommend to keep vowels and consonants separate, it will be better for traceability and in future it may help to trace.

Then i would say feel free to add the missing ones - what you see is your vocab but deduplicated :)
Also for the splitting feel free would be fine on my end 👍🏼

@sarjil77 Don't miss to rebase before please in the meanwhile i added a test case to Check the VOCABS entry values for duplicates :)

@felixdittrich92 i think done from my side :) haa,
thanks.

@sarjil77 your branch needs still to be rebased (see there is a conflicting file) :)

Update your fork
Checkout main and pull
Checkout your branch and pull / rebase
Then force push your changes

Additional the docs entry is missing take a look in my provided branch :)

i think now it is good. :)

@sarjil77 it's still not rebased on main :)
See:
This branch has conflicts that must be resolved
Use the web editor or the  to resolve conflicts.
Conflicting files
doctr/datasets/vocabs.py

And about the documentation entry if you have added more chars i think the number and char string has changed also ;) so please fix this :D

will again look, and for documentation i have added some char. and removed some, but coincidentally the count remained the same.

hey @felixdittrich92 , i think i have chnaged both the documentation and vocab, can you please look into it, and from my side i have checked for any conflicts. :)

@sarjil77 Looks like you merged the main branch into your feature branch instead of rebasing your branch on main 😅
See: https://github.com/mindee/doctr/pull/1811/files (It includes some previous already merged commits)
2 options:

Rebase your branch on main git checkout <YOUR_FEATURE_BRANCH> -> git rebase main (preffered option)
Close this PR and create a new feature branch / Add your changes / create a fresh PR

👍🏼

OKay i am closing this PR and will do as you suggested.
how can i be so stupid, let me correct it, i thought it was okay, sorry. :D

OKay i am closing this PR and will do as you suggested. how can i be so stupid, let me correct it, i thought it was okay, sorry. :D

Don't worry that's little things you will grow on believe me :) Without making things wrong we wouldn't learn ^^


Machine Learning Provider Abstraction Layer

I am a coder for a team looking to consider using SparkNet with another ML library besides caffe.  The intent of this Issue is to capture discussions on a ML Provider Abstraction Layer (MLPAL?) that would permit pluggable use of Caffe vs SomeOtherMLLibrary.
To the core committers:  do you already have thoughts and/or a Roadmap for this?  In any case our thoughts will start appearing here.

Thanks for bringing this up, we are very interested in this question. Providing unified APIs and data loading procedures is one of the areas where we can add value compared to what is already out there in terms of deep learning libraries. Data loading/processing is on of Spark's main strength.
Let us know about your suggestions, our current plan is to provide interfaces that can be implemented by various backends.
For the network, the interface would look like this:
trait NetInterface {
  def forward(rowIt: Iterator[Row]): Array[Row]
  def forwardBackward(rowIt: Iterator[Row])
  def getWeights(): WeightCollection
  def setWeights(weights: WeightCollection)
  def outputSchema(): StructType
}

For the Solver:
trait Solver {
  def step(rowIt: Iterator[Row])
}

Data would be loaded in a unified way from Spark DataFrames. We are working on this in the javacpp+dataframes branch, see for example this file.

Awesome!  This may be a fair bit less complicated than anticipated from our perspective.  I am interested in trying out that trait with another ml library.
Please suggest which test(s) to run that would best validate the usability of your NetInterface with the OtherMlLibrary framework.

I can sketch how we plan to implement the interface for TensorFlow.
Assume you have a TensorFlow graph definition like this (in Python):
import tensorflow as tf
sess = tf.InteractiveSession()
x = tf.placeholder(tf.float32, [None, 784])
W = tf.Variable(tf.zeros([784, 10]))
b = tf.Variable(tf.zeros([10]))
y = tf.nn.softmax(tf.matmul(x, W) + b)
tf.initialize_all_variables().run()

You can then serialize the graph and the weights in the following way:
saver = tf.train.Saver()
saver.save(sess, "model.bin")
g = tf.Graph()
g.as_graph_def()

SparkNet would provide a TensorFlowNet class which implements the Net trait and as a constructor takes the protocol buffer definition that is generated by g.as_graph_def(). Furthermore, there would be a procedure for loading the weights saved by tf.train.Saver into a WeightCollection object and an implementation of setWeights that loads the weights into the Network.
If you are interested in pursuing this, you can start from the JavaCPP TensorFlow implementation and implement the TensorFlowNet as well as TensorFlowSolver class. This is high priority for us, but before we get to it we would like to improve a few other things first.

OK i will first dig a bit into the javacpp-presets as a background and then
at the JavaCpp-presets for TensorFlow.   ETA for an update is late Thursday
2/18
2016-02-16 21:52 GMT-08:00 Philipp Moritz<EMAIL_ADDRESS>
I can sketch how we plan to implement the interface for TensorFlow.
Assume you have a TensorFlow graph definition like this (in Python):
import tensorflow as tf
sess = tf.InteractiveSession()
x = tf.placeholder(tf.float32, [None, 784])W = tf.Variable(tf.zeros([784, 10]))
b = tf.Variable(tf.zeros([10]))
y = tf.nn.softmax(tf.matmul(x, W) + b)
tf.initialize_all_variables().run()
You can then serialize the graph and the weights in the following way:
saver = tf.train.Saver()
saver.save(sess, "model.bin")
g = tf.Graph()
g.as_graph_def()
SparkNet would provide a TensorFlowNet class which implements the Net
trait and as a constructor takes the protocol buffer definition that is
generated by g.as_graph_def(). Furthermore, there would be a procedure for
loading the weights saved by tf.train.Saver into a WeightCollection object
and an implementation of setWeights that loads the weights into the Network.
If you are interested in pursuing this, you can start from the JavaCPP
TensorFlow implementation
https://github.com/bytedeco/javacpp-presets/tree/master/tensorflow and
implement the TensorFlowNet as well as TensorFlowSolver class. This is high
priority for us, but before we get to it we would like to improve a few
other things first.
—
Reply to this email directly or view it on GitHub
https://github.com/amplab/SparkNet/issues/70#issuecomment-185040009.

Great, any progress on this will be helpful for the project, and don't hesitate to ask questions if you run into problems. We have a bunch of experience with JavaCPP by now and might be able to help you.
To get started, you can both try to run the ExampleTrainer.java from the TensorFlow preset, and also our Cifar training app in the SparkNet javacpp+dataframes branch. It is almost ready to merge now, we just haven't gotten around to create the AMI.


Fix trigger update performance

Instead of using array subset operations, which Postgres doesn't appear to be able to use the btree index for, use the ANY keyword, which does appear to use the index. The WHERE clauses aren't quite so easy to read, but it results in much better query plans against my local database.
Connects to #593.
@rmarianski could you review, please?

:+1:


Enhancement: add resource group template

As an admin
I can define a template of a resource group that can be copied to become a resource group.
E.g: define a "physical server" with CPU, Memory, Disk

[ ] new model linked to nothing. but same attributes as existing RG. ResourceGrougTemplate &  ResourceGroupAttributeDefinitionTemplate
[ ] button create a template from this RG
[ ] List template (Full CRUD) + attribute CRUD
[ ] Instantiate template

I the v2, attribute are shared to be reused by any new resource group. Si this issue is outdataed.


Implement IEquality on Graphs

Is related to #111. The Singleton should check whether the new graph is different from the previous, or if just the selection changed.


Fix history persistence bugs

History file must be truncated in case new content is shorter than old
content (for example when duplicates are removed).

@gwenn - would it be possible to get a release of rustyline that includes this fix?

@jntrnr Version 9.0.0 released.

@gwenn thank you!

@gwenn thank you as well ---- we appreciate the fast turn around time on getting a release out for us... you are amazing !!


Shanghai 2 update

Reviewed and merged commits by IMX's continued shanghai
Modified our custom code to better reflect the new IMX processes
Modified the API to include new parameters
Modified the API to better support new input formats in the future
Reviewed environment variables and verified functional

Wrong target branch I presume @Stephen-BCW?

Wrong target branch I presume @Stephen-BCW?

haha yes, sorry it's Friday and am in a rush to be done for the day


[WIP]Proposal - Large scale Shuffle For Mars

Background
Shuffle is a performance critical part of distributed systems. In a large scale cluster, shuffle will be bottle-neck for scaling, and the cause of cluster inefficiency. Current mars shuffle has scheduling and execution performance inefficiency which needs to be addressed:

Scheduling cost

Serialization cost is very high. A mapper subtask contains thousands of chunks which are dependencies of ShuffleProxy if there are thousands of mapper chunks; A reducer subtask contains three groups of values which are part of FetchShuffle if there are thousands of mapper chunks. For a large shuffle which has thousands of chunks, serializing a subtask will take about 1~20S which is obviously unacceptable.
Scheduling gap. Mars will start schedule reducer subtasks only all mapper subtasks finish. For large scale cluster/shuffle, node jitter and mapper straggler is very common, the reducer will not be scheduled though mostly mapper subtasks have been finished.

IO cost

For large scale shuffle, the shuffle block will be small, thus IO cost and meta store cost will be high. Actually sometimes the block is less than 10kb. In the end, there will be too many small objects slowing down the whole system.

Optimization
The optimization can be splitted into following steps:
Optimize mars serialization for shuffle

We need do reduce the data needing sent to the workers
Avoid duplicate serialization for ShuffleProxy and FetchShuffle
Speed up serialization performance.

Broadcast Join
If one of the tables is pretty small, we can broadcast the smaller table to all mars workers, then execute the mapper join. In this way, there will be no shuffle.
Sort-Merge Join
For large scale shuffle, if we sort data in mapper, then all the things that reducer needs to do is juse merge all mappers data. The reducer will be faster. And if there is data skew, hash-join may get OOM too.
Push-based Shuffle

Push-based Shuffle has been proved the art of the state for shuffle algorithms. It's proposed by LinkedIn and spark 3.2 has used push-based  shuffle to improve shuffle efficiency. Mars should use Push-based Shuffle too.
Implement push-based shuffle using distributed future provided by ray is easy, only needs less than 300 lines of code. But mars does not provide such abstraction and mars shuffle is based on chunk abstraction.  So we propose two solutions:

Implement a complete push based shuffle backend for mars, just like spark. Then rewrite all shuffle operands based on the new shuffle backend.
Ray already supports push-based shuffle. So there is no need to implement a push-based shuffle backend. All we need to do is just provide a new group of push-based shuffle operands and replace all mars shuffle operands when mars is running on ray.
Refactor Mars shuffle operands so that it can use simple shuffle for oscar oscar backend and push-shuffle for ray backend.

The push-based shuffle service open-sourced by LinkedIn is about 14000 lines of code which is pretty work. So I prefer the solution 2 or 3.
Adaptive Data Skew Optimization
Data skew can severely downgrade the performance of join. We can dynamically handle skew in sort-merge join by splitting (and replicating if needed) skewed blocks into roughly evenly sized blocks.
Reference

Exoshuffle: Large-Scale Shuffle at the Application Level
SPIP: Support push-based shuffle to improve shuffle efficiency
Magnet: A scalable and performant shuffle architecture for Apache Spark

I've implemented a half-done branch https://github.com/wjsi/mars/tree/feature/shuffle_svc for shuffle. The reason why it is not merged is that currently storage service lacks the capability of remote readers and writers. Now working on it.

https://github.com/wjsi/mars/tree/feature/shuffle_svc

Is there a design doc for this?

https://github.com/wjsi/mars/tree/feature/shuffle_svc

Is there a design doc for this?

Not yet. I'll write it soon.


Doc: update the terminal info to CloudberryDB

Change logs
To have a unified and smooth experience, update the terminal info to CloudberryDB or Cloudberry Database, avoiding users' confusion.
Why are the changes needed?
Describe why the changes are necessary.
Does this PR introduce any user-facing change?
If yes, please clarify the previous behavior and the change this PR proposes.
How was this patch tested?
Please detail how the changes were tested, including manual tests and any relevant unit or integration tests.
Contributor's Checklist
Here are some reminders and checklists before/when submitting your pull request, please check them:

[ ] Make sure your Pull Request has a clear title and commit message. You can take git-commit template as a reference.
[ ] Sign the Contributor License Agreement as prompted for your first-time contribution(One-time setup).
[ ] Learn the coding contribution guide, including our code conventions, workflow and more.
[ ] List your communication in the GitHub Issues or Discussions (if has or needed).
[ ] Document changes.
[ ] Add tests for the change
[ ] Pass make installcheck
[ ] Pass make -C src/test installcheck-cbdb-parallel
[ ] Feel free to request cloudberrydb/dev team for review and approval when your PR is ready🥳

I have successfully verified these changes on my cloud machine, and they are now ready to be reviewed. PTAL @my-ship-it


Dapr Installer-Bundle v1.7.4   rumtime is 1.5.3?

Hi
I download [Dapr Installer-Bundle v1.7.4](https://github.com/dapr/installer-bundle/releases/tag/v1.7.4) and installed,
but I check version  is   1.5.3  ? why?
C:\dapr> dapr --version
CLI version: 1.7.1
Runtime version: 1.5.3

605f1873858f110fcf8716760e4f7ef1b08269c5dae24f2c43477caece75bbf4 *daprbundle_windows_amd64.zip

@Gsonovb - we will look into this, since this is clearly wrong.

It seems that daprd has changed 1.5.3 to the latest version.

Yes. This is wrong and we will get this fixed ASAP.

HI @Gsonovb, Thanks for pointing out the issue. The issue was due to daprd making 1.5.3 as the latest version. For now, we have deleted the 1.7.4 bundle and made 1.7.3 as the latest, since 1.7.4 bundle was clearly incorrect. We will fix the workflow soon and release 1.7.4 correctly

This is fixed: Check https://github.com/dapr/installer-bundle/releases/tag/v1.7.4


Update b01-1 to use device_factory

Instructions to reviewer on how to test:

Test beamline can still connect

Checks for reviewer

[ ] Would the PR title make sense to a scientist on a set of release notes
[ ] If a new device has been added does it follow the standards
[ ] If changing the API for a pre-existing device, ensure that any beamlines using this device have updated their Bluesky plans accordingly
[ ] Have the connection tests for the relevant beamline(s) been run via dodal connect ${BEAMLINE}

if partial success this means that the PR does not break the other devices. AFAIK it's mergeable now


Created Github Workflow that auto commit

I have created a Workflow that automatically commits when an issue is opened, a pull request is created, an issue is closed, or an issue is assigned or unassigned.
The issue number that resolves this particular issue is:https://github.com/group-patronage/group-patronage/issues/60

To run this Workflow you have to able to permission into the Repository setting

Changed the workflow permissions. Thank you for your contributions!

hey @Nishitbaria, the template is not working and I'm too not able to allow these permissions as you can see below.

the checkbox is not allowing^

Hey @LakshaySK106  The repo owner  only able to give this permission

Please Give to read write access please checkmark the first checkbox

I gave all the necessary permissions and it's working now. Thank you!

hey @LakshaySK106  please add the Gssoc label and the level 3 label without this it not count in Gsso2023 Leaderboard


Jruby Unzip and Parse CSV file

Unzipping ZIP and reading CSV when running with JRUBY is having encoding issues, calling common method incase file is CSV.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

This appears to heave been an issue with the JRuby version, or a problem with the file being accessed, since it passes fine on JRuby <IP_ADDRESS>.
To cleanup the use of CSV, suggest using .each instead:
      it "parses CSV which is inside a zip" do
        IOStreams.path(csv_zip_file_name).option(:zip, entry_file_name: "OFFICES2_ALL.CSV").each(:hash) do |row|
          assert Date.parse(row["rundate"])
        end
      end

Confirmed working on JRuby <IP_ADDRESS>


Running RUM terraform script fails on windows

Hello, i currently run the terraform setup using
Windows 10
GITBASH
Terrafrom executable on windows
AWS CLI configured
When I run the RUM terraform code I get an error when the post configuration tried to run an ssh connection to the machine. This is due to the agent setup and me being windows.
The code in question is
connection {
host = self.public_ip
type = "ssh"
user = "ubuntu"
private_key = file(var.private_key_path)
agent = "true"
}
the 'agent = "true"' code would work fine in linux and assuming MAC. But on windows I believe this would not work for anyone.
I had to set the agent=false on my box to get this to work.
please see this link for details
https://www.terraform.io/language/resources/provisioners/connection
Snipt from webpage...
agent - Set to false to disable using ssh-agent to authenticate. On Windows the only supported SSH authentication agent is Pageant.
hope this helps.
feel free to hit me up on slack or email<EMAIL_ADDRESS>

RUM is being reworked to fit closer to the workshop...  This should adress this


contabo-client: Glitch when creating a new instance.

When I create a new instance, I see 2 problems:

Contabo shows a "no setup" message in the dashboard; and
I cannot access such an instance via SSH.

Requirement
I need to be able to access the new instance via SSH, with the root user and the password specified in the script below:
require_relative '../lib/contabo-client'
require_relative './config.rb'

# Usage example
client = ContaboClient.new(
    client_id: CLIENT_ID,
    client_secret: CLIENT_SECRET,
    api_user: API_USER,
    api_password: API_PASSWORD
)

# Find the image ID for Ubuntu 20.04
Z = 100
ret = client.retrieve_images(size:Z)
n = ret['_pagination']['totalPages']
ret = client.retrieve_images(size:n*Z) if n>1
image = ret['data'].find { |h| h['name'] == 'ubuntu-20.04' }
raise 'Image not found' if image.nil?
image_id = image['imageId']

# First, create a secret for the root password (this step is assumed)
root_password_secret_id = client.create_secret('121124588')
puts "root_password_secret_id: #{root_password_secret_id}"

# Create the instance with the retrieved image ID
instance = client.create_instance(
  image_id: image_id,
  product_id: 'V45',
  region: 'EU',
  root_password: root_password_secret_id,
  display_name: 'MyUbuntu20Instance-b'
)

puts JSON.pretty_generate(instance)

Update
After some fixes, we still can't nail how to create an instance with cloud-init OFF.

Also, I can't access the server via SSH with the root user and the password provided during the server creation (in this example, the root password is 121124588)


Import MobileCoreServices for tvOS

Importing MobileCoreServices for os=tvOS allows Alamofire to compile on tvOS

You should be using the tvOS branch. We won't be supporting tvOS in the master branch once Xcode 7.1 is out of beta.


Correct Fixgit behavior via new regex matching

This is the change I made locally to get the git suggestions to work for me. I had a hard time following the original logic, and can think more clearly with regex, so I switched it to use regex check the following:

That the first line of $gitres matches the expectation of git: 'COMMAND' is ..., matching that command to a group and assigning to $origcmd
That the fourth line of $gitres matches the expected pattern of whitespace followed by a subcommand name.

This assumes, however, that the git output is roughly in this format:
git: 'pul' is not a git command. See 'git --help'.

The most similar commands are
        pull
        push

Questions for maintainers before considering this pull:

do you know if the above is a safe assumption? It seems reliable on my machine (running git version 2.32.0.windows.2)... but are there widely used versions of git that have breaking differences for that output?
I wasn't sure what the right course of action would be if the patterns fail to match. Is throwing the right choice here? I figure if we fail to find the right suggestion, all is pretty much lost, anyway, but if there's something we can do to be more graceful, let me know!

Oh!


We are done with a tokenizer but we need a parser! Oh damn!

We are done with a parser. ;-) Good Stats Jeff I recommend you to consider my Readme and change your docs


[tests-only] Bump core commit id for API tests

Get's new core API test scenarios added in:
https://github.com/owncloud/core/pull/38141 [Tests-Only] add more tests to cover ocis issues
https://github.com/owncloud/core/pull/38142 [tests-only] first TUS upload tests

Needs https://github.com/owncloud/core/pull/38144 merged

See #937


AzureDeployment Environment Dev center setup failing with key vault Integration

I was trying to create a Azuredeployment environment and Dev center with in it. When I am trying to create a catalog within the Devcenter using the keyvault integration (with private endpoint enabled), the catalog creation is failing.

We couldn't connect to ade-zzzzzzz. The DevCenter is misconfigured. Inform DevCenter owners that the key vault could not be found, and is required for this operation.

We already created a system managed identity for the devcenter and add thed the system managed identity to full permission for the secret in the keyvault. But still the catalog creation is failing. So a private keyvault is not supported with AzureDeployment environment?

Hi @vivuu1989, that is correct. Private endpoint is currently unsupported. This feature is in our backlog, but there is not currently a timeline on when it will become available.

Hi @vivuu1989, that is correct. Private endpoint is currently unsupported. This feature is in our backlog, but there is not currently a timeline on when it will become available.

is there any workaround to overcome this blocker?


WIP: Pass cert dir to ob run

Supersedes #799
I have:

[x] Based work on latest develop branch
[x] Followed the contribution guide
[x] Looked for lint in my changes with hlint . (lint found code you did not write can be left alone)
[ ] Run the test suite: $(nix-build -A selftest --no-out-link)
[ ] Updated the changelog
[ ] (Optional) Run CI tests locally: nix-build release.nix -A build.x86_64-linux --no-out-link (or x86_64-darwin on macOS)

Should this still be WIP?


Agent sending all ENV VARS is a security issue

As a developer, a number of other command line tools I use rely on passwords and secrets stored as ENV VARS on my computer, things like AWS keys, specific tool/file locations, keys for third party tools like Airbrake, Sendgrid, etc.
It strikes me that uploading all of these to VSO Agent Pool as capability options is a bit of a security risk. I understand the need to get things like paths to node/npm tools, etc but providing all of the ENV VARS doesn't seem very secure. Can the agent not just provide the vars for the tools it expects to use only?

Correct me if I'm wrong here...
Those passwords can be stored as secure variables under the Build \ Release variables tabs.
Rather than storing them as ENV variables, store them securely within TFS

Yes if secure variables works for your scenario that would be best. Otherwise you can add a variable VSO_AGENT_IGNORE that contains comma delimited list of vars not to publish as capabilities.

Correct, that's the reason the ignore variable exists.


OT_PLATFORM_LIB in ncp/mtd.cmake

Are there any reason src/ncp/mtd.cmake has no ${OT_PLATFORM_LIB} in target_link_libraries while src/ncp/ftd.cmake has one?

@nikita-s-wrk , good question. I believe this line can be removed: https://github.com/openthread/openthread/blob/dc7676a032ccd5610fbb0141c0c41c49cbb76710/src/ncp/ftd.cmake#L49
Feel free to remove that line in #7041