Discuss potential website contents for landing page

@bella-tassone and I will meet on sunday to discuss the contents of our website, as well as the layout of our website's HTML.

Closed as completed, seev #5


man page description for -c/--cpu-shares flag for docker run command.

Updating the man page to keep it in sync with https://github.com/docker/docker/pull/9318.

man page updated for offline access to documentation.

LGTM - the text here is a direct copy of that in run.md
@fredlf @jamtur01

LGTM


Add sudo option

add option to execute command using sudo for the following methods:
hostapd.disable
hostapd.enable
ifconfig.down
ifconfig.up
iw.scan
iwlist.scan
wpa_supplicant.disable
wpa_supplicant.enable
wpa_supplicant.manual

I'm against the use of sudo inside the code, tour program has to be run as root but you don't know in which context it will be used (ubuntu, mac, archlinux, lfs...).

I think it would be best to submit a PR for the readme to simply explain how to configure sudo for the specified commands for the user executing
Something as simple as
not recommended
/etc/sudoers.d/010_username-nopasswd
username ALL=(ALL) NOPASSWD: ALL

More defined list for each bin used.
username ALL=NOPASSWD: /usr/sbin/iwlist

please rebase

please rebase

done


enhance the xds and ca certificates finding

enhance the xds and ca certificates finding:

change the environment var to match istio-agent
handle SYSTEM special case
propagate the error for RootCert::File generation

@zhlsunshine: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

test_ztunnel
7b0612988d2fcd78d64615a3d586337eaa537908
link
true
/test test

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

Hi @howardjohn, could you please help to review or merge it? Thanks ^_^


convert from .lua to .t7

Hi,
How can i covert the models from ...def.lua to ...v1.t7? Could you help me, please?

Those are created by training the DNN model


Color

Could you change code of this program, because number of color is not good for christians. Lets change this number to 777.
Now, I will show fragments, where is this code is use
}
#urlInput:focus {
border-color: #0078D7;
color: #666;
.effect-moveleft .outer-nav a {
color: #666;
padding: 15px;
margin: 0;
cursor: pointer;
#favMenu .url {
font-size: 12px;
color: #666;

Hi @USERUSERU!
In this case #777 represents a different color (see here and here).

As you can see by the table above there's plenty more to the color besides its hex representation. For more on the complexities of color representation see this post.

But it is no many deiference from 6...6 and 677 (http://www.color-hex.com/color/667777). Please change it!!!


The table with error codes does not break lines correctly and forces horizontal scrolling

URL to the relevant documentation
https://docs.quantum.ibm.com/errors
Please describe the UI problem.
https://github.com/user-attachments/assets/c554788c-a47e-430c-af31-5bc6fa86be51
Reading the error code table is hard. It seems like break lines where it should not.

Lol... my usually-broken English found a new record.
I mean that table should fit in the column to avoid the horizontal screening and, if the line is too long, it should break accordingly.


[New Feature]: Adding a 'play again' button when the game ends

🎮 feature Request
a button shows up when the game ends and asks if the user wants to play that game again.
Point down the features
right now once the game ends the screen stops there and if some one wants to play again they have to reload the page again. We can place a button that does this work for user.
Select program in which you are contributing
GSSoC24
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

@123suraj-sky I request you to assign this issue to me under GSSoC'24. Thanks!

I would like to work on this project. Please assign it to me under this GSSoC'24.

Hii @123suraj-sky  I am interested in doing this work. Please assign this to me.

assign this task to me

I want to work on the nav section, please assign me this under gssoc level 2
Record
I agree to follow this project's Code of Conduct
I'm a GSSOC'24 contributor
I want to work on this issue

@voiiiiid @jigglypufflazybaby @royalrajputayush @mdramijzamadar @akilesh1706 Please raise any other issue, i'll assign you
If you have any doubt you can directly send message on our discord (https://discord.gg/rZb46cCMmK), we have created seprate chennals for all projects...
Thank you :)

please assign me this issue


Support string literal patterns

Adds support for sorting string literal patterns in match statements, per #13. This implementation treats a string "foo" as equivalent to a path/identifier foo.
Replaces crate::compare::Path (containing Idents) with a Comparable struct that can be used to compare other types of syntax, starting here with string literals.

@dtolnay 👋🙂🤞


chore: update dependencies and configurations

Update .gitignore to exclude more development-related files
Refactor Dockerfile for better build optimization and security
Upgrade Go version to 1.23 in go.mod
Update dependencies in go.sum
Improve error handling in internal/httphandling/impl.go
Enhance test coverage in internal/httphandling/impl_test.go

@gooroo-dev review


Better mobile layout

Simple fix to display the categories better on small screens.
New:

Old:

Merged!
Thanks for your contribution


Data missing from Maharashtra 27th April Onward

No New cases in Maharashtra since 27th April? is database corrupted ?

This was an issue during the maintenance of the back end sheets. This is fixed now.


[FLAW] Browser Client of admin interface requires publicly exposed api endpoint

Bug report
System info:
influxdb:1.0.0-beta3-alpine
rancher/stack on docker-for-windows (mobylinux host)
docker --version
Docker version 1.12.0, build 8eab29e, experimental

Steps to reproduce:
Unknown, need for debugging suggestions for further isolation.
Actual behavior:

while:docker exec 4e1cf8df45e6 wget -qO- http://localhost:8086/query?q=SHOW+SERIES+WHERE+FALSE
successfully returns: {"results":[{"error":"database name required"}]}
Obviously 4e1cf8df45e6 is the influxdb container.
This means that rancher dns setting are working.
Further proof, any of those is working:

docker exec 4e1cf8df45e6 wget -qO- http://influxdb:8086/query?q=SHOW+SERIES+WHERE+FALSE
docker exec 4e1cf8df45e6 wget -qO- http://tick_influxdb_1:8086/query?q=SHOW+SERIES+WHERE+FALSE
docker exec 4e1cf8df45e6 wget -qO- http://influxdb.tick.rancher.internal:8086/query?q=SHOW+SERIES+WHERE+FALSE

None of them host names work in the UI.

Awaiting further orientation on how to track this down. I'm as of now assuming it is a problem of influx using the *rancher.internal DNS servers. But beware:
docker exec 4e1cf8df45e6 cat /etc/hostname
tick_influxdb_1

Using tick_influxdb_1 on the UI neither works. No idea about influxdb internals that could cause this behaviour.

How to enable logging for the 8083 UI service? Obviously the 8086 logs do not receive any call from the UI, only the wget calls show up.

I think this is a Docker issue and is covered by the docs for the Admin UI in the image, but the docs could potentially be better. Since you're on Windows, this is probably similar to the same issue on Mac OS X related to Docker because Docker can't be natively run.

The administrator interface is not automatically exposed when using docker run -P. While the administrator interface is run by default, the adminstrator interface requires that the web browser have access to InfluxDB on the same port in the container as from the web browser. Since -P exposes the HTTP port to the host on a random port, the administrator interface is not compatible with this setting.

The hostname you need to use is the hostname of the virtual machine or the IP address of the virtual machine. Your localhost address won't work since Docker isn't running on localhost. Please try that and respond if that's not the issue. I'm going to close this since I don't think it's related to InfluxDB.

OK, got it: The browser client needs to be able to access this. Sidenote: Actually docker-for-windows does run on localhost. So exposing this port would make it work, however this brings about another issue:

When I work with overlay networks, I do not need to expose this port to the wild, as it could potentially be a security risk. In such a setup (eg rancher) I cannot make use of the influxdb admin interface unless the client would get refactoring.

Hm, if docker-for-windows runs on localhost it should work attached to localhost. You might want to try visiting http://localhost:8086/ping and see what that returns. If that works, then the admin interface should work fine.
Yes, the admin web UI interface will not work unless it is able to access the port in some way. This is a limitation of the admin UI at the moment. Considering that the admin UI would have to be publicly exposed to begin with for it to work, it shouldn't be a very big deal to have the other port open too. I can see how it can get difficult to manage the ports, but I don't understand what you mean by a security risk. Can you explain the security risk in greater detail?

On localhost, 8086 is not exposed currently, doing so would just solve the issue. :smile:
I've just seen that graylog Browser Client has a very similar pattern, so I guess it's somewhat a quite common pattern. Without really knowing about the detailed implications, I was thinking that the api endpoint has a tough enough job receiving telegraph messages throughout the network, so I thought it might not be optimal if someone from the outside world can reach it. Proxied through a web client is probably more elegant, as this has extra auth on it and can be put behind reverse proxy / web application firewall of choice.
Sidenote: My use case is a private cloud where normally every internal communication goes through a strongswan VPN network. So it just feels awkward if this is suddenly publicly available.


chore: Highlight trimmed spaces in identifiers

Thanks for submitting a PR! Please check the boxes below:

[x] I have run pre-commit to check linting
[x] I have added information to docs/ if required so people know about the feature!
[x] I have filled in the "Changes" section below?
[x] I have filled in the "How did you test this code" section below?
[x] I have used a Conventional Commit title for this Pull Request

Changes

This will highlight any identifiers with a tooltip and a ␣ character and a tooltip.
How did you test this code?

Hmm this seems like a pretty wild usecase to have, though sure I'll do [TAB] for tab and ↵ for new lines

@kyle-ssg what about other white space chars? e.g. \n or even \t ?

This is now implemented


Ability to combine outbox messages

If there are multiple outbox messages that have the same group id, application, message definition and subscription, AS WELL AS always needing to send the most up-to-date information of a specific record via the use of a resolver, then lets give a configurable checkbox to combine all of those callouts down to 1 and then we will mark all of the outbox messages and related subscriptions as having passed.

I discussed this in #10 (second point).  Although I think it makes sense to track in a separate issue.
I'm still not 100% on the best way to go about this...
The "Checkbox" option ("Deduplicate Outbox Messages with the same GroupId for this subscription") could work but kinda feels like it is "overloading" the functionality of the Group.
What if we also included the Message "Payload" (Outbox_Message__c.Message__c) in the check?
Configuration would look something like this:

[ ] Deduplicate Similar Messages: When checked, "active" messages with the same Payload & GroupId will only be relayed once per subscription.  All matching Subscription Outbox records will be updated based on the result of the single relay.

We could then just keep track of a map of ${subscription}-${groupid}-${payload} -> result for any subscriptions where this is configured.  If we encounter a match, then we can just copy the attempts and completed status from the context and add it to the finalizer without actually running a Relay Client


Fixed Infinite loop bug in useContractReader hook

If the contract function that we are calling has no arguments and we provide a pollTime, then tried state variable is never set to true, this results in an infinite loop of contract reads.

aha nice catch! I think I also saw this bug last night https://github.com/austintgriffith/scaffold-eth/pull/282

Oh cool, i will close this then.


Add CLI commands to manage LDAP authentication source

Add 4 CLI commands:

add-ldap: Add new LDAP (via Bind DN) authentication source
update-ldap: Update existing LDAP (via Bind DN) authentication source
add-ldap-simple: Add new LDAP (simple auth) authentication source
update-ldap-simple: Update existing LDAP (simple auth) authentication source

#5726

Codecov Report

Merging #6681 into master will decrease coverage by 0.69%.
The diff coverage is 74.21%.

@@            Coverage Diff            @@
##           master    #6681     +/-   ##
=========================================
- Coverage   40.87%   40.18%   -0.7%
=========================================
  Files         416      428     +12
  Lines       57013    58346   +1333
=========================================
+ Hits        23303    23444    +141
- Misses      30589    31771   +1182
- Partials     3121     3131     +10

Impacted Files
Coverage Δ

cmd/admin.go
0% <ø> (ø)

cmd/admin_auth_ldap.go
74.21% <74.21%> (ø)

models/unit.go
0% <0%> (-14.29%)
:arrow_down:

routers/repo/view.go
41.7% <0%> (-1.01%)
:arrow_down:

cmd/dump.go
0% <0%> (ø)

cmd/hook.go
0% <0%> (ø)

cmd/web_graceful.go
0% <0%> (ø)

cmd/web.go
0% <0%> (ø)

cmd/cert.go
0% <0%> (ø)

... and 6 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b9d1fb6...53f4abc. Read the comment docs.

Gogs copyright is removed.
I also updated func parseLoginSource which wasn't right

Is there anything else needed for approval?

@zeripath config flag removed

@ngourdon sorry I didn't get a chance to properly look at this this evening. I'll try to review tomorrow evening UK time.


Feature/mx 1660 ldap search endpoint

PR Context

LDAP search endpoint in mex-backend
mex-backend has a new search endpoint returning ldap persons

Added

extract ldap: get_persons methods and tests

Changes

Deprecated

Removed

Fixed

Security

ruff-linter fails. Could not comprehend which files were re-formatted. Therefore, I re-run ruff linter in .\tests\ldap and .\mex\common\ldap. But there all checks passed.

ruff-linter fails. Could not comprehend which files were re-formatted. Therefore, I re-run ruff linter in .\tests\ldap and .\mex\common\ldap. But there all checks passed.

@vyvytranngoc you can run pdm lint to run all pre-commit checks and linters on all files -- this should give you the same errors / re-formatting as the pipeline


mj-hero: mj-text is not centered within

I've come across this on my on project and was observing it as well on the try-it-live system,
if you just start the unedited Hero-Demo, the text is "Go to space" is not centered.
it does not center if i'm settings mj-hero-content to align="center" or the align tag within mj-text to anything else, not even right was working.

MJML version 2.3.1

Hi there,
Thanks for finding this ! I'll add a fix in next version, but try it live won't be updated within 2 week, sorry about that.

well, that's quite ok,
i'm working with mjml offline on a subsystem, if theres an update for that, that would be fine :D

i've just downloaded the mjml app with mjml 2.2.0 - the problem isn't in that version :|

Yes, some refactor in 2.3 caused it

Closing this as the fix was released back in version 2.3.3.


terminate called after throwing an instance of 'std::system_error'

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): N
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):  Ubuntu 16.04.1 LTS (GNU/Linux3.13.0-105-generic x86_64)
TensorFlow installed from (source or binary): binary (tf_nightly-1.head-cp36-cp36m-linux_x86_64.whl)
TensorFlow version (use command below): 1.7.0-dev20180222
Python version: 3.6
Bazel version (if compiling from source): N/A
GCC/Compiler version (if compiling from source): N/A
CUDA/cuDNN version: CPU(Intel Xeon E5-2620 v3)
GPU model and memory: N/A
Exact command to reproduce:

>>> import tensorflow as tf
>>> hello = tf.constant('Hello, TensorFlow!')
>>> sess = tf.Session()

Describe the problem
After I installed tensorflow which was downloaded from the main page you provided on github
tf_nightly-1.head-cp36-cp36m-linux_x86_64.whl
I tried to  test the tensorflow and when I run sess = tf.Session()
I got the error:
terminate called after throwing an instance of 'std::system_error'
  what():  Resource temporarily unavailable
Aborted

I use anaconda create a new python 3.6 enviroment for tensorflow. After I downloaded the .whl package I use
pip install tf_nightly-1.head-cp36-cp36m-linux_x86_64.whl
to install the tensorflow
I've seen a similar problem and in that case his system is CentOS. So is anyone having a similar experience with this problem?

This question is better asked on  StackOverflow since it is not a  bug or feature request. There is also a larger community that reads questions there. Thanks!

@LotusWang0723 Do you solve this problem? I have the same problem.

I just run "tf.test.is_gpu_available()" and get the same error, can anyone help me?

I upgraded the CUDA and cudnn, then the error was gone.
王落桐
Lotus WANG (Ms.)
博士生
北京大学 工学院
生物医学工程系
Ph.D Candidate
Department of Biomedical Engineering
College of Engineering, Peking University
原始邮件
发件人:Victor<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>发送时间:2019年3月20日(周三) 09:26
主题:Re: [tensorflow/tensorflow] terminate called after throwing aninstance of 'std::system_error' (#17216)
I just run "tf.test.is_gpu_available()" and get the same error, can anyone help me?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@LotusWang0723 I have no root privilege, so I use conda to install cudatoolkit and cudnn. The versions matches with the official built binary. But I still got this error.

By the way, in the same context (cudatookit=10.0, cudnn=7.4), PyTorch library can run without any issues, but TensorFlow just throws this error.

I solved this problem by increasing the max user processes.

I solved this problem by increasing the max user processes.

@theonegis Can you elaborate on how to do that?

I solved this problem by increasing the max user processes.

@theonegis Could you please let me know what is the max user processes did you choose to fix the problem please ?

@oksyassine Run ulimit, check the max user processes allowed (-u)
Run ulimit -u 4096 (if 4096 is the max user processes allowed).
This shouldn't need root access.


Bar API responses very slow

Bar API is responding very slowly

Resolved
Response times are normal again

RCA can be found here: https://example.com/rca-123


How do we load vss_search from python?

I have this code with the search query in python:
vss_search_query = f"""
SELECT rowid, filenames.filepath, Page_nr, Paragraph_nr, Sliding_Paras
FROM policy_docs
JOIN filenames ON policy_docs.filename_id = filenames.id
WHERE vss_search(Sliding_Embedding, '{search_term_vector_sql}')
LIMIT 20;
"""
I get the error
in search
cur.execute(vss_search_query)
sqlite3.OperationalError: no such function: vss_search
How do we load this vss_search function from python? I looked at the python examples and I could not find anything, the examples stop at inserting vectors, they do not go to searching afterwards.

I saw issue #25 was dealing with the same issue, and the inclusion of the LIMIT parameter fixed it. However I have the LIMIT parameter already, I still get the error.
Shall I downgrade sqlite? or how can I specify only one parameter? I am not sure what these parameters are and how they relate to my code, where are they specified?

Same issue.

From docs. Try something like this instead.
select rowid, distance
from vss_xyz
where vss_search(
headline_embedding,
vss_search_params(
(select headline_embedding from xyz where rowid = 123),
20
)
)

I started getting another error now.
query = f"""
SELECT rowid,
       distance
FROM   table_faiss
WHERE  vss_search(text, vss_search_params(('Search Text'), 20))
"""

sqlite3.OperationalError: 1st argument is not a vector.
table_faiss definition below
CREATE VIRTUAL TABLE IF NOT EXISTS table_faiss USING vss0(text(384));

Moved a bit ahead, but still getting error.
from this blog i needed to use the st_encode function.
So the query now became.
with matches as (SELECT rowid, distance
from
hadith_faiss
WHERE  vss_search(text, Vss_search_params({searchQuery}, 2))
)
SELECT hadith.text, matches.distance
from matches
left join hadith on hadith.rowid = matches.rowid

where searchQuery is
searchQuery = st_encode('Search Text')

and the definition of st_encode I found here
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("sentence-transformers/all-MiniLM-L6-v2")

def st_encode(x):
  result = model.encode([x])
  return json.dumps(result.tolist()[0])

Now I am getting error while executing the query.
Traceback (most recent call last):
  File "/home/alfi/Projects/VSSTest/hadithSearch.py", line 56, in <module>
    cursor = conn.execute(query)
sqlite3.OperationalError: no such column: -0.03610825166106224, 0.10422224551439285, -0.020350800827145576, 0.06060267984867096, -0.02063363417983055, -0.0003368522156961262, 0.08490633964538574, -0.0629068985581398, 0.11395560950040817, -0.03944713622331619, 0.011840143240988255, -0.019973117858171463, ...........(hundreds of other numbers)

Entire code is below.
import json
import sqlite3
import sqlite_vss

from sentence_transformers import SentenceTransformer
model = SentenceTransformer("sentence-transformers/all-MiniLM-L6-v2")

def st_encode(x):
  result = model.encode([x])
  return json.dumps(result.tolist()[0])

conn = sqlite3.connect("hadithVSS.db")
conn.enable_load_extension(True)
sqlite_vss.load(conn)

cursor = conn.cursor()
searchQuery = st_encode('Search Text')

query = f"""
with matches as (SELECT rowid, distance
from
hadith_faiss
WHERE  vss_search(text, Vss_search_params({searchQuery}, 2))
)
SELECT hadith.text, matches.distance
from matches
left join hadith on hadith.rowid = matches.rowid
"""

cursor = conn.execute(query)
data = cursor.fetchall()
print(data)
conn.commit()
conn.close()

@GibreelAbdullah

WHERE  vss_search(text, Vss_search_params({searchQuery}, 2))

try to apply json function

WHERE  vss_search(text, Vss_search_params(json({searchQuery}), 2))

WHERE vss_search(text, vss_search_params(json("{searchQuery}"), 2))

works


Fixing bug where null on load

Fixing a bug in the logic of the plugin.
Given that the reactorComponent Vue instance is created asynchronously, reactive properties are not set up until the created hook is called.
Previous to this PR, the enter function i.e.
const enter = () => { this.currentBreakpoint = key }

did nothing when initially triggered by cb(mql) because this.currentBreakpoint had not yet been set.
This PR fixed a problem in my own project where a computed property dependent on $mq was not being correctly set when the app loaded. This meant the is-desktop class was not being bound on the page load:
template>
  <div :class="classes></div>
</template>
<script>
export default {
  computed: {
    classes() { return { 'is-desktop': this.$mq === 'desktop' } }
  }
}
</script>

Looking at the diff I think something went wrong with your commit +15,462 −255, did you add some files that were not committed before?


Closing a bi-directional stream on both ends doesn't appear to close the stream

Hi!
Note: I'm not sure this is an issue in quic-go!
I've noticed a strange behaviour when closing bi-directional streams. I have a setup with a Peer and a Server, where the Peer establishes a connection to the Server. The Server then opens bi-directional streams with the following workflow:

Open stream
Write a message
Read a response
Close the stream

On the other end, the peer is accepting streams and has the following workflow:

Accept streams
Read the message
Write a response
Close the stream

I may have understood this wrong but closing a bi-directional stream will only close the Send part of it, while the Receive is untouched. Isn't the SendStream part of the Server, the ReceiveStream part of the Peer and vice-versa? Explicitly calling Close() on both ends shouldn't close the stream, making the peer available for a new one?
I have the maximum number of streams unset, which defaults to 100. While load testing the server, I noticed that after 100 messages, it was unable to open more streams. I was opening them with the Sync approach and, after changing to the non-sync version, I confirmed that the issue was due to "too many opened streams".
I also tried, on the Server, to call CancelRead() after Close() but it didn't help.
I'm I understanding this wrong, and I need to deal with the streams in a different way?
Thanks,
Vítor

Okay, I got it working by cancelling the Read part and closing the Stream, on both the Peer and the Server. Is this the expected behavior?

No, closing the stream from both sides is sufficient, you don't need to cancel the stream.
This exact same question has been asked 100 times here.
It's explained in RFC 9000. And it's explained in great detail in the documentation: https://quic-go.net/docs/quic/streams/#states.

Thanks for your reply.
First of all, I read most of the documentation but failed to go more in-depth on the closed issues to find similar ones. My sincere apologies.
Regarding closing the streams, what I was missing was reading the io.EOF frame, which was causing the streams to hang. Closing the stream and reading the io.EOF is enough and it is the proper way to deal with the stream's lifecycle.
Thank you!
Kind regards,
Vítor

First of all, I read most of the documentation but failed to go more in-depth on the closed issues to find similar ones. My sincere apologies.

@vitorpmoreira No worries. Do you have any suggestions on how we can make the documentation more helpful? This has come up so many times, and I'd love to clarify the documentation so it's clear for new users.

I'd probably add a note to the QUIC stream's page, indicating that one must read the io.EOF in order to finish the process of closing a stream. I double checked the Bidirectional Streams part and a good place would be to add this topic to the Warning Note that is already there.
However, if I'm not mistaken, this also applies to uni streams, right? Calling the Close will require the other end to read the frame. Since there's an Opening Streams section, how about a "Closing Streams"?


Idle detection not working all the time

User feedback, windows_native_app/7.3.199

My idle detection feature is definitely not working properly. It is set in preferences to every 4 minutes but it only seems to work works every now and then.

Additional info: 226921

Fixed with #2673


Update request: nushell 0.92.1 -> 0.93.0

Package name: nushell
Latest released version: 0.93.0

Current version on the unstable channel: 0.92.1
Current version on the stable/release channel: 0.87.0

[x] Checked the nixpkgs pull requests

Notify maintainers
@Br1ght0ne @johntitor @joaquintrinanes

Note for maintainers: Please tag this issue in your PR.

Add a :+1: reaction to issues you find important.

Looks like I was mentioned, or not..... :)


fix: do not build/publish website on code changes

I have done checkout today and noticed increased size of the repo. I think the way that publish happens is that every time gh pages will generate completely different website (Every file will be changed).
Over time this will significantly increase the size of the repository as every commit on every PR deploys website! This also counts renovate bump PR's that we leave for long time (and they are build numerous times a day)

Fully support your decision, but then I think we should deploy on merge to master. We have PR's with 20 commits. Each publishing website.. to production...

but then I think we should deploy on merge to master

This is what is happening I believe?

Each publishing website.. to production..

They are not publishing until merge to master I believe?

Each publishing website.. to production..

They are not publishing until merge to master I believe?

Exactly.

My bad. Website build works but commits disabling publishing. Closing


Update wine-py2exe.sh

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] Searched the bugtracker for similar pull requests
[x] Read adding new extractor tutorial
[x] Read youtube-dl coding conventions and adjusted the code to meet them
[x] Covered the code with tests (note that PRs without tests will be REJECTED)
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[x] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Explanation of your pull request in arbitrary form goes here. Please make sure the description explains the purpose and effect of your pull request and is worded well enough to be understood. Provide as much context and examples as possible.
Various changes I needed to make to the script to make it work on my Ubuntu 20.04 LTS machine.
Namely:

changed name of wine apt package so that script doesn't crash about unrecognised package
changed sourceforge download url for py2exe to a working url
added support for where 32-bit windows libraries are installed on 64-bit machines

I have tried to make the changes generic so that they should work on all machines.

The file devscripts/wine-py2exe.sh is outdated. The Windows bundled self-extracting executable is built with Python 3.4 and py2exe-0.9.2. Have a look at build.yml in the nightly build repo.
Nonetheless this could still be useful if anyone wanted to make a Py2.7 build, probably a bit smaller.


feat(#101): CachedModelSource.java for faster ml tests

In this pull I've implemented CachedModelSource.java to cache model download in ModelSourceInternet.java. Enabled all unit tests related to ml.
closes #101

PR-Codex overview
The focus of this PR is to enhance testing efficiency by introducing a cached model source for ML tests.
Detailed summary

Updated ModelSource.java to throw Exception instead of IOException
Added CachedModelSource for caching models in ML tests
Modified test classes to use the new cached model source

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

@volodya-lombrozo take a look, please

@volodya-lombrozo yes, definitely. I didn't check the speed of code in @BeforeAll section that loads a model. 16-19ms for tests execution, and ~3seconds for model loading. I will implement some sort of caching to speed up it a bit. Is 1.5 second of model load will be considered as acceptable? WDYT?

@h1alexbel Yes, it would be great. 1.5 seconds is acceptable. Please, go ahead.

@volodya-lombrozo updated pull request, take a look again, please

@volodya-lombrozo updated pull request. Take a look again, please

@rultor merge

@rultor merge

@volodya-lombrozo OK, I'll try to merge now. You can check the progress of the merge here

@rultor merge

@volodya-lombrozo Done! FYI, the full log is here (took me 16min)


PKGI freezes when searching for the word 'solider'

Not sure why this happens but when I search for 'solider' and press enter, the app freezes. It won't respond to any button presses. No choice but to manually close the app and restart it.
I think this happens anytime a game is not listed. I typed in "NFL game" just as a test and the same thing happened.

I can confirm. If nothing is found then app freezes or crash. I'll fix it.

Awesome! ya i was doing the same thing until I wanted to grab a game that wasnt there

Fix is working.
No more crash while using "search" in right menu.
Thanks.


Virtualize and unify Community members list

This PR

[x] load all members into JS from microchain (required for searching on real name until we have a better filter solution in box queries)
[x] virtualize all members list on Community page
[ ] optimize layout for mobile (remove footer on mobile, double check header size)
[ ] merge atomic assets info into all-members list
[ ] adjust tests

Subsequent PRs

[ ] add the member search filter
[ ] separate member box queries from election box queries; organize by domain

I've used the react-virtualized package on past projects with much success, but it's not a lightweight library. Given how much I like Tanner Lindsey's react-query, I thought I'd try out his react-virtual library. While it is lightweight, I fought with it for much of the day. It's not quite ready for prime time, IMHO.
react-virtualized is smoother and more natural for the user. It provides mechanisms for hooking into the window scroll, so that platform-specific niceties that people expect (like tap-status-bar-to-scroll-to-top on Mobile Safari) just work. And it let me delete most of the workaround code I had to write to try to get react-virtual to do (not quite) what I wanted it to.


@Formula annotation in nodes for calculable fields

I want to suggest implement @Formula(value="*Cypher query*") annotation like same one from JPA. It can set fields annotated with this annotation when node is fetched from database via Neo4jRepository.
Expected Behavior
Field int rating is annotated with @Formula(value="*Cypher query*"). When findById(id) is called, repository fetches node from database and sets field rating with result of Cypher query from value field of @Formula annotation.
Current Behavior
Now it is not implemented in Neo4j-OGM, but implemented in JPA with relational databases like Postgres.
Context
I have some computable fields in my entities (calculable rating based on rows in database). I started migration from JPA and Postgres to Neo4j and faced up with lack of such functionality.
It seems to be possible to implement because of same mechanism of fetching and mapping data from database.

Hello @IlyaLisov
While I did use @Formula in the past, what would be the exact specifications you'd expect as a user? Think about

Is the formula query executed once per entity, thus leading to additional n queries when n entities are fetched.
Shall the formula query be executed as a subquery within the generated query? Which Neo4j version shall then be supported? We still support 4.x and in the line of OGM 3.2, Neo4j 3.5
If the formula is executed as a subquery, what would be the preferred way of accessing the outer query? Which conventions for variable names?
Same holds true if executed separately… Shall the properties of the entity be passed as parameters to the additional queries?

Neo4j-OGM is very flexible when it comes to custom queries. It maps mostly anything you throw it. You could compute the formal in your custom query in annotated your field with @Transient so that it does not take part in any updates.

@michael-simons It can be called for each entity like it is in Hibernate. It also can be a subquery. User writes a query in annotation, so there is no need to generate a lot of names - we can generate only alias for this subquery.
Yes, it is flexible, but maybe unifying of mapping process would lead to faster and more effective development and transition from SQL to Neo4j


Merging Test Files and Target_Loader

In future (or even now if you want to try), when removing files such as the temporary files that were accidentally added to the commit, do it so that they're removed from the history as well, either by amending the original commit, or if there are commits added after the one you want to change, make a new commit, do an interactive rebase and fixup or squash the commit into the original commit (See here for an example). This will keep the history cleaner, and it can't be done cleanly once a fork has been merged.
Also, I don't think that the test image I'd added for testing TargetIdentification is going to be terribly helpful for testing Volume Calculation. However what we really need to do it create a single resource folder to store data to be used in tests to avoid bloating the project's history. We should also perhaps configure it as a submodule so that you don't have to download the large test images when cloning the project.

Not sure what to rebase. I tried to merge 6b0c2d04049043feba33f58ba792dc5e816dd260 with e6c619ac8bdec5789e115530587e57dcba8215be...but there are a lot of commits in between, and I had problems doing so without messing with a large amount of conflicts and history.

I was talking about merging 70d6af8 with 7dbc33f, and that you should create a new commit and do the same to get rid of the unnecessary image files.
Regarding the new commits you mentioned, personally I would just get rid of e6c619a entirely and rebase the branch onto upstream/master. For 6b0c2d0, note that I have got a boolean test class implemented here on a branch. just leave it for now though; the test_update branch isn't quite ready for merging.

Ah okay. I'll close this pull request then.


Adding Config Map

Willingness to contribute
Yes. I can contribute a fix for this bug independently.
Feathr version
0.9.0
System information

OS Platform and Distribution (e.g., Linux Ubuntu 20.0): macOS Monterey
Python version: python3.9
yarn version, if running the dev UI:

Describe the problem
Configmap Support

Environemnt Variables

[ ] feathr_config.yaml


cudaPackages.backendStdenv: can't be an argument to overrideCC

Issue description
Due to the way we abuse callPackage to wrap other callPackage-ed entities, overrideCC cudaPackages.backendStdenv newCC currently fails evaluation ("function called with an unexpected argument et cetera...")
Steps to reproduce
https://gist.github.com/SomeoneSerge/891ec2b8a05a0a00214e0a395ffd1bd6#file-flake-nix
Notify maintainers
@NixOS/cuda-maintainers

I think I typoed, sorry for the ping


Question about KGC datasets

Hi,
Thanks for the great work! Could you also share the KGC datasets fb15k-237 and WN18RR (the same format as wikidata5m)? BTW, I also see the dataset codex-m in the shared data but did not find results in your paper. Did you also conduct experiments on codex-m?

Hi Apoorv,
Thanks for the great work!
I can't find the entity_strings.txt  from data/wikidata5m/entity_strings.txt but the code need it.How can I get it？

Hi thanks for your interest.
@PlusRoss We did some preliminary experiments but unfortunately we don't have any final numbers to share
@2682989487 You can run the script https://github.com/apoorvumang/kgt5/blob/main/data/get_unique_entities.py to get the entity strigns

Hi Aporv,
I found that after running get_unique_entities. py, there will be some samples with three | in the training data, causing the program to fail. This problem was mentioned in question 2 #2 ，Has this problem been solved?

Hi, please see https://github.com/apoorvumang/kgt5/issues/18#issuecomment-1227189777 for the updated mappings from wikidata ID to text. You can use these to reconstruct the dataset. I would recommend using these.
I will update the readme soon to point to these mappings instead of our earlier kgc dataset. Let me know if this works for you or not

In #2 , I encountered a solved problem, that is, I could not get the entity string from wikidata5m. I seem to be using an old dataset. I will try to update the mapping from wikidata ID to text, thank you for your answer, and look forward to the update of the readme file.


Generic type constraint resolution doesn't see arrays as IEnumerable<>

Can you help please?
I've created a service with a generic constraint for IEnumerable<> on it - it works as expected with a List<T> but not T[]
public interface IMyThing<T> { }
public interface IMyThing<T, TValue> : IMyThing<T>
    where T : IEnumerable<TValue> { }

public class MyThing<T, TValue> : IMyThing<T, TValue>
    where T : IEnumerable<TValue> { }

var container = new Container();
container.Register(typeof(IMyThing<>), typeof(MyThing<,>), Reuse.ScopedOrSingleton);

// Works - constraint of IEnumerable<TValue> brings int from List<int> into the 2nd generic parameter.
container.Resolve<IMyThing<List<int>>>().ShouldBeOfType<MyThing<List<int>, int>>();

// Works - type is compliant with the generic constraints - would not compile otherwise.
var q = new MyThing<int[], int>();

// Fails when we try to resolve it through the container
container.Resolve<IMyThing<int[]>>().ShouldBeOfType<MyThing<int[], int>>();

Full exception is:
 ArrayDoesntMatch
   Duration: 48 ms

  Message:
    Test method GenericConstraintResolutionTests2.ArrayDoesntMatch threw exception:
    DryIoc.ContainerException: code: Error.NoMatchedGenericParamConstraints;
    message: Open-generic service does not match with registered open-generic implementation constraints Sqleze.Tests.GenericConstraintResolutionTests2.MyThing<,> when resolving: resolution root Sqleze.Tests.GenericConstraintResolutionTests2+IMyThing`1[System.Int32[]]
      from container without scope. ---> System.ArgumentException: GenericArguments[0], 'System.Int32[]', on 'Sqleze.Tests.GenericConstraintResolutionTests2+MyThing`2[T,TValue]' violates the constraint of type 'T'. ---> System.TypeLoadException: GenericArguments[0], 'System.Int32[]', on 'Sqleze.Tests.GenericConstraintResolutionTests2+IMyThing`2[T,TValue]' violates the constraint of type parameter 'T'.

  Stack Trace:
    RuntimeTypeHandle.Instantiate(Type[] inst)
    RuntimeType.MakeGenericType(Type[] instantiation)
    --- End of inner exception stack trace ---
    RuntimeType.ValidateGenericArguments(MemberInfo definition, RuntimeType[] genericArguments, Exception e)
    RuntimeType.MakeGenericType(Type[] instantiation)
    <>c.<GetGeneratedFactoryOrDefault>b__16_0(Type t, Type[] a) line 11598
    ReflectionTools.TryCloseGenericTypeOrMethod[T](T openGenericTypeOrMethod, Type[] typeArgs, Func`3 closeGeneric, Boolean throwCondition, Int32 error, Request r) line 14613
    --- End of inner exception stack trace ---
    ReflectionTools.TryCloseGenericTypeOrMethod[T](T openGenericTypeOrMethod, Type[] typeArgs, Func`3 closeGeneric, Boolean throwCondition, Int32 error, Request r) line 14618
    WithAllDetails.GetGeneratedFactoryOrDefault(Request request, Boolean ifErrorReturnDefault) line 11596
    IContainer.ResolveFactory(Request request) line 902
    Container.ResolveAndCache(Int32 serviceTypeHash, Type serviceType, IfUnresolved ifUnresolved) line 398
    IResolver.Resolve(Type serviceType, IfUnresolved ifUnresolved) line 386
    Resolver.Resolve[TService](IResolver resolver, IfUnresolved ifUnresolved) line 8433
    GenericConstraintResolutionTests2.ArrayDoesntMatch() line 47

I will backport.

@alansingfield DryIoc v5.3.1 with the fix is out on nuget.

Maksim, I've updated to 5.3.1 and all my tests now pass. Thanks again for your help.


Inputstream leakage in ParquetFileWriter.appendFile

Current implementation of ParquetFileWriter.appendFile is:

public void appendFile(InputFile file) throws IOException {
    ParquetFileReader.open(file).appendTo(this);
 }
this method never closes the inputstream created when the file is opened in the ParquetFileReader constructor.
This leads for instance to TooManyFilesOpened exceptions when large merge are made with the parquet tools.
something  like
 try (ParquetFileReader reader = ParquetFileReader.open(file)) {
    reader.appendTo(this);
 }
would be cleaner.

Reporter: Arnaud Linz
Assignee: Fokko Driesprong / @Fokko
PRs and other links:

GitHub Pull Request #611

Note: This issue was originally created as PARQUET-1470. Please see the migration documentation for further details.

Nándor Kollár / @nandorKollar:
Sounds like a reasonable improvement. Would you mind opening a PR?

Wes McKinney / @wesm:
[~ArnaudL] we all propose changes to the Parquet repositories using pull requests, not by pushing directly to the repo. Another committer will merge your patch if it is accepted

Arnaud Linz:
I tried, but I'm not a regular commiter and don't have push access to the repo. It would be quicker if someone else takes care of it.


Is this repository original google tacotron github??

I have a question.
google presented tacotron paper
but i couldn't find google tacotron source.
@keithito  just implemented voice synthesis program base on tacotron paper???
or this repo is original google tacotron source???

@weegwangjin No, this is not a google project.

@NTT123 so, google didn't open their source??

Yes, they didn't.


Creat xatu.txt

Xi`an Technological University

Student email using @st.xatu.edu.cn
school website:https://en.xatu.edu.cn/

@Iridescent-9 I am sorry, this request has signs of fraud. I have to close it without merging. If you are a student of this school, please apply with official document ("OFFICIAL DOCUMENT" tab at https://www.jetbrains.com/shop/eform/students).


Docker Engine hangs after calling "docker stop"

Description
This issue is sporadic and does only occur once a day on our Jenkins node. We are running our Jobs in a Docker container using the Jenkins Docker pipeline plugin. At the end of a Job the plugin stops the container and will hang from there on.
Steps to reproduce the issue:

This is sporadic and not reproducible step by step

Describe the results you received:
No repsonse from daemon to docker ps, docker stop <container>, docker kill <container>
Describe the results you expected:
Normal responses when calling docker ps, ...
Additional information you deem important (e.g. issue happens only occasionally):
Output of docker version:
Client:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   23cf638
 Built:        Thu Aug 18 05:22:43 2016
 OS/Arch:      linux/amd64

Server:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   23cf638
 Built:        Thu Aug 18 05:22:43 2016
 OS/Arch:      linux/amd64

Output of docker info:
Containers: 5
 Running: 1
 Paused: 0
 Stopped: 4
Images: 2
Server Version: 1.12.1
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 29
 Dirperm1 Supported: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: host bridge null overlay
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Security Options: apparmor
Kernel Version: 3.13.0-48-generic
Operating System: Ubuntu 14.04.4 LTS
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 992.5 MiB
Name: jenkins-node-1.internal
ID: IOJZ:PGC4:4HVY:4DKY:32EP:...
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: 23
 Goroutines: 45
 System Time: 2016-10-06T09:33:37.423801303Z
 EventsListeners: 0
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Insecure Registries:
 <IP_ADDRESS>/8

Additional environment details (AWS, VirtualBox, physical, etc.):
Docker is running on an EC2 t2.micro instance with Ubuntu 14.04.3.
Log output of a normal "docker stop" called from the Jenkins plugin:
time="2016-10-05T13:59:28.707836999Z" level=debug msg="Calling POST /v1.24/containers/75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a/stop?t=10"
time="2016-10-05T13:59:28.707907143Z" level=debug msg="Sending 15 to 75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a"
time="2016-10-05T13:59:38.708608718Z" level=info msg="Container 75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a failed to exit within 10 seconds of signal 15 - using the force"
time="2016-10-05T13:59:38.708649191Z" level=debug msg="Sending 9 to 75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a" ESC[37mDEBUESC[0m[5863] containerd: process exited                    ESC[37midESC[0m=75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a ESC[37mpidESC[0m=init ESC[37mstatusESC[0m=137 ESC[37msystemPidESC[0m=9973
time="2016-10-05T13:59:38.715182786Z" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"exit\", Id:\"75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a\", Status:0x89, Pid:\"init\", Timestamp:(*timestamp.Timestamp)(0xc820772e00)}"
time="2016-10-05T13:59:38.715501347Z" level=debug msg="Revoking external connectivity on endpoint pedantic_franklin (57dd9c924af5b9c48f9d193b748aa57dc8efb101786132ecdc1c55842979ec8c)"
time="2016-10-05T13:59:38.756258676Z" level=debug msg="Releasing addresses for endpoint pedantic_franklin's interface on network bridge"
time="2016-10-05T13:59:38.756291308Z" level=debug msg="ReleaseAddress(LocalDefault/<IP_ADDRESS>/16, <IP_ADDRESS>)"
time="2016-10-05T13:59:39.938467748Z" level=debug msg="Calling DELETE /v1.24/containers/75190c7ed862395af5a4dfed025f6f27a3bb39da9393a61ef724e698ab8d325a?force=1"

time="2016-10-05T14:01:56.270713926Z" level=debug msg="clean 182 unused exec commands"
time="2016-10-05T14:06:56.270678517Z" level=debug msg="clean 152 unused exec commands"

Log output of a "docker stop" called from the Jenkins plugin when the daemon does not respond afterwards:
time="2016-10-05T14:59:33.611998832Z" level=debug msg="Calling POST /v1.24/containers/b78f9f03b798f25a9eee84ac9db53f20bb7a6edf8059b640846c128b9f1f1e59/stop?t=10"
<< nothing, after calling stop, follows >>

dmesg and docker.log after calling kill -s SIGUSR1 <PID>:
https://gist.github.com/foxylion/166ffed66c95e46a7e12dd5c54447794
After such a container hangs it is possible to call docker run, but not docker ps or docker kill b78f9f03b798f25a9eee84ac9db53f20bb7a6edf8059b640846c128b9f1f1e59 to get rid of the hanging container.

Can you please send SIGUSR1 to the hung daemon and grab the stack trace from the daemon logs?
Also can you check dmesg?

Yes, I'll update the issue as soon as it happens again.

So, I got the stack traces, dmesg does not show anything new, but I've attached it anyways.
https://gist.github.com/foxylion/166ffed66c95e46a7e12dd5c54447794

@mlaventure I'm not sure since I've only glanced on this, but looks like it's stuck waiting for an exec to finish here: https://gist.github.com/foxylion/166ffed66c95e46a7e12dd5c54447794#file-docker-log-L715

It looks like the daemon is stuck waiting for an exec IOs to be closed.
@foxylion do you think you would be able to pinpoint which exec is being stuck?
The list of running containers can be retrieved through the filesystem:
$ ls -l /var/run/docker/libcontainerd/containerd/

The execs via:
$ find /var/run/docker/libcontainerd/containerd/ -mindepth 2 -maxdepth 2 -type d ! -name init

The base name of the result is the exec id. Could you check then that there's no process left in the system referring to this id?
Thanks

@mlaventure Okay here are the outputs (not that much):
root@rex:~# ls -l /var/run/docker/libcontainerd/containerd/
total 156
drwxr-xr-x 3 root root     80 Oct 10 15:59 193deeee7387e265e10175c0132c7c2dbc41392113b8022c4a94fbeb5b8d740c
-rwxr-xr-x 1 root root 158244 Oct 11 01:50 events.log

Second command does not return anything.
root@rex:~# find /var/run/docker/libcontainerd/containerd/ -mindepth 2 -maxdepth 2 -type d ! -name init

When calling ps aux | grep docker it returns something, maybe that helps:
root@rex:~# ps aux | grep docker
root     15828  0.0  0.1 190840  1960 ?        Sl   Oct10   0:00 docker-containerd-shim 193deeee7387e265e10175c0132c7c2dbc41392113b8022c4a94fbeb5b8d740c /var/run/docker/libcontainerd/193deeee7387e265e10175c0132c7c2dbc41392113b8022c4a94fbeb5b8d740c docker-runc
root     15895  0.0  0.8 119192  8988 ?        Sl   Oct10   0:00 docker exec 193deeee7387e265e10175c0132c7c2dbc41392113b8022c4a94fbeb5b8d740c env BUILD_DISPLAY_NAME=... BUILD_ID=... BUILD_NUMBER=... BUILD_TAG=... BUILD_URL=... CLASSPATH= ENCRYPTION_KEY=... EXECUTOR_NUMBER=1 HUDSON_HOME=/var/jenkins_home HUDSON_SERVER_COOKIE=... HUDSON_URL=... JENKINS_HOME=/var/jenkins_home JENKINS_SERVER_COOKIE=... JENKINS_URL=... JOB_BASE_NAME=... JOB_NAME=... JOB_URL=... NODE_LABELS=... NODE_NAME=rex... WORKSPACE=... nohup sh -c echo $$ > '/home/jenkins/workspace/.../durable-be0c937f/pid'; jsc=durable-bbe3408c905faaab0a5ce062be5372d8; JENKINS_SERVER_COOKIE=$jsc '/home/jenkins/workspace/.../durable-be0c937f/script.sh' > '/home/jenkins/workspace/.../durable-be0c937f/jenkins-log.txt' 2>&1; echo $? > '/home/jenkins/workspace/.../durable-be0c937f/jenkins-result.txt'
root     25407  0.0  0.8 119192  8824 ?        Sl   Oct10   0:00 docker stop 193deeee7387e265e10175c0132c7c2dbc41392113b8022c4a94fbeb5b8d740c
root     25565  0.0  0.0  10436   888 pts/2    S+   07:10   0:00 grep --color=auto docker
root     26241  0.0  2.2<PHONE_NUMBER>4 ?        Ssl  Oct10   0:33 /usr/bin/dockerd --bip=<IP_ADDRESS>/16 --storage-driver=aufs -D --raw-logs
root     26257  0.0  0.6 245232  6680 ?        Ssl  Oct10   0:10 docker-containerd -l unix:///var/run/docker/libcontainerd/docker-containerd.sock --shim docker-containerd-shim --metrics-interval=0 --start-timeout 2m --state-dir /var/run/docker/libcontainerd/containerd --runtime docker-runc --debug

@foxylion thanks for the output.
Effectively, it seems like as far that containerd is concerned, the exec process is dead. Could you attach the events log from containerd (at /var/run/docker/libcontainerd/containerd/events.log) and your daemon log please?
docker stop  gets stuck because the path that is waiting for the exec IOs to be closed has the container lock taken.

@mlaventure As soon as it occurs again I'll post the events.log.


gRPC fails to load data using storage_write_api

Specifically, using TARGET_BIGQUERY_DEBUG=true, I get the error:
google.api_core.exceptions.NotFound: 404 Requested entity was not found. Entity: projects/summitsift/datasets/test_data/tables/users/streams/_default

I don't know how gRPC works well enough to investigate this error. Looking at BigQuery, the dataset summitsift.test_data is created correctly, and it contains a table users with the correct schema.
What I can say is that

it's a custom tap, though loadertarget-jsonl works just fine
tap-carbon-intensity works fine most of the time with the same config (I can't reproduce it now)

meltano.yml:
  - name: target-bigquery
    variant: z3z1ma
    pip_url: git+https://github.com/z3z1ma/target-bigquery.git
    config:
      credentials_path: ${credentials}
      dataset: test_data
      denormalized: true
      fail_fast: true
      flattening_enabled: false
      location: europe-west1
      project: ${project}
      column_name_transforms:
        snake_case: true
        add_underscore_when_invalid: true

Interesting... I had this weird idea that it might be a race condition because I was only loading 40 records. So I ran it for 400 records and got this error instead:
google.api_core.exceptions.InvalidArgument: 400 Invalid proto schema: BqMessage.proto: AnonymousProto_bd328dbff4be7bd443dbe33af00f5f063ab87b11.attributes: ".net.proto2.python.public.target_bigquery.AnonymousProto_d1305d34ce666248739e2394ea7836d25b5d29a5" is not defined. Entity: projects/summitsift/datasets/test_data/tables/users/streams/_default


Fastboot mode, isAuthenticated always fasle

I'm enable the cookie store
// app/session-stores/application.js
import CookieStore from 'ember-simple-auth/session-stores/cookie';
export default CookieStore.extend();

in route
if (this.get('session.isAuthenticated')) {
  this.transitionTo('private.transactions');
} else {
  this.transitionTo('login', { queryParams: { previousUrl: 'private.transactions' } });
}

Cookies added after logging in, but this.get('session.isAuthenticated') always false.
Do you know how i can get session.isAuthenticated in fastboot mode?

Hm, this should work out-of-the-box. Which authenticator are you using and what do the session contents look like?

We have recently experienced this behaviour in our application too. It seems to be broken with v1.7.0, using v1.6.0 works for us as expected.

This seems to be an ember-fetch/fastboot issue - @mike-north has a good write-up on the cause here: https://github.com/ember-cli/ember-fetch/issues/115#issuecomment-419741647


panic during index rebuild with azure backend

Output of restic version
# restic version
restic 0.7.3
compiled with go1.9 on linux/amd64

How did you run restic exactly?
restic rebuild-index
What backend/server/service did you use?
Azure
Expected behavior
Rebuild the index
Actual behavior
# restic rebuild-index
counting files in repo
[1:26:41] 100.00%  197020 / 197020 packs
finding old index files
storage: service returned error: StatusCode=413, ErrorCode=RequestBodyTooLarge, ErrorMessage=The request body is too large and exceeds the maximum permissible limit.
RequestId:059980c3-001e-0066-36ba-4d2ff1000000
Time:2017-10-25T17:56:17.7914151Z, RequestInitiated=Wed, 25 Oct 2017 17:56:17 GMT, RequestId=059980c3-001e-0066-36ba-4d2ff1000000, API Version=2016-05-31, QueryParameterName=, QueryParameterValue=
CreateBlockBlobFromReader
github.com/restic/restic/internal/backend/azure.(*Backend).Save
	src/github.com/restic/restic/internal/backend/azure/azure.go:166
github.com/restic/restic/internal/repository.(*Repository).SaveUnpacked
	src/github.com/restic/restic/internal/repository/repository.go:230
github.com/restic/restic/internal/repository.(*Repository).SaveJSONUnpacked
	src/github.com/restic/restic/internal/repository/repository.go:215
github.com/restic/restic/internal/index.Save
	src/github.com/restic/restic/internal/index/index.go:292
github.com/restic/restic/internal/index.(*Index).Save
	src/github.com/restic/restic/internal/index/index.go:263
main.rebuildIndex
	src/github.com/restic/restic/cmd/restic/cmd_rebuild_index.go:67
main.runRebuildIndex
	src/github.com/restic/restic/cmd/restic/cmd_rebuild_index.go:43
main.glob..func17
	src/github.com/restic/restic/cmd/restic/cmd_rebuild_index.go:21
github.com/restic/restic/vendor/github.com/spf13/cobra.(*Command).execute
	src/github.com/restic/restic/vendor/github.com/spf13/cobra/command.go:650
github.com/restic/restic/vendor/github.com/spf13/cobra.(*Command).ExecuteC
	src/github.com/restic/restic/vendor/github.com/spf13/cobra/command.go:729
github.com/restic/restic/vendor/github.com/spf13/cobra.(*Command).Execute
	src/github.com/restic/restic/vendor/github.com/spf13/cobra/command.go:688
main.main
	src/github.com/restic/restic/cmd/restic/main.go:69
runtime.main
	/usr/local/go/src/runtime/proc.go:185
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:2337

Steps to reproduce the behavior
Reproduction might be difficult as it appears my repo may be corrupt.
Do you have any idea what may have caused this?
Not exactly.
Do you have an idea how to solve the issue?
No.

Thanks for reporting this issue! It looks like the Azure API rejects uploads larger than 256 MiB: https://godoc.org/github.com/Azure/azure-sdk-for-go/storage#Blob.CreateBlockBlobFromReader
We need to handle this differently, but I'm not sure how.
@tamalsaha would you mind having a look?

Ping @diptadas

This is resolved in #1412, we're restricting index files to 100MiB. I'm closing this issue for now, please feel free to add further comments. Thanks!


Sort Companies & add kidfund

Thanks and welcome!

Loving it! Using it to manage single instance Digital Ocean servers for QA & Stage, and a 4 server cluster at Armor for production


x/website: Effective go docs say there are 3 forms of for but with for .. range there are 4

What is the URL of the page with the issue?
https://go.dev/doc/effective_go
What is your user agent?
Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:108.0) Gecko/20100101 Firefox/108.0
Screenshot

What did you expect to see?
I expected the
for key, value := range
form of a for loop to conform to one of the three for loop forms listed above, since the doc says there are only three forms.
What did you see instead?
Three forms listed, then immediate use of the fourth (for..range) form.

key, value :=  range oldMap is a single condition in the second form.


Move the tag / feed file generation earlier in the posts hooks.

May resolve issue discussed in https://github.com/rcgsheffield/hpc-changelog/pull/16
Will Should resolve problem with local build process needing to run twice to generate the tag / feed precursor files, then a second time to generate the static site files (but doesn't?)
May need to force the hook to do a full regenerate when new tags/feeds are detected / added.

This will not resolve the issue but I do want to shift this earlier so I will merge this and put in another PR for fixes to the build process.


Update vote.sh

make props list more robust for differing chain outputs (such as Stride vs Kujira)

breaks Kujira, needs fixing


training-server: activate omero-ms-zarr

This starts the latest docker image for omero-ms-zarr from Docker Hub, listening on port 8080. This will allow us to point notebooks and similar at:
https://workshop.o.org:8080/image/$ID.zarr
Suggestions for similar other configuration welcome. It is unclear how many concurrent users this single endpoint will be able to handle.
cc: @pwalczysko @mtbc @will-moore @jburel @manics

I think I will use that approach in the ilastik notebook instead of endpoint_url = 'https://minio-dev.openmicroscopy.org/'
since we can then show both use cases in action cc @dominikl

One potential nice to have would be to set add a read-only DB user to the system.

A check-mode run shows:
TASK [Run docker for omero-ms-zarr] ********************************************************************************************************************************************************************************************
changed: [workshop.openmicroscopy.org]

TASK [Iptables Docker forward rules] *******************************************************************************************************************************************************************************************
System rules were not changed (e.g. rule weight changed, redundant rule, etc)
changed: [workshop.openmicroscopy.org]

TASK [Iptables Docker nat rules] ***********************************************************************************************************************************************************************************************
--- before
+++ after
@@ -1,4 +1,5 @@
 *nat
 -A POSTROUTING -o ens192 -j MASQUERADE -m comment --comment ansible[docker_outreach_nat]
 -A INPUT -p tcp -m tcp --dport 10389 -s <IP_ADDRESS>/0 -j ACCEPT -m comment --comment ansible[docker_outreach_nat]
+-A INPUT -p tcp -m tcp --dport 8080 -s <IP_ADDRESS>/0 -j ACCEPT -m comment --comment ansible[docker_outreach_nat]
 COMMIT

changed: [workshop.openmicroscopy.org]

however I'm currently having issues starting the image manually on workshop.

@pwalczysko et al. this has been updated to match workshop.o.org. I haven't deployed to any other servers.

....updated to match workshop.o.org.

This assumes you somehow did something on workshop manually ?
And you mean you did not run the playbook against any servers ?

This assumes you somehow did something on workshop manually ?

I tested the solution manually, but then I ran the playbook against just workshop and not the other servers in the inventory using -l workshop.openmicroscopy.org

Diff certainly looks plausible.

@manics: pushed

Thanks. @pwalczysko : a re-run on workshop would be good to deploy v0.1.2

Using omero-ms-zarr did not work when pointing to workshop this morning
i.e. workshop.o.org:8080/image/id.zarr

The iptables solution didn't work, so we're proxying through https:// port 443:
ome_zarr info https://workshop.openmicroscopy.org/image/1.zarr
root_attrs {'multiscales': [{'datasets': [{'path': '0'}], 'version': '0.1'}], 'omero': {'channels': [{'color': '00FF00', 'coefficient': 1.0, 'active': True, 'label': '525', 'window': {'min': 90.0, 'max': 367.0, 'start': 103.85, 'end':<PHONE_NUMBER>9999998}, 'family': 'linear', 'inverted': False}, {'color': 'FF0000', 'coefficient': 1.0, 'active': True, 'label': '632', 'window': {'min': 89.0, 'max': 151.0, 'start': 89.0, 'end': 151.0}, 'family': 'linear', 'inverted': False}], 'rdefs': {'defaultT': 96, 'model': 'color', 'defaultZ': 0}, 'name': 'test11_R3D.dv', 'id': 1}}

Even if it did work port 8080 is blocked at the UoD firewall. Are there any advantages in not proxying through Nginx?

All the commits from here taken and deployed on wrorkshop and outreach servers.
Went fine, the servers are alive and browsing and viewing is intact.
cc @joshmoore


Updated the architecture document including the diagram to include the reverse vpn tunnel and sni.

How to categorize this PR?

/area documentation
/kind enhancement
What this PR does / why we need it:
It updates the architecture document and adds an updated version of the architecture diagram. It is based on https://github.com/gardener/documentation/pull/248.
Which issue(s) this PR fixes:
Fixes #4120
Special notes for your reviewer:
Release note:

None.

Thanks! In the picture, there is an "request arrow" from the Istio Ingress LB to the API Server of the shoot, but doesn't it first go to Envoy and only from their to the API Server?

Thanks! In the picture, there is an "request arrow" from the Istio Ingress LB to the API Server of the shoot, but doesn't it first go to Envoy and only from their to the API Server?

You are correct that on a lower level the flow is:
infrastructure load balancer => isto-ingress/envoy => kube-apiserver
I intentionally combined the load balancer and the istio-ingress/envoy components semantically to have a more concise structure. Do you want me to add it?

OK, no strong opinion, maybe it's out of scope of this PR as the goal was to reflect the changes related to the ReversedVPN.

If there are no other thoughts on this PR, let's merge it by end of today.

Has the ReservedVPN graduated to beta?
There are other changes in the architecture that can be contributed, like the CSI controllers, rename calico to something more general as cilium is also supported. Gardenlet is not connected only to the Gardener API, but also the Seed and Shoot APIs. There is dependency watchdog, gardener resource manager, etcd druid. Should n't this change also show the ManagedIstio components? What about the apiserver proxy component in the shoots?

@vpnachev Isn't this out of scope of this PR? The purpose of @ScheererJ was to fix #4120 which he did.
Personally, I think we might want to overhaul the architecture picture to make it less "complex" (I have this on my "TGIF" list, still, didn't make it yet).

I was just wondering why we want to touch only the VPN that is still alpha. And instead of depicting the exact implementation, shouldn't we just show that there is some VPN solution that bridges the seed and shoot networks. Currently we have 3 different solutions and obviously we cannot show all of them in this picture.
The rest is for sure out of the scope of this PR. I just wanted to show that there is a lot of components that are implemented but missing in this picture.

@vpnachev What's your concrete suggestion then, holding the PR until the ReversedVPN is the default?

Yes, this my personal opinion.
But I am fine if rest of the team wants and merge this even now when it is still alpha.

Yes, this is my personal opinion.
But I am fine if rest of the team wants and merge this even now when it is still alpha.

There was no other feedback from anybody else yet. Personally, I'm fine with both. @ScheererJ Would you be okay with closing this PR until the ReversedVPN gets promoted to beta, or do you prefer to merge this even now?

I did the pull request in response to #4120. No hard feelings if you think that now is not the right time.
@RaphaelVogel What is you opinion as you opened the issue?

Sorry for jumping late in. The reason for the request to update the picture/documentation is that we are going to start a Beta program on our LIVE landscape for CCloud soon. I was told, that before starting a Beta program, the documentation should be up-to-date. @hoeltcl is this correct?

@RaphaelVogel In this repository we are maintaining open-source documentation which is/should be independent of internal timelines or milestones of dedicated companies.

Sorry for jumping in late. The reason for the request to update the picture/documentation is that we are going to start a Beta program on our LIVE landscape for CCloud soon. I was told, that before starting a Beta program, the documentation should be up-to-date. @hoeltcl is this correct?

Requirement came from the TM workshop last week. Isn't there an internal location for the architecture diagram?

Not sure what TM is, but I guess all of this speaks for closing this PR for now and wait for the beta promotion of ReversedVPN. Any objections?

TM=Threat Modelling
However, the diagram to be updated based on the thread modelling was already updated in #4159.

/close as discusssed above

Also, see https://github.com/gardener/gardener/pull/4157#issuecomment-859310002, we might need to re-draw this entire picture soon anyways, hopefully less complex and more clean.


Update API Parameter Abstraction section in README

The README contains the following code snippet:
Alamofire.request(Router.Search(query: "foo bar", page: 1)) // ?q=foo+bar&offset=50
I found that the resulting query is not ?q=foo+bar&offset=50 as the comment indicates, but rather ?q=foo%20bar&offset=50.
Perhaps a bigger issue is that as I'm trying to work with the GitHub Search API, I'm unable to include + signs in my query, and GitHub doesn't seem to like the encoded version of + (%2B), nor the encoded version of space (%20).

@joshuatbrown I believe Alamofire is handling URI encoding correctly, but it is very strange that GitHub Search API wouldn't handle decoding the URI correctly.
You could work around this issue with the GitHub  Search API by implementing a custom encoded (see ParameterEncoding.swift), that wraps the URL encoded and replaces the encoded characters that the API can't handle with decoded characters (%2B -> +, %20 ->  ).

@tobiasoleary Thanks for the tip on implementing a custom encoding - I'll go that route for now. I appreciate it!

It looks like #167 is where this was changed. But since the + sign wasn't included in parameter encoded values before, should it be?

And suddenly, GitHub Search is working with the encoded + sign (%2B).

@joshuatbrown Glad GitHub Search started working for you. I've looked into your question.
After reading (When to Encode - Section 2.4 - RFC3986)[http://tools.ietf.org/html/rfc3986#section-2.4] I believe it should be encoded, since Alamofire does build the URI up from its component parts.

@tobiasoleary :+1: I think that issue can be put to rest, then. I still think the docs need to be updated, so perhaps I'll do that now.

@joshuatbrown I worry that my initial assessment is flawed. After reading Reserved Characters - Section 2.2 - RFC3989.
Since encoded reserved characters are not necessarily semantically identical to unencoded characters.
For example, suppose I want to search GitHub for an extensions (MyExtension) of some class (MyClass). In some languages convention dictates that you name the file the extension is in with a plus symbol (MyClass+MyExtension.filtetype). So I search for MyClass+MyExtension.
Now if the search url is encoded as ?q=MyClass%2BMyExtension that should indicate I want to search for the string "MyClass+MyExtension", however it the search url is ?q=MyClass+MyExtension that should indicate I want to search for the strings "MyClass" and "MyExtension". This is according to the RFC3986.
Now the reason I believe Alamofire should not change what is currently does is many real-world web applications ignore the semantic differences.
For example, doing the following searches lead to equivalent results:

https://www.google.com/#q=my+wife+is+beautiful
https://www.google.com/#q=my%2Bwife%2Bis%2Bbeautiful

Same with bing:

(https://www.bing.com/search?q=my+dog+eats+poop)[https://www.bing.com/search?q=my+dog+eats+poop]
(https://www.bing.com/search?q=my%2Bdog%2Beats%2Bpoop)[https://www.bing.com/search?q=my%2Bdog%2Beats%2Bpoop]

If the API you are integrating with doesn't ignore the semantic differences, then you can implement a custom encoder.

Thank you for your excellent discussion here @joshuatbrown and @tobiasoleary! It is much appreciated and allows others using Alamofire to learn from you. 👍🏻
I've dug through this discussion along with PR #500 and have combined everything into PR #504. If you could take a look I'd appreciate it. I'm going to close this issue out for now. Please direct all info related to this topic to #504 from this point.
Thanks again! 🍻


Update doc

@agahkarakuzu I could compile the doc without any issue.
I just saw some problems with qsm_sb:

Header is not complete

     Explanation of all parameters:
        chiSBM
        chiSB
        chiL2M
        chiL2
        nfm
        unwrappedPhase
        maskOut (maskSharp, gradientMask or same as the input)

Output map does not make sense to me:

@tanguyduval I did not know that it was on purpose. Thanks for the input.
There is a long explanation of why the figure is like that, but I will fix it on this branch.

Coverage remained the same at 43.746% when pulling 49626a0cadf7d11931627dc840327eead3f5fa77 on update_doc into 6571c9b1e8e6e084bd4b1327d4ce0af0b9fc61ff on master.

@mathieuboudreau this branch is ready to be merged:

Resolves issues regarding qsm_sb documentation.

Now the output image makes sense
Header is complete

This required a workaround, because unlike other voxelwise=0 methods, this one is computationally intensive. You can see explanations in the doc.
https://qmrlab.readthedocs.io/en/update_doc/qsm_sb_batch.html#9

Fixes PR template issue.

Used my administrator privileges to merge this pull request. Changes in documentation and minor edits on community files.