TusCommunicationError when uploading a video of 500MB

Hi, i have an issue when i try to upload videos (500MB as minimum), at begin is uploading correctly, after a while i got an exepcion, it work perfectly when i upload small video (4MB), i'm using python-sdk with the function upload inside my class, in the construct i initialize the user
`class VimeoAPI():

def upload_file(self,file_path,file_name,file_description):
	file = self._service.upload(file_path,
		data = {
			"name" : file_name,
			"description" : file_description,
			"privacy.add" : False,
			"privacy.comments" : "nobody",
			"privacy.download" : False,
			"privacy.embed" : "private",
			"privacy.views" : "unlisted",
			"chunk_size" : (100 * 1024 * 1024) # 100 MB
		}
	)
	return {
		"response" : True if file else False,
		"video_uri" : file
	}
`

Python-sdk only use the "tus" option to upload video (when using the upload function inside the Pyvimeo), i'm getting errors based in the tus-py-client, im gettin this exception from tusclient inside exception.py in the vimeo-sdk:
message = getattr(response, 'message') AttributeError: 'TusCommunicationError' object has no attribute 'message'
The exception class is this:
class TusUploadFailed(TusCommunicationError):

"""Should be raised when an attempted upload fails"""
pass

How you can see, the exception is empty and i'm getting that exception, also, i'm getting this:
raise TusCommunicationError(error) tusclient.exceptions.TusCommunicationError: HTTPSConnectionPool(host='files.tus.vimeo.com', port=443): Max retries exceeded with url: /files/vimeo-prod-src-tus-us/8c77eeeb2a0ec1aa466cf045d9c042d6 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f1e52422a90>: Failed to establish a new connection: [Errno 110] Connection timed out',))
###############################
###############################
raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPSConnectionPool(host='files.tus.vimeo.com', port=443): Max retries exceeded with url: /files/vimeo-prod-src-tus-us/8c77eeeb2a0ec1aa466cf045d9c042d6 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f1e52422a90>: Failed to establish a new connection: [Errno 110] Connection timed out',))
###############################
###############################
raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='files.tus.vimeo.com', port=443): Max retries exceeded with url: /files/vimeo-prod-src-tus-us/8c77eeeb2a0ec1aa466cf045d9c042d6 (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f1e52422a90>: Failed to establish a new connection: [Errno 110] Connection timed out',))
###############################
###############################
"Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f1e52422a90>: Failed to establish a new connection: [Errno 110] Connection timed out
###############################
###############################
raise TusUploadFailed(e) tusclient.exceptions.TusUploadFailed: (55, 'SSL_write() returned SYSCALL, errno = 32')
###############################
###############################
pycurl.error: (55, 'SSL_write() returned SYSCALL, errno = 32') ###############################
###############################
raise TusUploadFailed(e) tusclient.exceptions.TusUploadFailed: (55, 'SSL_write() returned SYSCALL, errno = 32')
###############################
###############################
raise TusUploadFailed(e) tusclient.exceptions.TusUploadFailed: (55, 'SSL_write() returned SYSCALL, errno = 32')
###############################
###############################
self.handle.perform() pycurl.error: (55, 'SSL_write() returned SYSCALL, errno = 32')
the error is based in the python vimeo-sdk or the tus-py-client or is something else?

Yes, i tried to upload an .avi and .MKV and got the same error in both upload

What version of Python are you running? What version of the PyVimeo?

Python==3.6.3 and PyVimeo==1.0.11

We're working on an exclusive Python 3 version this week (#140), but I'm curious if this is a problem with your environment and tuspy 0.2.1. Are you able at all to run your upload integration under Python 2?
If not, hold on a couple days until we're able to release the 2.0.0 release that targets just Python 3+ and latest versions of tuspy, and see if that helps.

Hi, i tried to run using Python 2 and got this error:
 'Unexpected error when uploading through tus.' VideoUploadFailure: (55, 'SSL_write() returned SYSCALL, errno = 32')

Where do we stand with this? I just got the same exception Unable to upload video to Vimeo ('TusUploadFailed' object has no attribute 'message') with a video of around 60mb. My depedencies in my virtualenv environment are (Python 3):
cachetools==3.0.0
certifi==2018.11.29
chardet==3.0.4
cssmin==0.2.0
Django==2.1.4
django-appconf==1.0.2
django-common-helpers==0.9.2
django-compressor==2.2
django-cron==0.5.1
django-rosetta==0.9.0
django-widget-tweaks==1.4.3
ffmpeg-python==0.1.17
fpdf==1.7.2
future==0.17.1
google-api-python-client==1.7.7
google-auth==1.6.2
google-auth-httplib2==0.0.3
google-auth-oauthlib==0.2.0
gunicorn==19.9.0
htmlmin==0.1.12
httplib2==0.12.0
idna==2.8
markdown2==2.3.7
mysqlclient==1.3.14
numpy==1.16.2
oauth2client==4.1.3
oauthlib==2.1.0
opencv-python==<IP_ADDRESS>
Pillow==5.3.0
polib==1.1.0
progressbar2==3.39.2
pyasn1==0.4.5
pyasn1-modules==0.2.3
pycurl==7.43.0
python-utils==2.3.0
pytz==2018.7
PyVimeo==1.0.11
rcssmin==1.0.6
requests==2.21.0
requests-oauthlib==1.0.0
rjsmin==1.0.12
rsa==4.0
six==1.10.0
smsapi-client==2.2.10
tinydb==3.13.0
tuspy==0.2.1
uritemplate==3.0.0
urllib3==1.24.1
uWSGI==<IP_ADDRESS>

Never got a solution using the Tus upload option. I used the form upload option, was getting the action link from the form and used a request with PUT to upload large size videos, tested with videos 500MB+ and worked.

For some reason, vimeo module has a deffault chunk size of 200mb, why?! A single chunk is 200mb? Anyway, I forced with parameter data={'chunk_size': 512 * 1024} down to 512kb. It doesn't matter how small it may be, as internally it is overriden if number of chunks is more than 1024. And now I can upload video through the tus upload option!

This error appears to be intermittent and an issue with Vimeo's backend.  I have received this error before and then when re-attempting with the exact same file and same code at a later date (few hours later) it works fine.
To me this means it has nothing to do with chunk sizes above as suggested, and only a coincidence that it started working again after you changed this setting.  Vimeo should actually address this.


Add an emptyCache test for service name sanitizer

Coverage increased (+0.04%) to 98.985% when pulling 280a10c760e7c06ca814e374a0dcb0a0d5c5aa86 on add_sanitizer_test into 56d1efc4d7e8fd56923c367ef0ec69257cec596c on master.

Coverage increased (+0.04%) to 98.985% when pulling 941a31724137c3fc360320d162baf5a96eb45f40 on add_sanitizer_test into 56d1efc4d7e8fd56923c367ef0ec69257cec596c on master.

Coverage increased (+0.04%) to 98.985% when pulling 164636df54cd379534080884678b91c5de7e43cc on add_sanitizer_test into aac4033dc18843e0aaa11a84f41b3c4193cb9a76 on master.

Coverage increased (+0.04%) to 98.985% when pulling c82c640c1e5f84bd59c6cb6e6a23a615d7927110 on add_sanitizer_test into 7e6aa97fbba279f55187a20eecec9d3806b4a1fe on master.


Read-only attribute on files copied from CD-ROM

I use Winfile mainly as a replacement for Windows Explorer due to the issue that the latter has with optical media. When using Explorer the CD or DVD is being read a lot and it can take several minutes or even lock up optical drive requiring disc eject. I guess Microsoft doesn't do much testing with optical drives these days...
Anyhow Winfile works great and has no issues reading and copying files from CD-ROM or DVD discs. Only issue I have with it is that it retains the read-only file attribute when the files are copied to the hard disk. I guess this is by design but since Windows Explorer does not do this and it is a bit tedious to go through the files manually to remove the read-only attribute I was wondering if a winfile.ini option could be implement to not retain the read-only attribute when files are copied from optical media?

Winfile uses the Win32 CopyFile() function:
File attributes for the existing file are copied to the new file. For example, if an existing file has the FILE_ATTRIBUTE_READONLY file attribute, a copy created through a call to CopyFile will also have the FILE_ATTRIBUTE_READONLY file attribute.

Yes, I believe the code is in lfn.c. I am probably just going to build a custom build for my personal use that does not retain the read-only attribute for any files copied. Should be good enough for my needs. I am closing this issue.

Well I re-opened this issue since it is probably better for the project owner to decide if it should be closed or not.
Something like this to remove a read only attribute should do:
SetFileAttributes(FileName, GetFileAttributes(FileName) & ~FILE_ATTRIBUTE_READONLY);
And if one wanted more control then an if statement could check if the file was originating from CD-ROM drive or not...

Usually people close the items themselves if done.


API calls not working with blockfrost-backend-ryo

Hello,
Unfortunately, I have a few API calls that don't work with my blockfrost-backend-ryo instance. I tried multiple PostgreSQL performance optimizations without any success.
API Calls
The following two API calls take forever (more than 1h) to complete, most of the time they simply fail (error 500). If I query the official Blockfrost instance, I get the result in less than 1 second for both API calls.
Blockfrost RYO

/networktime curl http://localhost:3000/network

/pools/extendedtime curl http://localhost:3000/pools/extended

blockfrost.io

/network
time curl https://cardano-mainnet.blockfrost.io/api/v0/network -H 'Accept: application/json' -H 'project_id: xyz'
real	0m0.110s
user	0m0.039s
sys	0m0.004s

/pools/extended
time curl https://cardano-mainnet.blockfrost.io/api/v0/pools/extended -H 'Accept: application/json' -H 'project_id: xyz'
real	0m0.893s
user	0m0.035s
sys	0m0.013s

Setup
Specifications
The hardware specifications are:

16 cores
98304 MB memory
4 NVMe drives in RAID-5

Versions
The software versions are:

Debian 12
cardano-node 8.9.4
postgresql 15.x
cardano-db-sync <IP_ADDRESS>
blockfrost-backend-ryo 2.0.3

Indexes
I've added the following indexes to my PostgreSQL:

https://github.com/blockfrost/blockfrost-backend-ryo#indices
https://github.com/IntersectMBO/cardano-db-sync/issues/1349#issuecomment-1416017488

PostgreSQL

The postgresql.conf file contains:

checkpoint_completion_target = 0.9
checkpoint_timeout = 1h
datestyle = 'iso, mdy'
default_statistics_target = 500
effective_cache_size = 36GB
lc_messages = 'en_US.UTF-8'
lc_monetary = 'en_US.UTF-8'
lc_numeric = 'en_US.UTF-8'
lc_time = 'en_US.UTF-8'
listen_addresses = '*'
log_destination = 'stderr'
log_timezone = 'UTC'
maintenance_work_mem = 2GB
max_locks_per_transaction = 256
max_parallel_maintenance_workers = 4
max_parallel_workers_per_gather = 4
max_wal_size = 2GB
min_wal_size = 1GB
port = 5432
random_page_cost = 1.1
shared_buffers = 12GB
synchronous_commit = off
temp_buffers = 64MB
timezone = 'UTC'
wal_buffers = 16MB
work_mem = 1024MB

I am happy to provide logs or further details if needed. Thank you for your help.

Hello there,
This is expected. These calls are very heavy and even in most powerful setups and well tuned databases can take several minutes (to hours!) to complete. If you find a way how to optimize these queries, we are welcoming all suggestions! I'm going to close this issue, as these do work, just are very slow. On the blockfrost.io we are using heavy (pre)caching on most queries, if fast responses are important to you, I think it is the way to go for most of the use cases.


audit-argument-checks rule stopped working

I'm using this plugin for past 5 to 6 months. And audit-argument-checks rule worked fine.
But recently few weeks back I noticed it stopped working. I tried adding
"meteor/audit-argument-checks": 2 in the rules of my eslintrc.json, but no success.
I tried re-installing the plugins then also its not working?
Atom version: 1.17.2 x64
My devDependencies:
"devDependencies": {
    "babel-eslint": "^7.1.1",
    "chimp": "^0.47.2",
    "eslint": "^3.10.2",
    "eslint-config-airbnb": "^13.0.0",
    "eslint-import-resolver-meteor": "^0.3.4",
    "eslint-plugin-import": "^2.2.0",
    "eslint-plugin-jsx-a11y": "^2.2.3",
    "eslint-plugin-meteor": "^4.0.1",
    "eslint-plugin-react": "^6.7.1"
  }

eslintrc.json
{
  "parser": "babel-eslint",
  "parserOptions": {
    "allowImportExportEverywhere": true
  },
  "extends": [
    "airbnb",
    "plugin:meteor/recommended",
    "eslint:recommended",
    "plugin:import/errors",
    "plugin:import/warnings"
  ],
  "plugins": [
    "jsx-a11y",
    "import",
    "meteor"
  ],
  "settings": {
    "import/resolver": "meteor"
  },
  "env": {
    "browser": true,
    "node": true
  },
  "rules": {
    "import/extensions": ["off", "never"],
    "import/no-extraneous-dependencies": "off",
    "import/prefer-default-export": "off",
    "no-var": "error",
    "import/no-absolute-path": "off",
    "meteor/template-names": [2, "camel-case"],
    "meteor/audit-argument-checks": 2
  }
}

Can you set up a small reproduction repository with minimal dependencies to reproduce the error?

Still works for me. Closing this. Please provide a reproduction repository in case you're still seeing the issue.


Bugs with Parkour Scoreboard

When players join parkour this error appears, and they don't get a scoreboard.
https://pastebin.com/xzwKfQyq
Also, before this bug began,  current time wasn't displayed on the scoreboard, even though its enabled in the config.
Scoreboard:
  Enabled: true
  Display:
    CourseName: true
    BestTimeEver: true
    BestTimeEverName: true
    BestTimeByMe: true
    CurrentTime: true
  MainHeading: '&b&l== Parkour =='
  TitleFormat: '&b%TITLE%'
  TextFormat: '&f%TEXT%'

I think this was fixed in commit d257d96 (6.0 branch).
For the scoreboard timer to work, you also have to enable the live timer in config.yml
OnCourse:
   DisplayLiveTime: true

Also the scoreboard manager is enabled when the plugin initialises (when the server starts), so the safest method is:
stop the server;
make the config changes (enable scoreboard and enable live timer as above);
save the config file;
start the server.

ah so current time was changed to DisplayLiveTime instead of CurrentTime. Let me build the newest version of the plugin and see if that fixes the problems.

Yeah seems to be working fine now.


Question, Disable -ms-clear on Hosted Fields

Is it possible to disable -ms-clear on IE, on inputs created by hosted field iframe?

You can do this by passing this into the styles option:
'input::-ms-clear': {
  color: 'transparent'
}

You can see that we do exactly that in Drop-in which uses Hosted Fields.

Great, thank you so much!


Unable to correctly upload ContentVersion

Looking for some much appreciated help - I'm struggling to successfully upload a readable ContentVersion from Salesforce to my S3 buckets.
I've tried a few things.  Some methods simply fail, while others upload an unreadable or corrupt file.
public class S3Controller {

    public static String region = 'us-east-2';
    public static String bucket = 'my-bucket';

    public static void upload(Id contentVersionId)
    {
        ContentVersion file = [
            SELECT ContentDocumentId, Title, FileType, VersionData
            FROM ContentVersion
            WHERE Id = :contentVersionId
            LIMIT 1
        ];

        String path = 'https://s3.' + region + '.amazonaws.com/' + bucket + '/' + EncodingUtil.urlEncode(file.Title, 'UTF-8');

        AWS.S3.PutObjectRequest request = new AWS.S3.PutObjectRequest();

        request.url = path;
        request.contentType = 'application/pdf';

        request.body = file.VersionData; // System.StringException: BLOB is not a valid UTF-8 string

        /*
         * This uploads a file, but the file is improperly structured/encoded and unreadble..
         *
         * request.body = Blob.valueOf(EncodingUtil.base64Encode(file.VersionData));
         */

        AWS.S3.PutObjectResponse response = new AWS.S3.PutObject().call(request);
    }
}

This look in order on the surface. Can you try this setup with a TXT file with content type text/plain and
see if it is still garbled? If that works then we can dig deeper into the binary case. Best regards,

Interesting, works flawlessly with a plain text file.  The only thing I had to change was appending the file extension if/when the ContentVersion.FileType = TEXT because the ContentVersion.Title doesn't appear to typically include an extension for plain text files.
Text file (lorem.txt)

PDF file (lorem.pdf)

Curious if a change to the PutObjectRequest might be necessary for the other binary/base64 file types.  For instance, many of the articles that I've seen demonstrating PDF uploads will use the request.setBodyAsBlob() method after encoding and then decoding the base64 VersionData...which just seems unnecessary.
https://salesforcecodex.com/salesforce/uploading-files-to-s3-server-using-apex/
String strBody = EncodingUtil.base64Encode(ContentVersion.VersionData);

HttpRequest req = new HttpRequest();
...
Blob blobBody = EncodingUtil.base64Decode(strBody);
req.setBodyAsBlob(blobBody);

I wish I knew more about this, but really appreciate the response and any help.  Love this sdk, btw.

@bigassforce - any ideas on a workaround or solution for being able to upload other file types.  I would think that the majority of the Content Documents in Salesforce would be PDFs...


fix(events): events card responsiveness

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#83
#82
#81  👈
#80
#79
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @xdjeremy and the rest of your teammates on  Graphite


Added custom hooks to replace Timer component

Fixes #2313
Changelog Entry

Added custom hooks - useTimer and useIntervalSince - to replace Timer component, by @tdurnford, in PR #23XX

Description

Added useTimer and useIntervalSince hooks
Removed Timer component from the RelativeTime component

[X] Testing Added

Coverage increased (+0.2%) to 61.322% when pulling b5ee481958d0faf124b2500890a757fb6533c1c6 on tdurnford:2313-timestamp into 6c664a9d4083e3de8f6b6dbd2f33403b2b7cfbaa on microsoft:master.

@compulim ping


Refactor tasks.py

Hey,
So I noticed the tasks.py file, and I can't help noticing this reminds me of a long way to do a tool that I once saw that works quite well, called Nox.  I think that it could greatly simplify it, so just putting it out there.

Nox actually references Invoke in it's docs under "Other Useful Projects":

Invoke is a general-purpose task execution library, similar to Make. Nox can be thought of as if Invoke were tailored specifically to Python testing, so Invoke is a great choice for scripts that need to encompass far more than Nox’s specialization.

So while Invoke and Nox both provide similar functionality, Invoke is more general, while Nox is more specialized.
Personally I am a fan of Nox, but if @pawamoy is more familiar with Invoke, I don't see much reason to switch. However, he may be open to a PR, if it would actually be more maintainable as a noxfile.py rather than tasks.py.

I actually tried nox, and I agree that it's a great tool. It seems well-maintained, it has great documentation, and noxfiles are a pleasure to read. Compared to it, invoke feels a bit old, not so well-maintained, and misses some functionality for Python. But there are a few things that led me to choose invoke over nox (at least for a small amount of time, to experiment with it a bit):

nox creates virtualenvs for each session. I know the benefits, but in my opinion, it also has disadvantages: it generates lots of files. IDEs can choke on so many files. These venvs are created in the repo folder, so when you maintain lots of projects the venvs are scattered across all these projects (a matter of preference I guess).
nox makes you define dependencies and install them in the noxfile. It creates redundancy with the dependencies in pyproject.toml. I guess this could be improved with such a trick, if there's a way to tell nox to install the current package with specific extras.
I wasn't sure if I could run arbitrary commands like with invoke, mainly bash, rm, find and such (which, I know, are not really cross-platform, but one thing at a time :p). I don't think I can run a command in a pseudo-terminal like invoke allows to do with pty=True.
with nox I'm not really in control of the ouput

But now that you raised that issue, I looked at nox again, and I think some of these points can be solved. There are obvious benefits to using nox as well, like @nox.parametrize to test against multiple versions of multiple dependencies, and the native support for testing against different Python versions (that I had to reimplement myself for invoke).
So, in the end I'd be open to a PR replacing invoke with nox. Or you coulod simply help me solve these pain points I mentioned above, and I'll try to migrate myself :slightly_smiling_face: I think I'll give it a second try anyway, seeing how complicated my tasks become :sweat_smile:

I tried nox and in the end I don't really like it. It's painfully slow. I run checks and tests really often and I need it to be fast. Of course I can use the options to re-use the virtualenvs, or even not create them at all, but then there's no point in using nox over invoke I think :confused:. It's also very verbose, when I prefer a single sentence with a check mark if it passes or a cross if it doesn't.
Anyway, I really simplified the tasks.py with this commit: 645ca24. I remove the Python versions logic from it, and put it outside, in simple shell scripts. These scripts are optional: contributors can run tasks with make TASK if they fancy it (it has some advantages), or directly with poetry run invoke TASK (or even invoke TASK if they are in poetry shell).
The task are actually written in Python (to be somewhat cross-platform), and this was my main requirement, so I'm satisfied with this setup :slightly_smiling_face:


HBASE-28064:Implement truncate_region command

Cherry-picked commit from master and fixed merge conflicts.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 16s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+0 :ok:
prototool
0m  0s
prototool was not available.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ branch-2 Compile Tests _

+0 :ok:
mvndep
0m 11s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 47s
branch-2 passed

+1 :green_heart:
compile
4m 40s
branch-2 passed

+1 :green_heart:
checkstyle
1m 36s
branch-2 passed

+1 :green_heart:
spotless
0m 44s
branch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
5m 17s
branch-2 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 14s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 50s
the patch passed

+1 :green_heart:
compile
6m 14s
the patch passed

+1 :green_heart:
cc
6m 14s
the patch passed

+1 :green_heart:
javac
6m 14s
the patch passed

+1 :green_heart:
checkstyle
1m 45s
the patch passed

-0 :warning:
rubocop
0m 14s
The patch generated 8 new + 726 unchanged - 0 fixed = 734 total (was 726)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
18m 26s
Patch does not cause any errors with Hadoop 2.10.2 or 3.2.4 3.3.6.

+1 :green_heart:
hbaseprotoc
2m  4s
the patch passed

+1 :green_heart:
spotless
0m 45s
patch has no errors when running spotless:check.

-1 :x:
spotbugs
1m 14s
hbase-client generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)

_ Other Tests _

+1 :green_heart:
asflicense
0m 38s
The patch does not generate ASF License warnings.

59m 54s

Reason
Tests

FindBugs
module:hbase-client

Possible null pointer dereference of hri in org.apache.hadoop.hbase.client.HBaseAdmin.truncateRegionAsync(byte[])  Dereferenced at HBaseAdmin.java:hri in org.apache.hadoop.hbase.client.HBaseAdmin.truncateRegionAsync(byte[])  Dereferenced at HBaseAdmin.java:[line 2081]

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5480

JIRA Issue
HBASE-28064

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile cc hbaseprotoc prototool rubocop

uname
Linux 0b0c30cc493c 5.4.0-156-generic #173-Ubuntu SMP Tue Jul 11 07:25:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2 / e876afe8a4

Default Java
Eclipse Adoptium-11.0.17+8

rubocop
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-general-check/output/diff-patch-rubocop.txt

spotbugs
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-general-check/output/new-spotbugs-hbase-client.html

Max. process+thread count
80 (vs. ulimit of 30000)

modules
C: hbase-protocol-shaded hbase-client hbase-server hbase-thrift hbase-shell U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/console

versions
git=2.34.1 maven=3.8.6 spotbugs=4.7.3 rubocop=1.37.1

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 43s
Docker mode activated.

-0 :warning:
yetus
0m  4s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ branch-2 Compile Tests _

+0 :ok:
mvndep
0m 14s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 31s
branch-2 passed

+1 :green_heart:
compile
1m 46s
branch-2 passed

+1 :green_heart:
shadedjars
4m 57s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
1m 10s
branch-2 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 10s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 11s
the patch passed

+1 :green_heart:
compile
1m 49s
the patch passed

+1 :green_heart:
javac
1m 49s
the patch passed

+1 :green_heart:
shadedjars
4m 55s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
1m  9s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
0m 23s
hbase-protocol-shaded in the patch passed.

+1 :green_heart:
unit
7m 53s
hbase-client in the patch passed.

+1 :green_heart:
unit
205m 40s
hbase-server in the patch passed.

+1 :green_heart:
unit
6m 54s
hbase-thrift in the patch passed.

+1 :green_heart:
unit
7m 41s
hbase-shell in the patch passed.

254m 40s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5480

JIRA Issue
HBASE-28064

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 52e9cdbc5c84 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2 / e876afe8a4

Default Java
Temurin-1.8.0_352-b08

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/testReport/

Max. process+thread count
4555 (vs. ulimit of 30000)

modules
C: hbase-protocol-shaded hbase-client hbase-server hbase-thrift hbase-shell U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 39s
Docker mode activated.

-0 :warning:
yetus
0m  5s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ branch-2 Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 58s
branch-2 passed

+1 :green_heart:
compile
2m  4s
branch-2 passed

+1 :green_heart:
shadedjars
5m 18s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
1m 25s
branch-2 passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 16s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 35s
the patch passed

+1 :green_heart:
compile
2m  5s
the patch passed

+1 :green_heart:
javac
2m  5s
the patch passed

+1 :green_heart:
shadedjars
5m 16s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
1m 22s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
0m 30s
hbase-protocol-shaded in the patch passed.

+1 :green_heart:
unit
8m  9s
hbase-client in the patch passed.

+1 :green_heart:
unit
214m 10s
hbase-server in the patch passed.

+1 :green_heart:
unit
6m 56s
hbase-thrift in the patch passed.

-1 :x:
unit
7m 41s
hbase-shell in the patch failed.

266m 16s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5480

JIRA Issue
HBASE-28064

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 118bfa121122 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
branch-2 / e876afe8a4

Default Java
Eclipse Adoptium-11.0.17+8

unit
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-shell.txt

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/testReport/

Max. process+thread count
4783 (vs. ulimit of 30000)

modules
C: hbase-protocol-shaded hbase-client hbase-server hbase-thrift hbase-shell U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5480/1/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Looks like the UT failure is looking unrelated to my changes. Previous yetus run reported "org.apache.hadoop.hbase.client.TestTableShell" as failed test.
But this test is working fine in my local environment.

Looks like the UT failure is looking unrelated to my changes. Previous yetus run reported "org.apache.hadoop.hbase.client.TestTableShell" as failed test.
But this test is working fine in my local environment.

I agree, the UT failure seems unrelated. LTGM, +1.


Fixing issue Create Azure VM Set Example

Fixed:
#52394
#52671

@cakriwut : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Reviewing...

I need to verify something with the engineering team and will reply back
#hold-off

Thanks!
#sign-off

@mimckitt: I'm sorry - only the author of this article, @TomArcherMsft, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

A file-based merge conflict exists because the content has been moved to a different repo since the PR was created. @TomArcherMsft Are you still planning to apply this approved update in the article's current repo? Thanks.

@TomArcher - bump
"A file-based merge conflict exists because the content has been moved to a different repo since the PR was created. @TomArcherMsft Tom Archer FTE Are you still planning to apply this approved update in the article's current repo? Thanks."

CC: @Jak-MS
@cakriwut Thanks for the feedback. The articles with this syntax have been fixed and should be live tomorrow afternoon (PST).


fix(android): uppercase conversion in getEnumName() method

Description
Fixed a bug affecting locales such as
Turkish, where lowercase 'i' was incorrectly converted to 'İ' instead of 'I'. Now, the US locale is explicitly used for enum name conversion to ensure correct character mapping.
Fixes #3255
Checklist

[X] I've read CONTRIBUTING.md
[X] I updated the doc/other generated code with running yarn generate in the root folder
[X] I have tested the new feature on /example app.

[ ] In V11 mode/ios
[ ] In New Architecture mode/ios
[X] In V11 mode/android
[X] In New Architecture mode/android

[ ] I added/updated a sample - if a new feature was implemented (/example)

Amazing! Thanks much!

@mfazekas, could you please provide an estimated timeline for when you expect the merge to be completed?

@mfazekas, could you please provide an estimated timeline for when you expect the merge to be completed?

Let a note on the change, then it can be merged


Add support for @click

Right now, putting a @click or v-on:click doesn't run the function that it is passed.  I'm not sure if this was intended or not, but there are many circumstances where an on click handler is useful/needed.

Hi daniel
thanks for your suggestion
but why don't you use @change or v-on:change instead?
anyway i intended to make the components just like html default inputs and if that @click is supported in theme i will add that feature as soon as possible

Hi
i found this conversation which is related to our case here
https://github.com/vuejs/vue/issues/3253
as @AnsonHwang86 suggests there, you can use .native modifier if you need listen to click event and @change isn't suitable for your specific use case

Cheers Hamed! @click.native is exactly what I used as well.. that way I can disable the event.target for the time of the AJAX call and re-enable it later having the result of the request.
It's nice because the checkbox now represents the exact state of the model.attribute in the database :)


RTEMS export arc4random

Description
Export ´arc4random_buf´ for RTEMS.
Seems to be preferred to the getentropy method (see here: https://github.com/rust-lang/rust/pull/131774).
Sources
https://docs.rtems.org/branches/master/bsp-howto/getentropy.html
Checklist

[x] Relevant tests in libc-test/semver have been updated
[x] No placeholder or unstable values like *LAST or *MAX are
included (see #3131)
[x] Tested locally (cd libc-test && cargo test --target mytarget);
especially relevant for platforms that may not be checked in CI

r? @tgross35 This is a small follow-up we figured out here https://github.com/rust-lang/rust/pull/131774, but since we can do with the work-around in the rust repo it doesn't have high priority.


.center-align for element in card's footer

Hi,
In the 0.95.3 release, .center-align isn't working anymore for element place in a card's footer.

It is working for me. I tested it on the cards on the docs page.

In deed it works if .center-align is alone. If combine with valign-wrapper itsn't working anymore. Thanks you help :)


[WR-1486] remove lime border used for debugging

Oh boy, this is embarrassing, I accidentally committed and merged a lime border used for debugging.  This PR removes it.

Closing.  Additional work has been requested for ticket WR-1486.  I'll incorporate this fix with the other fixes into a single PR.


Proposal: prefer local installs for implicit depedencies

Currently, pkgx uses this loop to bring in dependencies automatically to a dev environment, based on contents. This can cause some surprising behaviors like #1041 .
It would probably be better to bring in dependencies only when missing. This could potentially be generalized into a async function load_implicit_deps(binname: string, dep: PackageRequirement). This would add some load time to a dev env, unfortunately, but it means not loading our git in if it is already present on the path.
Since dependencies can always be explicit in the YAML file, this should be a less surprising at the cost of checking the path on load, and result in fewer instances where a user needs to forcibly "unload" a pkgx package from their environment due to conflicts.

I have thought this was right many times.

I would also be interested in "partial" dev environments. We have git around,  python is managed by virtual environments managed with uv, and node might be handled with volta.
I would be happy to explicitly exclude some integrations to avoid "magic".
Or the way around: Something like dev +pnpm +curl +yy - the same as env but using the logic dev uses to resolve versions.

Or maybe an opt-out with something like dev -python.org -git.


Design Monitoring Plan Data Services

Open in MURAL
CAMD 3-PI Roadmap - EPA CAMD Business Suite - ECMPS and AMPD

No longer needed. Will be handled by Manage Monitoring Plan Data epic


In what setting do you work?

Not geographically, more… ergonomically?

Heya; neato question. As you may or may not know I have a history with RSI. This
is a quite common condition for us programmers to develop; but it's definitely
made me realize I had to invest in better posture / gear to match. If you do
something for the majority of your waking hours and like is your main source of
income it's worth investing in not getting injured I think. Hah.
I generally work from cafes, kind of conforming to whatever they provide. I try
and work as ergonomically but that doesn't always work out for me. I run a 12"
macbook, and while the screen size is fine for me the built in keyboard is
pretty horrible. That's why I always pack an external keyboard (magic keyboard)
and use a laptop stand (Roost). The latter helps a lot to reduce strain on my
back and neck, forcing me to take a better posture.
I used to work heaps from bed / couches also but that's contributed to my RSI
in such a degree that I've stopped doing that. When at home I work from a desk
and recently picked up an Ergodox EZ to make sure I change wrist posture when
at home. Diversity is the key to not getting like horrible RSI so umm yeah,
working on that.
Also one other thing I recently picked up is the Timeout App - it forces me to
take micro breaks every 2 mins, and longer breaks every 30. That's helped a lot
with managing RSI and since I've started using it in November my symptoms have
been drastically reduced.
Hope this answers your question; thanks again for asking!
Gear

roost laptop stand
ergodox EZ
magic keyboard
timeout app
orochi mouse

Just curious. I get the sense that you work mainly from cafes, so was curious what sort of physical constraints it requires to actually work effectively. That's a big hiccup for me currently: dealing every day with wondering where I'll be working. More of a mental burden than a physical burden, really.

I have my regular spots in Berlin; it can be a bit more challenging to find
good spots in new places but once I've found a good one I tend to come back
On Thu, Jan 12, 2017, 23:57 Ricky Reusser<EMAIL_ADDRESS>wrote:

Just curious. I get the sense that you work mainly from cafes, so was
curious what sort of physical constraints it requires to actually work
effectively. That's a big hiccup for me currently: dealing every day with
wondering where I'll be working. More of a mental burden than a physical
burden, really.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/yoshuawuyts/ama/issues/3#issuecomment-272310783, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ACWleleBugYm-q6JIiHWCZobcM0BXdVxks5rRq_zgaJpZM4Lg-Kd
.

Doing an issue cleanup; closing for now!


How do I change the full version of the list

Hi, I was wondering how you change the full version of the list, I know that this array is generated dinamically but what about if I want to change the full version of array of the list with some new data?

This was already added in version 1.1.1.
By the way, I'm currently working on version 2.0, which will contain a couple more features (including the one you requested in the previous issue). Also, I'll update the readme to provide a full explanation of how everything works. So, stay tuned :).


Lab E1 Small content suggestions/issues

Do the preview warnings still apply now? Exercise 2 Step 3

Exercise 3 Step 2
Question, do you think some URL examples or what is supported should be described here, can I just paste in a site, library, file.

Placeholder in text Exercise 3 step 4

Good catch will remove this! Thanks so much :)


Fix web build

Changes to module loading to fix webmode build.  Reverts back the module maps in workbench.html.  I'll look into updating back the newer approach during the next merge.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 48.242%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
14795

Relevant Lines:
29104

💛  - Coveralls


I take it from the above that the conv~ abstraction is not expected to be in working order presently?

not really, do you have issues?

When I tried the abstraction yesterday (Linux x64), no sound was produced from it. I assumed that was why it "seems fucked". I double checked that the sample player in the help patch works fine, my speakers were turned on, etc.
Please let me know if I can help in any way. And many thanks for your excellent library.

please file a detailed bug report and let's see if it's reproducible. It makes sounds here...

I think there is something unusual going on, perhaps not related to the abstraction... I notice that even if I make an outlet~ at the top level of the abstraction and connect the input directly to it, there is still no audio passed through the abstraction.
As far as a detailed bug report, please let me know if there is any more information you would require than the following:
$ uname -a
Linux [hostname] 5.18.14-arch1-1 #1 SMP PREEMPT_DYNAMIC Sat, 23 Jul 2022 11:46:17 +0000 x86_64 GNU/Linux
$ pd -version
Pd-0.52.2 ("") compiled 08:57:44 Apr  4 2022

Bug description:
conv~ produces no audio at its output
Steps to reproduce:
Open the help patch for conv~. Unmute the output abstraction and turn up the volume.
Expected behaviour:
Reverberated vacuous sound clip should play through speakers.

please create a new issue for this


[GSoC] Give more technical inside about containerd plugin for kata-container runtime

Hello, I am interested in plugin of containerd for kata-container runtime.I read the preliminary design doc for containerd plugin.but I am confused about architecture that showed in a doc.Correct me if I am wrong but we are trying to build a replacement for docker runtime "runc" with "kata-container" runtime for kubernetes and later for docker.Is that right?Please give me more information about following "architecture of plugin" which showed an image:

I am familiar with docker container state diagram which is: dockerd -> containerd -> runc.
Can someone Please give me some inside of how this same thing works on kata-container runtime and which security benefits they provide?

It should related to @laijs 's area. Let's PING him

Disclaimer : Not an expert at this. I am also a potential intern for Gsoc. Just giving my 2 cents.
Kata Containers is an opensource project which aims to merge the Intel Clear Containers runtime and the Hyper runv runtimes. Kata already has support for Docker. It aims to be a substitute for runc.
As @urvil38 said normally the container state diagram is docked -> containerd -> runc.
When used with kubernetes, the state transition diagram is kubernetes -> cri-containerd ->containerd -> kata. This blog post may be of help if you want to understand how kubernetes works with containerd. I believe the rest would be clear to you then.
As far as the benefits are concerned, when you run a container with Kata as a runtime, a new QEMU based virtual machine is spawned, this gives you much better hardware based isolation than the traditional software (OS) based isolation. There is no sharing of the host kernel when you run with kata as the guest is now insde a VM. A kata runtime based container uses its own minimalistic linux kernel.
For more details you may like to visit the Kata Containers, Clear containers or runv repos.

This doc presented in an earlier architecture committee meeting may be helpful if you wish to learn more about the architecture of the kata runtime

@urvil38 dockerd -> containerd -> kata-runtime is already a ready solution that kata-containers community has worked long with as the same GSoC doc says. This solution is excellent expect that the data path too long: dockerd -> containerd -> containerd-shim -> kata-shim -> [vm: agent -> container]. In this paradigm, containerd-shim is very specified for containerd+runc which hold something including Stdio and reaper ownership that keeps the container running when containerd is dead. In kata-cantainers case, the hypervisor along with the agent can do the same thing and we can shorten the data path. kata-shim is also specified for dockerd/containerd and acts as a presentation in the host with a referencable system pid.
Both containerd-shim and kata-shim are unnecessary in containerd's runtime plugin with kata-containers. So a new containerd-kata plugin will be introduced for it, which is also the aim of this Gsoc project. After it is done, the data/control path will be:
dockerd/kublet -> containerd with containerd-kata runtime plugin -> [vm: agent -> container]
and remove the unnecessary interlayer.

thanks, @ydjainopensource and @laijs.
Any data are available for how much time it will take to create vm sandbox and container inside it with kata-container runtime?I am curious about how much time hypervisor-based container take to start and stop than normal OS based container.

@laijs can you give some inside about what is a current state of frakti cri and containerd-kata runtime plugin?

less than 100ms when work with proper VM factory.


Added pt-br translation

Thanks (again) for the translation. This will be available in the next release (I should be able to publish one before the end of the month)


Clarify what all sources are supported for Terraform Dependency Updates

What article on docs.github.com is affected?
https://docs.github.com/en/code-security/supply-chain-security/keeping-your-dependencies-updated-automatically/configuration-options-for-dependency-updates
What part(s) of the article would you like to see updated?
Terraform section.
Additional information
Terraform supports the following sources:

Local paths
Terraform Registry
GitHub
Bitbucket
Generic Git, Mercurial repositories
HTTP URLs
S3 buckets
GCS buckets
Modules in Package Sub-directories

Out of these, it is very unclear which all are supported by Dependabot.

Update following discussion below
Answer
For anyone else with the same question, the answer was:

Dependabot can be used to manage version updates for dependencies that are stored in GitHub for all the supported package managers. In addition, for some package managers, you can include a registries section in your configuration file to allow access to private registries. This is supported for Terraform, see Configuration options for private registries.

If you need to access dependencies in git hosted by other services, like GitLab and BitBucket, you can add the git option to your registries section. See Configuration options for dependency updates.

Content design plan
"Supported repositories and ecosystems" section of About Dependabot version updates

[ ] Update the introduction  to mention that dependencies in private registeries are also supported (similar to the mention of vendored dependencies).
[ ] Update the link to the article with configuration options - link to both the #vendor anchor and also the #registries anchor.

"package-ecosystem" section of Configuration options for dependency updates

[ ] Add a brief sentence, similar to that for vendor mentioning private registries and linking to registries.

"Configuration options for private registries" section of Configuration options for dependency updates

[ ] Add a brief sentence to the first paragraph, mentioning that you can give Dependabot access to private package registries hosted by GitLab or Bitbucket by specifying a type of git and linking to git.

@captn3m0 Thanks so much for opening an issue! I'll triage this for the team to take a look :eyes:

@captn3m0 :wave

A note about Mercurial repos and S3 buckets not being supported would be nice.

I'm out of time today, but will come back to this issue and suggest a change to the docs to make this clearer when I get an opportunity. It's difficult to get the right balance in keeping a readable table as well as providing detailed information.

I've updated the issue summary with the information from our discussions and a plan for content changes to make the support clearer. I've also added a note to an internal issue so that when we next refactor these articles, we take your full feedback into account.

I'm having trouble understanding all this stuff driving me crazy


LAB_09c-Implement_Azure_Kubernetes_Service.md

English:
Enabled
Current Translation:
Enabled
Suggested Translation:
啟用
Description:
It should be translated according to the context. Global check.

Hello contributor,
Thank you for your contribution! We are processing your suggestions and we will update you shortly.
Kind regards,
Microsoft Worldwide Learning Team

Run the bugfix tool and waiting for result. ICMS QUERY

The issue has been fixed, so I close the PR.


At least some boolean arguments in query functions are not working correctly

Describe the bug
Functions like list_models have boolean arguments supposedly determining whether or not to include certain data in the results, e.g. full, cardData, or fetch_config. The mix of camel case and snake case aside, being type hinted as boolean, one would expect this to toggle the respective feature using True/False. Instead, one has to pass None instead of False to disable it.
This smells of a possible misunderstanding of what cardData: typing.Optional[bool] = None means, in that typing.Optional doesn't in fact make the argument optional, it simply allows None being explicitly passed as a value. It is made optional simply by providing a default value, and so I suspect that a better way to define these signatures is simply using cardData: bool = False.
Reproduction
Setting cardData=False doesn't turn this option off (only setting it to None does):
list_models(author="huggingface", cardData=False)[0]

ModelInfo: {
	modelId: huggingface/CodeBERTa-small-v1
	sha: None
	lastModified: None
	tags: []
	pipeline_tag: fill-mask
	siblings: None
	private: False
	author: None
	config: None
	_id: 621ffdc136468d709f17bd02
	id: huggingface/CodeBERTa-small-v1
	cardData: {'language': 'code', 'thumbnail': 'https://cdn-media.huggingface.co/CodeBERTa/CodeBERTa.png', 'datasets': ['code_search_net']}
}

Setting fetch_config=False doesn't turn this option off (only setting it to None does):
list_models(author="huggingface", fetch_config=False)[0]

ModelInfo: {
	modelId: huggingface/CodeBERTa-small-v1
	sha: None
	lastModified: None
	tags: []
	pipeline_tag: fill-mask
	siblings: None
	private: False
	author: None
	config: {'architectures': ['RobertaForMaskedLM'], 'model_type': 'roberta'}
	_id: 621ffdc136468d709f17bd02
	id: huggingface/CodeBERTa-small-v1
}

Logs
No response
System Info
huggingface_hub=0.10.1

Hi @buhrmann thanks for reporting ! That is definitely a bug and it seems to come from a server-side issue.
About the Optional[bool] / bool, I get your point. The slight difference between fetch_config=None and fetch_config=False is that in the first case the default behavior is decided by the server as in the second case it is hard-coded in the lib. This rule could be revisited but at least that's the short explanation about it.


windows 10 RS4

will u update this for last windows update? tks.

Maybe, and only for release.

tks.


Interactive window will not support non-python languages

This used to work.
We now hardcode the controller to the active interpreter.

Closing the loop here--we never supported starting the IW from a non-Python file. We did (and still do) support switching the kernel from a Python to a non-Python kernel after the IW is up.


.fit() returns last not best weights in ddp_spawn

Fixes #2547

In ddp_spawn the model is only updated in a subprocess. Thus when .fit() ends the original model is still untrained.
This PR makes sure we restore the weights to that model from the last state of the model instead of the "best"

@williamFalcon ok and you use the queue to send back the best weight path to the main process in case the user wants the best weights for testing. got it.

Hello @williamFalcon! Thanks for updating this PR.

In the file tests/callbacks/test_model_checkpoint.py:

Line 109:1: E305 expected 2 blank lines after class or function definition, found 1


Remove non-working android specific code for scrollview

See https://github.com/leecade/react-native-swiper/issues/449

I'll take a look at this PR. Thank you.
You might want to fix conflicts in order to merge it later on

I've resolved the conflicts.

@basvdheijden Thank you :)
Can you explain a bit more what you are doing here and how we can test it, maybe with an example?

@arribbar I believe this is related to this issue.
We also faced a problem with ViewPagerAndroid not showing dynamically added children, but a workaround with key={pages.length} seems to do the thing (It works locally).

Ok, thanks @AtticusFetch.
@basvdheijden Can you make the change and remove setDimension function ? Or @AtticusFetch, you can make another PR, up to you guys ! :)

I would really like it merged ASAP, so, @basvdheijden, hope you won't mind if I create another PR with key={pages.length} fix

Thanks for your work @AtticusFetch and above all, @basvdheijden. I close this PR now the other one is merged


Show input and output on the examples page.

As suggested here: https://news.ycombinator.com/item?id=29450476

That's a good idea, thank you!


docs: update usage.md

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (8e8fb84) to head (ad2f88d).
Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff            @@
##            master      #365   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           41        41
  Lines         3662      3662
=========================================
  Hits          3662      3662

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


How to build a library that can be linked with rnpm?

I can't find any docs on this anywhere. But how do I build a library that can can be consumed via rnpm?

Hey! Most of the libraries can be linked with rnpm "by default", you don't need to perform any additional steps.

There are few exceptions (like if you want to link fonts), but they are all described in the readme.

Yup, as long as you have xcodeproj in your library and android folder, we will work it automatically.

Whoa that's pretty magical. Where do I look under the hood to understand how the magic works?

Check this file https://github.com/rnpm/rnpm/blob/master/src/config/index.js and just follow the referenced functions :)

on the iOS  platform rnpm  just  let the  project know your library, so your library  cant find the React Native  header  files, you should  link  by hand,
http://reactnative.cn/docs/0.26/linking-libraries-ios.html#content

Found this in react-native-code-push's repo package.json. Seems that library authors can choose to interact with rnpm. Where is this documented?

Not all of them. I'm planning to improve rnpm's docs section once we finish merging it into react-native

Here https://github.com/rnpm/rnpm#params. For now, only packageInstance is supported as a param. We haven't found any other good places yet, so feature requests welcome :)

I think this one can be closed.


Get latest value and calculate stddev, mean for the last 24 hours

I'm trying to check on the value on a field every 10 minutes and see if the latest value is 2 standard deviations more than the mean value in the past 24 hours. I came up with following tick script:
var last_24h_mean = batch
    |query('''
            SELECT mean("twoway_delay_avg") AS mean
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(10m)
        .groupBy(*)
        .align()
    |shift(1d)  // is this needed?

var last_24h_stddev = batch
    |query('''
            SELECT stddev("twoway_delay_avg") AS stddev
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(10m)
        .groupBy(*)
        .align()
    |shift(1d)  // is this needed?

var last_value = batch
    |query('''
            SELECT last("twoway_delay_avg")
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(10m)
        .groupBy(*)
        .align()

last_24h_mean
    |join(last_24h_stddev, last_value)
        .as('mean', 'stddev', 'last_value')
        .on('site', 'paa')
        .tolerance(10m)
    |eval(lambda: "last_value.last",
          lambda: "mean.mean",
          lambda: "stddev.stddev",
          lambda: "last_value.last" - "mean.mean" - 2 * "stddev.stddev")
        .as('last_value_last',
            'mean',
            'stddev',
            'diff')
    |alert()
        .crit(lambda: "diff" > 0)
        .log('/tmp/alerts.log')

However, I'm not getting any results, while I could see from influxdb log that the queries are executed:
[query] 2016/06/28 17:16:51 SELECT stddev(twoway_delay_avg) AS stddev FROM latency_prod."default".latency WHERE time >= '2016-06-27T15:40:00Z' AND time < '2016-06-28T15:40:00Z' GROUP BY *
[query] 2016/06/28 17:17:01 SELECT last(twoway_delay_avg) FROM latency_prod."default".latency WHERE time >= '2016-06-27T15:40:00Z' AND time < '2016-06-28T15:40:00Z' GROUP BY *
[query] 2016/06/28 17:17:27 SELECT mean(twoway_delay_avg) AS mean FROM latency_prod."default".latency WHERE time >= '2016-06-27T15:40:00Z' AND time < '2016-06-28T15:40:00Z' GROUP BY *
......

But the result log file is never created. I even tried crit(lambda: TRUE) to make kapacitor always log everything, but sounds like the join() returns no data.
I found out that if I do mean() or stddev() with date range, the timestamp would always be the beginning of the time range. So I tried with the shift(1d), but it doesn't help. I feel like this is something people do all the time, but I couldn't find any references. Any advice is appreciated. Thanks.

@shang-wang The shifting of data is not needed. In general |shift is used in conjunction with .offset.
Your script looks correct (minus the shifts). This bug #683 was fixed this morning related to doing joins with batch data and using the .on property. Do you have the ability to build master and try it out with the latest version?

@nathanielc I did try to pull the latest code and rebuilt, but since I didn't originally set every up I'm not sure if I did it correctly(he was on vacation). I run again but the result is still empty. I didn't have the exact outcome of bug #683 because my kapacitor didn't panic. However, I found out that getting ride of on() statement all together would actually make the script work. I was trying to be explicit about the join condition but sounds like I'll just do without it for now. Sorry for not being able to verify it, but will keep working on it and update. Thanks for making everything available and clear!

@nathanielc Sorry for bringing up an issue again. I ran my tick script without any problems, saw the log and everything makes sense. However, after I enabled the script and load it into kapacitor, it stops producing result again. I did kapacitor show latency_alert:
TICKscript:
var last_24h_mean = batch
    |query('''
            SELECT mean("twoway_delay_avg") AS mean
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(1m)
        .groupBy(*)
        .align()

var last_24h_stddev = batch
    |query('''
            SELECT stddev("twoway_delay_avg") AS stddev
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(1m)
        .groupBy(*)
        .align()

var last_value = batch
    |query('''
            SELECT last("twoway_delay_avg") AS last
            FROM "latency_prod"."default".latency
           ''')
        .period(1d)
        .every(1m)
        .groupBy(*)
        .align()

last_24h_stddev
    |join(last_24h_mean, last_value)
        .as('stddev', 'mean', 'last_value')
        .tolerance(1d)
    |eval(lambda: float("last_value.last") - 2.0 * "stddev.stddev" - "mean.mean")
        .as('diff')
    |alert()
        .crit(lambda: "diff" > 0.0)
        .log('/tmp/influxdb_alerts.log')

DOT:
digraph latency_alert {
graph [throughput="0.00 batches/s"];

query3 [avg_exec_time_ns="0" batches_queried="3649" connect_errors="0" points_queried="3649" query_errors="0" ];
query3 -> join6 [processed="3649"];

query2 [avg_exec_time_ns="0" batches_queried="3649" connect_errors="0" points_queried="3589" query_errors="0" ];
query2 -> join6 [processed="3649"];

query1 [avg_exec_time_ns="3.279303159s" batches_queried="3649" connect_errors="0" points_queried="3649" query_errors="0" ];
query1 -> join6 [processed="3649"];

join6 [avg_exec_time_ns="8.739µs" ];
join6 -> eval7 [processed="0"];

eval7 [avg_exec_time_ns="0" eval_errors="0" ];
eval7 -> alert8 [processed="0"];

alert8 [alerts_triggered="0" avg_exec_time_ns="0" crits_triggered="0" infos_triggered="0" oks_triggered="0" warns_triggered="0" ];
}

As you can see, on join6 -> eval7 [processed="0"];, it processes nothing. I initially thought "diff" > 0.0 has no match so it doesn't evaluate anything, but even if I change the eval to "diff" < 0.0 the result graph still looks the same. What could be the problem? Thanks!

Hey @nathanielc I hope you are well. I kept trying to make the script to work and I got some progress. I realize that changing the tolerance() would actually cause more/less metrix to join. However, the value of the tolerance() is mysterious to me. Yesterday I set it to tolerance(48h) and all the points are joined correctly. However, at around 20:00 the data stops coming in. When I came in this morning I played a little more, and I ended up setting it to 47h before any alerts show up. So how does the timestamp for mean() and the last() would match? I know from influxdb doc that aggregation would return the lower bound timestamp if a time range is specified, but that doesn't explain the tolerance value that I'm using. Can you somehow explain/reproduce this? Thanks.

Unless you are waiting more time than the tolerance time aka 47h between tests then the cause of the issue is not likely related to the tolerance.
Internally all that is happening is the times on the points are rounded to the nearest interval of the tolerance time. Then if the rounded times are equal then the points "match" an can be joined.

@nathanielc  I have more information that might lead to the solution, sorry for reopening the issue.
I figured that it's better to log the query results for 2 different batches and compare by just looking at them to make sure that they look as I expected(and they do). Even though the join() still creates no result, I was able to obtain the 2 logs(attached here). I can clearly see that:

Both have same number of entries. I verified that they contain exactly the same set of data grouped by tags.
All entries in both files has the same timestamp.

Here's the show command result again:
TICKscript:
var last_24h_mean_stddev = batch
    |query('''
            SELECT last("twoway_delay_avg_mean") AS mean,
                   last("twoway_delay_avg_stddev") AS stddev
            FROM "latency_prod"."default".latency_mean_stddev
            WHERE "site" != 'moscow'
           ''')
        .period(1d)
        .every(1m)
        .groupBy('site', 'paa')
        .align()
    |shift(1d)

last_24h_mean_stddev
    |alert()
        .crit(lambda: TRUE)
        .log('/spare/local/kapacitor_data/scripts/24h.txt')

var last_value = batch
    |query('''
            SELECT mean("twoway_delay_avg")
            FROM "latency_prod"."default".latency
           ''')
        .period(5m)
        .every(1m)
        .groupBy('site', 'paa')
        .align()
    |shift(5m)

last_value
    |alert()
        .crit(lambda: TRUE)
        .log('/spare/local/kapacitor_data/scripts/5m.txt')

last_24h_mean_stddev
    |join(last_value)
        .as('mean_stddev', 'last_value')
        .on('site', 'paa')
    |eval(
        lambda: "last_value.mean",
        lambda: "mean_stddev.mean",
        lambda: "mean_stddev.stddev",
        lambda: float("last_value.mean") - "mean_stddev.mean" - 3.0 * "mean_stddev.stddev"
    )
        .as('last_value_mean', 'mean_stddev_mean', 'mean_stddev_stddev', 'diff')
    |alert()
        .crit(lambda: TRUE)
        .log('/spare/local/kapacitor_data/scripts/joined.log')
DOT:
digraph latency_separate_measurement {
graph [throughput="0.00 batches/s"];

query4 [avg_exec_time_ns="0" batches_queried="3462" connect_errors="0" points_queried="3462" query_errors="0" ];
query4 -> shift5 [processed="3462"];

shift5 [avg_exec_time_ns="120ns" ];
shift5 -> alert6 [processed="3462"];
shift5 -> join8 [processed="3462"];

alert6 [alerts_triggered="3462" avg_exec_time_ns="220.597µs" crits_triggered="3462" infos_triggered="0" oks_triggered="0" warns_triggered="0" ];

query1 [avg_exec_time_ns="0" batches_queried="3462" connect_errors="0" points_queried="3462" query_errors="0" ];
query1 -> shift2 [processed="3462"];

shift2 [avg_exec_time_ns="272ns" ];
shift2 -> join8 [processed="3462"];
shift2 -> alert3 [processed="3462"];

join8 [avg_exec_time_ns="7.779µs" ];
join8 -> eval9 [processed="0"];

eval9 [avg_exec_time_ns="0" eval_errors="0" ];
eval9 -> alert10 [processed="0"];

alert10 [alerts_triggered="0" avg_exec_time_ns="0" crits_triggered="0" infos_triggered="0" oks_triggered="0" warns_triggered="0" ];

alert3 [alerts_triggered="3462" avg_exec_time_ns="122.076µs" crits_triggered="3462" infos_triggered="0" oks_triggered="0" warns_triggered="0" ];
}

Could you look at the log files and let me know why the join failed? Thanks.
By the way, my kapacitor version command shows Kapacitor master (git: master HEAD) as of 07/07/2016.
5m.txt
24h.txt

I'm trying to check on the value on a field every 5 minutes using morgoth algo but the alert is not triggering. I am not getting any result
var yesterday = batch
|query('''Select (usage_idle)  From "telegraf"."autogen"."cpu" ''')
.offset(1d)
.period(5m)
.every(1m)
var today = batch
|query('''Select (usage_idle)  From "telegraf"."autogen"."cpu" ''')
.period(5m)
.every(1m)
yesterday
|join(today)
.as('yesterday', 'today')
.tolerance(1s)
@morgoth()
.field('today')
.scoreField('Anomalyscore')
.sigma(3.0)
|alert()
.crit(lambda: "Anomalyscore" > 0.9)
.message('CPU usage alert')
.log('/tmp/abd.log')
DOT:
digraph abd {
graph [throughput="0.00 batches/s"];
query2 [avg_exec_time_ns="11.808391ms" batches_queried="121" errors="0" points_queried="7260" working_cardinality="0" ];
query2 -> join4 [processed="121"];
query1 [avg_exec_time_ns="13.226706ms" batches_queried="121" errors="0" points_queried="7260" working_cardinality="0" ];
query1 -> join4 [processed="121"];
join4 [avg_exec_time_ns="66.386µs" errors="0" working_cardinality="1" ];
join4 -> morgoth5 [processed="120"];
morgoth5 [avg_exec_time_ns="1.407µs" errors="0" working_cardinality="0" ];
morgoth5 -> alert6 [processed="120"];
alert6 [alerts_inhibited="0" alerts_triggered="0" avg_exec_time_ns="27.402µs" crits_triggered="0" errors="0" infos_triggered="0" oks_triggered="0" warns_triggered="0" working_cardinality="1" ];


Show an extra colon next to ‘Container’ in Resource types part on Shared Access Signature dialog

Storage Explorer Version: 1.12.0
Build: 20200311.2
Branch: master
Platform/OS: Windows 10/ Linux Ubuntu 16.04/ Linux Ubuntu 19.04/macOS High Sierra
Architecture: ia32/x64
Regression From: Previous release(1.12.0)
Steps to reproduce:

Select one Non-ADLS Gen2 storage account -> Right click it.
Click 'Get Shared Access Signature...'.
Check the Resources types part on Shared Access Signature dialog.

Expect Experience:
No colon shows next to ‘Container’ in Resource types part.

Actual Experience:
Show an extra colon next to ‘Container’ in Resource types part.

Verified this issue on build 20200314.6. Fixed. So we close it.


Create migration for specialist requirementLengths

This PR is part of this story on Pivotal and has come about due to this PR.
The migration is to add a requirementsLength value to published specialists briefs.
Currently the downgrade is blank as without adding a new flag somewhere, I'm not sure how the migrated briefs could be differentiated from actual briefs. Any advice more than welcome!

Yeah, I don't think we can do anything with the downgrade in this case, since the API change goes out first. 👍


Any way deploy Kubernetes cluster in L2 network with VNF use PFsense with CloudStack Kubernetes Service

ISSUE TYPE

Improvement Request
Enhancement Request
Feature Idea

COMPONENT NAME

CloudStack Kubernetes Service, L2 Guest Network

CLOUDSTACK VERSION

<IP_ADDRESS>

CONFIGURATION

L2 network
VNF use PFsense
OS / ENVIRONMENT

Ubuntu 22.04 for Managerment Cloudstack
PFsense 2.7.2 for VNF
SUMMARY

STEPS TO REPRODUCE

Create L2 network
Create VNF appliances and link to L2 network
Create Kubernetes in L2 network

EXPECTED RESULTS

ACTUAL RESULTS

Deploy Kubernetes cluster in L2 network with VNF

@leduyquy , At the moment CKS in L2 networks is not supported. for CKS to function the management server needs tcp level access to the nodes. I wonder how you would implement this.


Make all xeon tgi image version consistent

Description
Make all xeon tgi image version consistent
Issues
n/a.
Type of change
List the type of change like below. Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds new functionality)
[ ] Breaking change (fix or feature that would break existing design and interface)
[ ] Others (enhancement, documentation, validation, etc.)

Dependencies
n/a.
Tests
n/a.

Hi @lvliang-intel, as we discussed, let's use ghcr.io/huggingface/text-generation-inference:sha-e4201f4-intel-cpu as the tgi image on xeon for all examples.

Hi @lvliang-intel, I replace the ghcr.io/huggingface/text-generation-inference:sha-e4201f4-intel-cpu with ghcr.io/huggingface/text-generation-inference:latest-intel-cpu

Hi @lvliang-intel @lianhao @chensuyue, after discussed with Intel Xeon TGI image support engineer, we'd better to use the specified version of TGI image, such as ghcr.io/huggingface/text-generation-inference:sha-e4201f4-intel-cpu, instead  ghcr.io/huggingface/text-generation-inference:latest-intel-cpu which would update every day.

Please resolve the conflicts.

Please resolve the conflicts.

Hi @chensuyue sure, done!


io: LimitReader decreases limit with negative Read count

What version of Go are you using (go version)?
go version go1.8.3 linux/amd64
Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
GOARCH="amd64"
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOOS="linux"
GORACE=""
GOROOT="/usr/lib/go-1.8"
GOTOOLDIR="/usr/lib/go-1.8/pkg/tool/linux_amd64"
GCCGO="gccgo"
CC="gcc"
GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build916457943=/tmp/go-build -gno-record-gcc-switches"
CXX="g++"
CGO_ENABLED="1"
PKG_CONFIG="pkg-config"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
What did you do?
There is a potential bug in io.LimitReader in case of bad io.Reader implementation that returns negative read bytes. In that case variable N in io.LimitReader increase ( but it should decrease ). In the end it reads more bytes than has to.
This is not critical bug, but in some cases it might be quite seriously, even despite bad implementation of io.Reader.
Here is a demo of the bug: https://play.golang.org/p/2PYFi7J0CR
I think it would be reasonable to check read bytes before N decreasing, and do return in case of negative reading without decreasing
What did you expect to see?
I want to read 8 bytes
What did you see instead?
I receive 9 bytes.
ping @dsnet

If I'm relying on io.LimitedReader to protect a region of memory, then it can be a critical issue when used with io.TeeReader
io.TeeReader(io.LimitReader(n), buf)) // constraint: no access to buf beyond n

In #22097, I mentioned that this is a slippery slope and I'm hesitant to add further checks unless we consciously make a decision that we want all functions that take in an io.Reader to protect against invalid readers (and writers).
Adding the checks to bufio.Reader and bytes.Buffer.ReadFrom was fine since those are probably the most common vectors through which a bad reader would be detected.
There are several broader question at hand:

Should users of io.Reader and io.Writer be responsible for checking non-compliant implementations?

If so, what type of non-compliant issues do we check for? Negative counts are hardly the only issue.

Do we check that Read returns a count within 0 <= n <= len(b)?
Do we check that Write returns a count within 0 <= n <= len(b)?
Do we check that Write returns n == len(b) if err == nil?

What do you do when you discover an error? Do we panic (that's what bufio.Reader does). Do we convert it into an error?

Where should we perform these checks?

I can see at least the following needing to be addressed: io.Copy, io.CopyBuffer, io.CopyN, io.ReadAtLeast, io.ReadFull, io.LimitedReader, io.MultiReader, io.TeeReader, io.SectionReader, ioutil.ReadAll, etc...

Given the large scope creep that adding these checks will cause, I'm hesitant to penalize all users of io.Reader to handle invalid implementations.

I don't even know what LimitReader means for a broken Reader.  I don't see why any particular behavior is correct.

If your code base is encountering a number of invalid implementations of io.Reader, I would suggest wrapping your readers in CheckReader and see what types of things fail.
Even better, for all the implementations of io.Reader, do something similar in your unit tests.

I'm going to decline this issue.  We are not going to add checks in the standard library for all possible erroneous behavior by io.Reader values.

@dsnet

Your concerns are valid. On the one hand I agree that is a slippery slope, but I don't like that clients should totally trust the io.Reader contract only. On the other hand that is a protocol that have been agreed by both sides for communication.

I like the idea with CheckReader/CheckWriter, and I would add a check to consecutive empty reads with 0, nil ( e.g. 100 consecutive empty reads, as bufio.maxConsecutiveEmptyReads )

What do you think, should we add those checkers to io package?
I believe that it might be a good way of checking an io.Reader implementation ( the only source of the truth; automatic self-test in units ioutil.ReadAll(io.CheckReader(CustomReader))) )

@dsnet thank you for explanation


DRY out broadcast! method

What changed and Why
This PR reduces complexity and duplication by handling the message creation in BroadcastRequestJob instead of only handling planned requests there.

There are a few things that are not that intuitive for me ...

Proposal: Why is broadcast! a class method if you handover then an instance of this class itself? Can't this not just be an instance method .. maybe to be renamed to sth like 'trigger_broadcast', 'schedule_broadcast' or 'handle_broadcasting' as it will not directly broadcast but handover the responsibility of broadcasting to the job.
Remark: Even with the comment it took me a while to understand why we need to check for the request.planned? in the job again. First i thought we should put this decision solely to the calling method. What is a little odd, is that we now have to check the same conditional in to subsequently called methods. Well but it seems that it is necessary if we don't accept to delay the  RequestScheduled notification. (Maybe extend the comment?)
Optional: I think it would be nice to move out the inner loop in the job and move it in an instance method "send_request(request)" on the contributor itself maybe even calling an send_message(message) on the Contributor instance after the message is set up -that would allow to remove the send_if_outbound from the after_create_commit on the message itself and allow to have the message commit only taking place after the message has really been sent - or if needed setting only the broadcasted to true if the sending succeeded.


Update gvf_validator.pl to use correct ontology file

The SO GVF validator, gvf_validator.pl, uses the obsolete page:
http://www.sequenceontology.org/resources/obo_files/current_release.obo
Instead, it should be updated to use the following page:
https://raw.githubusercontent.com/The-Sequence-Ontology/SO-Ontologies/master/so-xp.obo
Who can do this?

https://github.com/The-Sequence-Ontology/GAL/blob/master/bin/gvf_validator line 1994

Closed this as a duplicate of https://github.com/The-Sequence-Ontology/GAL/issues/1

I've updated to gvf_validator, gff3_validator and gff_tool to point to the PURL location of the SO obo file (http://purl.obolibrary.org/obo/so.obo) as suggested by @thefferon and @cmungall.  Changes committed and pushed to git.

I've updated to gvf_validator, gff3_validator and gff_tool to point to the PURL location of the SO obo file (http://purl.obolibrary.org/obo/so.obo) as suggested by @thefferon and @cmungall. Changes committed and pushed to git.


Menu Issues

Version
WSL version: <IP_ADDRESS>
Kernel version: <IP_ADDRESS>
WSLg version: 1.0.33
MSRDC version: 1.2.2924
Direct3D version: 1.601.0
Windows version: 10.0.22000.613
WSL Version

[X] WSL 2
[ ] WSL 1

Kernel Version
<IP_ADDRESS>
Distro Version
Ubuntu 20.04
Other Software
Intellij 2022.1
Emacs 26.3
Dolphin 19.12.3
Konsole 19.12.3
Repro Steps
I noticed the issue with Intellij but it affects all applications.
In Intellij, right-click in an editor tab to open the context menu then hover over an entry with a submenu and note that the submenu does not appear.  To get the submenu to appear, the mouse needs to be moved over to where the menu is expected to appear.
What is actually happening is that the submenu is getting displayed behind the main window and pops up when the mouse is moved over.
I poked around a little and found that this affects all applications, not just Intellij, with a sampling given above.  Also, submenus are where this is most obvious but the main menus are also affected.
Expected Behavior
Menus work as expected
Actual Behavior
As described above
Diagnostic Logs
weston.log excerpt:
[11:08:03.599] app_list_monitor_thread: readlink failed /proc/7797/exe:No such file or directory
[11:08:03.599] Client: ClientGetAppidReq: WindowId:0x177 does not have appId, or not top level window.
[11:08:04.307] app_list_monitor_thread: readlink failed /proc/7797/exe:No such file or directory
[11:08:04.307] Client: ClientGetAppidReq: WindowId:0x178 does not have appId, or not top level window.
[11:08:05.028] app_list_monitor_thread: readlink failed /proc/7797/exe:No such file or directory
[11:08:05.028] Client: ClientGetAppidReq: WindowId:0x179 does not have appId, or not top level window.
Log entries like these appear as menus are exercised

I too also noticed this using Intellij. I made a ticket in YouTrack for it but turns out it's probably a WSLg problem. Most of my information is in that ticket but can provide more if it will help at all.
https://youtrack.jetbrains.com/issue/IDEA-292733/Menus-and-popups-invisible-until-hovered-over?s=Menus-and-popups-invisible-until-hovered-over

Looks like this might have been fixed with the latest WSL release as I'm no longer seeing the problem.


Alllow to conditionally remove fields

Like this:
// synchronous hook
service.before({
  create: hooks.remove('test', hook => hook.params.remove)
});

/// asynchronous hook
service.before({
  create: hooks.remove('test', hook => new Promise(resolve => {
    setTimeout(() => resolve(hook.params.remove), 20);
  }))
});

Closes #48

Oh man this is sweet. Just going to pull it down and test with a running app with auth.

Booya! :shipit:


Installing packages sourced from one environment to another

Is there a way that I can utilize uv to install packages sourced from a conda base environment into a virtual environment created with uv?
My use case is that I have an offline system with the Anaconda python distribution used solely for the bundled interpreter and  packages provided.
I don't really want to utilize conda for creating virtual environments with their YAML file approach. I'd much rather utilize uv for package management & virtual environment creation, and define my project dependencies the normal way with pyproject.toml (with the obvious limitation that any projects on the system have to utilize pinned versions of packages available in the Anaconda distribution).
Any suggestions would be appreciated.

Maybe with uv venv --system-site-packages?

PS C:\Users\user\git\project> uv venv --system-site-packages
Using Python 3.12.4 interpreter at: C:\ProgramData\anaconda3\python.exe
Creating virtualenv at: .venv
Activate with: .venv\Scripts\activate
PS C:\Users\user\git\project> .venv\Scripts\activate
PS C:\Users\user\git\project> uv pip list
PS C:\Users\user\git\project> uv sync --offline --no-build-isolation
warning: `uv sync` is experimental and may change without warning
  × No solution found when resolving dependencies:
  ╰─▶ Because pytest was not found in the cache and project==0.1.0 depends on pytest==7.4.4, we can conclude that project==0.1.0 cannot be used.
      And because only project==0.1.0 is available and you require project, we can conclude that the requirements are unsatisfiable.

      hint: Packages were unavailable because the network was disabled
PS C:\Users\user\git\project>

It seems like uv is not actually creating a venv with the system site-packages. It doesn't detect pytest as being already installed in the venv.
Here's what the pyproject.toml looks like:
[build-system]
requires = ["setuptools>=69.5.1"]
build-backend = "setuptools.build_meta"

[project]
name = "project"
version = "0.1.0"
requires-python = ">=3.12"
dependencies = ["pytest==7.4.4"]

It doesn't seem to be respecting --no-dev either:
(project) PS C:\Users\user\git\project> uv sync --offline --no-build-isolation --no-dev
warning: `uv sync` is experimental and may change without warning
  × No solution found when resolving dependencies:
  ╰─▶ Because codespell was not found in the cache and project==0.1.0 depends on codespell>=2.3.0,<3, we can conclude that project==0.1.0 cannot
      be used.
      And because project==0.1.0 depends on project:dev==0.1.0, we can conclude that project==0.1.0 cannot be used.
      And because only project==0.1.0 is available and you require project, we can conclude that the requirements are unsatisfiable.

      hint: Packages were unavailable because the network was disabled

We don't really respect --system-site-packages. We allow writing it to the virtualenv, but we don't actually query it, it just makes them available at the runtime.
I think there's no way to accomplish what you're describing. If you were using the Conda environment and installing packages etc., we'd respect those, but we don't support reading packages from another environment.

--no-dev applies when installing, not when resolving. To sync, we have to resolve, and the resolution is failing.

I agree I don't think we can really support this. I think you'd have to use uv pip install --no-deps or something and remove all the existing dependencies from a requirements.txt?  Seems a bit weird.
Sorry we aren't much help here. Let us know if you figure something out!

I think we'll eventually support using a system environment with uv sync, but I don't know that we can support this kind of "layered" environment.


HueBot Cannot join the call

Describe the issue
I´ve followed the steps described in the repository for HueBot. I get the service up and running on the Azure Service Fabric cluster, as I can do the requests via Postman.
But when I try the joinCall endpoint with a meeting previously set up, my bot does not join. If later I try to Delete the call, I get a Call Not Found exception.
Code Snippet
The HueBot example.
Expected behavior
I would expect to happen what is described in the steps. The bot should Join to the call and I would be able to change the Hue color or to Delete (stop) the call.
Graph SDK (please complete the following information):

Version [e.g. 22]

Call ID
My last CallId is this one:
d61f0200-911f-4572-9d3e-c901ae4698c9
And it was done a few minutes ago: 2020-06-01T14:55:32.1842499Z
Logs
This is the full Log trace for that call Id. I just did the joinCall and later the Delete:
$>2020-06-01T14:55:32.1842499Z Error: GraphAuthClient.cs:117 SendHttpRequestAsync
ScenarioId: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
AppId: 6d7f21cb-9d70-47b5-b126-f8af2cb6bfa5
AppName: HueBot
CallId: d61f0200-911f-4572-9d3e-c901ae4698c9
TenantId: ed23bf79-4739-44a9-8b18-9674332ecc6b
TransactionDirection: Outgoing
TraceType: HttpResponse
ResponseTime: 47
request: DELETE https://graph.microsoft.com/v1.0/communications/calls/d61f0200-911f-4572-9d3e-c901ae4698c9
response: 404 NotFound
headers:
request-id: bc0931df-6a21-417a-b84d-1eaa5c847ce2
client-request-id: dd0541b6-b984-48b9-a429-5cd5d9b69471
x-ms-ags-diagnostic: {"ServerInfo":{"DataCenter":"North Europe","Slice":"SliceC","Ring":"4","ScaleUnit":"005","RoleInstance":"AGSFE_IN_29"}}
scenario-id: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
Strict-Transport-Security: max-age=31536000
Cache-Control: private
Date: Mon, 01 Jun 2020 14:55:32 GMT
Content-Length: 205
Content-Type: application/json
{
"error": {
"code": "8522",
"message": "Call not found.",
"innererror": {
"request-id": "bc0931df-6a21-417a-b84d-1eaa5c847ce2",
"date": "2020-06-01T14:55:32"
}
}
}
$>2020-06-01T14:55:32.1217507Z Info: GraphAuthClient.cs:100 SendHttpRequestAsync
ScenarioId: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
AppId: 6d7f21cb-9d70-47b5-b126-f8af2cb6bfa5
AppName: HueBot
CallId: d61f0200-911f-4572-9d3e-c901ae4698c9
TenantId: ed23bf79-4739-44a9-8b18-9674332ecc6b
TransactionDirection: Outgoing
TraceType: HttpRequest
request: DELETE https://graph.microsoft.com/v1.0/communications/calls/d61f0200-911f-4572-9d3e-c901ae4698c9
headers:
Scenario-Id: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
Client-Request-Id: dd0541b6-b984-48b9-a429-5cd5d9b69471
User-Agent: GraphCommunicationsClient-HueBot/<IP_ADDRESS>0
Authorization: (redacted)
$>2020-06-01T14:55:16.7225989Z Info: GraphAuthClient.cs:153 SendHttpRequestAsync
ScenarioId: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
AppId: 6d7f21cb-9d70-47b5-b126-f8af2cb6bfa5
AppName: HueBot
TransactionDirection: Outgoing
TraceType: HttpResponse
ResponseTime: 192
request: POST https://graph.microsoft.com/v1.0/communications/calls
response: 201 Created
headers:
request-id: 22d72e3f-ef25-4360-b6f1-7afd359abf36
client-request-id: df37fc2d-3afe-4bd7-bb99-646f6fd03544
x-ms-ags-diagnostic: {"ServerInfo":{"DataCenter":"North Europe","Slice":"SliceC","Ring":"4","ScaleUnit":"005","RoleInstance":"AGSFE_IN_29"}}
scenario-id: 328c4ba7-0d9c-400f-9cd0-c53e9e4fafdc
OData-Version: 4.0
Strict-Transport-Security: max-age=31536000
Cache-Control: private
Date: Mon, 01 Jun 2020 14:55:14 GMT
Location: https://graph.microsoft.com/v1.0/communications/calls/d61f0200-911f-4572-9d3e-c901ae4698c9
Content-Length: 2538
Content-Type: application/json; odata.metadata=minimal; odata.streaming=true; IEEE754Compatible=false; charset=utf-8
{
<EMAIL_ADDRESS>"#microsoft.graph.call",
"state": "establishing",
"direction": "outgoing",
"callbackUri": "https://yeboahbot.northeurope.cloudapp.azure.com:9445/api/calls",
"callRoutes": [],
"source": {
<EMAIL_ADDRESS>"#microsoft.graph.participantInfo",
"identity": {
<EMAIL_ADDRESS>"#microsoft.graph.identitySet",
"application": {
<EMAIL_ADDRESS>"#microsoft.graph.identity",
"displayName": "(Identity: WpP6+t7j)",
"id": "6d7f21cb-9d70-47b5-b126-f8af2cb6bfa5"
},
"phone": null,
"guest": null,
"encrypted": null,
"onPremises": null,
"azureApplicationInstance": null,
"applicationInstance": null
}
},
"targets": [],
"requestedModalities": [
"audio",
"video"
],
"mediaConfig": {
<EMAIL_ADDRESS>"#microsoft.graph.appHostedMediaConfig",
"blob": "{"mpUri":"net.tcp://yeboahbot.northeurope.cloudapp.azure.com:8446/MediaProcessor","audioRenderContexts":["640e683f-5a02-4ad0-968a-a2805bde6849"],"videoRenderContexts":["cef5da06-76bb-4319-aa79-70b0f88d6e28"],"audioSourceContexts":[null],"videoSourceContexts":["b8bbb862-508c-408b-b794-0c67d01c3698"],"dataRenderContexts":null,"dataSourceContexts":null,"supportedAudioFormat":"Pcm16K","videoSinkEncodingFormats":["Yuv"],"mpMediaSessionId":"4fd55f0e-b372-4601-83d6-641e1110b922","regionAffinity":null,"skypeMediaBotsVersion":"<IP_ADDRESS>9","mediaStackVersion":"2<IP_ADDRESS>","mpVersion":"<IP_ADDRESS>36","callId":"0b98b60e-75aa-4b9a-afd2-0968a8400cbe"}"
},
"chatInfo": {
<EMAIL_ADDRESS>"#microsoft.graph.chatInfo",
"threadId"<EMAIL_ADDRESS>"messageId": "0"
},
"callOptions": {
<EMAIL_ADDRESS>"#microsoft.graph.outgoingCallOptions",
"allowGuestToBypassLobby": null
},
"meetingInfo": {
<EMAIL_ADDRESS>"#microsoft.graph.organizerMeetingInfo",
"organizer": {
<EMAIL_ADDRESS>"#microsoft.graph.identitySet",
"user": {
<EMAIL_ADDRESS>"#microsoft.graph.identity",
"id": "07f00289-c791-4643-8a66-523174088992",
"tenantId": "ed23bf79-4739-44a9-8b18-9674332ecc6b"
},
"phone": null,
"guest": null,
"encrypted": null,
"onPremises": null,
"azureApplicationInstance": null,
"applicationInstance": null
},
"allowConversationWithoutHost": null,
"lobbyBypass": null
},
"tenantId": "ed23bf79-4739-44a9-8b18-9674332ecc6b",
"myParticipantId": "2fb1d249-bae3-46bb-a521-3d397d130e57",
"callChainId": "fd97c5cb-1e53-4126-876d-fbf7f1d996b5",
"id": "d61f0200-911f-4572-9d3e-c901ae4698c9",
<EMAIL_ADDRESS>"https://graph.microsoft.com/v1.0/$metadata#communications/calls/$entity",
"transferState": null,
"terminationReason": null,
"ringingTimeoutInSeconds": null,
"activeModalities": [],
"routingPolicies": [],
"answeredBy": null,
"meetingCapability": null,
"terminationSender": null
}
Additional context
Worth mention that this is being part of a POC within my company, and we set up a nginx server which should being ignoring certificates, and redirecting the requests. Not sure if this might be causing the issue.

Closing this (Not solved but will try generating a cert)

@franciscojgonzalez did you manage to fix it? I am having the same issue, but I managed to generate a cert with Let's Encrypt for the ngrok address.

Yep. This is what worked for me:

I had to generate a wildcard certificate for my bot´s domain *.mydomain.com
I had to configure proper CNAMES in my domain
I had to configure properly the --dns and --cn values pointing to my domain in the powershell script

@franciscojgonzalez by *.mydomain.com do you mean *.ngrok.com, since that's what it's supposed to use in local? And can how did you get one since *.ngrok.com seems like a cert for all of ngrok which is a bit big.

Nope. I did not use ngrok as I deployed it to Azure SF.
I´m not really sure how this might work with ngrok (Local), but I seem to remember you may use self-signed certs in this case. You´d also need to create CNAME entry in Ngrok (please see Local section here https://github.com/microsoftgraph/microsoft-graph-comms-samples/tree/master/Samples/V1.0Samples/LocalMediaSamples/HueBot#prerequisites)
Are you using free lincense of ngrok? Please review the available features, because I think some of things you´d need here are not available for free.


Updated asset

Please note: This repository is being rebuilt to accept the new volume of token additions and modifications. PR merges will be delayed.

I agree to not ping anybody on Discord/Twitter/email about this pull request. Instead I will inquire by posting a new comment in the pull request if needed.

PRs are reviewed in bulk and and can take up to two weeks to be merged.
This repository is managed using an auto merge action. Please ensure your PR has no deleted lines, and it will be merged.
Please provide the following information for your token.
Please include change to the src/tokens/solana.tokenlist.json file in the PR.
DON'T modify any other token on the list.
At minimum each entry should have

Token Address:
Token Name:
Token Symbol:
Logo: (logo should be uploaded under assets/mainnet//*.<png/svg>)
Link to the official homepage of token:
Coingecko ID if available (https://www.coingecko.com/api/documentations/v3#/coins/get_coins__id_):

Auto merge requirements
Your pull request will be automatically merged if the following conditions are met:

Your pull request only adds new tokens to the list. Any modification to existing
tokens will require manual review to prevent unwanted modifications.

Your pull request does not touch unrelated code. In particular, reformatting changes to unrelated
code will cause the auto merge to reject your PR.

Any asset files added correspond to the token address you are adding. Asset files
must be PNG, JPG or SVG files.

Your change is valid JSON and conforms to the schema. If your change failed validation,
read the error message carefully and update your PR accordingly.

No other tokens shares the same name, symbol or address.

For example, this change would be rejected due to unrelated changes:

The bot runs every 60 minutes and bulk-merges all open pull requests to prevent conflicts.
This means that you need to wait up to 60 minutes for your pull request to be merged or reprocessed.

I think you would be better off replacing the file with and leaving the old name, but I'm not sure
@keone what is the best practice for this kind of update?

Hi @keone &  @bartosz-lipinski , Can you kindly approve this pull request as I am trying to update my own token.

If you need somebody to save you time and merge it for you, i'm your guy!!
https://github.com/SolanaTokenMerger

added in https://github.com/solana-labs/token-list/commit/c58a79b83d38fc24ada607d186c82b57aaaaa195


get single project

Is there a plan to support getting a project by its id? (for instance in a use case where you just want to determine the project's name)

It's doable, the api does provide it, https://developer.bentley.com/apis/projects/operations/get-project/
If you want it you'll have to contribute it tho


refactor: modify lua vm

Signed-off-by: Frankzhaopku<EMAIL_ADDRESS>
Brief change log

Refactor Lua VM to support async function in js

Checklist

Are tests written for added code?

[x] Yes
[ ] No because:

Did you introduce any new dependencies?

[x] No
[ ] Yes

Dependency:
Reason:

@GoodMeowing Can you review this one?


Removing make_chain in favor of run_prompt

We seemed to always make_chain and then immediately call it. This PR just removes the make_chain closure in favor of a normal stateless free function run_prompt
This PR also cleans up make_chain by:

Decomposing it into two private methods
Simplifies its implementation where possible

What's the difference between PromptRunner and make_chain?

What's the difference between PromptRunner and make_chain?

So in general:

make_chain was a method creating a closure to bind arguments, run_prompt is a stateless (no pre-binding) method
When talking about map_fxn_summary, it was designed around a partially bound function. Its Chain was a type alias for the output closure from make_chain

This PR could take two stances:

Invent a functools.partial'd version of run_prompt that's compatible with the old make_chain. Correspondingly, PromptRunner is a type alias equivalent to Chain (it basically renames Chain)
Pass an additional argument to map_fxn_summary which handles the additional arguments for a non-closure

Anyways, we discussed this in person, going to merge this PR


feat: add metadata

This PR has to pass asap before the quantum leap promotion

This should be merged asap to follow the new contract interface

Note: This pull request will require a new env variable: NEXT_PUBLIC_SALES_SERVER_LINK. On testnet its value should be https://goerli.api.sales.starknet.id. Make sure to add it to your .env.local to try it. I already updated it on the vercel configs even though it is not yet deployed on mainnet.


docs(scale): refactor Scale Agent docs; update dynamic accounts content with new material; install quick start

Resolves Jira: DOC-699
Deploy previews:
Dynamic accounts

Concept:  https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/concepts/dynamic-accounts/
Dynamic Accounts Tasks landing page https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/tasks/dynamic-accounts/
Enable Dynamic Accounts  https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/tasks/dynamic-accounts/enable/
Migrate Clouddriver Kubernetes Accounts to the Armory Scale Agent  https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/tasks/dynamic-accounts/migrate-accounts/
Armory Scale Agent Dynamic Accounts API Reference  https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/reference/dynamic-accounts/

Install changes

Armory Scale Agent Quick Start  https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/install/quickstart/
Armory Scale Agent Advanced Installation   https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/install/advanced/

Landing page updates

https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/

New pages (from existing content)

Armory Scale Agent Architecture https://deploy-preview-1803--armory-docs.netlify.app/scale-agent/concepts/architecture/

this PR is getting out of hand, so created 2 separate PRs:

Dynamic account updates https://github.com/armory/docs/pull/1837
Quick Start and general refactoring in prep for Scale Agent launch  https://github.com/armory/docs/pull/1838