UKTV "Main Page" Video Support

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.04.25. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.04.25

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[x] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
youtube-dl https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/ -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/', '-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2018.04.25
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.16299
[debug] exe versions: ffmpeg N-90656-ga26c9fdd1b, ffprobe N-90656-ga26c9fdd1b
[debug] Proxy map: {}
[generic] watch-online: Requesting header
WARNING: Falling back on generic information extractor.
[generic] watch-online: Downloading webpage
[generic] watch-online: Extracting information
ERROR: Unsupported URL: https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpad1hmn8r\build\youtube_dl\YoutubeDL.py", line 789, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpad1hmn8r\build\youtube_dl\extractor\common.py", line 440, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpad1hmn8r\build\youtube_dl\extractor\generic.py", line 3182, in _real_extract
youtube_dl.utils.UnsupportedError: Unsupported URL: https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
I'd like to see support for single-episode UKTV shows. Currently youtube-dl has no problem downloading specific episode links (eg: https://uktvplay.uktv.co.uk/shows/alan-davies-as-yet-untitled/watch-online/?video=3973655453001), but for shows where only a single episode is present and only the "main page" URL is available (eg specials: https://uktvplay.uktv.co.uk/shows/alan-davies-xmas-untitled/watch-online/) youtube-dl cannot grab the episode (likely because no episode ID is specified). The video still plays correctly in web browsers when giventhe provided URL. If you would like any further information, please do not hesitate to ask,

Until this possibly gets added to the UKTV downloader plugin, there's a manual fix.
It would appear the video code for single videos is appended as "videoId=xxxxxxxxxxxxxxx" to the end of the poster image URL in the video-content  of the HTML. "Inspecting" the element within your browser, you can get that "empty" url and just add "?video=xxxxxxxxxxxxxxx" to the end.

Just wanted to add that I have officially confirmed that manually grabbing that code and adding it to the URL does download the correct video in youtube-dl.

I appreciate knowing there is a workaround for the time being, thank you for looking in to this for me @zang74

I greatly appreciate knowing there is a workaround until this is fixed. Thank you for looking in to this for me @zang74

The workaround seems to no longer be working:
youtube-dl https://uktvplay.uktv.co.uk/shows/secrets-of-the-london-underground/watch-online/?video=6261469555001 --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://uktvplay.uktv.co.uk/shows/secrets-of-the-london-underground/watch-online/?video=6261469555001', '--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.03.24
[debug] Python version 3.8.10 (CPython) - Linux-5.11.0-25-generic-x86_64-with-glibc2.29
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4, rtmpdump 2.4
[debug] Proxy map: {}
[brightcove:new]<PHONE_NUMBER>001: Downloading JSON metadata
ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line 797, in extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/brightcove.py", line 668, in _real_extract
    return self._parse_brightcove_metadata(
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/brightcove.py", line 549, in _parse_brightcove_metadata
    self._sort_formats(formats)
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 1327, in _sort_formats
    raise ExtractorError('No video formats found')
youtube_dl.utils.ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

They seem to now be separate pages and not just one, as the video ids are no longer a query string but a new page.


docs: S3 SDK users might believe that OpenDAL does not support multipart upload pre-sign URL

A Python code snippet for a multipart upload demo
In the OpenDAL SDK, I believe the following three APIs are missing to fully support multipart uploads, which are available in the AWS S3 Python SDK (boto3):

create_multipart_upload - To initiate a multipart upload and obtain an upload ID for the object that will receive multiple parts.
generate_presigned_url - OpenDAL already has the capability to generate presigned URLs, but it may need to extend its parameters to support multipart uploads by including the upload ID and part number.
complete_multipart_upload - To signal that the multipart upload for the object is complete after uploading all parts.

import boto3
import requests

s3 = boto3.client('s3')
max_size = 5 * 1024 * 1024 #you can define your own size

res = s3.create_multipart_upload(Bucket=bucket_name, Key=key)
upload_id = res['UploadId']

# please note this is for only 1 part of the file, you have to do it for all parts and store all the etag, partnumber in a list

parts=[]
signed_url = s3.generate_presigned_url(ClientMethod='upload_part',Params={'Bucket': bucket_name, 'Key': key, 'UploadId': upload_id, 'PartNumber': part_no})

with target_file.open('rb') as f:
      file_data = f.read(max_size) #here reading content of only 1 part of file

res = requests.put(signed_url, data=file_data)

etag = res.headers['ETag']
parts.append({'ETag': etag, 'PartNumber': part}) #you have to append etag and partnumber of each parts

#After completing for all parts, you will use complete_multipart_upload api which requires that parts list
res = s3.complete_multipart_upload(Bucket=bucket_name, Key=key, MultipartUpload={'Parts': parts},UploadId=upload_id)

Note: Copied from https://github.com/boto/boto3/issues/2305#issuecomment-591128376
The provided Python code snippet demonstrates how these APIs are used in boto3 for a multipart upload. This could serve as a reference for implementing similar functionality in OpenDAL.

Additional Reference
It's worth noting that for full compatibility with the AWS S3 Multipart Uploads API.
If the OpenDAL team needs an S3 API compatibility document for reference, it's the following.

AbortMultipartUpload
CompleteMultipartUpload
CreateMultipartUpload
ListMultipartUploads
ListParts
UploadPart
UploadPartCopy
(Note: copied from minio's s3-api-compatibility for the Multipart Uploads part)

In the OpenDAL SDK, I believe the following three APIs are missing to fully support multipart uploads, which are available in the AWS S3 Python SDK (boto3):

Hi, OpenDAL has its own abstractions that hide implementation details. By design, we do not expose these APIs to users. When users create a Writer on s3, OpenDAL uses create_multipart and complete_multipart under the hood.
This design allows us to build a unified API layer across azblob, gcs and many other storage services.

I thought we discussed pre-sign support for multialart in https://github.com/apache/opendal/issues/4282. It seems there's some misunderstanding here.

My idea was to look for a way to generate pre-signed URLs for multipart operations and let the client app, such as on the browser or mobile, run the multipart operations.

It will inevitably call underlying apis like create_multipart_upload and CompleteMultipartUpload.

That's what opendal wants to avoid.

The problem is finding a good API design that can generate such an upload URL for users without leaking the storage details.

The problem is finding a good API design that can generate such an upload URL for users without leaking the storage details.

I'm guessing the most important part is allowing the client to upload data, right? The initiate multipart and complete multipart can be called directly from the server.
Is supporting URL generation for part uploads sufficient for you?

I'm guessing the most important part is allowing the client to upload data, right? The initiate multipart and complete multipart can be called directly from the server.

Yes, it allows the client to upload data, but it's through multipart operations when the case is for a large object (like over 100 MB in size).
The purpose is that the upload operation can continue in any part if the network connection is suddenly broken. In this case, it may need ListParts to know the current progress and continue it.

Is supporting URL generation for part uploads sufficient for you?

No, my reason is above. But I know your standpoint. I'm thinking of it.

I dump my rough idea here.
The following code is written in Python.
# trigger the underlying CreateMultipartUpload API and make a MultiPartUploadFile
multipart_file = op.multipart("filename")  including UploadID

# Calling the part(...) will get a PartUploadFile
# Calling presign for a PartUploadFile object to expose a URL to serve the client
multipart_file.part(number).presign(expire_second)
or
multipart_file.presign_part(part_number: int, expire_second: int)

# Calling the underlying CompleteMultipartUpload API to tell the S3 server
multipart_file.complete([{'ETag': etag, 'PartNumber': part}...])

I'm happy to hear your feedback.
Thank you.

Hi, as I mentioned in previous comments, OpenDAL's vision is to provide free data access. Any design that violates this vision is unlikely to be accepted. In reality, opendal users should be able to write code without knowing which underlying storage service is being used.
In our current design, there are following places that doesn't work:

multipart: Not all storage services offer multipart abstraction, like gcs, azblob, hdfs, ..
The url generated by presign_part could return different responses that need users to handling.

I think it's hard to create such an abstraction for multipart presign since it needs the data returned by upload_part to do complete.
Other storage services like gcs, azblob maybe possible since users can just call uploading without parsing the returning response.

multipart: Not all storage services offer multipart abstraction, like gcs, azblob, hdfs, ..

Oops, I thought that gcs and azblob had the same ability, but they actually don't have that.
For this reason, I won't proceed with this discussion anymore.


"open" CSS class should not be hardcoded

Issue #104

looks good

actually, can you PR it into 1.0.0?

yep, will do


[api-minor] Allow specifying an extra-delay, in RenderTask.cancel, for worker-thread aborting of operatorList parsing

This is done to support upcoming viewer-changes, and in order to prevent third-party users from outright breaking things we'll simply ignore too large values.

/botio test


Exclude completions of binding pattern variable initializers

Bug Report
Completions from binding pattern variable initializers are included, but they shouldn't
🔎 Search Terms
no suggestions const destruct destructure
🕗 Version & Regression Information
Copied from available fix https://github.com/microsoft/TypeScript/pull/52723 :
const {a1} = a/* should not complete a1 */

Real world case:
let pageToReturn

const { data: pageData } = await octokit.repos.listTags({
    page: page /* pageData is suggested first */
})

Some kind of follow up for https://github.com/microsoft/TypeScript/pull/42087

Care should be taken to not cause false negatives, e.g.
const { tick } = {
  tick() {
    window.setTimeout(tick, 100);
    //                ^^^^ valid
  }
}


Add API key

Description
There's an epidata covidhosp api call in hhs run module that got exposed to needing api key. The key is already available in params.json, so only need to add in code.
Changelog
Add api key to hhs_run.

adding tests.


DNS issues on NTP client

During NTP server querying through the ntpclient.c, different NTP server domain names (e.g., 0.uk.pool.ntp.org, 1.uk.pool.ntp.org) might resolve to the same set of IP addresses due to DNS caching. This can lead to repeated queries to the same non-responsive IP addresses, resulting in failures to obtain the correct time.
For example, in the following, there are some logs that I added to ntpclient.c, in order to understand why the NTP was failing:
[   51.046000] [25] (Info)  '0.pool.ntp.org' resolved to: <IP_ADDRESS>
[   51.046000] [25] (Info) ntpclient.c-447-gethostbyname for 0.pool.ntp.org OK
[   51.046000] [25] (Info) ntpclient.c-480-Sending a NTP packet
[   51.055000] [25] (Info) ntpclient.c-509-sendto ret: 68
[   51.056000] [25] (Info) ntpclient.c-515-Recv a NTP packet
[   56.055000] [25] (Info) ntpclient.c-521-recvfrom nbytes: -1
[   56.056000] [25] (Info)  '0.pool.ntp.org' resolved to: <IP_ADDRESS>
[   56.056000] [25] (Info) ntpclient.c-447-gethostbyname for 0.pool.ntp.org OK
[   56.056000] [25] (Info) ntpclient.c-480-Sending a NTP packet
[   56.063000] [25] (Info) ntpclient.c-509-sendto ret: 68
[   56.063000] [25] (Info) ntpclient.c-515-Recv a NTP packet
[   61.065000] [25] (Info) ntpclient.c-521-recvfrom nbytes: -1
[   61.066000] [25] (Info)  '0.pool.ntp.org' resolved to: <IP_ADDRESS>
[   61.066000] [25] (Info) ntpclient.c-447-gethostbyname for 0.pool.ntp.org OK
[   61.066000] [25] (Info) ntpclient.c-480-Sending a NTP packet
[   61.075000] [25] (Info) ntpclient.c-509-sendto ret: 68
[   61.075000] [25] (Info) ntpclient.c-515-Recv a NTP packet
[   66.075000] [25] (Info) ntpclient.c-521-recvfrom nbytes: -1
[   66.076000] [25] (Info)  '0.pool.ntp.org' resolved to: <IP_ADDRESS>
[   66.076000] [25] (Info) ntpclient.c-447-gethostbyname for 0.pool.ntp.org OK
[   66.076000] [25] (Info) ntpclient.c-480-Sending a NTP packet
[   66.085000] [25] (Info) ntpclient.c-509-sendto ret: 68
[   66.085000] [25] (Info) ntpclient.c-515-Recv a NTP packet
[   71.085000] [25] (Info) ntpclient.c-521-recvfrom nbytes: -1
[   71.086000] [25] (Info)  '0.pool.ntp.org' resolved to: <IP_ADDRESS>
[   71.086000] [25] (Info) ntpclient.c-447-gethostbyname for 0.pool.ntp.org OK
[   71.086000] [25] (Info) ntpclient.c-480-Sending a NTP packet
[   71.095000] [25] (Info) ntpclient.c-509-sendto ret: 68
[   71.095000] [25] (Info) ntpclient.c-515-Recv a NTP packet
[   76.095000] [25] (Info) ntpclient.c-521-recvfrom nbytes: -1
[   76.095000] [25] (Info) ntpclient.c-563-ERROR: recvfrom() failed: 11
[   76.095000] [25] (Info) ntpclient.c-589-The NTP client is terminating

To mitigate this issue, a possible option is to flush the DNS cache after cycling through all configured NTP servers, ensuring that subsequent DNS resolutions provide potentially new and responsive IP addresses, thereby increasing the likelihood of successful time synchronization. However, I cannot manipulate the DNS cache from the user space, unless I create an API for it.
Overall, do you have a workaround or a hack that I can use in order to solve this NTP issue? Or at least to force a new IP resolution for an NTP hostname after some failures?

@duduita thank you for finding and reporting this issue!
@wengzhe did you see that?

Hi @duduita , since 12.1.0, the DNS caching will become invalid after the TTL from the DNS server has expired, then we'll send a new query for the domain names. I found the TTL is always less than 100s (and normally ~20s) for 0.pool.ntp.org in my local environment. Maybe your DNS server gives you non-responsive IP addresses with a longer TTL which causes this problem.
There is a hack that may force resolving the domains: set CONFIG_NETDB_DNSCLIENT_LIFESEC to a shorter value, e.g. 5 seconds, then after 5sec the cache will become invalid and the domain will be resolved again if you do the lookup.


SSL verification is Failed - CNAME setup took time, and verificartion retry fails

App Id: d1f2sjshpf2182
Region: ap-northeast-1
Step: SSL verification
Status: Failed
Issue/question
Our domain is hosted under third-party DNS server, and took a week to setup CNAME record.
After the record is set, we retried but it seems to fail. Is there any way to succeed?
Error message
We could not verify ownership of the domain. Please ensure you own the domain and choose retry. If retrying fails, please create an issue in our GitHub issue tracker.
Error message: The status of this certificate request is "Failed". One or more domain names have failed DNS validation. Please check your domain name validation routes and try re-adding the custom domain to your app. Learn more: https://docs.aws.amazon.com/amplify/latest/userguide/custom-domains.html#custom-domain-troubleshoot-guide

Hi @gommmmmm Sorry to hear that you have custom domain issue. For this issue, you could either contact the DNS provider to diagnose why the DNS verification CNAME is not resolving or migrate your DNS to Route53.
How to migrate your DNS to Route53: https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/MigratingDNS.html

Hello @Joycehao19 Thank you for responce.

For this issue, you could either contact the DNS provider to diagnose why the DNS verification CNAME is not resolving

Our DNS server answers correctly to the CNAME record provided by amplify console. So its not a case with DNS, it seems problem on retrying. Does the checking of CNAME keep repeating now?

@gommmmmm I'm not sure what happened now... Did you check your domain name validation routes and re-adding your custom domain?

@Joycehao19
Thank you for your response.
Re-adding custom domain works, without changing CNAME record.
Now the "Status detail" step proceeds to "Domain activation", and failed because our domain currently points to another CloduFront distribution (and it is in use for production environment...)
I will look into a documentation for movingan alternate domain name between CloudFront distribution.
Thank you again, I close this issue (may be reopen if alternate domain name matters).

Hello again, I have another question. Is there any way to use wildcard domain name in Amplify Console's domain setting?
I read a documentation on CloudFrotn "Move a subdomain name, like marketing.example.com, to another distribution" ant can't follow the instruction because Amplify console does not accept wildcard on  creating custom domain.
Or, is it necessary to contact AWS support as mentioned in the next section of the document?

@gommmmmm We currently do not support wildcard subdomains. Would you mind tell us why you want this feature?

@Joycehao19
Thank you for your response, we are in such situation:

Our domain (ex. example.com, www.example.com) is currently hosted with CloudFrront + S3, and it is in production
To move www.example.com to another CloudFront distribution, the document above says setup *.example.com on new distribution and change DNS record of www.example.com to point to new  distribution
Amplify console does not allow wildcard in domain settings

It's not fundamentally an Ampify problem, but is fthere are any ways to achieve this?

@Joycehao19
Sorry, forgot to reopen with my comment.

Hi @gommmmmm Can you open a new ticket of wildcard feature request? We can discuss there. We will close this issue for now. Thank you!


VB state variable

Our implementation follows the paper notation of having separate variables s, c, m, L and s0, c0, m0, L0 for the prior, and things like L_inv for efficiency. This makes it ugly (debatable, I know) to represent the rough structure of the algorithm
while keep_running(s, c, m, ...):
  update_parameters(s, c, m, ...)
  update_noise(s, c, m, ...)
  update_prior(s, c, m,...) # e.g. for ARD
  evaluate_model_and_jacobian(m)
  f = free_energy(s, c, m, ...)

because each methods needs almost all parameters. Introducing a VBState may clear that up.
Disadvantage: The structure and notation of the original paper may be harder to follow. But maybe slight improvements of the algorithm justify to write our own (small) paper, that we can refer to.

From my point of view, that is a good option. How would you call it, maybe just q according to the distributions in the paper eq.3?


Translate symbols in a hash applied to Relation#where to attributes

We store qualified attributes in schemas, that's good. But when you call .where(name: 'abc') then symbols from the hash don't get converted to attributes from the schema and thus get translated to unqualified SQL identifiers. At the same time, using the block syntax will produce qualified attributes: where { name.is('abc') }. This discrepancy confuses people, we should transform symbol keys into qualified attributes. This will be a breaking change.

Ah yes, we wanted to do it long time ago :) I'm glad you reported an issue about it <3


mbed-cli support for .mbedignore file definition in mbed_app.json

We have a situation that some of our configuration requires this kind of .mbedignore file and some other ones require a slightly different one.
Right now you can already say to mbed-cli with mbed_app.json file to use, but you can't give it the .mbedignore -file. We should either have the option to define that as well --ignore <thisfileas .mbedignore> OR alternatively add a config to the mbed_app.json file itself which would point to the relevant .mbedignore -file.
I know there is a differing view as well that we should not use the .mbedignore -files at all, but
a) until that perfect day arrives, we have to live somehow - manually copy pasting .mbedignore -files is not a good solution
b) compiling with Windows -machines at least is so slow, that  every file you can get OUT of the compilation is a big win. I'm still dumbfound how much slower Windows 10 is compiling the exactly same app compared to a virtual machine running Ubuntu 16.04 on the same laptop.
So, how should it work then?
.json parameter -option.
I have files under
/configs/this_config.json
         that_config.json
         this_ignore
         that_ignore

The _config.json -files would have a JSON parameter indicating the .mbedignore-file to use,
this_config.json would refer to this_ignore and that_config.json to that_ignore.
Using the --profile -option with that_config.json would imply that the compilation would be similar as if

that_config.json was in the / -folder as mbed_app.json AND
that_ignore -file was in the / -folder as .mbedignore.

Same way with the extra option --ignore or similar, but I think the .json approach would yield a slightly simpler usability from end-user point of view.
Addition / 15-Dec-2017:

may be self-evident, but if there are existing mbed_app.json and .mbedignore -files in the / -folder, we should not harm them in any way.

Related items;
https://github.com/ARMmbed/atmel-rf-driver/issues/59 AND
https://github.com/ARMmbed/stm-spirit1-rf-driver/issues/1
This problem is not going away too soon, unfortunately

cc @theotherjimmy

@screamerbg  - can you get this moving, please?

This is a build system question.
cc @theotherjimmy @sg-

We should either have the option to define that as well --ignore <thisfileas .mbedignore> OR alternatively add a config to the mbed_app.json file itself which would point to the relevant .mbedignore -file.

This is not something I would like to see. I see this as yet another way that the files in a
build would change.

We have a situation that some of our configuration requires this kind of .mbedignore file and some other ones require a slightly different one.

Could you share that situation?

Using the --profile -option with that_config.json would imply that the compilation would be similar as if
that_config.json was in the / -folder as mbed_app.json AND
that_ignore -file was in the / -folder as .mbedignore.

This is not how the --app-config parameter works right now, and I don't know what the --profile option is doing in that sentence. The --app-config parameter does not pretend that it's argument was found in the root, instead it treats the file specified as the application configuration. When the parameter to --app-config contains file names, they are relative to the location of that file not to the project root. An ignore file would need to pretend to be in the root, and would not be consistent with this behavior.

Have you considered using extra_labels?

Bump @JanneKiiskila

FWIW I would also like the ability to change the subset of compiled files depending upon configuration.  My scenario is that I wish to compile both a minimal bootloader and an application from the same codebase.  There is a small amount of shared code but the 'feature set' is very different between the two builds and I don't want the bootloader dragging in all the unused features.  More generally, I may want to build different platform variants with different features sets from the same application code base in future.
cc'ing @MarceloSalazar  since he was involved in some discussion around this.

Issue header has missing or incorrectly filled in fields! Please fix.

@adbridge  - a little bit more guidance needed?

@JanneKiiskila  Apologies, the comment is from our new automated issue checking script that got rolled out yesterday. Unfortunately it looks like I missed some configuration in a number of repos. I will fix it :)

I assume this issue is effectively dead, but has anybody come up with an easy way to do conditional compilation of features in mbed?  I saw another thread where somebody had proposed a custom Makefile, which IMO defeats the purpose of mbed being a quick way to organize and build projects.  In my particular case I have two copies of mbed-os, one being a development branch from the chip vendor for an early silicon revision, and the other being the main mbed-os branch for mainstream processors.  Keeping two copies of the project just to compile different targets is somewhat of a drag and I don't want to go through the manual effort of merging the Vendor's changes back into the main mbed branch.

I agree regarding the desire for conditional compile/build.
Best option I have found is buckaroo 2.0 for package managment. I have no good solution build wise.

Best option I have found is buckaroo 2.0 for package managment. I have no good solution build wise.

@40Grit Can you elaborate about build wise?

Im referring to the fact that I do not know of a good alternative to make nor the build scripts that are part of mbed-os/tools.

Thank you for raising this issue. Please note we have updated our policies and
now only defects should be raised directly in GitHub. Going forward questions and
enhancements will be considered in our forums, https://forums.mbed.com/ . If this
issue is still relevant please re-raise it there.
This GitHub issue will now be closed.


Add changelog file

Adding template following guidelines from https://keepachangelog.com - but calling file NEWS.md as seems to be more common practice in the R world?

calling file NEWS.md as seems to be more common practice in the R world?

Thanks. Yes, calling it NEWS.md is common practice in R packages.


test: cherry-pick unstable test fix

What problem does this PR solve?
Problem Summary:
Some unstable test fix did not cherry-pick into release-4.0 branch because the CI on release-4.0 unstable
What is changed and how it works?
What's Changed:
cherry-pick https://github.com/tikv/tikv/pull/7873 and https://github.com/tikv/tikv/pull/8558
Release note

No release note

/run-unit-tests

/merge


Fix test tagging and add interfaces to documentation

Add better tags for tests to partially fix #197, and add interfaces into documentation. Example:

Adding the test data to the docs still needs to be added, but this fixes the errors for the test data not being found.

Yeah no problem.


mongoalchemy import error

I installed flask-mongoalchemy today but keep getting the error:
ImportError: No module named mongoalchemy.
I saw that this issue was fixed in one of the previous releases but I am still getting this.

@fsouza Please close this issue as this is dead now :)

Worked for me after changing this (from docs):
from flask.ext.mongoalchemy import MongoAlchemy
To this:
from flask_mongoalchemy import MongoAlchemy

thanks @stevula , it worked


Bolt "getting started repo" needs to be updated to bolt 3.0

Getting started with Bolt should be updated to be compatible to bolt 3.0.
See: https://puppetcommunity.slack.com/archives/C7GP57T50/p1682538663686969?thread_ts=1682538449.203429&cid=C7GP57T50

At a glance @donoghuc I think this has been done

Yep, looks like this got addressed.


Babel error on converting .es6 file

I have install babel-jekyll and  execjs.
I also has set the _config.yml file and use front matter in .es6 file but I'm getting this error

Unable to reproduce, here's a working example: https://github.com/thejameskyle/jekyll-babel-example
Closing this, but if you can create a repo that reproduces this issue I'll gladly take a look.

The working example not working either.

I've added you to collaborators in my repo.
This is just new repo so nothing special yet

Seems like an issue with windows, I'll check it out on my other machine

I have been trying to get ruby/rubygems/bundler/jekyll for hours and can't get anything working (I seriously don't know how anyone develops anything on windows machines).
I'm afraid I can't really help you here, hopefully someone else comes along that knows more, or you're able to find the source of the problem.

I have Ubuntu, maybe it will work there.
Please tell me if you've figured that out.
Thank you :)


Limit host Faker URLs to example.com

These sometimes generate URLs with existing spammy websites which isn't
a good look (especially as we use them to generate fake data for review
apps). This way we end up with URLs that are guaranteed to not exist.

Review app deployed to https://teaching-vacancies-review-pr-3133.london.cloudapps.digital


Enhancing Utility Functions in ops.h

I have tried to use highway library in the AddFrom, MulBy, MulByConst, MulByConstAndAdd, and create_distribution functions.

Nice! Did you see any performance differences (positive or negative) @enum-class ?

Nice! Did you see any performance differences (positive or negative) @enum-class ?

@austinvhuang Du to hardware limitations, I couldn't do the performance test on the entire pipeline.
I did check individual functions like MulBy, MulByConst and MulByConstAndAdd as much as fair I could.
Anyway, On 12th Gen Intel Core i7-1265U with SSE, -O3, I saw roughly 2x speedup.
I can share the details if you are interested:)


Browser Culture & other environment variables

It would be very useful to have informationon about the runtime environment, such as browser culture, in an Environment class. In particular the CurrentCulture might be set automatically to the browser culture, so that dates and numbers might be automatically displayed according to the Browser culture.
(I know this is easily achieved by calling some JavaScript environment filling function, but....)
It would be nice to have also information on the supported tags, so that "smart components" might automatically revert to widget when an Html5 input is not supported (Html5 input support is far from being complete on the mainstream browsers...also among the ones that support WebAssembly).

We're tracking the localization items in #60

It would be nice to have also information on the supported tags

That's something that a third-party JavaScript feature detection library would probably do best. We won't have the resources to maintain a database of which browsers support which features, or how to do feature detection in each of them. Third-party JS libraries specifically exist for this use case, so it will be best to invoke them via JS interop.


Fix matplotlib

Fix-matplotlib-changes@657 aka 20210326.3 vs main ewma over 7 builds from 637 to 655


Error querying the blockchain after receiving testnet Coin

I'm running my own BWS. A wallet works fine until after generating the first address and receiving testnet coins. When I try to open wallet and check balance I get the error
 Error querying the blockchain
Note: I can create new wallet and generate the first address. The wallet stops working after that.
I'm still running of testnet network.
Please assist.
Thank you.

Okay any idea s

Well, I wasn't able to solve this problem. I switched to livenet and everything was fine so I didn't bother further.

same problem here

Any update regarding this?


fix pizzas configmap

Description
Changes proposed in this pull request:

...
...
...

Related issue(s)

/test pre-busola-smoke-test-docker

/retest

/retest

/retest


feat(config): Add the ability to update config to later minor versions

Add the ability to update config to later minor versions

I think it would be ok if we are aware that there might be unknown config keys and values from previous iterations unless we are updating to a major version like civitdl v2 to civitdl v3


Size of models?

Hello
I am wondering about the difference compared to models listed at the PyTorch repo. (They are roughly 500MB). Are the models here the same, and if so - how come BlingFire models are so small in comparison?

BlingFire models are only tokenizer models, not the NN weights.


Codegen address prefixes

Changes:

Generate p2pkh / p2sh / hrp from coin definition (coins.json)
Fix Decred p2sh lock script

@alejandro-isaza would you mind to take a look? Thanks


container/heap: optimize heap to reduce number of comparisons during heapify and heap pop

This is an optimization specified in Knuth Volume 3 (Exercise 5.2, problem 18 I believe) where down() is called on an element in a certain position (during heap pop or init). It states that it's beneficial to move that element all the way to the leaf and then move up to its appropriate place instead of breaking out as soon as we find a position where the item is <= both of its children.
Python does this and the comment about this method in its heapq module describes it better than I can articulate (also includes comparison numbers).
# The child indices of heap index pos are already heaps, and we want to make
# a heap at index pos too.  We do this by bubbling the smaller child of
# pos up (and so on with that child's children, etc) until hitting a leaf,
# then using _siftdown to move the oddball originally at index pos into place.
#
# We *could* break out of the loop as soon as we find a pos where newitem <=
# both its children, but turns out that's not a good idea, and despite that
# many books write the algorithm that way.  During a heap pop, the last array
# element is sifted in, and that tends to be large, so that comparing it
# against values starting from the root usually doesn't pay (= usually doesn't
# get us out of the loop early).  See Knuth, Volume 3, where this is
# explained and quantified in an exercise.
#
# Cutting the # of comparisons is important, since these routines have no
# way to extract "the priority" from an array element, so that intelligence
# is likely to be hiding in custom comparison methods, or in array elements
# storing (priority, record) tuples.  Comparisons are thus potentially
# expensive.
#
# On random arrays of length 1000, making this change cut the number of
# comparisons made by heapify() a little, and those made by exhaustive
# heappop() a lot, in accord with theory.  Here are typical results from 3
# runs (3 just to demonstrate how small the variance is):
#
# Compares needed by heapify     Compares needed by 1000 heappops
# --------------------------     --------------------------------
# 1837 cut to 1663               14996 cut to 8680
# 1855 cut to 1659               14966 cut to 8678
# 1847 cut to 1660               15024 cut to 8703
#
# Building the heap by using heappush() 1000 times instead required
# 2198, 2148, and 2219 compares:  heapify() is more efficient, when
# you can use it.
#
# The total compares needed by list.sort() on the same lists were 8627,
# 8627, and 8632 (this should be compared to the sum of heapify() and
# heappop() compares):  list.sort() is (unsurprisingly!) more efficient
# for sorting.

def _siftup(heap, pos):
    endpos = len(heap)
    startpos = pos
    newitem = heap[pos]
    # Bubble up the smaller child until hitting a leaf.
    childpos = 2*pos + 1    # leftmost child position
    while childpos < endpos:
        # Set childpos to index of smaller child.
        rightpos = childpos + 1
        if rightpos < endpos and not heap[childpos] < heap[rightpos]:
            childpos = rightpos
        # Move the smaller child up.
        heap[pos] = heap[childpos]
        pos = childpos
        childpos = 2*pos + 1
    # The leaf at pos is empty now.  Put newitem there, and bubble it up
    # to its final resting place (by sifting its parents down).
    heap[pos] = newitem
    _siftdown(heap, startpos, pos)

Is there any interest in doing this optimization? I'm fairly new to Go, but I'd love to contribute with this if it's something you'd like to see. Thanks!

cc @griesemer

Sounds reasonable.  You'll need some benchmarks to justify your change.
Such a change may make the Pop() order change for keys which are unordered.  That's getting close to "breaking the go1 compatibility guarantee" territory, although I think it is probably ok.

What @randall77 said. Feel free to give it a shot. Please be aware that this is not a high-priority issue so it may take a while to get this reviewed thoroughly.

Great, thanks! I'll put a review up in Gerrit soon and try out some benchmarking.

@rajathagasthya are you still working on it?

@Windsooon Yes, PR needs review.


DIF/train.py

Thank you very much for your work, but the DIF/train .py does not exist in the code, can you add it

Thank you for your update. I have encountered some new issues. Firstly, the downloaded datasets/bottom folder does not have a surface_ pts_ n_ normal files,there are files such as 1071fa. When I created a surface_pts_n_normal folder and copied all the files such as 1071fa, mio.py still couldn't read and generate .mat files. Moreover, I found that some of these files have two types: images and models, while others only have models; May I ask how to solve these problems

Please refer to readme to download dataset

Please preprocess the data as described in the readme


[Security] Bump rubyzip from 1.2.1 to 1.2.2

Bumps rubyzip from 1.2.1 to 1.2.2. This update includes security fixes.

Vulnerabilities fixed
Sourced from The Ruby Advisory Database.

Directory Traversal in rubyzip
rubyzip version 1.2.1 and earlier contains a Directory Traversal vulnerability
in Zip::File component that can result in write arbitrary files to the filesystem.
If a site allows uploading of .zip files, an attacker can upload a malicious file
which contains symlinks or files with absolute pathnames "../" to write arbitrary
files to the filesystem.
Patched versions: >= 1.2.2
Unaffected versions: none

Commits

d07b13a Merge pull request #376 from jdleesmiller/fix-cve-2018-1000544
fd81bd5 Bump version to 1.2.2
cf35774 Bump version to 1.3.0
ffb374c Bump version to 2.0.0
8a1de58 Expand from root rather than current working directory
3dd165b Disable symlinks and check for path traversal
ffebfa3 Consolidate path traversal tests
9c468f3 Add jwilk's path traversal tests
0586329 Trigger CI again
cf71583 Move jruby to allow failures matrix till crc uint 32 issues are resolved
Additional commits viewable in compare view

(This is an example of the kind of PRs Dependabot creates, so you can see it in action alongside #84. It won't automatically rebase or any of the clever stuff Dependabot normally does because I've manually copied it across, though.)

/domain @jmileham
/platform @jmileham
<< domain lgtm platform lgtm
Thanks!


Segmentation fault when oper_get_items()

Hi
I have found a segfault when fill in a leafref node.In the model o-ran-performation-management.yang, there is a LeafRef node that causes the netopeer2-server to work incorrectly, generating segment errors without any warning or reporting errors.The Lerfref node is written in a two-level nested linked list, and whenever I return the node in the sysrepo::oper_get_items() callback to sysrepo's C++ interface, the server immediately exits with a segment error.
This is the model (the node that caused the exception is between 177 and 176, which is the type I overwrote), and I try to overwrite the node's type to String, and the server works fine.
o-ran-performance-management.yang.txt
The server printing information does not seem to have much effect, so it is not provided.
The version information is as follows：
netopeer2-1.1.39
sysrepo-1.4.70
libyang-1.0.184
libnetconf2-1.1.26
Regards.
Fizz.

Can you maybe provide gdb or better valgrind output for netopeer2? That should help tracking this down.

Can you maybe provide gdb or better valgrind output for netopeer2? That should help tracking this down.


NME - copy/paste action does not select newly pasted node

##Bug
When a selected node is copied, the resulting pasted node is not selected, but rather the original node that was copied remains selected. This becomes problematic when you copy several nodes at once. We paste the chain down sometimes over other nodes that are already in the graph that were not part of the originally selected nodes. In this case it is important that we keep the newly pasted nodes selected so we can easily move those nodes to a free space in the graph.
original nodes selected to be copied:

pasted nodes:

I'll take care of it


Missing word to complete statement

In the Note (pruple box) section, where it states:
" Note
Microsoft will not allow a domain name to be verified with more than Microsoft Entra tenant. Once you delete a domain name from your tenant, you will not be able to re-add/re-verify it with your Microsoft Entra tenant if it is subsequently added and verified with another Microsoft Entra tenant."
I believe you are missing the word "one" in the first sentence, so it should read: "Microsoft will not allow a domain name to be verified with more than one Microsoft Entra tenant."

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 67566e6a-ffb4-4adf-73b5-3d6c0c58cd05
Version Independent ID: 9c9a6f63-ec87-0e45-9d0e-f5030041ab06
Content: Add and verify custom domain names - Microsoft Entra ID
Content Source: docs/identity/users/domains-manage.md
Service: entra-id
Sub-service: users
GitHub Login: @barclayn
Microsoft Alias: barclayn

@Joyos7
Thanks for your feedback! We will investigate and update as appropriate.

@Joyos7
Thanks for reporting this! We have created a PR for this issue and the changes should go live soon.


'Quantity with units' produces confusing error codes for students

When answering the 'Quantity with units' question type you receive error messages that could be confusing to students. For example when entering only the units (without a number before it) or when entering units that aren't supported or don't exist you are given the following error message:

Error evaluating variable mark: Variable close_enough is not defined.

An example of when this might occur: A student types in '5 Nm' instead of the correct answer '5 N m' or '5 N*m'. This leads them to believe the mistake lies with the question author and not themselves and could deter them from completeing the question.

I've seen this too. I'll try to sort it out.
Thanks for the report!


Error when loading configuration file

I can't open Spyder via Anaconda, if i want to start spyder, the loading bar will apear but after that nothing happen. Also if i want to update it to a newer version like 5.0.5, it will load until infinity.
If i want to open spyder via the terminal, this will appear:
(base) C:\Users\fuzhan>spyder
Traceback (most recent call last):
File "C:\Users\fuzhan\anaconda3\Scripts\spyder-script.py", line 10, in
sys.exit(main())
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\app\start.py", line 97, in main
from spyder.config.manager import CONF
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\config\manager.py", line 351, in
CONF = ConfigurationManager()
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\config\manager.py", line 64, in init
self._user_config = MultiUserConfig(
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\config\user.py", line 782, in init
self._configs_map[name] = config_class(**new_kwargs)
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\config\user.py", line 212, in init
self._load_from_ini(previous_fpath)
File "C:\Users\fuzhan\anaconda3\lib\site-packages\spyder\config\user.py", line 333, in _load_from_ini
self.read(fpath, encoding='utf-8')
File "C:\Users\fuzhan\anaconda3\lib\configparser.py", line 697, in read
self._read(fp, filename)
File "C:\Users\fuzhan\anaconda3\lib\configparser.py", line 1067, in _read
raise DuplicateSectionError(sectname, fpname,
configparser.DuplicateSectionError: While reading from 'C:\Users\fuzhan.spyder-py3\config\transient.ini' [line 117]: section 'find_in_files' already exists
I have already deleted spyder, as well as anaconda and installed it new, but nothing changed.
Ps. i hope i posted this issue in the right category, i am new in GitHub.

Hey @Programmfailer, thanks for reporting. Please run the following command in the Anaconda Prompt:
spyder --reset

and after that, start Spyder again. That should solve your problem.
Let us know if it works for you.

Note: we should catch and load our default config with this kind of errors because there's nothing else users can do about them than resetting their preferences.

thanks for your help, the reset worked.

Great! I'm reopening this because we plan to do this automatically in one of our next versions.

@dalthviz, this is a serious bug because any error when loading/reading our config files generates a crash at startup. My idea to solve this is catching those errors and load our default config values instead.

So in case of errors loading/reading the config should get resetted (probably showing a dialog saying to the user that in order to continue the config should be resetted)? Or just the load?
Probably If you load the default values but you don't reset the config then the config causing the error will not be removed and probably when trying to write to the config files more errors could arise, right?

Probably If you load the default values but you don't reset the config then the config causing the error will not be removed and probably when trying to write to the config files more errors could arise, right?

Yeah, that's a very good point. In Spyder 3 we were simply loading the default config instead of resetting it. But, as you said, that will never fix the underlying error.
So I agree with you and now I think we need the reset the user's config and inform them with a dialog that we needed to do that because their previous configuration was broken.


Fix extrude direction

Keep track of the nearest face when extruding and use that to determine the extrude direction.
Hopefully fixes #43

OK. I'll see if I can restore the original behaviour when it's a single face.


ArgumentOutOfRangeException during resizing the window

After I resized the window to minimum ( just title bar left ), it throws an ArgumentOutOfRangeException.

Duplicate of #1411


Android Basics: polished-user-experience

URL of codelab
https://developer.android.com/codelabs/basic-android-kotlin-training-polished-user-experience?continue=https%3A%2F%2Fdeveloper.android.com%2Fcourses%2Fpathways%2Fandroid-basics-kotlin-unit-2-pathway-1%23codelab-https%3A%2F%2Fdeveloper.android.com%2Fcodelabs%2Fbasic-android-kotlin-training-polished-user-experience#5
In which task and step of the codelab can this issue be found?
Step 6
Describe the problem
The 4th paragraph of the section (Optional) Adjust the tint of the vector drawables has a typo:
One visual enhancement we can make to the app is to tint the drawable based on the primary color of the app theme. BFor light theme, the icon will appear...
The typo is as seen Before, "Bfor".
Steps to reproduce?

Go to the codelab.
Click on the 6th step
See error on 4th paragraph of the section (Optional) Adjust the tint of the vector drawables section.

Versions
Android Studio version:  N/A
API version of the emulator: N/A
Additional information

@srLitem
Thank you for reaching out to us.
This should be fixed now.


Removed the orient property exclusion from the axis rebinding

Fixes #547
This bug was introduced here:
https://github.com/ScottLogic/d3fc/pull/518/files#diff-6f455d17dcde9ea880da5741db76089eL110
I hadn't spotted that linearTimeSeries was rebinding orient. It didn't really feel logic to be rebinding that property, but clearly I was wrong as I was using it myself ;-)

:+1:


Show consensus information

Following up on https://github.com/blockstack/explorer/issues/297, in a similar vein, we should try to be as transparent as possible on our leader election process, so trust can be built with miners.
What's our take on giving some real estate in block pages?
Again, the UI and colors are not the right ones, but as a miner, I think that's the kind of data that would love to see.

Thoughts?

@lgalabru this is so helpful! I love these kinds of contributions 👍
I would be so happy to implement this. It really depends on if/how much of this data is available for me to consume and display :) if it is ready, do let me know, otherwise once it's implemented in the node/api I'll get started.

@lgalabru this is so helpful! I love these kinds of contributions 👍
I would be so happy to implement this. It really depends on if/how much of this data is available for me to consume and display :) if it is ready, do let me know, otherwise once it's implemented in the node/api I'll get started.

For inspiration
https://tbtc.bitaps.com/2006717

cc @xanbots since he may be interested in this for https://stxmining.club/ as well

Thanks Mark. We already pull this information in for the mining monitor.
We'll have an API others can plug into as well, if that's at all useful to anyone else here.

This is a great idea. As we work on the blocks page we can take inspiration from the OnStacks Explorer

We may come back to this issue later.


nm_extract seems to require --output

when running without --output flag, nm_extract says something like "I will use the current directory" but then errors with cannot create output directory ""

Could be related to #39

this was on thinlinc. possibly we didn't recompile nm_extract?


Smart contract FT internal security audit

Following the internal audit described here,
The following report has been written with few recommendations:
https://www.notion.so/massa-innoteam/FT-NFT-Contract-Audit-comments-0dd27b501ce44fcf9fbe131a7b6ebb8e?pvs=4#0385a7301ef442b89759faf6577b9f67
Recommendations
Code Coverage

Enable Code Coverage Reporting Automatically:

[ ] Implement automatic code coverage reporting in the as-pect.config.js file.
[ ] Ensure that code coverage is enabled as part of the Continuous Integration (CI) pipeline.

Dependencies

Update "semver" Package:

[ ] Upgrade the "semver" package to the latest version to address any potential vulnerabilities.
[ ] Integrate npm audit into the CI pipeline to automatically check for package vulnerabilities.

Code Security Checkup
root

Token Constructor Security:

[ ] Extract arguments from the constructor before setting them to Storage to prevent potential issues.

Safe Math Library Usage:

[ ] Use a safe math library for all (u256) token manipulation operations to prevent overflow vulnerabilities.

burnable

Burn Functions Security:

[ ] Ensure that burn functions check for overflow to prevent potential issues.

mintable

Mint Functions Security:

[ ] Implement overflow checks in the _increaseBalance and _increaseTotalSupply functions.

Unit Tests Enhancements:

[ ] In the ft.spec.ts unit test, check for transfer and allowance overflows.
[ ] In the ft-burn.spec.ts unit test, check for burn and decreaseTotalSupply overflows.
[ ] In the ft-mint.spec.ts unit test, verify that increase balance and supply do not overflow.

@peterjah @gregLibert FYI


Update commons-lang3 to 3.12.0

Updates org.apache.commons:commons-lang3 from 3.5 to 3.12.0.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.apache.commons", artifactId = "commons-lang3" } ]

labels: library-update

Superseded by #55.


UnpicklingError: invalid load key, '\x00'!!!  How to get started with training model

Hi
I had small number of malware and benign samples and I tried to re-produce your result. I reran your notebook but I got a bug as below. It seems that I do not prepare dataset correctly. I created a folder "data" and make two subfolders "benign" and "malware". Do you know what's wrong with this?
UnpicklingError                           Traceback (most recent call last)
<ipython-input-3-94d0005c49d2> in <module>
      3
      4 model = MalConvPlus(8, 4096, 128, 32, device).to(device)
----> 5 train(model, train_loader, val_loader, device, "malconv_plus")
      6 plot_confusion_matrix(model, test_loader, "malconv_plus", device)

~/Documents/GitHub/pytorch-malware-detection/utils.py in train(model, train_loader, val_loader, device, save_title, lr, patience, num_epochs, verbose)
    131     for epoch in range(1, num_epochs + 1):
    132         model.train()
--> 133         train_loss = run_epoch(model, train_loader, device, criterion, optimizer)
    134         train_loss_history.append(train_loss)
    135         model.eval()

~/Documents/GitHub/pytorch-malware-detection/utils.py in run_epoch(model, data_loader, device, criterion, optimizer)
    155 def run_epoch(model, data_loader, device, criterion, optimizer=None):
    156     total_loss = 0
--> 157     for inputs, labels in tqdm(data_loader, leave=False):
    158         inputs = inputs.to(device)
    159         labels = labels.to(device)
...

UnpicklingError: invalid load key, '\x00'.

yes, indeed. Thank @jaketae

@jaketae I've met this error, but I cannot access your script, can you please produce it again?

Hey @vanloc1808, I updated the structure of the repository and it seems to have broken the link. It's been a while and I don't quite remember what the linked file was, but I suspect it is this one.


Error while adding Ingress Add-on

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az aks enable-addons Extension Name: aks-preview. Version: 0.4.62.
Errors:
'IngressApplicationGateway'
Traceback (most recent call last):
python3.6/site-packages/knack/cli.py, ln 215, in invoke
    cmd_result = self.invocation.execute(args)
cli/core/commands/__init__.py, ln 654, in execute
    raise ex
cli/core/commands/__init__.py, ln 718, in _run_jobs_serially
    results.append(self._run_job(expanded_arg, cmd_copy))
cli/core/commands/__init__.py, ln 711, in _run_job
    six.reraise(*sys.exc_info())
...
cliextensions/aks-preview/azext_aks_preview/custom.py, ln 2468, in aks_enable_addons
    _add_ingress_appgw_addon_role_assignment(result, cmd)
cliextensions/aks-preview/azext_aks_preview/custom.py, ln 742, in _add_ingress_appgw_addon_role_assignment
    config = result.addon_profiles[CONST_INGRESS_APPGW_ADDON_NAME].config
KeyError: 'IngressApplicationGateway'

To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Put any pre-requisite steps here...
az aks enable-addons -n {} -g {} -a {} --appgw-id {}

Expected Behavior
Environment Summary
Linux-4.15.0-1092-azure-x86_64-with-debian-stretch-sid (Cloud Shell)
Python 3.6.10
Installer: DEB

azure-cli 2.11.1

Extensions:
aks-preview 0.4.62
ai-examples 0.2.3

Additional Context

aks

+1
It then works after removing and then re-adding the add-on...

Issue does not occur in my environment with below versions. Does not occur in Cloud Shell too for me.
please update azure-cli and aks-preview, and retry.
azure-cli                         2.12.1
aks-preview                       0.4.63

I get same error when i do az aks create ... --enable-addons ingress-appgw  --appgw-name {} --appgw-subnet-prefix {}
Versions used:
{
  "azure-cli": "2.14.2",
  "azure-cli-core": "2.14.2",
  "azure-cli-telemetry": "1.0.6",
  "extensions": {
    "aks-preview": "0.4.66"
  }
}

Any way to work around this?

I also have the same issue when i try to enable the addons
Versions used:
{
"azure-cli": "2.15.1",
"azure-cli-core": "2.15.1",
"azure-cli-telemetry": "1.0.6",
"extensions": {
"aks-preview": "0.4.67"
}
}

I get same error when i do az aks create ... --enable-addons ingress-appgw --appgw-name {} --appgw-subnet-prefix {}
Versions used:
{
  "azure-cli": "2.14.2",
  "azure-cli-core": "2.14.2",
  "azure-cli-telemetry": "1.0.6",
  "extensions": {
    "aks-preview": "0.4.66"
  }
}

Any way to work around this?

I fixed this by adding --enable-managed-identity. It seems this is mandatory, although it is not clearly specified in the documentation: the documentation says it supports managed identities, not that it's required.

@akshaysngupta can you comment here?

Can you try updating the extension using az aks extension update -n aks-preview and see if the problem persists ? Latest version is .69.

@akurathimohan Apologies for the late reply. Could you please let me know if you had a chance to try the above action plan ? This issue is open for quite sometime. Please let us know if you need any assistance on this. Awaiting your reply.


Error getting Artifacts on running a pipeline

cc @knkski

This happens for example pipelines (in this case conditional), when you click on one pipeline component

related with #338


GH-36885: [Java] Add substrait dependency to maven build profiles

Rationale for this change
The Java JNI dataset module recently included the Substrait module as a dependency. The dependency was added to the CI scripts, but not added to the build profiles and documentation yet.
What changes are included in this PR?

Update maven build profiles
Update Java build documentation

Are these changes tested?
I tested locally on MacOS and was able to reproduce + fix with this change.
Are there any user-facing changes?
No

Closes: #36885

@github-actions crossbow submit java


(spanish) 5-Clustering/2-K-Means/assignment.md

Translate file 5-Clustering/2-K-Means/assignment.md to spanish

thank you!


Updating the README files with troubleshooting instrutions related to…

This Pull Request updates the README files adding the troubleshooting to fix the B3 SSL Certificate X509 issue. Fix #37

Tested and ready to be merged


Add information about ruleset schema

This change adds information about the XML schema of rulesets in the existing ruleset documentation.

@sunnychatterjee : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@sunnychatterjee : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off

@TylerMSFT: I'm sorry - only the author of this article, @corob-msft, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

@TylerMSFT This bounce seems bogus. I wonder what setting controls this?
#sign-off

Hi @TylerMSFT - PRMerger looks for the value of the author metadata attribute as the "authorized" person to approve/sign off on an article that's updated in the public repository. In this repo, that value is set in docs/docfx.json. You can see that @corob-msft is set as the author of articles in this folder:

The PR review team can accept another authorized reviewer's approval, aka from "trusted source". You are one, so, we'll merge the PR. We sweep for approved PRs to merge twice a day M-F.


Instantiation of RetryPolicy and CircuitBreaker

Add annotation like @RetryPolicy in order to inject retry policies as well.

Idea which was discussed with @duergner today is to do it like it's in Put it to Rest project. By defining RetryPolicy in application.properties.
failsafe.policies:
 breaker1:
  retryOn: Class1, Class2
  delay: 1, SECONDS
  maxRetries: 3

By this CircuiBreaker and RetryPolicies could be created easily as Beans and injected via @Autowired annotation.

Same mechanism should be used to instantiate Circuit Breaker. The created Beans, can then be looked up by the Pointcut using context.getBean(CircuitBreaker.class, "identifier");
In case no CircuitBreaker with given Identifier can be found, and no global defaults have been defined in application.yaml an Exception will be thrown. If global defaults are defined and Circuit Breaker doesn't exist, defaults will be applied and the Circuit Breaker is created on the fly.

Replaces #45

See #39


Fix fiat currency conversion display

Fixed fiat currency conversions not displaying properly due to attempting to parse the already well-formed & deserialized JSON response from the requests in useCurrencyConversions. The failed fetch resulted in SyntaxError: JSON.parse: unexpected character at line 1 column 2 of the JSON data.

[!NOTE]
I would recommend adding some logging to the catch callback, but totally up to the Reservoir team!

Before (check bottom right):

This issue can also be seen in the screenshot in #573.
After:

Nice find! Yeah this slipped into production, the log would've been useful in finding it. We'll add something there as well. Thanks for the help.


Disable e2e tests cron to not push on nightly

Questions
Answers

Description?
Disable e2e tests cron to not push on nightly

Type?
bug fix

BC breaks?
no

Deprecations?
no

Fixed ticket?
N/A

How to test?
N/A

Possible impacts?
N/A

Thank you @boubkerbribri I hope we can see nightly live again soon 👍


Fix depwarn on 0.5 and 0.6 in build script

Coverage decreased (-2.9%) to 80.0% when pulling b95c1c98b64083f5e153fe6d98bd14217d52007b on yyc/0.6-depwarn into be82ae8263a77c3e21b75dd5fd81b904e99ed3de on master.


Bump version ready to import into Android tree.

I need to bump the version number so that I can get the changes from #1905 into the version of the libc crate vendored into the Android tree at https://android.googlesource.com/platform/external/rust/crates/libc/.

r? @JohnTitor
(rust_highfive has picked a reviewer for you, use r? to override)

The test failure looks like a flake, can we re-run?

Josh released 0.2.78 at e3312f5a5ccb6e37f08a60ccc32a7e1cad02eeac so that version should be available now. Thanks anyways!


fix(github-desktop-deb): repology version fix

I don't think we need a separate variable for the -linux2

Well we definitely don't need one but it may be better to have a variable. I'm fine if don't though.

Well, it seems that they change the suffix every other release, so it might be useful to add a variable. For now, I think not adding one is fine.


how to apply released code to the actual program

So I'm having the the config problem and I saw that a code that would fix it is released. How would i apply that new code to the program?
When clicked on so it runs, It does nothing.

Alot of us would like to use your program, some need it while others want it. We understand you may be busy to, Could you please just make 2.6.5 into an offical version and put it on the website, because most users do not know how to use the code you released, Most of us aren't that techy, So Could you please help us out here?

either install using npm, or download the new image from their website.
both methods work fine on linux.

@TobiHoKage
How long does the Downloading application update take?

@MC117243 less than few minutes depending on your internet. use npm, it is about 53MBs.

okay.


Abandoned, non-functional code base?

Hi there :)
Apologies for my overly negative title, but I have great difficulty getting this to "just work".
I'm on Ubuntu 22, dependencies installed (python3, pip3, pandoc, texlive-full, etc.), and a myriad of errors.
In no particular order:

had to go to wg21/deps/python/pyvenv.cfg  and change the variable include-system-site-packages to true, otherwise it couldn't find the installed Python packages, e.g. requests.
It complained multiple times about "error reading bibliography file wg21/data/csl.json", in which case I had to manually delete that file before I could run the Makefile again.
After fixing a lot of problems that should seem unrelated / I don't care, I get an error with a Latex command "\CSBlock" undefined.

There are (asides from this one) 7 open issues unattended.
It seems I must resort to raw Latex, because at least that works :/
This tool looks really cool otherwise, I'm really hoping these issues get fixed / documented.
Kind regards.

Haha, definitely not abandoned. I'm surprised by how much issues you've had... I can try it myself but I'm on a Mac. Let me try to repro. I've been working on this project intermittently in batches, unless there are breaking issues. The pending issues I haven't particularly considered to be breaking issues so far.

Great to hear! Perhaps I didn't do things right with the Python stuff. Also, the pandoc version is quite outdated (apparently things move fast in Python world!) - that could be related?

I played with a Docker image a little bit, and I've experienced some of what you've experienced. It is quite bad at the moment when there are missing dependencies and such due to the Makefile being written seemingly rather poorly 😞I'll be working on addressing these issues.

@alexpanter I ran into all these same problems running wg21 on new Linux system.  However, it seems I may have copied it from my previous Linux system, OR I cloned it without having all the dependencies in place before I ran make for the first time.
I just re-cloned from my github project that uses wg21, and it worked the first time in the new clone.  This is after trying numerous times to get things to work with the old clone, and installing dependencies as I saw errors.
So -- try getting all the deps first, then grabbing a fresh clone.  HTH.


Wrong Mean Reciprocal Rank calculations

Mean Reciprocal Rank metric depends on predictions list order, but the function remove_duplicates() from util/metrics.py returns shuffled predictions (since an order of elements in a set is undefined) and therefore we get wrong results after calling mrr().

Oh good catch @rulezzzz08 ! I removed the call to remove_duplicates() from mrr().
Thank you!

Also, if I understand correctly, FSM results should be sorted in descending order of confidence. However, at the moment this sorting is absent and therefore the value of MRR for this recommender is biased.

Hi, not ignoring you. I will take a look at the aforementioned issue asap.

Hi @rulezzzz08 , thanks for spotting this issue. It should be fixed now: https://github.com/mquad/sars_tutorial/commit/7744941eb47dd807e76bf3a0fb15bf55a68bae4e


Convenience methods described in README.

Hi,
I've tweaked README a little bit. Please take a look if it's all right, or maybe we should add something more.

Add swift before code block.
All the rest looks cool.


Require user to dismiss the interaction

I often find that I don't know that I got new Github notifications when I was away from my desk, so making these require interaction makes them more like Slack's notifications.

Yes please!

I imagine quite a few people would be upset by this change. Can you make it a config option?

Yes, needs to be opt-in.

Is there a possibility to decide in a smart way?
Like if you are typing or moving the mouse then it will dismiss automatically after the normal time frame, because you are obviously sitting in front of the computer. If no input/movement is detected it'll stay.


Implement --platform parameter

You can limit the resolve of image tags to only a specific platform by specifying the --platform command-line flag with the target platform e.g. linux/amd64.
Fixes https://github.com/google/k8s-digester/issues/3

Thanks for your contribution! I've left some comments above.

@halvards I have closed the other PR in favour of this one which has all the version bumps inlcluded. thanks


Array index is out of range

Hey everybody,
over night my savegame simulation started to fail without me changing anything (subscribing a mod or whatsoever).
Do you have an idea what the problem is? Sorry if i forgot some important informations. This is my first time i post an issue.
Thanks!
output_log.txt

Investigating....
Mod list:
The following mods were used when this asset was created:
UnlimitedMoney
UnlockAll
791221322
552324460
650805785
878991312
1274199764
1369729955
812125426
530871278
928128676
898480258
883332136
881291183
877950833
837734529
814903880
802066100
793346248
787611845
785528371
767233815
694512541
689937287
666425898
651322972
639486063
625608461
611254368
595017353
593588108
559172768
543722850
537973489
530771650
529129546
523824395
502750307
497033453
458519223
456408505
455403039
445589127
438449058
409776678
1412844620
1546357276
781767563
602077938
463845891
1394468624
1403136223
576327847
654707599
652921941
586012417
564141599
466834228
816260433
1349895184
1094334744
724382534
795514116
1548831935
932192868
924884948
667342976
714056356
707497031
1619685021
1420955187
583429740
556784825
  [Modding]

Errors:
Seeing this error in lots of log files recently - doesn't seem to cause any major problems:
NullReferenceException: Object reference not set to an instance of an object
  at PrefabCollection`1[PropInfo].InitializePrefabs (System.String collection, .PropInfo[] prefabs, System.String[] replaces) [0x00000] in <filename unknown>:0
  at PropCollection+<InitializePrefabs>c__Iterator0.MoveNext () [0x00000] in <filename unknown>:0
  at LoadingManager.Update () [0x00000] in <filename unknown>:0

Bahnhof Bülowstr can;t find its train tracks: Subscribe and enable the ETST mod ...
Custom Assets:<PHONE_NUMBER>.Bahnhof Bülowstr_Data: NetInfo missing
  at BuildingInfo.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabHook.BuildingInfoHook.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabCollection`1[BuildingInfo].InitializePrefabImpl (System.String collection, .BuildingInfo prefab, System.String replace) [0x00000] in <filename unknown>:0   [Core]

[LSM] Asset failed:<PHONE_NUMBER>.Bahnhof Bülowstr_Data
Exception: BuildingInfo<PHONE_NUMBER>.Bahnhof Bülowstr_Data failed
  at LoadingScreenMod.AssetLoader.Initialize[BuildingInfo] (.BuildingInfo info) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader.LoadImpl (ColossalFramework.Packaging.Asset assetRef) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader+<LoadCustomContent>d__22.MoveNext () [0x00000] in <filename unknown>:0
UnityEngine.DebugLogHandler:Internal_LogException(Exception, Object)
UnityEngine.DebugLogHandler:LogException(Exception, Object)
UnityEngine.Logger:LogException(Exception, Object)
UnityEngine.Debug:LogException(Exception)
LoadingScreenMod.AssetLoader:AssetFailed(Asset, Package, Exception)
LoadingScreenMod.<LoadCustomContent>d__22:MoveNext()
LoadingManager:Update()

Kopfbahnhof can't find its train tracks; Subscribe and enable the ETST mod ...
Custom Assets:<PHONE_NUMBER>.an1_Data: NetInfo missing
  at BuildingInfo.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabHook.BuildingInfoHook.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabCollection`1[BuildingInfo].InitializePrefabImpl (System.String collection, .BuildingInfo prefab, System.String replace) [0x00000] in <filename unknown>:0   [Core]

Exception: BuildingInfo<PHONE_NUMBER>.an1_Data failed
  at LoadingScreenMod.AssetLoader.Initialize[BuildingInfo] (.BuildingInfo info) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader.LoadImpl (ColossalFramework.Packaging.Asset assetRef) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader+<LoadCustomContent>d__22.MoveNext () [0x00000] in <filename unknown>:0
UnityEngine.DebugLogHandler:Internal_LogException(Exception, Object)
UnityEngine.DebugLogHandler:LogException(Exception, Object)
UnityEngine.Logger:LogException(Exception, Object)
UnityEngine.Debug:LogException(Exception)
LoadingScreenMod.AssetLoader:AssetFailed(Asset, Package, Exception)
LoadingScreenMod.<LoadCustomContent>d__22:MoveNext()
LoadingManager:Update()

There are a bunch more errors like that for other stations. Subscribe and enable the ETST mod :)

The POCO furniture market requires larger footprints mod, which is obsolete and no longer maintained. I would suggest unsubscribing this asset. There is another version that doesn't require the footprints mod, you can find it here: POCO furniture-market (RICO ready).
Custom Assets: 785969267.POCO furniture market_Data: Invalid dimensions (Max sizes: 16x8, 15x9, 14x11, 13x12, 12x13, 11x14, 9x15, 8x16)
  at BuildingInfo.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabHook.BuildingInfoHook.InitializePrefab () [0x00000] in <filename unknown>:0
  at PrefabCollection`1[BuildingInfo].InitializePrefabImpl (System.String collection, .BuildingInfo prefab, System.String replace) [0x00000] in <filename unknown>:0   [Core]

Exception: BuildingInfo 785969267.POCO furniture market_Data failed
  at LoadingScreenMod.AssetLoader.Initialize[BuildingInfo] (.BuildingInfo info) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader.LoadImpl (ColossalFramework.Packaging.Asset assetRef) [0x00000] in <filename unknown>:0
  at LoadingScreenMod.AssetLoader+<LoadCustomContent>d__22.MoveNext () [0x00000] in <filename unknown>:0
UnityEngine.DebugLogHandler:Internal_LogException(Exception, Object)
UnityEngine.DebugLogHandler:LogException(Exception, Object)
UnityEngine.Logger:LogException(Exception, Object)
UnityEngine.Debug:LogException(Exception)
LoadingScreenMod.AssetLoader:AssetFailed(Asset, Package, Exception)
LoadingScreenMod.<LoadCustomContent>d__22:MoveNext()
LoadingManager:Update()

continued below...

This error is from WG population mod, not sure what causes it...
Hopefully @WhitefangGreytail can advise :)
Simulation error: Array index is out of range.
  at WG_PopOnly.CommercialBuildingAIMod.getArray (.ItemClass item, Int32 level) [0x00000] in <filename unknown>:0
  at WG_PopOnly.CommercialBuildingAIMod.CalculateWorkplaceCount (Level level, Randomizer r, Int32 width, Int32 length, System.Int32& level0, System.Int32& level1, System.Int32& level2, System.Int32& level3) [0x00000] in <filename unknown>:0
  at PrivateBuildingAI.BuildingLoaded (UInt16 buildingID, .Building& data, UInt32 version) [0x00000] in <filename unknown>:0
  at CommercialBuildingAI.BuildingLoaded (UInt16 buildingID, .Building& data, UInt32 version) [0x00000] in <filename unknown>:0
  at BuildingManager+Data.AfterDeserialize (ColossalFramework.IO.DataSerializer s) [0x00000] in <filename unknown>:0
  at ColossalFramework.IO.DataSerializer.Deserialize[Data] (System.IO.Stream stream, Mode mode, ColossalFramework.IO.LegacyResolverHandler customResolver) [0x00000] in <filename unknown>:0
  at ColossalFramework.IO.DataSerializer.Deserialize[Data] (System.IO.Stream stream, Mode mode) [0x00000] in <filename unknown>:0
  at LoadingManager+<LoadSimulationData>c__IteratorB.MoveNext () [0x00000] in <filename unknown>:0
  at AsyncTask.Execute () [0x00000] in <filename unknown>:0   [Core]

CSL music mod issue? Seen this in several log files recently, but doesn't seem to cause any major problems.
NullReferenceException: Object reference not set to an instance of an object
  at RadioPanel.AssignStationToButton (ColossalFramework.UI.UIButton button, .RadioChannelInfo station) [0x00000] in <filename unknown>:0
  at RadioPanel.OnLevelLoaded (UpdateMode updateMode) [0x00000] in <filename unknown>:0
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at (wrapper delegate-invoke) LoadingManager/LevelLoadedHandler:invoke_void__this___SimulationManager/UpdateMode (SimulationManager/UpdateMode)
  at LoadingManager+<LoadLevelComplete>c__Iterator9.MoveNext () [0x00000] in <filename unknown>:0
  at LoadingManager.Update () [0x00000] in <filename unknown>:0

Here is the main prop instance error:
Simulation error: Object reference not set to an instance of an object
  at PropInstance.CalculateGroupData (UInt16 propID, Int32 layer, System.Int32& vertexCount, System.Int32& triangleCount, System.Int32& objectCount, .VertexArrays& vertexArrays) [0x00000] in <filename unknown>:0
  at PropManager.CalculateGroupData (Int32 groupX, Int32 groupZ, Int32 layer, System.Int32& vertexCount, System.Int32& triangleCount, System.Int32& objectCount, .VertexArrays& vertexArrays) [0x00000] in <filename unknown>:0
  at RenderManager.Managers_CalculateGroupData (Int32 groupX, Int32 groupZ, Int32 layer, System.Int32& vertexCount, System.Int32& triangleCount, System.Int32& objectCount, .VertexArrays& vertexArrays) [0x00000] in <filename unknown>:0
  at RenderGroup.UpdateMeshData (.MeshLayer layer, UnityEngine.Vector3& min, UnityEngine.Vector3& max) [0x00000] in <filename unknown>:0
  at RenderGroup.UpdateMeshData () [0x00000] in <filename unknown>:0
  at RenderManager.SimulationStepImpl (Int32 subStep) [0x00000] in <filename unknown>:0
  at SimulationManagerBase`2[Manager,Properties].SimulationStep (Int32 subStep) [0x00000] in <filename unknown>:0
  at RenderManager.ISimulationManager.SimulationStep (Int32 subStep) [0x00000] in <filename unknown>:0
  at SimulationManager.SimulationStep () [0x00000] in <filename unknown>:0
  at SimulationManager.SimulationThread () [0x00000] in <filename unknown>:0   [Core]

It's preceded by maybe a thousand Random props not refreshed yet!  [Core] messages in the log file. This is likely due to one of the earlier errors breaking the load cycle / preventing one of the loading events from firing. Could also be caused by outdated mods, will check those next...

Mods:
Automatic Bulldoze v2 is reported as having a few minor issues. I'd recommend "Bulldoze It!" mod by keallu instead.
European Building Unlocked is obsolete; it's better to just enable the European Building Theme in Main Menu -> Content Manager.
No Pillars is a bit dated - consider using Network Skins instead. If you were using it to place props and trees in buildings, etc., I'd recommend Prop & Tree Anarchy mod.
Control Building Level Up mod is somewhat obsolete; you can use the "Historic Building" option from base game (it appears on growable building info popups) - it still allows level up (improves land value), but the building itself won't change if historic. Best of both worlds :)
Things to do:

Subscribe and enable "Extra Train Station Tracks" mod
Replace the POCO market with the RICO ready version
If problems persist, try disabling the WG Population mod.

thank you for the help! will try out tomorrow and give feedback!

sub Extra Train Station Tracks --> didn't fix it
Unsub Automatic Bulldoze 2, sub Bulldoze it --> didn't fix it
Unsub European Buildings Unlocked, Unsub No Pillar, Unsub Building Level up Control --> didn't fix it
Disbaling WG Population mod --> fixed it! Hooray!
Thank you very much for your support!
Can it be that "WG Population Mod" has a different name in workshop now? Could'nt find it to unsub.

Good to hear your save is working again!
Regarding the population mod, I think it might be this one in the workshop: https://steamcommunity.com/sharedfiles/filedetails/?id=652921941
If not, here are all his workshop items: https://steamcommunity.com/profiles/76561198055516404/myworkshopfiles/

I've updated Configurable Population Modifiers v1.7 (which has the internal name WG_PopOnly) to not break on an array out of index (taking code from Realistic Pop). Thank you for bringing it to my attention!

Awesome, thanks WG!


Need to add Data Privacy page

To satisfy GDPR requirements we need to setup a data privacy page.

Added a privacy page.  New ticket opened to update the specific statements.


Rewrite ClusterRoleBindings test; fix RoleBindings test

testPodClusterRoleBindings needed to be re-written to check for the pod using cluster roles in general.  It is not allowed per the requirements documents.

testPodRoleBindings needed some updates as far as how it was looking for role bindings attached to the pod.  In the previous implementation we were just comparing the service account name to the role binding name.  We needed to be looking at the Subjects of the role binding to see if the service account matches up.

GetClusterRoleBindings() and GetRoleBindings() were looking at the wrong object types from the API.  These functions were moved inside of the autodiscover portion of the code because we don't need any context for looking these up and we would avoid calling the API multiple times during the actual test.

Just note that access-control-cluster-role-bindings is currently failing on DCI: https://www.distributed-ci.io/jobs/3768e67d-bac4-455b-8db4-a8acc5b61083/tests/1a51ab34-803c-43d8-b5c8-3e0f19acb4ae
> Enter [BeforeEach] access-control - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:54 @ 04/27/23 21:57:35.097
< Exit [BeforeEach] access-control - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:54 @ 04/27/23 21:57:35.097 (0s)
> Enter [It] access-control-cluster-role-bindings - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:154 @ 04/27/23 21:57:35.097
STEP: Pods should not have ClusterRoleBindings - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:446 @ 04/27/23 21:57:35.097
STEP: Testing cluster role binding for pod: test-0 namespace: production-cnf - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:452 @ 04/27/23 21:57:35.097
pod: test-0 ns: production-cnf is using a cluster role binding
STEP: Testing cluster role binding for pod: test-1 namespace: production-cnf - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:452 @ 04/27/23 21:57:35.101
pod: test-1 ns: production-cnf is using a cluster role binding
Non-compliant []string: [test-0 test-1]
[FAILED] Number of Non-compliant []string = 2
In [It] at: /usr/tnf/tnf-src/pkg/testhelper/testhelper.go:162 @ 04/27/23 21:57:35.103
< Exit [It] access-control-cluster-role-bindings - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:154 @ 04/27/23 21:57:35.103 (6ms)
> Enter [ReportAfterEach] access-control - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:57 @ 04/27/23 21:57:35.103
< Exit [ReportAfterEach] access-control - /usr/tnf/tnf-src/cnf-certification-test/accesscontrol/suite.go:57 @ 04/27/23 21:57:35.103 (0s)

@ramperher We may have to change something on your end as far as making this test pass.
pod: test-0 ns: production-cnf is using a cluster role binding
From the requirements docs it is stated that CNFs must not have cluster roles so I had to rewrite the test to actually do what it's supposed to do. Prior to this change the implementation was incorrect in many spots.

Thanks @sebrandon1 for checking this. We'll need to check this, because we're currently using ClusterRoles, e.g., to attach the VZs recommended SCC to test them: https://github.com/redhat-cip/dci-openshift-app-agent/blob/master/samples/tnf_test_example/hooks/install.yml#L32-L92, so we'll need to check the impact of this change in order to refactor everything.

Marking this issue as blocked.  We have a couple of things that need to be addressed before this can merge.

The crd-operator-scaling repo needs to be updated to remove the cluster role bindings it is currently using.  This is installed via the partner make install path and the tests fail because of it.
The DCI team is going to work to remove the cluster role bindings on their side as well so the DCI jobs start passing again.

/dci-rerun


MissingKeyMapError with Meteor and React

How can I solve this problem? After showing the map, no more than 1 second it will show an error, Oops! Something went wrong. Then in the console,
Google Maps API error: MissingKeyMapError appeared.

I have an app where the component works as expected. But another one in which the map crashes after 1s showing that error. I haven't found the root cause yet, I'm inclined to believe that it is something about Google. Given that package does not use an api key, probably if the domain is registered in Google console it acts differently. Will post more if I solve the issue.

Ok. I think is because of this: https://maps-apis.googleblog.com/2016/06/building-for-scale-updates-to-google.html
Starting 2016/06 all apps using Google Maps need an API Key. This package does not include the ApiKey yet, so it will work with domains using the API before that date.
For new domains I guess is better to fork and include the functionality.

You can add an API key just check the docs under load

@dburles Yes! Thank you, works as expected by adding the api key in the options object.


Make 'id' a mandatory parameter in FusSceneConverter.ConvertFrom()

It is optional in 0.9 to be backwards compatible.
It should be forced to prevent #202.

Since it was unclear in the last meeting, this is the line this issue is talking about.
https://github.com/FUSEEProjectTeam/Fusee/blob/2a624eab4af7bbe984194a196c8a053ab453b563/src/Engine/Core/FusSceneConverter.cs#L25


Proof of concept for conformance tests

Create a mechanism to perform conformance tests. A conformance test analyzes a group of files and produces a report showing which assertions contained in those files pass or fail. The test can be run in three modes:

write the report to a file and pass
compare the report to the written file and pass if there are no changes
emit all failures

I'm not stoked about "fact" either but I don't see a better idea. We need "finding" to refer to the specific kind of fact that means "potential issue", and this to more broadly include "the type of this thing."
It's anything the checker can "determine" about the code it's analyzing, but "determination" is too long and weird.

I'm not stoked about "fact" either but I don't see a better idea. We need "finding" to refer to the specific kind of fact that means "potential issue", and this to more broadly include "the type of this thing."
It's anything the checker can "determine" about the code it's analyzing, but "determination" is too long and weird.

We can change this terminology at any time.

I'm not stoked about "fact" either but I don't see a better idea. We need "finding" to refer to the specific kind of fact that means "potential issue", and this to more broadly include "the type of this thing."
It's anything the checker can "determine" about the code it's analyzing, but "determination" is too long and weird.

We can change this terminology at any time.

What about this?

A "fact" is anything we expect a tool to be able to tell us about the code.
Some facts are "problems": something that may be worth reporting to the user.

The test can assert any fact about the code, and the test fails if the tool does not agree with that fact.
But all problems must be asserted in the code; the test fails if a tool reports a problem that isn't asserted.

(definitely prefer "findings" over "problems" but agreed it doesn't have to be resolved now)


UNetAnchorManager forces you to use the Spatial Mapping Manager if it is provided

Overview
If you include Spatial Mapping Manager in the scene the UNetAnchorManager will force you to use it when it tries to find the anchor position.
In my project, I want to have the anchor where I have placed my SharedCollection, but with the current implementation the anchor position gets overwritten by the Spatial Mapping if it is in the scene.
Having the option to choose between using it or not would be neat.

You could always just create a public Boolean and an if statement to do it in the UnetAnchorManager under the CheckConfiguration method. However, I suspect its not in there already because its advised to use the SpatialMapping in order to get a good anchor location.
            if(allowSpatialMappingAnchor)                 spatialMapping = SpatialMappingManager.Instance;

Chances are this whole feature area will be rewritten soon with a complete overhaul of how we manage dependencies in our feature areas.
Adding a bool is a bandaid at best.

I am looking forward to it. Having everything tightly coupled won't work in the long run.

I'd like to know if there's a section somewhere where the overhaul is discussed or discribed. We also had to do things a little differently and would like to know about and contribute to the new design.


Search SDK: Provide a custom "ignore" attribute to exclude properties from serialization

From this issue on User Voice: http://feedback.azure.com/forums/263029-azure-search/suggestions/8905012-provide-azure-specific-json-ignore-attribute#comments
"I had a need to ignore properties from the search index (and not defining it as a field threw an error). The provided way to do that is a JsonIgnore attribute, but in this instance I also needed to serialize the object for something else where I did need those properties.
I worked around it by creating another azure search specific class and projecting to that, but it's a bit painful.
Having an AzureSearchJsonIgnore attribute would mean I could use it without interfering with the rest of my code."

This issue falls into the same bucket as this one: https://github.com/Azure/azure-sdk-for-net/issues/1063
We'll address them together before the first non-preview release of the SDK.

Rather than introduce a new attribute, we decided to allow more general extensions to serialization behavior via well-known mechanisms in JSON.NET (JsonConverters and IContractResolvers). This kind of customization will be enabled in the next version of the SDK (1.0.0-preview), due to ship in a few weeks.

FYI, the new serialization functionality is now available in the latest version of the SDK on NuGet.


DEBUG

Checklist

[ ] App update process has been followed
[ ] Target branch is develop
[ ] Application version has been bumped

Codecov Report
Attention: Patch coverage is 88.15490% with 156 lines in your changes are missing coverage. Please review.

Project coverage is 89.42%. Comparing base (4a4b1cd) to head (3a42ee7).

Files
Patch %
Lines

libstellar/parser.c
89.81%
83 Missing :warning:

libstellar/printer.c
85.15%
72 Missing :warning:

libstellar/base64.c
94.11%
1 Missing :warning:

Additional details and impacted files
@@             Coverage Diff              @@
##           develop      #18       +/-   ##
============================================
+ Coverage    76.87%   89.42%   +12.55%
============================================
  Files           14        5        -9
  Lines         2378     2742      +364
============================================
+ Hits          1828     2452      +624
+ Misses         550      290      -260

Flag
Coverage Δ

unittests
89.42% <88.15%> (+12.55%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


fix: show negative stream buffer values

Description
Display negative delta values in the "Stream Buffer" field of TransactionSummaryView
Issue
fixes #260
Checklist:

[x] My commit message follows the Conventional Commits specification
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have tested my code
[x] My changes generate no new warnings
[x] My PR is rebased off the most recent develop branch
[x] My PR is opened against the develop branch

Alert Reviewers
@codynhat @gravenp

Is this ready for review? @gravenp?

No, sorry should have put a comment in here rather than just chat. This was blocked while we investigated the Superfluid buffer mismatches/clipping. There could be additional outstanding problems here with calculating buffer deltas that may or may not be related to clipping.

@tnrdd Could you pull in the latest develop and we can review again?


About object separation

Hi,
Thank you for releasing the code. Your work is impressive.
I have some questions about object separation. It seems that your work can separate the objects in the input images. And we can set N to change the number of objects we want the network to recognize. So my question is, what would happen if we set a big N which is much bigger than the number of objects in one scene? In general, we see one person or one face as a whole object. But can the network learn different parts of one general object (like eyes, mouth, nose from one face)? If the network can do that, how? Maybe need more constraints?
Best regards,
Hengfei

Hi @hengfei-wang , thanks for your intriguing question. We have never tried this, but theoretically the model could learn to disentangle parts of objects instead of objects themselves. However, the performance presumably heavily depends on your dataset: For a face dataset, it could see "similar eyes" with "different lip types", while e.g. disentangling chair legs from the chair body is probably much harder as the two entities are very entangled. In general, I think the network "can" learn this if this is the "easier solution" - and whether or not this is the case depends on how correlated the entities are.


Scroll direction (Up/Down)

Hi Tomas,
In 0.6.3 Scrolling now works in the inverse direction to what is set in the OS. Can you verify on your end?
I am using Windows 7 u40b23.

Ha! Yes :)

:D

Try again ;)

Yep, now works as expected!


ftp: Control user auth status

Don't allow users to do stuff per FTP without signing in first.
Closes #36

FTP allows to do stuff like: "correct username, need password". Thats currently not implemented but also not essential - so I give it a pass anyway. I ind the code somewhat hard to read. I.e. I often have to look up what sendStdString(replies[2]); actually means. Or why are all if-statements inverted?

FTP allows to do stuff like: "correct username, need password". Thats currently not implemented but also not essential - so I give it a pass anyway.

Is it not? I thought it was, maybe you're thinking of some procedure I'm not aware of?

I find the code somewhat hard to read. I.e. I often have to look up what sendStdString(replies[2]); actually means.

Readability sure is a problem. I'm thinking of using std::map<std::string,std::string> for the replies instead.

Or why are all if-statements inverted?

The reason for the negation is that std::basic_string::compare returns 0 on a match.

re FTP authentication: No, everything is fine, I misremember the RFC, sorry.
re code quality: Thought so, similar to C strcmp 🧐
Good, please merge. Code quality should be a PR on its own anyway.


requestBody.content cannot be array

Hello!
I think it should be possible to use an array for the requestBody.content.
The following does not work!
request: {
  body: {
    content: z.array(z.string().uuid()).openapi({ description: 'List of uuids'}),
  },
}
...

@astrolemonade this is possible. However your syntax is incorrect. The correct way to define this would be:
 request: {
    body: {
      content: {
        'application/json': {
          schema: z
            .array(z.string().uuid())
            .openapi({ description: 'List of uuids' }),
        },
      },
    },
  },

Notice the application/json key and the presence of a schema key where the zod array goes.

I understand, thank you!


Support inherit policies when moving item

When moving an item, an option is present to make the item inherit the new collection’s policies. The checkbox is present in the UI, but no code is present yet to support the operation.
This issue is related to PR #335

Yep, this is a duplicate of #1702, which was fixed in 7.6.  Closing.  See #1702 for more details