Build recipe_result.handlebars Partial

Done with the base code for how it should work.  Need to test, but need to wait for route logic to be complete for that.


[Improvement][Docker] Reduce docker image size and improve log out

Tips

Thanks very much for contributing to Apache DolphinScheduler.
Please review https://dolphinscheduler.apache.org/en-us/community/index.html before opening a pull request.

What is the purpose of the pull request
Improve docker
This pr is an improvement of docker, and the idea comes from the pr #3291 which has not been updated for a long time, but also different from and better than the pr #3291.
This closes #3291.
Brief change log

Reduce docker image size
Improve log out

Verify this pull request
(Please pick either of the following options)
This change added tests and can be verified as follows:
(example:)

Manually verified the change by testing locally.

After this pr:

Image size:

The official image size is 692MB
The rockxsj image size is 408MB from #3291
This pr image size is 355MB

Video check link: link

could you remove the nginx ?, this can be consistent with non-docker deployment

could you remove the nginx ?, this can be consistent with non-docker deployment

@dailidong The frontend including nginx has been removed, and it runs normally in docker compose and docker swarm modes.
Please access the new video link to check: link
In kubernetes mode, I will improve the deployment and remove the frontend in the next pr, and this work is related to the pr #4419

@dailidong The frontend including nginx has been removed, and it runs normally in docker compose and docker swarm modes.
Please access the new video link to check: link
In kubernetes mode, I will improve the deployment and remove the frontend in the next pr, and this work is related to the pr #4419


use of hboost instead of BOOST_NS in HUSD_PythonConverter.C in h19.5 branch

In "src/houdini/lib/H_USD/HUSD/HUSD_PythonConverter.C" (lines 213,214) please replace hboost with BOOST_NS namespace.

Thanks for pointing this out! This was done in 19.5.362 (https://github.com/sideeffects/HoudiniUsdBridge/commit/73baddc3beb4c629ed052b8f459f41c5fb5d6f3e).


Passive sts sample has some issue

Describe the issue:
Once deploy the passivists sample and navigate to http://localhost:8080/PassiveSTSSampleApp?samlv=2-0 following screen has been shown.

How to reproduce:
Deploy passivestst as mentioned in [1] then navigate to http://localhost:8080/PassiveSTSSampleApp?samlv=2-0 as mentioned in [2]
[1] https://is.docs.wso2.com/en/latest/learn/deploying-the-sample-app/#deploying-the-passivestssampleapp-webapp
[2] https://is.docs.wso2.com/en/latest/learn/configuring-single-sign-on-wsfed/
You will see the above login page
Expected behavior:
Successfully redirected to the login page without console logs printed.

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Remove JavaScript from Details component

Part of #3464

@domoscargin what needs to be done to get this out of draft / mergeable? 🙂

@36degrees I was waiting till #3758 is ready, since merging this PR will create the styling issue with older browsers which aren't polyfilled.
Otherwise we could take the view that we're going to merge #3758 shortly anyway, and get this one merged sooner? Happy either way.

@domoscargin How about I merge the ES2015 classes first in #3771 but then rebase this branch for you, avoiding any conflicts?

@colinrotherham Was just opening this up to do a rebase, but since you're close to the work, go ahead!

@domoscargin Rebased this one + https://github.com/alphagov/govuk-frontend/pull/3758


[DatePicker] Date display width is 270 but component width is 310

Problem description
The date display of the DatePicker component in portrait is fixed to 270, but the component width is fixed to 310.
This means that the color on the top of the date display does not reach all the way across the component.

Steps to reproduce
Create a DatePicker and open it.
Versions

Material-UI: 0.15.0
React: 15.0.2
Browser: Chrome 50.0.2661.94

@clayne11 "Chrome" isn't a version! 😄

Fixed

Not sure what you're seeing in that case. Date display has width 270, but padding 20 (total 310).
Does the docs site look okay to you?
http://www.material-ui.com/#/components/date-picker

Docs look fine but it's definitely not working in my project and I haven't set any on the date picker.

I think I figured out what's happening.
It looks like the date display is expecting box-sizing: content-box but in my CSS reset I set:
html {
  box-sizing: border-box;
}

*, *:before, *:after {
  box-sizing: inherit;
}

Am I interpreting this correctly? Do you guys actually use content-box? It's a very old and frankly poor standard that makes layout very difficult, I don't know why the date picker would expect that.

@mbrookes we should be using border-box 99% of the time IMO. Everyone does it except for specific use cases where content-box is needed.

Well this doesn't make a whole lot of sense then. The date display component is fixed to 270 but the main component width is 310. If you're not using content-box then it isn't going to fill the space and padding won't change that.

@clayne11 What are your responding to? I was just stating that even regardless of this specific case, IMO we should be using border-box for most things.

@nathanmarks I had to create #4263 to second your statement :)

we should be using border-box for most things. (Which would avoid issues like this, which sprout up every now and then)

@nathanmarks sorry I misunderstood.
If I add box-sizing: content-box to the date display it fixes the issue. I think we should switch the width to 100% though. Will you guys accept a PR if I push one?

@clayne11 Opening the discussion witha nother contributor here: https://github.com/callemall/material-ui/issues/4263#issuecomment-219238546

I am having the same issue. I think width 100% is the best solution

Same issue here

used following workaround until the issue is fixed either way.
div[mode="portrait"] {
  box-sizing: content-box !important;
}

I found no other way to give the selector a more narrow scope. Hope that helps in the meanwhile.

Adding boxSizing: 'content-box' in styles.root solved this problem for me (both landscape and portrait displays), i think it doesn't mess anything as setting it's width or height to 100%.

@FernandoFigueroa  Fixing the date picker is very simple. We've concluded at this point that using border-box throughout the library is safer and more predictable than content-box. The issue is that there is no way to fix the date picker without changing the source for material-ui as far as I can tell.

Sure @clayne11, maybe providing an style prop for the dialog container would do the trick? I mean, it involves changing the date picker code, but it'll aloud to do whatever we want without compromising material-ui source. Separating the styles object for landscape and portrait will remove the logic performed when this object if first set to then decide in the render if it'll load with portrait/landscape styles.

I'm OK with that. As long as a solution exists for me to style it that works for me.
It would also be nice to have a className on the date picker itself (not the root) so that we can style nested components within the date picker in case something like this comes up again in a different nested part of the date picker.
Since the date picker doesn't render into the DOM tree, but onto the body, there's no other reliable way to style it. Usually a wrapper div with a class would work but because of how this component renders it's not a viable solution.

I have the feeling that fixing #4422 is way more work than adding the box-sizing to the DatePicker. So could you maybe just add that until #4422 is fixed? Otherwise we would have to wait too long for a fix as there is no workaround possible at the moment ( The div[mode="portait"] selector doesn't match in my case).

@hmeerlo div[mode="portait"] selector works only if you've set mode property on the DatePicker explicitly


Add Dockerfile for FFmpeg-6.1 based Ubuntu-22.04

jrottenberg/ffmpeg is used as the based for the video recorder in SeleniumHQ/docker-selenium
As of now, images in SeleniumHQ/docker-selenium were already moved on Ubuntu 22.04
The motivation from https://github.com/SeleniumHQ/docker-selenium/issues/2037. We are trying to have a unified OS, so I go ahead and created a new Dockerfile for Ubuntu 22.04 with FFmpeg 6.1 (the latest can be found).
Dockerfile is cloned from Ubuntu 20.04, with minor updates in version of
FFMPEG_VERSION=6.0 -> 6.1
LIBXCB_VERSION=1.13.1 -> 1.15
XCBPROTO_VERSION=1.13 -> 1.15
In step RUN      buildDeps=", updated python to python3
Image is available for testing ndviet/ffmpeg:6.1-ubuntu2204 - this is also tested in SeleniumHQ/docker-selenium

If I understand correctly, we want to have our own Dockerfile with Ubuntu 22.04 because the upstream project still uses Ubuntu 20.04?
If so, I would not want to maintain another Dockerfile. Unless someone asks for it, with a strong reason, I would simply wait for the upstream repo to move to Ubuntu 22.04.


[AutoPR netapp/resource-manager] Initial stable version

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/5683

(message created by the CI based on PR content)

This PR has been merged into https://github.com/Azure/azure-sdk-for-python/pull/4948


Cannot launch cloudman despite having access key ID and secret key from AWS

I have an AWS account, EC2, S3 and IAM along with an access key ID and secret key but am unable to launch Cloudlaunch in order to run Galaxy. The error message I get is: "FAILURE
Create appliance task failed: An error occurred (AccessDenied) when calling the GetRole operation: User: arn:aws:iam::xxx:user/galaxy_xx is not authorized to perform: iam:GetRole on resource: role xx-genomics-virtual-lab-20-05-25t17-07-cm2-kube-role
Any suggestions please?

You need to give yourself more permissions through the IAM console (https://console.aws.amazon.com/iam/home#/users). Easiest fix is to give the user associated with your access credentials AdministratorAccess. Let us know if you encounter any other issues!

Hi almahmoud,
I have the same problem with 'GetRole operation'.
Can you please explain more detail on how to give the user with access credential explained by you? I'm a very beginner, I cann't follow the way to solve this problem. Thank you for your help in advance.

You can either give yourself AdministratorAccess through the IAM console link given above, (and here's a rough tutorial for it: https://www.sweetprocess.com/procedures/_eG30mkvYDrfAmevj78A0i6E1GZE/add-an-administrator-to-your-amazon-aws-account/ ) or create an IAM policy (
https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_manage.html) mimicking the following specifications would be enough if you don't want to be a full account administrator:
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "VisualEditor0",
            "Effect": "Allow",
            "Action": [
                "iam:CreateInstanceProfile",
                "iam:GetRole",
                "iam:PassRole",
                "iam:CreateServiceLinkedRole",
                "iam:GetInstanceProfile",
                "iam:GetPolicy",
                "iam:CreatePolicy",
                "iam:CreateRole",
                "iam:AttachRolePolicy",
                "iam:AddRoleToInstanceProfile"
            ],
            "Resource": [
                "arn:aws:iam::*:instance-profile/*",
                "arn:aws:iam::*:role/*",
                "arn:aws:iam::*:policy/cm2-kube-policy"
            ]
        },
        {
            "Sid": "VisualEditor1",
            "Effect": "Allow",
            "Action": "iam:DescribeKeyPairs",
            "Resource": [
                "arn:aws:iam::*:instance-profile/*",
                "arn:aws:iam::*:role/*",
                "arn:aws:iam::*:policy/cm2-kube-policy"
            ]
        }
    ]
}


Flash VPAID Ads?

In the past I saw on comments this plugin did not support Flash VPAID creatives due to the lack of support in Google IMA. Does this update:
http://googleadsdeveloper.blogspot.com/2016/03/ima-sdk-for-html5-now-supports-vpaid.html
Mean we can now use this plugin to run Flash VPAID ads or does a change need to be made? Sorry for using a Github issue for this..

Yes, Flash VPAIDs will work with the video.js plugin as well. Note that your users will still need to be in an environment that supports Flash.

Test

You shouldn't have to make any changes to the code, unless your VPAID ad requires access to the parent frame. In that case you'll need to use INSECURE mode, which can be enabled with the vpaidMode setting in the plugin settings.

Thank you. Just to be sure, since I'm totally newbie on ima sdk, is this the proper way to do that?
var options = {
    id: 'video',
    adTagUrl: adTag,
    VpaidMode: google.ima.ImaSdkSettings.VpaidMode.INSECURE
};

I think you'll need to lower-case the "v", but that should work:
vpaidMode: google.ima.ImaSdkSettings.VpaidMode.INSECURE

Thanks man.


Move Prometheus Metrics into Misk Metrics as it's the only impelmentation

Rework Misk's Prometheus Metrics implementation to delegate to Misk Metrics, and move the implementation into there.
This is a prereq for removing this project, and I need to consolidate all the classes and usages into as few as possible to make further migration work straight forward.
I'll do another PR moving the implementation classes for the prom backend into misk metrics once this is done. I'm trying to keep breaking changes to the absolute minimum.
I did a bunch of searches for usages of the prometheus types here, and realistically only the modules are ever referenced directly, and in most cases I would say it's a mistake.

looks good, unsure if you'll need to wait a few months before removing misk-prometheus or not -- i'd lean towards probably

Most likely it'll get dropped once I have a complete migration off of misk metrics.


Terminal colors

Hey! I followed the suggestion about the base class and made one.
Didn't remove anything, because I lack the understanding what's happening in Model or Engine
P.S. I bonked up last merge with force pushes, I'm sorry for possible notification bombardment...
P.P.S. There's also merge conflicts now, not the cleanest of my PR's

Hey, thanks a bunch!! Sorry I missed this earlier -- don't think I have notifications set up right for my fork... rather than a bombardment I didn't get any 😅
I'm heading out for the evening, but I'll take a look in the morning!

@dimondjik if you get back to this before I do, just pointing you to something experimental I am trying out... It's definitely beyond the original scope of this branch, but it's spiritually similar to what you were thinking with respect to bookkeeping the state as a list of objects rather than as a single string. Just like what you did here, the structured approach makes formatting way easier. No more parsing html...
It's not quite fully functional (primarily it's disagreeing horribly with role blocks), but it may be a good starting place towards more structured data. Note the Image class for multimodality...

I'm floating the "structured state" idea to some colleagues -- if it's well liked, it might simplify this implementation a bit. I'll keep you in the loop!
In the meantime, maybe you could just rebase on top of my branch of terminal_colors, only picking your latest commit 8982ee0? Might be the easiest way to resolve the issues/conflicts.


HTTP error fetching URL. Status=403

Hello,
I am getting the version of a resource on a website where I have my resource published.
When I use it in a new project from 0, I test if it works and correctly it works without problem, I get 0.0.1 which is the version of the resource. The problem comes when I use it in my real project where I check if it is using the latest version, I get the following error:
[05:36:25 WARN]: net.shibacraft.simpleblockregen.api.libs.jSoup.HttpStatusException: HTTP error fetching URL. Status=403, URL=[https://mc-market.org/resources/24046/history/] [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.libs.jSoup.helper.HttpConnection$Response.execute(HttpConnection.java:890) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.libs.jSoup.helper.HttpConnection$Response.execute(HttpConnection.java:829) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.libs.jSoup.helper.HttpConnection.execute(HttpConnection.java:366) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.libs.jSoup.helper.HttpConnection.get(HttpConnection.java:353) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.analytics.Updater.getLatestVersion(Updater.java:69) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.analytics.Updater.isLatest(Updater.java:82) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.analytics.Updater.checkForUpdates(Updater.java:48) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.api.analytics.Updater.load(Updater.java:93) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.modules.MainModule.load(MainModule.java:116) [05:36:25 WARN]:        at SimpleBlockRegen-0.0.2-SNAPSHOT.jar//net.shibacraft.simpleblockregen.SimpleBlockRegen.onEnable(SimpleBlockRegen.java:18) [05:36:25 WARN]:        at org.bukkit.plugin.java.JavaPlugin.setEnabled(JavaPlugin.java:264) [05:36:25 WARN]:        at org.bukkit.plugin.java.JavaPluginLoader.enablePlugin(JavaPluginLoader.java:370) [05:36:25 WARN]:        at org.bukkit.plugin.SimplePluginManager.enablePlugin(SimplePluginManager.java:541) [05:36:25 WARN]:        at org.bukkit.craftbukkit.v1_18_R2.CraftServer.enablePlugin(CraftServer.java:560) [05:36:25 WARN]:        at org.bukkit.craftbukkit.v1_18_R2.CraftServer.enablePlugins(CraftServer.java:474) [05:36:25 WARN]:        at net.minecraft.server.MinecraftServer.loadWorld0(MinecraftServer.java:665) [05:36:25 WARN]:        at net.minecraft.server.MinecraftServer.loadLevel(MinecraftServer.java:432) [05:36:25 WARN]:        at net.minecraft.server.dedicated.DedicatedServer.e(DedicatedServer.java:316) [05:36:25 WARN]:        at net.minecraft.server.MinecraftServer.w(MinecraftServer.java:1164) [05:36:25 WARN]:        at net.minecraft.server.MinecraftServer.lambda$spin$0(MinecraftServer.java:316) [05:36:25 WARN]:        at java.base/java.lang.Thread.run(Thread.java:833)
On the other hand, if I use it in a project from 0, it says this:

The code I am using is very simple (I put image because GitHub doesn't accept the code well, I don't know why):

Thanks

A 403 HTTP error means that the server is explicitly denying the request. You will need to understand why and configure jsoup to make a permitted request. E.g. things like the requesting IP may be blocked, you may be getting rate limited, you need an auth token, etc.
You should ask in a different forum than this, such as Stack Overflow (where this is a jsoup FAQ...). This forum is for bugs / new features in jsoup.
Also you seem to have some repackaged version of jsoup, so I have no idea what's in that code specifically.

I recently had this problem.
The root of the problem is that the server does not trust you and therefore does not inform you.
It is very simple for the server to trust you. For this, activate the review tab of this website.
Then add everything to the header from the request headers section.


deltachat-desktop: 1.40.4 -> unstable-2023-11-02 (security)

The last release still uses insecure electron versions.
This is fixed in master.
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

addressed

No, the commit message is still wrong.

It's okay to merge the deltachat-desktop bump relatively fast but not with the wrong commit message that I pointed out and not at the same time as plenty of other nontrivial changes. I'll revert now.

Sorry. I will not touch it again. But please fix it though. It has severe security issues.

@Mic92 What do you think about putting deltachat-repl in a separate expression? It's a completely separate build process after all.

@Mic92 What do you think about putting deltachat-repl in a separate expression? It's a completely separate build process after all.

Please, just skip this commit for now. I can find a different way to address this issue.


Simple Producer error after topic auto-creation

The SimpleProducer send_messages call will fail with an exception if the Kafka instance it connects to does not have a topic corresponding to the string provided as the topic in the function call. Topic auto-creation suceeds, but the message is not logged. A subsequent run of the script will log the message, but catching the exception and resending will fail with the original exception.
Reproduction steps:
Create a KafkaClient, and a SimpleProducer using the KafkaClient.
Send a message to a non-existent topic.
Expected Results: The message is sent, the topic creates, and the message is logged
Actual Results: The message is sent, the topic creates, and the script fails with a kafka.common.LeaderNotAvailableError exception.
This issue occurs when using the latest code from master. When I used the previous release, I was receiving an UnknownTopicOrPartitionError(topic) exception instead.
kafka-python version: master
Kafka version: kafka/<IP_ADDRESS>/kafka_2.9.2-<IP_ADDRESS>
Zookeeper version: 3.4.6
Script:
from __future__ import absolute_import
from kafka import KafkaClient, SimpleProducer

class Message(object):
    def __init__(self, topic, message):
        self.topic = topic
        self.message = message

    def send(self):
        kafka = KafkaClient("localhost:9092")
        producer = SimpleProducer(kafka)
        producer.send_messages(self.topic, self.message)

message = Message('abcd-test', 'test message')
message.send()

Run 1 output (client):
Traceback (most recent call last):
File "message.py", line 18, in
message.send();
File "message.py", line 15, in send
producer.send_messages(self.topic, self.message)
File "build/bdist.linux-x86_64/egg/kafka/producer/simple.py", line 69, in send_messages
File "build/bdist.linux-x86_64/egg/kafka/producer/simple.py", line 56, in _next_partition
File "build/bdist.linux-x86_64/egg/kafka/client.py", line 323, in load_metadata_for_topics
File "build/bdist.linux-x86_64/egg/kafka/common.py", line 215, in check_error
kafka.common.LeaderNotAvailableError: TopicMetadata(topic='abcd-test', error=5, partitions=[])
Run 1 output (Kafka):
[2014-09-29 18:41:14,761] INFO Topic creation {"version":1,"partitions":{"0":[1]}} (kafka.admin.AdminUtils$)
[2014-09-29 18:41:14,765] INFO [KafkaApi-1] Auto creation of topic abcd-test with 1 partitions and replication factor 1 is successful! (kafka.server.KafkaApis)
[2014-09-29 18:41:14,778] INFO Closing socket connection to /<IP_ADDRESS>. (kafka.network.Processor)
[2014-09-29 18:41:14,792] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions [abcd-test,0] (kafka.server.ReplicaFetcherManager)
[2014-09-29 18:41:14,810] INFO Completed load of log abcd-test-0 with log end offset 0 (kafka.log.Log)
[2014-09-29 18:41:14,813] INFO Created log for partition [abcd-test,0] in /tmp/kafka-logs with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 536870912, flush.ms -> 1000, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, cleanup.policy -> delete, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 10000, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000}. (kafka.log.LogManager)
[2014-09-29 18:41:14,814] WARN Partition [abcd-test,0] on broker 1: No checkpointed highwatermark is found for partition [abcd-test,0] (kafka.cluster.Partition)
Run 2 output (client):
none (message submits successfully
Run 2 output (Kafka):
[2014-09-29 18:41:19,897] INFO Closing socket connection to /<IP_ADDRESS>. (kafka.network.Processor)

you've got it -- try/except and catch the LeaderNotAvailableError.  Creating a topic does take a short amount of time, so the first attempt to produce a message to a new topic using auto-create will fail and you will need to sleep briefly and retry.

I know this ticket is closed, but can anything else cause this issue? I've tried both workarounds I've found, wrapping send_messages() in a try/except and putting ensure_topic_exists() at the front of my code. Running kafka 0.8.2 and zookeeper 3.4.6 in docker containers with latest kafka-python pull.

If you are getting the LeaderNotAvailable exception unexpectedly, the best place to start is to check for more information in your kafka server logs.
For kafka-python, you might consider switching to the async producer. It should be much more reliable as of the latest kafka-python release, and it will handle retries internally.

@joshuarichard, I was having LeaderNotAvailable happen persistently even well after it had created the topic. In my case, it was a result of having set "advertised.host.name" incorrectly (typo).


Log Configuration: debug?

via: http://ssdb.io/docs/config.html
Log Configuration

See also Log Analytics.

    logger.level Log Levels

The log levels are: debug, info, warn, error, fatal.

**Generally, I recommend you set logger.level to debug.**

I'd like to discuss the debug mode.
We did recently reach a disk limit on our servers (30k iops). The debug was enabled, but for now we have turned it off...
But you recommend to have it enabled.
In my perception, every SSDB operation produces 1 line of log, is that right?
So we probably did reduce the disk writes by 50%?
Or maybe the logs are buffered in the
leveldb.write_buffer_size
That is not what I do observe, since it is written into log instantly
Could you elaborate on that?

In my perception, every SSDB operation produces 1 line of log, is that right?
Yes
So we probably did reduce the disk writes by 50%?
You did reduce disk load.

Set log level to other than debug does not make any harm to you data. The log is helpul if you encounter any problem. Feel free to what you have done.


TLS security issues

Security issues found by https://github.com/drwetter/testssl.sh:
SWEET32 (CVE-2016-2183, CVE-2016-6329)    VULNERABLE, uses 64 bit block ciphers
BEAST (CVE-2011-3389)                     TLS1: ECDHE-RSA-AES128-SHA
                                                 ECDHE-RSA-AES256-SHA
                                                 AES128-SHA AES256-SHA
                                                 ECDHE-RSA-DES-CBC3-SHA
                                                 DES-CBC3-SHA
                                           VULNERABLE -- but also supports higher protocols  TLSv1.1 TLSv1.2 (likely mitigated)
LUCKY13 (CVE-2013-0169), experimental     potentially VULNERABLE, uses cipher block chaining (CBC)

TLS configuration needs more precise configuration to mitigate these issues:
https://github.com/gambol99/keycloak-proxy/blob/ab5ef860694f75238419f135ab0e0d60f897002d/server.go#L498-L501
I recommend to add:
CipherSuites  - suggested default value TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
MinVersion - suggested default value VersionTLS12, note: min TLS v1.2 can be a problem for old clients:
 Android 4.2.2                TLSv1.0 ECDHE-RSA-AES128-SHA, 256 bit ECDH (P-256)
 IE 7 Vista                   TLSv1.0 ECDHE-RSA-AES128-SHA, 256 bit ECDH (P-256)
 IE 8 Win 7                   TLSv1.0 ECDHE-RSA-AES128-SHA, 256 bit ECDH (P-256)
 IE 8 XP                      TLSv1.0 DES-CBC3-SHA
 Tor 17.0.9 Win 7             TLSv1.0 ECDHE-RSA-AES128-SHA, 256 bit ECDH (P-256)
 Java 7u25                    TLSv1.0 ECDHE-RSA-AES128-SHA, 256 bit ECDH (P-256)

These TLS configs should be configurable by user.
Reference: https://golang.org/pkg/crypto/tls/

much appreciated @jangaraj ... I'll take a look at raising a PR against this

@jangaraj thanks for taking your time reporting this. The repository keycloak-proxy was moved to Keycloak organization and renamed to keycloak-gatekeeper. If you still think this issue is valid, please read https://www.keycloak.org/community.html and report your bug/feature request to https://issues.jboss.org/browse/KEYCLOAK.
Also, for any potential security issue, please follow the guidelines here https://www.keycloak.org/security.html


Fatal error with Promise.all()

So i got this piece of code:

  console.log('RECEIVED ALL HASHES');
  const promises = [];

  data.paths.forEach(path => {
    console.log('RECEIVED PATH:', path)
    promises.push(hasha.fromFile(path, {
      algorithm: 'md5'
    }));
  });
  console.log('FINISHED LOOP');

  const results = [];
  for (let i = 0; i<promises.length; ++i) {
    const r = await promises[i];
    console.log(data.paths[i], ' got HASH: ', r);
    results.push(r);
  }

  console.log('FINISHED PROMISES');
  return results.map((r, i) => ({path: data.paths[i], hash: r}))

Running it like this it produces the right output as expected. It takes a while but creates all the hashes

But when using Promise.all like this:
  console.log('RECEIVED ALL HASHES');
  const promises = [];

  data.paths.forEach(path => {
    console.log('RECEIVED PATH:', path)
    promises.push(hasha.fromFile(path, {
      algorithm: 'md5'
    }));
  });
  console.log('FINISHED LOOP');

  const results = await Promise.all(promises);
  console.log('FINISHED PROMISES');
  return results.map((r, i) => ({path: data.paths[i], hash: r}))

I receive this fatal error:
#
# Fatal error in , line 0
# ignored
#
#
#
#FailureMessage Object: 0000005D5B5FC610
 1: 00007FF6D6B7B43F node::Buffer::New+127615
 2: 00007FF6D68C544A IsSandboxedProcess+653770
 3: 00007FF6D4D2F05B v8::Platform::SystemClockTimeMillis+413467
 4: 00007FF6D4A75BE3 v8::ArrayBuffer::GetContents+291
 5: 00007FF6D4A75AB0 v8::ArrayBuffer::Externalize+16
 6: 00007FF6D798AB74 uv_dlerror+338660
 7: 00007FF6D798CE41 uv_dlerror+347569
 8: 00007FF6D798D341 uv_dlerror+348849
 9: 00007FF6D4ABD62E v8::CFunction::CFunction+233422
10: 00007FF6D4ABCA8B v8::CFunction::CFunction+230443
11: 00007FF6D4ABC130 v8::CFunction::CFunction+228048
12: 00007FF6D4ABBDB7 v8::CFunction::CFunction+227159
13: 00007FF6D54D957C v8_inspector::V8StackTraceId::ToString+3453724
14: 00007FF6D546DE75 v8_inspector::V8StackTraceId::ToString+3013653
15: 00007FF6D549BC51 v8_inspector::V8StackTraceId::ToString+3201521
16: 00007FF6D55234D8 v8_inspector::V8StackTraceId::ToString+3756664
17: 00007FF6D548E4FA v8_inspector::V8StackTraceId::ToString+3146394
18: 00007FF6D546B82C v8_inspector::V8StackTraceId::ToString+3003852
19: 00007FF6D4B7D4D1 v8::Unwinder::PCIsInV8+2705
20: 00007FF6D4B7DF6F v8::Unwinder::PCIsInV8+5423
21: 00007FF6D4B7E076 v8::Unwinder::PCIsInV8+5686
22: 00007FF6D4BA2103 v8::Unwinder::PCIsInV8+153283
23: 00007FF6D4BA1EDF v8::Unwinder::PCIsInV8+152735
24: 00007FF6D546ED2E v8_inspector::V8StackTraceId::ToString+3017422
25:<PHONE_NUMBER>0D38F2
npm ERR! code ELIFECYCLE
npm ERR! errno 3
npm ERR<EMAIL_ADDRESS>electron:serve: `wait-on tcp:4200 && npm run electron:serve-tsc && npx electron . --serve`
npm ERR! Exit status 3
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>electron:serve script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!      C:\Users\danie\AppData\Roaming\npm-cache\_logs\2020-12-26T20_09_51_843Z-debug.log
ERROR: "electron:serve" exited with 3.
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>start: `npm-run-all -p electron:serve ng:serve`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!      C:\Users\danie\AppData\Roaming\npm-cache\_logs\2020-12-26T20_09_51_947Z-debug.log

I have no idea what it's trying to tell me...
I have a 8 core 3700x and 32 GB of ram if this is any help.
I would like to run it in parallel since there are alot of files that get hashed somewhat often.

What Node.js version? Try with the latest one. It should not crash like that no matter what. You should report this to the Node.js project if it's still an issue in the latest version.
You probably want to limit the concurrency as Node.js doesn't seem to be able to handle it. You can use https://github.com/sindresorhus/p-all or https://github.com/sindresorhus/p-map
Closing as this is not an issue with this package.

Even when using your queue plugin with concurrency 1 it still crashes like this. I updated my electron version and am now using node 12.18.3 and it's still happening so i think its an issue with this package.
  const queue = new PQueue({concurrency: 1});
  const results = await queue.addAll<string>(data.paths.map(f => () => hasha.fromFile(f, {algorithm: 'md5'})));

Also bear in mind these files are rather big video files maybe that breaks smth in the package?

I updated my electron version and am now using node 12.18.3 and it's still happening so i think its an issue with this package.

No, it's not. The error is a native V8 error, which JS code should not be able to trigger at all. So even if hasha did something wrong (which it does not), it should not have been able to crash Node.js like this.
This is definitely a problem with Electron.


SEO

SEO search engines require plain HTML tags
It should be possible to build a pages function for CF Pages which will fetch some content about a given URL and render the html with OpenGraph tags and relevant metadata tags

Duplicate


Added dep. badges, fixed typo

It doesn't have any business benefit

You need to get up to helicopter perspective, and considering how this will future proof the foundation of this project, the benefit will be major.


MUI Datatable filter option is not working for numbers/integer

Expected Behavior

Steps to Reproduce (for bugs)

I am using mui data table from last 8 months.I found one isue Numbers/Integer not getting search.if i am converting numbers into string then its working fine but after that column sorting option is not working.
2.
3.
4.
Your Environment

Tech
Version

Material-UI
^4.11.0

MUI-datatables
^3.5.0

React
^16.14.0

browser
chrome

etc

same for me

hi did u find solution for this? please reply

Hey I specified types for my column which solved the issue
Link to doc: https://mui.com/x/react-data-grid/column-definition/#value-formatter
example:
const columns = [   { field: "sensor", headerName: "Sensor Name", flex: 1, minWidth: 150, type: 'string' },   {     field: "min",     headerName: "Min Value",     flex: 1,     minWidth: 150,     type: 'number'   } ]

This is a MUI issue - I get the same issue using standard functionality in MUI rather than MUI-datatables.


Instances for Yoga.Tree probably not stack-safe

@sigma-andex ever worked with trampolines, any idea how to make this stuff stack-safe?

Long time ago. we can try  it in a hacking session if you want

I'll merge it for now, need more instances.


Disable Inventory click while bank pin

To avoid unnecessary drinking and eating of supplies while you enter your bank pin.
(Sometimes you switch world and don't realize it and you drink a pot while willing to put the pot in the bank (because of the pin interface))

Isn't there a bank option in game to remember the pin for like 5 minute even if you dc, hop etc?


Adding power (ppc64le) architecture

Changes

Add ppc64le architecture

Fixed by https://github.com/traefik/official-images-publisher/pull/15


dist.sh improvements

Let us comment that strip command out (for licensing reasons on some backend tools). We should better update the workcraft-distr-template repo with stripped binaries (I will do this as soon as I hear back from the UnfoldingTools author).

I'll remove the commit then. It makes sense to do all of this in the template repo if we're not allowed to tamper with the binaries.

If not too much trouble, could we have all the distribution files and temporary directories under the distr directory? Just to make it  cleaner... This is low priority though.

Sure. I'll do that now.


Question: How can I render two carousel on one page with nuxt?

I have a problem with nuxt:
If I use two carousel into one page, I get this error
you may have an infinite update loop in a component render function
And the first carousel doesn't have correct width/height
The template is like:
<div>
    <no-ssr>
        <carousel>
            <slide>
                ...
            </slide
            <slide>
                ...
            </slide
        </carousel>
    </no-ssr>
    ...
    ...

    <no-ssr>
        <carousel>
            <slide>
                ...
            </slide
            <slide>
                ...
            </slide
        </carousel>
    </no-ssr>
</div>

And plugin:
import Vue from 'vue'

import VueCarousel from 'vue-carousel'

Vue.use(VueCarousel)

Hmm, I'm not 100% familiar with nuxt. There are many cases of multi-carousel working over SSR though, so there's a way this will work! I'll flag this and see if someone can offer some help

I'm not having this problem with Nuxt. I'm loading the carousel with nuxt.config:
plugins: [     {       src: '~/plugins/vue-carousel.js',       ssr: false     }   ],
In vue-carousel.js:
`
import Vue from 'vue';
import { Carousel, Slide } from 'vue-carousel'
Vue.component('carousel', Carousel);
Vue.component('slide', Slide);
`
and on my page I just use , without declaring in Components or anything.
Hope that helps

I've got the same problem when using multiple carousels. In my case this seems to be caused by using the perPageCustom prop. In the computed function breakpointSlidesPerPage this prop is mutated due to being sorted in place, triggering a recompute in the second carousel and starting an infinite loop.

I've got the same problem with Nuxt and 2 carousels in one page...

I'm not having this problem with Nuxt. I'm loading the carousel with nuxt.config:
plugins: [ { src: '~/plugins/vue-carousel.js', ssr: false } ],
In vue-carousel.js:
import Vue from 'vue';
import { Carousel, Slide } from 'vue-carousel'
Vue.component('carousel', Carousel);
Vue.component('slide', Slide);

and on my page I just use , without declaring in Components or anything.
Hope that helps

Works a treat!
Nuxt: 2.0.0
vue-carousel: 0.15.0

I'm not having this problem with Nuxt. I'm loading the carousel with nuxt.config:
plugins: [ { src: '~/plugins/vue-carousel.js', ssr: false } ],
In vue-carousel.js:
import Vue from 'vue';
import { Carousel, Slide } from 'vue-carousel'
Vue.component('carousel', Carousel);
Vue.component('slide', Slide);

and on my page I just use , without declaring in Components or anything.
Hope that helps

Works a treat!
Nuxt: 2.0.0
vue-carousel: 0.15.0

Weird.
Also  "nuxt": "^2.0.0" and  "vue-carousel": "^0.15.0". Added vue-carousel.js at plugins and nuxt config but still having window is not defined error.

My bad, solution above add in nuxt config and adding as plugin actually works. I just forgot to remove import at the vue file that uses the carousel.

@ynte I'm having the same issue, did you find a way to fix it?

@Yezuz05 I created two separate data members (with the same contents) for my two carousels. You cannot pass the same object to multiple perPageCustom props.
Caroussel 1:
<carousel :paginationEnabled="false" :navigationEnabled="true" :perPageCustom="breakpoints"  ...

Caroussel 2:
<carousel :paginationEnabled="false" :navigationEnabled="true" :perPageCustom="breakpoints2"  ...

@ynte Thanks. :smile:

solution to use is as plugin with ssr: false works but I'm receiving a warning:
[Vue warn]: The client-side rendered virtual DOM tree is not matching server-rendered content. Bailing hydration and performing full client-side render.
which actually negates ssr effort of prerendering page (bailing hydration)
does anyone know how to fix that?

@ynte Thnaks, save my time.


requirements: Use maintained fork django-sendfile2 of django-sendfile

The original seems to be unmaintained (johnsensible/django-sendfile#65).  Notably, this fixes a bug in the filename parameter, which perviously showed the Python 3 repr of a byte string (johnsensible/django-sendfile#49).
Testing Plan: Downloaded attachment from dev server and production (https://andersk.zulipdev.org).

Also, since we aren’t using or maintaining https://github.com/zulip/django-sendfile-zulip, maybe we should delete that.

I removed that fork and merged this.


Quadrature example fails :(

I followed:
https://github.com/nschloe/quadpy/wiki/Creating-your-own-Gauss-quadrature-in-three-simple-steps
I did this small script:
import numpy as np
import sympy as sp
import quadpy
import orthopy

print(np.__version__)
print(sp.__version__)
print(quadpy.__version__)
print(orthopy.__version__)

N = 20
def leg_polys(x, N):
    return orthopy.line_segment.tree_legendre(x, N, "monic", symbolic=True)

moments = quadpy.tools.integrate(
    lambda x: [x**2 * leg_poly for leg_poly in leg_polys(x, N)],
    -1, +1
)
print(moments)
print(len(moments))

_, _, a, b = \
   orthopy.line_segment.recurrence_coefficients.legendre(N, "monic", symbolic=True)

alpha, beta = quadpy.tools.chebyshev_modified(moments, a, b)

# Convert to float
alpha = np.array([sp.N(a) for a in alpha])
beta = np.array([sp.N(b) for b in beta])

points, weights = quadpy.tools.scheme_from_rc(alpha, beta, decimal_places=20)

With the following output:
1.16.4
1.4
0.14.2
0.6.2
[2/3 0 8/45 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
21

and then fails since the length of the moments is 21 (there is an assert len(moments) % 2 == 0).
I can't seem to figure out why this happens?

Well, you need an even number of moments. Have you tried putting N=21? That should work.

I will update the readme later today to make things a bit clearer.

It was more that I was surprised your wiki apparently worked, and that was using N=20. :)
Thanks!

Fixed now; check out the new description.

thanks!


E5108: Error executing lua [string ":lua"]:1: attempt to call global 'lua_function' (a nil va lue)

I found that with NVIM v0.5.0-424-g6ca7ebb34, the <M-C-G> key sequence leads to:
E5108: Error executing lua [string ":lua"]:1: attempt to call global 'lua_function' (a nil va lue)

Changing:
nmap <M-C-G> :lua lua_function()<CR>

to:
nmap <M-C-G> :lua myluadmodeul.lua_function()<CR>

in nvim-example-lua-plugin.vim seems to make things work better.

P.S. Thanks a lot for putting this repository together.  Much appreciated :+1:

Experiencing the same.

I adjusted the pattern of how I exported the Lua function from the module and forgot to update the calling code. Should be working now.


Some basic issues！Thanks！

Hello author, thank you very much for your outstanding contribution!But I have a few basic questions that I would like to consult with you，My predicted mask folder layout and my own dataset layout are shown in the following figure

When I use the following command line, there will be a basic error

When I use the following command line, there will be a basic error

Excuse me again! Another issue, which caused me to use the absolute path to not display the above issue, resulted in the following issue.

很抱歉，我是一个菜鸟新手，可能问的问题很基础！打扰了

Relative paths should work. Are you sure that the paths are pointing to the correct directory?
Might happen if the code cannot find a single video in the path that you provided.

Thank you very much for your reply! There are still some issues with relative paths. I have temporarily used absolute paths and made some changes, which have been effective! thanks


Switch transactions/calls/account stuff to etherscan

http://testnet.etherscan.io/apis#proxy
That way it's a) not run by ff and b) actually scales instead of just 1-2 nodes

done by jack but they kicked us off


update web actions documentation

merged a93750225b463bf3ac7bf888506421dbda133217
Thank you @cfjedimaster for raising the doc confusion and feedback. Keep them coming


Error with Netflix-Sync

When trying to import my Netflix history it throws me back to the selection screen. Here's the log from Chrome:
ehlckfimahifadnbecobagimllmbdmde-1674136387599.log
I also tried Firefox - this spits out:
ff.log
I'm not really sure how to extract more useful logs - very happy to try if someone could point me to a how-to or sth. like that :-)

Came here to say this, it almost feels like it gets overloaded. I'm trying to import years of Netflix history so my assumption is that that is maybe just not possible? Would be cool if there was a way to manually import

Would have been my assumption as well - it dies when scrolling down. But it doesn't seem to be an API-lockout, as I can immediately retry and it fails at the same location (would expect it to fail right at the start if it were a lockout of some sort).

I'm getting the same issue. It's because of these lines checking for summary.
It seems that unavailable IDs (doesn't matter if it's a season or not) don't have the summary in the response.
Example here with Superstore not being available anymore in my country (Czech Republic):

Toggle response from pathEvaluator

{
  "value": {
    "videos": {
      "81059939": {
        "seasonList": {
          "current": [
            "seasons",
            "81165490"
          ]
        }
      },
      "81425010": {
        "releaseYear": 2022,
        "summary": {
          "idx": 1,
          "id": 81425010,
          "type": "episode",
          "isOriginal": true,
          "episode": 1,
          "season": 1,
          "isPlayable": true,
          "$type": "leaf"
        }
      },
      "81471764": {
        "releaseYear": 2020
      },
      "81471765": {
        "releaseYear": 2020
      },
      "81471766": {
        "releaseYear": 2020
      },
      "81471767": {
        "releaseYear": 2020
      },
      "81471768": {
        "releaseYear": 2020
      },
      "81471769": {
        "releaseYear": 2020
      },
      "81471770": {
        "releaseYear": 2020
      },
      "81471771": {
        "releaseYear": 2020
      },
      "81471772": {
        "releaseYear": 2020
      }
    },
    "seasons": {
      "81165490": {
        "summary": {
          "id": 81165490,
          "name": "Heartstopper",
          "shortName": "S1",
          "hiddenEpisodeNumbers": false,
          "length": 8,
          "$type": "leaf"
        }
      }
    }
  },
  "error": {
    "innerErrors": [
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471772
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471771
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471770
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471769
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471768
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471767
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471766
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471765
          ],
          "summary"
        ]
      },
      {
        "message": "OnError while emitting onNext value: [Lrx.Observable;.class",
        "pql": [
          "videos",
          [
            81471764
          ],
          "summary"
        ]
      }
    ]
  },
  "paths": [
    [
      "videos",
      "81425010",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471772",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471771",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471770",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471769",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471768",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471767",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471766",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471765",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81471764",
      [
        "releaseYear",
        "summary"
      ]
    ],
    [
      "videos",
      "81059939",
      "seasonList",
      "current",
      "summary"
    ],
    [
      "videos",
      "80061132",
      "seasonList",
      "current",
      "summary"
    ]
  ]
}

Interesting. The lines were supposed to fix this issue #232

Ah I see, the Firefox addon wasn't updated for almost 2 months (last update on Dec 10, 2022), so this fix merged on January 6 isn't available there.
I tried running it locally, it worked.
And for Chrome, there's currently no GitHub release as seen in #270, but I guess it would work there too.

Sorry. I forgot to run the release manually again. Please verify and close if it works.

Managed to set up node.js and compiled it here. It still crashed so I tried my non-existent JS skills and tried to dump pretty much everything I could think of...
Very much the same error as #232 but slightly different flavor. Crashing item is:
{     "bookmark": 1212,     "country": "DE",     "date":<PHONE_NUMBER>341,     "dateStr": "5/27/22",     "deviceType": 1725,     "duration": 1560,     "episodeTitle": "Benjamin Blümchen im Krankenhaus",     "estRating": "47",     "index": 13,     "movieID": 80227732,     "seasonDescriptor": "Season 2",     "series": 80227721,     "seriesTitle": "Benjamin Blümchen",     "title": "Season 2: \"Benjamin Blümchen im Krankenhaus\"",     "topNodeId": "80227721",     "videoTitle": "Benjamin Blümchen im Krankenhaus",     "releaseYear": 2002,     "season": {       "summary": {         "id": 81620106,         "name": "Season 5",         "shortName": "S5",         "hiddenEpisodeNumbers": false,         "length": 6,         "$type": "leaf"       }     }   },
So here the whole "summary" property is missing. My naïve solution would be
				season = historyItem.summary?.season || 0; 				number = historyItem.summary?.episode || 0;


[IMPORTANT] No logs for Waypoint and QR Code scanner node

In many of our flights during flight day 3, the log for the waypoint and qr code scanner node are completely empty.

The logs can be found here: https://drive.google.com/drive/folders/1-2gnSmibS07wBIrM6wb0Xbhact38qdht

@J0las @J0hn-Lawrence @di-math

And is it on purpose that we don't log DEBUG messages?

And is it on purpose that we don't log DEBUG messages?

No, this can´t be right. We need debug messages in the logs.

The logs can be found here: https://drive.google.com/drive/folders/1-2gnSmibS07wBIrM6wb0Xbhact38qdht

Do you have a specific folder this happened in?

At least in the current dev branch, the debug log level setting is commented out:
https://github.com/THI-Drone/mission_software_launch/blob/37fa88a271cfc421fffa6081314fa58014b4f5ab/launch/launch.py#L59

Do we need a PR and approve flow here as well?

For example this one: https://drive.google.com/drive/folders/1gIfrk5p6EuIPCZ26kYghqS4K3qMkEg5n

Do we need a PR and approve flow here as well?

We had one: https://github.com/THI-Drone/mission_software_launch/pull/7

For example this one: https://drive.google.com/drive/folders/1gIfrk5p6EuIPCZ26kYghqS4K3qMkEg5n

Are we sure this isn´t an scp issue and the files on board are not empty?

Do we need a PR and approve flow here as well?

We had one: #7

Yeah, that one shouln´t have been merged

For example this one: https://drive.google.com/drive/folders/1gIfrk5p6EuIPCZ26kYghqS4K3qMkEg5n

Are we sure this isn´t an scp issue and the files on board are not empty?

No, we can't be sure about that. But the other files are looking fine and this is a rather consistent issue.

For example this one: https://drive.google.com/drive/folders/1gIfrk5p6EuIPCZ26kYghqS4K3qMkEg5n

Are we sure this isn´t an scp issue and the files on board are not empty?

No, we can't be sure about that. But the other files are looking fine and this is a rather consistent issue.

I would like to double check that, so that we are not hunting a phantom here while the issue lies somewhere else entirely

Does your mdf checker node use ros logs? @Philipp66904
Maybe you can set the env var and try if the log file is created even if there was no recorded log

Does your mdf checker node use ros logs? @Philipp66904
Maybe you can set the env var and try if the log file is created even if there was no recorded log

No, it doesn't. It's kept completely ROS free and therefore only uses printf. The final error message is inside the exception, though.

I just think it is strange why an empty log file would have been created. I would think it will be created upon the first log.
Thats why I think the MDF checker would be a good canidate to test that, because it uses no ros logs

Updated launch file for UAV nodes

Ensured logging is enabled for Waypoint and QR Code scanner nodes.
Remapped rosout into the namespace for all nodes.
Maintained debug log level for detailed logging.


Improve Footer Section

I want to improve footer section of your website, for looking more attractive.
Please @Damini2004 @iamparas0 assign me this task. Please label hacktober-accepted, gssoc-ext labels.

@iamparas0 Assign me for this task, i love to contribute and Please label hacktober-accepted, gssoc-ext labels.


Combined graph of multimodule project

If I have a multimodule project, is there a way of creating a combined graph of all the dependencies of the entire project? If there's a single root, this is easy, but sometimes you have multiple...

I'd love to have this too... At the moment I'm writing Scala code to parse the output of the dependency graph. :neutral_face:


finalize project plan drafts

https://drive.google.com/drive/folders/1fw41QPOh0m1L3j5Pmk2CuHrXqfhE7pLr?usp=drive_link

Hi @CECSpecialistI - I'm looking at Milestones to get a sense of the volume of issues working towards the end of the year. We have 172 issues without a milestone, and some milestones that are unused. In June 2022, meeting notes say BSR milestone = MVP. In July 2022, Decisions Index says "Current milestone: MVP for Transform. Priority order for subsequent milestones: BSR, CSR, Mapping Review, Publication [milestone for transform will be created once we have MVP done]."

The MVP for Transform milestone should be collapsed into the BSR milestone. The Mapping Review milestone can probably be abandoned since we are doing review as we go as part of the BSR/CSR milestones

I've deleted the Mapping Review milestone and moved all issues (open & closed) that were under MVP for Transform into PCC RDA BSR. For the moment I've left the MVP for Transform milestone available, with a note to not use, and see this thread

Hi @CECSpecialistI - here's a proposal for Timelines & Milestones, and a few questions/comments - let me know
Timeline:

Phase I: March 3, 2021 - December 20, 2024
Post-Phase I Close-out: January 2, 2025 - February 28, 2025
Phase II: March 1, 2025 - June 30, 2026

Milestones:

Phase I:

PCC RDA BSR: December 20, 2024
Wikibase Cloud: December 20, 2024
Phase I Publication: December 20, 2024

Post-Phase I Close-out:

Post-Phase I Publication: February 28, 2025

Phase II:

Transformation Output Review: March 31, 2025
PCC RDA BSR v2: December 23, 2025
PCC RDA CSR: June 30, 2026
Phase II Publication: June 30, 2026

Comments/Questions:

I initially was considering Wikibase Cloud to be a milestone next year. My current thinking is that the current work setting it up is both a milestone and deliverable that is part of this year's Phase 1. Then next steps with it are part of a Transformation Output milestone next year.

I understand from discussing with Cypress that a full end-to-end transformation output will not be complete by EOY. Given that, I'm thinking of this as a separate milestone from what we'll complete this year towards transformation

Currently we have a milestone called Publication. Since publications are ongoing, I suggest we update this to account for Phase 1. Then, we open another for later phases of publications. I think this would be items that are a combination of our community engagement and documentation labels (i.e., all community engagement, but likely a subset of all documentation).
I'm considering the white paper to justify phase 2 as part of a separate Post-Phase 1 Close-out milestone, rather than part of Phase 1 or 2 itself. Do you think about this differently?

I would include grant applications as part of this as well

Do the proposed dates seem like a good starting point?

I'm presuming we'll tighten up Phase 2 dates following the white paper. With BSR taking 3+ years, I cut CSR to 1.5 years, since I'm optimistic we'll be able to leverage work and learnings to be quicker.

Thank you Sara for all of this work!! I think it's ready to be used as a starting point for sure.

Thanks, Crystal! I've incorporated high-level problem statement, goals, impact into the wiki About section. I've updated the Projected Phases and Timelines. The Project Overview document has this information in one place. I also created a high-level Project Overview Brief slider that has Phase I executive summary style overview. Last on this task is finalizing the longer form project plan document.

We should talk about what end-to-end transformation means and what transformation review means, because Phase II and work into March of next year, while it would be great, requires commitments that haven't yet been made.

I discussed this more with Cypress yesterday. End of year all coding will be done for the transform. Being able to run it against LC will most likely not be done, i.e., we will not have all the output (and therefore, won't have that to review). We need more memory to run against otherwise the transform process will time out. We also expect there will be errors that will need debugging, as part of the regular course of the coding lifecycle, once we run the transform against LC. If Wikibase Cloud is also not ready, then will have only files.

Now that we've assigned out all issues that were in the 'PCC RDA BSR v2 (TBC)' milestone, I've moved the remaining issues to the PCC RDA BSR milestone. I've deleted these old milestones: 'PCC RDA BSR v2 (TBC)', 'MVP for Transformation (Do Not Use)', and 'Publication (Do Not Use)'. I've renamed 'PCC RDA BSR' to 'Phase I (BSR)' and 'PCC RDA CSR (TBC)' to 'Phase II (CSR & BSR)' for clarity, and updated descriptions. I've updated the due dates to match 2024-12-03 Strategy Meeting - will see how our discussion of the project plan evolves in the new year if they need to be adjusted.


H100 Support in Python

Hi,
are there any plans to support the H100 hub in python? I can see the hub, but I'd like to get data from a temperature sensor thats connected to the hub.
Thanks

The plan is to have the Python version on version parity with the Rust one. Support for H100 in Python will come in the next couple of months.

I'm currently working on this.

Added partial support for the H100 hub and its child devices. Currently, only the get_device_info function is supported for the child devices through the hub's get_child_device_list method.

Closing this as H100 is now fully supported in the Python wrapper.


fix: add sbom validator to deployments

Fixes #691

Could you also run make in deploy/openshift?

Done


Upgrade to Jackson 2.12.4

I'm using Java Client 5.5.0, and it's using Jackson 2.11.1, which is a little on the old side now:
https://search.maven.org/artifact/com.fasterxml.jackson.core/jackson-databind
2.12.4 was released on July 6, 2021 and is the latest stable release. I'm thinking it's worth upgrading this as it's such a widely used library, and it seems better to be on the latest release.

Release notes - https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.12
And list of bugfix releases since 2.12 was released:

https://github.com/FasterXML/jackson-databind/issues?q=is%3Aclosed+milestone%3A2.12.1
https://github.com/FasterXML/jackson-databind/issues?q=is%3Aclosed+milestone%3A2.12.2
https://github.com/FasterXML/jackson-databind/issues?q=is%3Aclosed+milestone%3A2.12.3
https://github.com/FasterXML/jackson-databind/issues?q=is%3Aclosed+milestone%3A2.12.4

One benefit of going up to 2.12.4 is that the ml-gradle stack is now on Spring 5.3.9. And then to get DHF on Spring 5.3.9, we need to update the Spring Boot version that DHF Hub Central uses to its latest version. And that latest version of Spring Boot depends 2.12.4 of jackson-databind .
I am thinking that a 5.5.1 Java Client release could do this upgrade, assuming that the upgrade from 2.11 to 2.12 doesn't cause any issues.

Hi @rjrudin, do you mean you would like a new release 5.5.1 which contains only this Jackson upgrading?

I'm only proposing that if a 5.5.1 release was an option, I think it would be consistent with semver (some conversation on the topic is at https://github.com/semver/semver/issues/148 ) to produce a new release that only upgrades a thirdparty dependency, assuming that doing so doesn't require additional improvements that would then necessitate a 5.6.0 release.

No regressions seen.


zoom filter for marker

Is it possible to set zoom filter for marker?

No, for dynamic filtering of features you would want to create a new data source instead (MapData on Android).


[Bug]:  Cannot install EasyPhoto in Mac with M3 chip

Is there an existing issue for this?

[X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Is EasyPhoto the latest version?

[X] I have updated EasyPhoto to the latest version and the bug still exists.

What happened?
Each time I try to install, I met this:

It seems that tensorflow-cpu is not available for MacOS. Instead, it should be tensorflow-macos.
Steps to reproduce the problem

Install easy-photo in a macbook with M3 chip
You'll never install it successfully

What should have happened?
It should be installed successfully
Commit where the problem happens
webui: The latest
EastPhoto: The latest
What browsers do you use to access the UI ?
Google Chrome
Command Line Arguments
No

List of enabled extensions
No
Console logs
ERROR: Could not find a version that satisfies the requirement tensorflow-cpu (from versions: none)
                                                          ERROR: No matching distribution found for tensorflow-cpu
                                                  Install extension ComfyUI-Portrait-Maker failed: Install(git-clone) error: https://github.com/THtianhao/ComfyUI-Portrait-Maker / Error: Command failed with exit code 1: /Users/yanggao/miniconda3/envs/comflowy/bin/pip install -r requirements.txt
                                      ERROR: Could not find a version that satisfies the requirement tensorflow-cpu (from versions: none)
         ERROR: No matching distribution found for tensorflow-cpu
 Collecting aliyun-python-sdk-core-v3==2.13.10 (from -r requirements.txt (line 1))
                    Using cached aliyun_python_sdk_core_v3-2.13.10-py3-none-any.whl.metadata (1.4 kB)
                                     Requirement already satisfied: opencv-python in /Users/yanggao/miniconda3/envs/comflowy/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (<IP_ADDRESS>)
        Extension ComfyUI-Portrait-Maker install failed

Additional information
No response

i has the same problem

there is no tensorflow-cpu package for Mac ARM64.
I skipped the installation, so sd-web can load the plugin.
But photos cannot be trained using this setup.


The replacement file cannot be larger than the source file

solved in https://github.com/Mas0nShi/jscHookR/commit/0a0d00b86250f6209dd8c922d7a4a7b8d49eeaad


🐞 Otel traces and logs cannot be turned off together

What is the issue?
discord conversation
Goal - I am trying to disable traces and logs both.
What I did and actaul outcome - if we set this env var OTEL_EXPORTER_OTLP_LOGS_ENDPOINT to empty value https://github.com/dagger/dagger/blob/7527e4bf607f1206afc64565fefdf78737fcef9a/sdk/go/telemetry/init.go#L125, logs exporter won't intialize(disabled)
But to disable the traces, there should not be any env var prefixed with OTEL_ https://github.com/dagger/dagger/blob/7527e4bf607f1206afc64565fefdf78737fcef9a/sdk/go/telemetry/init.go#L29, then doing so it will disable traces but then we have to remove  OTEL_EXPORTER_OTLP_LOGS_ENDPOINT, which will be enabled to check logs exporter(it comes with wierd errors in logs that endpoint is not set), so basically these settings cannot work together becasue one is not allowing other to work properly.
Expectation - traces and logs are disabled
Dagger version
v0.13.0
Steps to reproduce
No response
Log output
No response

does having all the OTEL vars unset AND being logged out result in undesirable behavior? I'm able to reproduce the annoying "can't send traces" log, but only when logged in. if I log out and unset all the OTEL vars, it's quiet and doesn't send anything.


Dependency Resolver

Enables multiple entities referring to one another to be created in a single migration.
Imperfect but (IMO) solves most non-contrived use cases

Codecov Report

Merging #24 (9f058a4) into master (47a6425) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #24   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           11        11
  Lines          482       518   +36
=========================================
+ Hits           482       518   +36

Flag
Coverage Δ

unittests
100.00% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

src/alembic_utils/pg_view.py
100.00% <ø> (ø)

src/alembic_utils/replaceable_entity.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 47a6425...9f058a4. Read the comment docs.

Codecov Report

Merging #24 (9f058a4) into master (47a6425) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #24   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           11        11
  Lines          482       518   +36
=========================================
+ Hits           482       518   +36

Flag
Coverage Δ

unittests
100.00% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

src/alembic_utils/pg_view.py
100.00% <ø> (ø)

src/alembic_utils/replaceable_entity.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 47a6425...9f058a4. Read the comment docs.


Ask for API to get debug console output

Hi, Teams! I want to write some end-to-end tests for my debugger extension, but the current vscode extension APIs seem to be not enough. What I need is to access the output log of debug console after using 'startDebugging' API to start a debug session. Could this be done with any existed api or would you consider to provide some? Thanks.

You can use the DebugSessionTracker for this and listen to output events.

Thanks, it works.


Create Release so it can be imported via SPM

SPM expects a release in semantic versioning in order to be able to import. I'd PR but that isn't possible with releases

https://github.com/Reiszecke/swift-opus/releases/tag/1.0.0

Sure, I’ll take a look.

Just cut a 0.0.1 release. Let me know if this works!

Works, thanks!


Update swagger-UI from v2.1.4 to v2.2.6

There is a lot of fixes from swagger ui.
I'm particularly interested in the problem of the api_key not being sent in header but in query even when specified in security config.

Duplicate of #384.


git push is stalled on fedora 39 when 'Syncing encrypted data to Keybase'

I encounter the following on fedora 39:
$ git push
Initializing Keybase... done.
Syncing with Keybase... done.
Preparing and encrypting: (0.00%) 0/9 objects... done.
Syncing encrypted data to Keybase: (0.00%) 0.00/171.86 KB...
# stalled forever

on
$ keybase --version
keybase version 6.2.3-20231016183016+06cb935ee3
$ git-remote-keybase --version
6.2.3-20231016183016+06cb935ee3
$ git --version
git version 2.42.0

Is there a way to provide more information?
Kind regards,
aanno

Seems to be restricted to my f39 linux system. On Win11, everything works as expected.

The problem has been caused by corrupted files in ~/.local/share/keybase/ . I delete the directory, run run_keybase and logged in again with keybase login.
I guess that one of the `*.ldb' files has been corrupted.
I guess there is room for better error reporting in this case.


Can this code suppot free-form QA task?

I noticed that the datasets supported in the code are all multiple-choice and classification types, such as IMDB, QNLI, and BoolQ. Can the code in this repository support free-form types of tasks, such as TriviaQA and NQ? For free-form QA tasks, the possible answer space is infinite. How should the CCS method allocate X+ and X- labels for such tasks?

@lauritowal @artkpv @crowsonkb @trisongz

Free form tasks, imho, can be reduced to a classification tasks by appending question and answer each time like [Original Question]  Answer: "[Sampled Answer]" Is the last answer true or false? True / False (contrast pair). And so on for multi-class


Duplicate data when having forecasted values

Bug report
System info: [Include InfluxDB version, operating system name, and other relevant details]
Influx 1.0.2
Debian Jessie
Steps to reproduce:
We have some planned energy production processes that have plannings. We are injecting the forecasts up to 5 days in advance. The day after is always filled with non-zeroes data and the last 4 days are often zeroes.
exemple: on the 22nd (@14:00), we are filling the data for the 22nd midnight to 26th midnight. The 22nd and 23rd are filled with non-zero values and 24, 25 and 26 with zeroes.
on the 23rd (@14:00), the data for the 23rd and 24 are updated with non-zeroes and the 25, 26, 27 are filled with zeroes. And so forth.
It is quite difficult to reproduce because it seems to be dependent to the current server date/time.
When the writing window is getting on the "summer time" change (March 27th this year) the zeroes are not overwritten and we get duplicate data into the measurement.
When selecting the data, if the 27 is not in the selection, only the zeroes are selected otherwise, both are.
Remark: it is more visible with zero and non zero values, but could potentially happen with any value.
Expected behavior: [What you expected to happen]
Zeroes must be overwritten
Actual behavior: [What actually happened]
Duplicated timestamp data
Additional info: [Include gist of relevant config, logs, etc.]
influx -execute "show shards" > shards.txt
`425	"tpm"	"default"	425	"2017-03-20T00:00:00Z"	"2017-03-27T00:00:00Z"	"2017-03-27T00:00:00Z"
431	"tpm"	"default"	431	"2017-03-27T00:00:00Z"	"2017-04-03T00:00:00Z"	"2017-04-03T00:00:00Z"	`

We have the same problem here and can confirm that it happens with non-zero values, too. For us, it happens independently of current server date/time or DST. Up to now, we faced the problem only when dealing with timestams ahead of the current time (forecast values).

Since it is not linked to the summer time, I've removed the quote from the title.


[Fix #7569] Make Style/YodaCondition accept __FILE__ == $0

Fixes #7569.
This PR makes Style/YodaCondition cop accept __FILE__ == $0
I think that both operands __FILE__ == $0 can be assumed to be read-only, as mentioned in #7569. If users try to assign __FILE__, an error will occur. Also, it is not usually assigned to $0 by users.
Therefore, this PR will make Style/YodaCondition cop accept both __FILE__ and $0 on the left side.
Also, this PR will change only an idiom __FILE__ == $0.

Before submitting the PR make sure the following are checked:

[x] Wrote good commit messages.
[x] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Added an entry to the Changelog if the new code introduces user-observable changes. See changelog entry format.
[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Run bundle exec rake default. It executes all tests and RuboCop for itself, and generates the documentation.

Thanks for the review!
file_constant_equal_program_name? is actually a private method. However, it is declared at the top of the file because it is a declarative code by DSL.

def_node_matcher :file_constant_equal_program_name? is actually a private method. However, it is declared at the top of the file because it is a declarative code by DSL.

That does not seem to be correct:
[4] pry(RuboCop)> Cop::Style::YodaCondition.public_instance_methods.grep /program_name/
=> [:file_constant_equal_program_name?]

I think you would need to move the definition to after private.

Oops!

a private method

This is a typo that should be written as public method.

Is __FILE__ the only such variable? I thought there were more.

Yeah, this PR only covers __FILE__ where a pragmatic use case is shown, but there may be others.

👍


feat: add automatic semver release

Description
Attempt to automate releases.
Looking into:

https://github.com/semantic-release-cargo/semantic-release-cargo
https://github.com/semantic-release/semantic-release?tab=readme-ov-file#-semantic-release

Yeah, I'm not quite sure of how it works either 😅 Was thinking of exploring further in this draft.
But it seems that theoretically the "prepare" step (source code) modifies the Cargo.toml file. But not sure how it does it without knowing "how to commit" 🤔


Disable delete action when user is locked (task #6800)

A user can be deleted only and only if:

User is not the system user defined in .env
User is not the currently logged in user

Codecov Report

Merging #600 into master will increase coverage by 0.21%.
The diff coverage is 100%.

@@             Coverage Diff              @@
##             master     #600      +/-   ##
============================================
+ Coverage     33.02%   33.24%   +0.21%
- Complexity     1096     1099       +3
============================================
  Files            99       99
  Lines          3691     3703      +12
============================================
+ Hits           1219     1231      +12
  Misses         2472     2472

Impacted Files
Coverage Δ
Complexity Δ

src/Controller/UsersController.php
68.13% <100%> (+4.84%)
23 <3> (+3)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cd0eeea...986278a. Read the comment docs.


Warning double conditional visibility

Hi @tblanke
As we discussed previously, add_link_2_show() and show_option_under_multiple_conditions cannot be stacked. This leads to potentially wrong outcomes, which do not raise any warnings to the programmer of the GUI.
I now implemented a warning for this. If one option is conditionally visible via either add_link_2_show or show_option_under_multiple_conditions, a warning is show (not raised) so the programmer is aware that there can be some unexpected behaviour.
What do you think?
Best,
@wouterpeere

You can btw see this warning already in action in the example document, where this is already the case ...


Added long-press gesture support and new delegate methods

Support for long-press gestures with new delegate methods to match.
Delegate syntax inspired (heavily) by #302 - thanks @getaaron! However the implementation differs in its use of a UILongPressGestureRecognizer.

:+1:


Fixed documentation

Removed documented parameter which does not exist anymore in
constructor.

Hi @manu-silicon, I'm your friendly neighborhood .NET Foundation Pull Request Bot (You can call me DNFBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by .NET Foundation and real humans are currently evaluating your PR.
TTYL, DNFBOT;


Java Client

Should support Android. Make sure it has enough Factory types to pass Java Style Guidelines.

When will this be available?

We're aiming to do a Java client in the next milestone (2.2) but right now there is no date on when 2.2 will be available.

Re-targetting this issue to preparing the plan and breaking it up into smaller chunks (each with it's own issue)
The work for this includes choosing the Java infrastructure we want to use (Maven, Gradle, etc.) and laying out the basic structure of the library

Started an outline for this issue here https://github.com/aspnet/SignalR/issues/2482


chmod a+x cnf-testsuite in curl_install.sh

Description
cnf-testsuite isn't executable in the archive which breaks Installation and Usage
curl_install.sh must also chmod the binary.
Types of changes:

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation update

This is confirmed working now after running the install instructions for source curl installation method:
$ ls -alhtr ./.cnf-testsuite/cnf-testsuite
-rwxr-xr-x. 1 dbentley dbentley 20M Mar  6 21:50 ./.cnf-testsuite/cnf-testsuite


SqliteDict read-only mode should not create table

The current behavior of SqliteDict is to always create the table it should operate on.  Would a PR be accepted to change this behavior, for mode='r', to not to create a table?
The behavior in sqlitedict right now is as follows:
$ python3
>>> from sqlitedict import SqliteDict
>>> db = SqliteDict('sqlite3.db', 'nonexistant-table', mode='r')
>>> <ctrl-d>
$ sqlite3 sqlite3.db
sqlite> .tables
nonexistant-table
sqlite> .quit
$

Hm, interesting question. I have no preference either way – how did this come up for you? What's your motivation, use-case where this makes a difference? CC @mpenkov thoughts?

Hm, interesting question. I have no preference either way – how did this come up for you? What's your motivation, use-case where this makes a difference? CC @mpenkov thoughts?

Yeah, I think it wouldn't be a bad idea, because it's quite unexpected to modify something by opening it for reading.
I think the expected behavior in the above case would be something like a ValueError being raised if the table does not exist.

Yeah, I think it wouldn't be a bad idea, because it's quite unexpected to modify something by opening it for reading.
I think the expected behavior in the above case would be something like a ValueError being raised if the table does not exist.

I would like to keep things fairly consistent with how things work right now.  Raising an exception would be a new workflow.
I think it would be reasonable for .commit to raise an exception on a read-only db but it should be OK to open a SqliteDict without problem even if the table does not exist.
>>> d=SqliteDict('foo.db', flag='r')
>>> d['foo']='bar'
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/site-packages/sqlitedict.py", line 249, in __setitem__
    raise RuntimeError('Refusing to write to read-only SqliteDict')
RuntimeError: Refusing to write to read-only SqliteDict
>>> d.commit()
>>> d
SqliteDict(foo.db)
>>> dict(d)
{}
>>>

I would like to keep things fairly consistent with how things work right now.  Raising an exception would be a new workflow.
I think it would be reasonable for .commit to raise an exception on a read-only db but it should be OK to open a SqliteDict without problem even if the table does not exist.
>>> d=SqliteDict('foo.db', flag='r')
>>> d['foo']='bar'
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.9/site-packages/sqlitedict.py", line 249, in __setitem__
    raise RuntimeError('Refusing to write to read-only SqliteDict')
RuntimeError: Refusing to write to read-only SqliteDict
>>> d.commit()
>>> d
SqliteDict(foo.db)
>>> dict(d)
{}
>>>

Hm, interesting question. I have no preference either way – how did this come up for you? What's your motivation, use-case where this makes a difference?
CC @mpenkov thoughts?

The use case is somewhat bespoke but IMO not unreasonable. I am using SqliteDict to store user account data and I am bolting on an authentication workflow onto this now. The table name is basically the username and the dict is all the user account data for that user.  In the authentication workflow the auth service checks the passwd field in the user account details (stored as a SqliteDict). However, if the username does not exist I do not want the db to change. So, I either have to store valid usernames in a separate db or allow rouge usernames to be created by the auth service.

Internet botnet tries to login as "admin", "root" etc.
reverse proxy calls out to auth service
auth service probes Sqlite('accounts.db', username) for the 'password' field (pw hash)
If they match, allow request, otherwise deny.

The problem right now is that in step 3 the auth service will populate the db with random username that people are trying to login as. Valid or invalid.

Hm, interesting question. I have no preference either way – how did this come up for you? What's your motivation, use-case where this makes a difference?
CC @mpenkov thoughts?

The use case is somewhat bespoke but IMO not unreasonable. I am using SqliteDict to store user account data and I am bolting on an authentication workflow onto this now. The table name is basically the username and the dict is all the user account data for that user.  In the authentication workflow the auth service checks the passwd field in the user account details (stored as a SqliteDict). However, if the username does not exist I do not want the db to change. So, I either have to store valid usernames in a separate db or allow rouge usernames to be created by the auth service.

Internet botnet tries to login as "admin", "root" etc.
reverse proxy calls out to auth service
auth service probes Sqlite('accounts.db', username) for the 'password' field (pw hash)
If they match, allow request, otherwise deny.

The problem right now is that in step 3 the auth service will populate the db with random username that people are trying to login as. Valid or invalid.

Thanks, that makes sense. Yes, a separate table (not DB) with valid usernames makes sense – as long as you can keep it in sync with the corresponding user tables (atomic operations).

.commit to raise an exception on a read-only db but it should be OK to open a SqliteDict without problem even if the table does not exist.

Isn't that what happens now? I don't follow.

Thanks, that makes sense. Yes, a separate table (not DB) with valid usernames makes sense – as long as you can keep it in sync with the corresponding user tables (atomic operations).

.commit to raise an exception on a read-only db but it should be OK to open a SqliteDict without problem even if the table does not exist.

Isn't that what happens now? I don't follow.

Isn't that what happens now? I don't follow.

Per my example it does not look like .commit raises an exception on a read-only db.  It does however raise an exception on assignment. I am not sure that I agree that the semantics are right.  IMO it should raise an exception on commit and not on assignment.  If autocommit is true it should raise an exception on assignment, as that should implicitly commit.

Isn't that what happens now? I don't follow.

Per my example it does not look like .commit raises an exception on a read-only db.  It does however raise an exception on assignment. I am not sure that I agree that the semantics are right.  IMO it should raise an exception on commit and not on assignment.  If autocommit is true it should raise an exception on assignment, as that should implicitly commit.


Possible to include content from other notes in export?

Would it be possible to include content from other documents (possibly through something like https://hackage.haskell.org/package/pandoc-include) in one's conversion/export of a document? For example, if someone composed an essay out of other smaller notes, would be possible to export the entire essay from a single markdown file that pointed to those other notes under different sections?

Yes, you can use Obisidan's embedded note syntax!
Currently I think it only works if all the embedded notes are in the same folder as the main note, but that will be fixed soon. Let me know if you encounter any other issues with it.
Here's an example: if you have EssayChapter1.md etc. then the following will include that note when exported:
# My Essay
## Chapter 1
![[EssayChapter1]]
## Chapter 2
![[EssayChapter2]]
## References
![[EssayReferences]]


Setting env variables can break mesos docker deployment

Decription
When sending a REST call to marathon the env variable is declared on apps level. These environment variables are passed into the mesos task as 'os' variables. For normal mesos task this is sufficient / desired.
But there can be docker variables that you only want to pass into mesos docker run command and not onto the mesos os.
For example the 'http_proxy': we run into an issue where the image cannot be pulled from a private repository because we want to set the http_proxy on a docker container (the registry can only be contacted internally).
It would be nice if we can define env variables on a container level which are only passed to mesos docker run command (with the '-e' flag).
marathon version: 0.13.0
mesos version: 0.25.0
To reproduce:
POST http://marathon.mayfly.bol.com/v2/groups
{
  "id": "/test",
  "apps": [
    {
      "id": "ubuntu-without-path",
      "instances": 1,
      "cpus": 0.15,
      "mem": 512.0,
      "container": {
        "docker": {
          "image": "ubuntu:15.04",
          "network": "BRIDGE"
        },
        "type": "DOCKER"
      },
      "env": {
        "PATH": ""
      }
    }
  ],
  "groups": []
}

Mesos will not be able to execute its command because its PATH variable is gone. And give this result:
I0121 08:39:00.021203 11446 exec.cpp:134] Version: 0.25.0
I0121 08:39:00.023387 11481 exec.cpp:208] Executor registered on slave f78200b5-2bfa-4d2d-b425-871e55729ec5-S0
ABORT: (/tmp/mesos-build/mesos-repo/3rdparty/libprocess/src/subprocess.cpp:177): Failed to os::execvpe in childMain: No such file or directory*** Aborted at<PHONE_NUMBER> (unix time) try "date -d @1453365540" if you are using GNU date ***
PC: @     0x7f650931ecc9 (unknown)
*** SIGABRT (@0x2ce8) received by PID 11496 (TID 0x7f64fee07700) from PID 11496; stack trace: ***
    @     0x7f65096bd340 (unknown)
    @     0x7f650931ecc9 (unknown)
    @     0x7f65093220d8 (unknown)
    @           0x419b12 _Abort()
    @           0x419b4c _Abort()
    @     0x7f650b138c3b process::childMain()
    @     0x7f650b13ac6d std::_Function_handler<>::_M_invoke()
    @     0x7f650b138adc process::defaultClone()
    @     0x7f650b139972 process::subprocess()
    @     0x7f650a9907f1 Docker::run()
    @           0x4397f2 mesos::internal::docker::DockerExecutorProcess::launchTask()
    @     0x7f650b10cb61 process::ProcessManager::resume()
    @     0x7f650b10ce5f process::internal::schedule()
    @     0x7f6509e98a40 (unknown)
    @     0x7f65096b5182 start_thread
    @     0x7f65093e247d (unknown)
W0121 08:39:00.023387 11448 logging.cpp:81] RAW: Received signal SIGTERM from process 1470 of user 0; exiting

I'm also seeing this issue, although my PATH var is not empty in the marathon spec.

@jeroenwijdemans this is a Mesos bug. The Mesos fetcher should use it's own environment, without the variables from TaskInfo.
Can you please file an issue in Mesos' bug tracker?


How to change flutter default editable text long press copy,pause,select menu

Steps to Reproduce

...
...
...

Target Platform:
Target OS version/browser:
Devices:
Logs

It is the bug in Flutter itself. They going to fix it in future releases. For now you should change
child: Row(mainAxisSize: MainAxisSize.min, children: items),
in flutter/packages/flutter/lib/src/material/text_selection.dart on line 61 with
child: ListView(
scrollDirection: Axis.horizontal,
children: items,
),
More details you can find on Flutter github

Hi @gongxh13
This platform is not met for assistance on personal code.
Please see https://flutter.dev/community for resources for asking questions like this,
you may also get some help if you post it on Stack Overflow.
Closing, as this isn't an issue with Flutter itself,
if you disagree please write in the comments and I will reopen it
Thank you


Add support for Sysdig Secure compliance tasks

As well as adding support to fetch policy events by id.

@meskio unfortunately this time the build was failing for real:
+/home/travis/build/draios/python-sdc-client/test/../examples/set_secure_user_falco_rules.py [secure] /tmp/test_apis_user_rules.yaml
user falco rules set successfully
+/home/travis/build/draios/python-sdc-client/test/../examples/get_secure_user_falco_rules.py [secure]
+diff /tmp/falco_rules.yaml /tmp/test_apis_user_rules.yaml
+/home/travis/build/draios/python-sdc-client/test/../examples/delete_all_policies.py [secure]
++/home/travis/build/draios/python-sdc-client/test/../examples/list_policies.py [secure]
Traceback (most recent call last):
  File "/home/travis/build/draios/python-sdc-client/test/../examples/list_policies.py", line 49, in <module>
    res[1] = res[1]['priorities']['policyIds']
TypeError: 'tuple' object does not support item assignment
+OUT=
The command "bash test/test_secure_apis.sh" exited with 1.

Would you mind taking a look and see if you can file another PR to fix the test (or code)? Let me know if you need any help.
Thanks!

Ouch, I thought I tested. I'm looking into that.


upgrade codegen

sorry, this should have been part of the last PR

will wait to incorporate https://github.com/ShiftLeftSecurity/overflowdb/pull/355 once it's reviewed/merged/released

given there's some uncertainty about the PR, merging this now


Possible to get Air quality and temperature

Can you get this from a withings scale, I cannot find how?

@tvillingett the Withings developer API does not currently support these measures. It only support activity measures, body measures and sleep measures. Unfortunately their API is not very well supported, and I don't see this changing anytime soon.
From the Withings API FAQ: "Air quality and temperature data from the Smart Body Analyzer are currently not supported."


IPv6 problems in resolvers.conf

Hello,
I'm running this container on unraid, and use Xiaomi router, the following IPv6 address belongs to the router.
I got the following error:

nginx: [emerg] invalid IPv6 address in resolver "[fe80::6664:4aff:fe9a:3cb1%br0]" in /etc/nginx/conf.d/include/resolvers.conf:1

Could you provide the output of the following command:
docker exec -ti NginxProxyManager cat /etc/resolv.conf

I get the same errors. It is fixed by going to the file by console. Then vi resolvers.conf, then remove the %br0 at the end and it fixes it all. Not sure what is adding the %br0 to the end of the IPv6 line. Im running on unriad.

Could you provide the output of the following command:
docker exec -ti NginxProxyManager cat /etc/resolv.conf

Sorry, I forgot to review this issue for a long time.
The container log shows as follows
nginx: [emerg] invalid IPv6 address in resolver "[fe80::6664:4aff:fe9a:3cb1%br0]" in /etc/nginx/conf.d/include/resolvers.conf:1
The following is what resolv.conf contains
root@NAS:~#docker exec -ti NginxProxyManager cat /etc/resolv.conf
Generated by dhcpcd from br0.dhcp6, br0.ra
nameserver <IP_ADDRESS>
nameserver <IP_ADDRESS>
nameserver <IP_ADDRESS>
nameserver fe80::6664:4aff:fe9a:3cb1%br0

This should be fixed with the latest Docker image.


What to do with blogs that require tumblr login?

I've seen some blogs that works only after I login on tumblr website.
Is there any idea how we can implement authorization?

This is a big issue for me. Is there some way to route TumblThree through an OAuth token?

I've written a bit here about it. The newer Tumblr API v2 works with OAuth. The Code section in question would be in here.
I'll probably have some time over the next weeks too, so I might look into it as well. But I've never used OAuth, so I'm new to it as well. Maybe there is already a official or similar implementation to look at around.

Check out this wiki page. Its certainly far from the optimal solution, but everything we have so far.

Well, that didn't turn out to be a good idea.
It's probably easier than I thought to do it the manual way and parse the whole website using a library like Html Agility Pack or AngleSharp. We could use the internal .NET browser to open the login page and use the cookie container to grab all the cookies and than use them within the WebRequests and parse the results with Html Agility Pack/AngleSharp.
It's probably worth a try and I'd try it out if no one else is willing to once I've some more spare time again.

I already worked on a code for a WebSite that require login to download pages from it correctly, and it worked fine with me using cookie container and WebClient to download the pages and parse them and get images URLs and download them. as below, the issue is that looks like custom to this website , any be there are other ways which is easier and should be formalized on universal process to fit for all websites, or you can use the option login manually and open the WebBrowser control and do all your work from within it ,after you login to your site , NewDownloader application is using the same way, but IDM is more smarter and I think it has the super process to achieve this
`
CookieAwareWebClient client = new CookieAwareWebClient();
public Boolean LogintoThePage(CookieAwareWebClient client)
{
       client.Encoding = Encoding.UTF8;

        var loginData = new NameValueCollection();
        loginData.Add("login", "YourUserName");
        loginData.Add("password", "YourPassWord");
        loginData.Add("submit", "Войти");
        client.UploadValues("http://gde-fon.com/user/login", loginData);

        return IloggedSuccessfully = true;

    }

`

So, we could also use a WebDriver, which essentially is a chrome/firefox without the UI. That would also simplify the private blog access. It probably uses lots of memory and fattens the application a lot, but it sure is the most simple implementation for now.

I've actually played around with these several times. You need ajax/XMLHttpRequest in a POST request from what I've seen in the Chrome developer tools for the pagination (i.e. get the next images). But I couldn't figure out how to properly do this within C#'s HttpWebRequest and what Headers/cookies need to be send with, how to wait for the answer, etc. Does this even work without any javascript?

Okay, I've figured it out. It will probably work with the upcoming safe mode too, and we might even drop the whole api. Would be beautiful ..

This release can download private blogs that require a login. It also sends a flag in every request to get nsfs content. For this to function it uses a different server from the Tumblr.com network and a cookie for authentication.
Until this part of this branch has been included into the main branch it will stay here as a separate download. It would be nice to have a proper detection that switched between the different detection method depending on its requirement. Say you don't want to download a private/nsfw blog, than you don't have to login use the cookie for every request. If the request fails, try again with a cookie..

Should allow to bypass the safe mode and download nsfw/explict content after July 5.
Allows to download private blogs (#4).
Can grab more meta information. Someone has to parse the proper parts. I'll probably not do this.
You must login in order to do anything unlike previous releases. Even for adding a blog. Go to Settings->Authenticate and fill in your username / password in the Internet Explorer window. It will automatically close after the login process and store the cookie. Alternatively, you could also open the Internet Explorer and login there.
You can increase/remove the rate limit for crawling the website since it doesn't use the Tumblr api. But I personally wouldn't without a solid reason.
The maximum posts per pages are now 100 posts instead of 50 as it used to be with the Tumblr api. So, I would increase the post per page count as it reduces the amount of connections necessary to crawl the blog.
Pre-release for a reason: It's not well tested at all. I personally would use the latest stable release, unless you want to download a private blog, or if the stable release of TumblThree will not work anymore after July 5.

TumblThree-v<IP_ADDRESS>.zip