Services: first build: abs added

Linter check found the following problems:
The following problems have been found:
ERROR: clone/recipe/meta.yaml:14: pip_install_args: pip install should be run with --no-deps and --no-build-isolation.
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
WARNING: clone/recipe/meta.yaml:44: missing_description: The recipe is missing a description
ERROR: clone/recipe/meta.yaml:44: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:44: missing_dev_url: The recipe is missing a dev_url
ERROR: clone/recipe/meta.yaml:44: missing_license_family: The recipe is missing the about/license_family key.
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
Errors were found

Linter check found the following problems:
The following problems have been found:
WARNING: clone/recipe/meta.yaml:15: avoid_noarch: noarch: python packages should be avoided
ERROR: clone/recipe/meta.yaml:22: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: clone/recipe/meta.yaml:45: missing_dev_url: The recipe is missing a dev_url
ERROR: clone/recipe/meta.yaml:45: missing_documentation: The recipe is missing a doc_url or doc_source_url
WARNING: clone/recipe/meta.yaml:45: missing_description: The recipe is missing a description
Errors were found


add overwrite option for migrate

Codecov Report
Patch and project coverage have no change.

Comparison is base (4280cf4) 31.31% compared to head (ab8f13d) 31.31%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff            @@
##             master      #96   +/-   ##
=========================================
  Coverage     31.31%   31.31%
  Complexity       79       79
=========================================
  Files            30       30
  Lines          1536     1536
  Branches        241      241
=========================================
  Hits            481      481
  Misses          985      985
  Partials         70       70

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Protection can be deactivated easily using double slash character "//"

If I want to protect "test1" index, i'm writing to constraint, "/test1" path.
http://localhost:9200/test1?pretty

It gives me "{"status":403,"message":"Forbidden. Not authorized."}" code. But;
http://localhost:9200//test1?pretty

I can reach that index still with double slash character.

facing the same issue


Method/Property precedence logic only considers get_ / set_ and not is_

Describe the bug
On a Sprite2D class, there is a property called flip_h.  The action registration performs a precedence algorithm to favor methods rather than properties where a method is defined to access or mutate a property.  This algorithm does not account for methods that begin with the is_ prefix for boolean types.
This means for flip_h this can be accessed/mutated like this:

Since methods have precedence, the Get Flip H property shouldn't be possible.
Expected behavior
No response
Actual behavior
No response
How to Reproduce?
No response
Godot full version
No response
Orchestrator version
2.1.rc2
Additional information
No response

While our logic mostly works, its not perfect because, as seen in Sprite2D, the accessor or mutator method may be registered in an unexpected way, is_flipped_h rather than is_flip_h.  This breaks our poor-mans pattern matching algorithm.
Instead, we should propose to expose the ClassDB::get_property_setter and ClassDB::get_property_getter methods in the Godot engine so that we can retrieve the configured accessor and mutator methods without making any assumptions.

Opened https://github.com/godotengine/godot/pull/94826 in the upstream Godot repository.

Fixed in #761


Stringtie tmp folder is not deleted

Hi,
It is my first time with Stringtie v.1.3.4. Program has finished with no error. But in the gtf output folder a tmp folder still remains. Is that a problem of unsuccessful submission?
Here is the command I used:
stringtie $INPUT_BAM -l $SAMPLE -p 8 -G $REF_GFF -o $OUTPUT_GTF

Best of all,
Asuman

The tmp folder should be removed when the program exits normally. However I suppose there are situations (particularly grid environments or some network file systems) where the directory removal may fail unexpectedly even though the program otherwise finishes successfully (i.e. the output file was fully written). I have a few questions in order to further investigate this issue:

is the leftover tmp folder empty? (any files in there?)
are you running StringTie in a grid environment ? (if so, which kind?)
is the GTF output file valid ? Take a look at the last line in the file, does it appear truncated? (does it have the same number of columns as previous lines?)

If there is a file present in the tmp folder, the last line (transcript) in that file should correspond to the last transcript in the output GTF if the output GTF was written successfully. In that case I suppose the tmp folder should be ignored (or removed manually after the stringtie execution).
(Obviously if you're running multiple StringTie processes writing to the same output directory then it is possible that those tmp folders may be from other processes that are still currently running or from past failed processes.)

Thanks for your super quick reply!
I run the job on university's HPC using Slurm.
There is only one file -.gtf.tmp- remaining in the tmp folder. It does seem truncated. Column numbers are not consistent.  The last transcript is not the same for tmp and gtf file of the same sample and number of lines are very few in tmp file. That seems like a problem.
Then, I compared line counts between gtf of that particular sample(not tmp) and other samples. That seems consistent. So, I assume even though there is a tmp file only for one sample, maybe it was written out successfully.
This is what I run exactly:
for SAMPLE in $(cat $SAMPLES);
do
    INPUT_BAM=map/${SAMPLE}.bam
    OUTPUT_GTF=assembly/${SAMPLE}.gtf
    $COMMAND $INPUT_BAM -l $SAMPLE $OPTIONS -G $REF_GFF -o $OUTPUT_GTF
done

I've come to think the same as your last note. Yet, given the details above, I would like to hear a further confirmation from you.

I run the same code for another dataset. This time there were two tmp folders with the same file name. However, the file was empty.

"(Obviously if you're running multiple StringTie processes writing to the same output directory then it is possible that those tmp folders may be from other processes that are still currently running or from past failed processes.)"
Just create a new folder for each sample:
for SAMPLE in $(cat $SAMPLES);
do
INPUT_BAM=map/${SAMPLE}.bam
OUT_PATH=assembly/$SAMPLE
mkdir -pv $OUT_PATH
OUTPUT_GTF=$OUT_PATH/${SAMPLE}.gtf
stringtie $INPUT_BAM -l $SAMPLE -p 8 -G $REF_GFF -o $OUTPUT_GTF
done

"(Obviously if you're running multiple StringTie processes writing to the same output directory then it is possible that those tmp folders may be from other processes that are still currently running or from past failed processes.)"
Just create a new folder for each sample:
for SAMPLE in $(cat $SAMPLES)
do
  INPUT_BAM=map/${SAMPLE}.bam
  OUT_PATH=assembly/$SAMPLE
  mkdir -pv $OUT_PATH
  OUTPUT_GTF=$OUT_PATH/${SAMPLE}.gtf
  stringtie $INPUT_BAM -l $SAMPLE -p 8 -G $REF_GFF -o $OUTPUT_GTF
done


CI: Catch missing tables

Change Summary
Script to catch schema table files not covered in role docs files
Fixes #3025
Checklist
User Checklist

N/A

Repository Checklist

[x] My code has been rebased from devel before I start
[x] I have read the CONTRIBUTING document.
[x] My change requires a change to the documentation and documentation have been updated accordingly.
[x] I have updated molecule CI testing accordingly. (check the box if not applicable)

Let's add this to .pre-commit-config.yaml to run after the schema regeneration steps.
Print some header and the files missing tables with one table file per line.
Avoid running the function twice.

Please add an option to ignore certain files.

Please fix issues reported by pre-commit. I will move to draft, so please mark "ready for review" when it is passing CI.


Need tweak to downsync to be described in the API

#1099 added special handling depending on an annotation whose key is
const downsyncOverwriteKey = "edge.kubestellar.io/downsync-overwrite"

This is part of the API and the special behavior should be described in an API file, probably https://github.com/kubestellar/kubestellar/blob/main/pkg/apis/edge/v2alpha1/edge-placement.go

Done.


Update scala-library to 2.12.20

About this PR
📦 Updates org.scala-lang:scala-library from 2.12.19 to 2.12.20
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

🔍 Files still referring to the old version number
The following files still refer to the old version number (2.12.19).
You might want to review and update them manually.
src/main/scala/org/apache/daffodil/DaffodilPlugin.scala

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang", artifactId = "scala-library" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scala-lang", artifactId = "scala-library" }
}]

labels: library-update, early-semver-patch, semver-spec-patch, old-version-remains, commit-count:1

From the SBT Plugin Docs

sbt plugins must be compiled with Scala 2.12.x that sbt itself is compiled in. By NOT specifying scalaVersion, sbt will default to the Scala version suited for a plugin.
By default sbt plugin is compiled with whichever the sbt version you are using. Because sbt does NOT keep forward compatibility, that would typically require all of your plugin users to upgrade to the latest too. pluginCrossBuild / sbtVersion is an optional setting to compile your plugin against an older version of sbt, which allows the plugin users to choose from a range of sbt versions.

So we should probably shouldn't set scalaVersion at all. I think setting crossSbtVersion like we do now is sufficient.


custom json encoder omits None when serializing

Hi, this pull request prevents optional header fields with value None from being serialized and therefore saves a few bytes in the resulting token. This is done by creating an implementation of the rustc_serialize::Encodable trait (instead of using automatically deriving RustcEncodable).

Great, thanks!


I get a 502 error in Grafana

I really need help. All settings are completed correctly, CORS headers are connected and the plugin is connected successfully.
I wrote more about the problem in the Grafana community:
https://community.grafana.com/t/simplejson-get-502-error/31155
I can not solve the problem for 3 days

You'll have to find how the two requests differ from each other.

Sorry I don't understand. What requests do I need to compare?

The working one from postman and the one that is not working. Something is obviously wrong on your side but I have no idea what exactly. You have to find a root cause of your problem. One request is working, the other one does not, find what is different.
BTW you're using this datasource https://github.com/grafana/simple-json-datasource, not this one.

I solved this problem. When I wrote URL in JSON plugin I used localhost:5000. Need to use your local address, for example: <IP_ADDRESS>. And change "applicationUrl" in launchSettings.json


lodash.get is required in runtime dependencies

lodash.get is used here : https://github.com/PayU/api-schema-builder/blob/master/src/index.js#L2
and it's not mentioned in package.json dependencies.

thanks, will fix shortly


Need more pins because Raspberry Pi 3 has more

Thanks for that statement.
Next time please provide a description with some information in it even if it was just the "Pi 3 now has support for x number of pins would you be able to add support for that".
I will now go off and research the new pin count and find a way if identifying what version of pi the code is running on so that the project can prevent someone trying to access a pin that does not exist on Pi 2.

After checking the code this just needs closing because both the original and the changed that are fixed in pull #10 don't use predefined pins they obtain the pins from the directory setup by the GPIO controllers in the operating system.

 if (pinNumber < 1 || pinNumber > 26)
            {
                throw new ArgumentOutOfRangeException("Valid pins are between 1 and 26.");
            }

I rebuilt with pinNumber > 40 and work for me so far and we are using Raspberry Pi 3
May be you can do the same or I can make pull request, I think simplest way to implement would be RaspberryPi2GpioController implements GpioController with 26 pins and RaspberryPi3GpioController implements GpioController with 40 pins. May be something like this
RaspberryPi2GpioController : GpioController {
    RaspberryPi2GpioController() : base(26) {
        ...
    }
}

RaspberryPi3GpioController : GpioController {
    RaspberryPi2GpioController() : base(40) {
        ...
    }
}

Who stop!!!!!
you should not have access to all 40 pins, some of them pings are 3.3v and 5v others are ground and you should not have programmable control over them doing so could seriously damage your pi or the equipment your building off it, you can't just use the pins willy nilly,
So as an example me and a friend build a light sensor when the beam is broken we wanted to know, so we had a 3.5v (live to the LED) negative out of that to GND, 3.5v to live of the sensor, and the negative of the sensor went to a GPIO because that is the only one I needed to read data from also known as the control/state wire.
And yeah the 3.5v went to multiple sources this was via a plugboard.
But my point is out of 4 wires only 3 went to the pi and only 1 of them 3 were connected to a GPIO pin on the header

Thank you reminding sir :D but I have a project to finish by tomorrow :disappointed:  and all pins we need will be staticly embeded to code, so everything will be fine until next programmer :smile:

I was reading this lib code to use outside the raspberry pi platform, this code restriction really sucks, if you wanna create a cross-platform lib you should not restrict to only one hardware platform.
If you wanna protect the gpio some platform selection should be developed, so the developer is able to define specific restrictions without changes in the lib.

@viniciusmiguel
What are you on about this uses technology specifically implemented in the raspberry pi, clearly, you have no idea how hardware communication works the GPIO is not directly tied into the OS as Raw ports. It goes through a GPIO controller chip on the Rasberry Pi. In this case, that controller chips' Drivers use a File System handler this library sits on top of that Driver.
It is not a Low-Level cross-platform driver and just so your aware they are impossible no hardware on this planet has a cross-platform driver you have them developed for each OS and each instruction set.
Just so you know this lib uses Paths they are different on Nix to Windows because the Whole Filesystem structure is different on nix to windows, /home/{user} vs C:\Users{user}


Correct links when hosted

The links w/ .md do not work. If you remove .md then they work.

I believe we'd like to fix this when the site is generated so the links still work when hosted as Markdown on github.com vs the HTML version on electron.atom.io
I believe if the .md extensions are removed then the links won't work when rendered on pages like https://github.com/lonnylot/electron/blob/patch-1/docs/tutorial/desktop-environment-integration.md
Refs https://github.com/atom/electron.atom.io/issues/150
/cc @jlord any thoughts on this one

I believe we'd like to fix this when the site is generated so the links still work when hosted as Markdown on github.com vs the HTML version on electron.atom.io

Yep, we keep the files here as-is and then process them for electron.atom.io in atom/electron.atom.io. This file is parsing for .md but looks like it's missing some. I'll close this out here as the fix needs to happen over there and has an issue opened where @kevinsawicki mentioned: https://github.com/atom/electron.atom.io/issues/150


Update README.md

@sanatgarg this destroys the Markdown syntax and breaks the link. What does this PR intend?

I think this can be safely closed. Seems like it was made in error.


On system with nsscache required "cannot find name for user"

Issue description
I just tried to use Nixops on a new system, this system is managed by puppet and has the following in /etc/nsswitch.conf:
passwd:         files cache

Which means that it's using the following nss module:
https://github.com/google/nsscache
https://github.com/google/libnss-cache
This has thus very similar symptoms (and workarounds) as #31700 but it's a different issue.
Running strace over whoami shows this:
open("/nix/store/g1g31ah55xdia1jdqabv1imf6mcw0nb1-glibc-2.25-49/lib/libnss_cache.so.2", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)

I see that nsscache is not available in nixpkgs, and I can thus volunteer to package it (when I'll find time for it, unfortunately). But even by having it available, I'm not sure what would be the best way forward:
Adding it as a dependency of glibc seems a bit heavy handed, given that most people won't need it. Should we expect users that require this to create an overlay to add it as a dependency of glibc? (but this means that all their packages will need to be rebuilt from scratch, without being able to rely on the binary caches)
A possible workaround is to set LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libnss_cache.so.2 (or whatever is the path to the libnss_cache)
Steps to reproduce
> nix run nixpkgs.coreutils -c whoami
whoami: cannot find name for user ID 498066

Technical details

system: "x86_64-linux"
host os: Linux 4.9.0-5-amd64, Debian GNU/Linux, noversion
multi-user?: no
sandbox: no
version: nix-env (Nix) 2.0
channels(berdario): "nixpkgs-18.03pre129212.098c7f3d945"
nixpkgs: /nix/store/lmg9r94g2dq9prd87n8jzcdga6nglmk7-cfc4fcf05293f15d02a1f6358e24ec389d7f9b30.tar.gz

Enable NSCD and set system.nssModules similar to how sssd does it.

Uhm, good to know. But in this case it's not a system service. Every
program that requires to find information from /etc/passwd seems to have a
dependency on it (whoami, sudo, ssh, etc.)... So I don't think I can change
the LD_LIBRARY_PATH of a single system
Sent from mobile. Please excuse my brevity.
On 4 Mar 2018 16:14, "Tuomas Tynkkynen"<EMAIL_ADDRESS>wrote:

That was the suggestion; i.e. to enable NSCD as a system service from your distro. In fact if you do that, you don't even need to package nsscache at all and just use the version from your distro.

I'm running into the same problem, but with sssd and libnss_sss.so.  Assuming that we don't want to modify the host OS (RHEL 7.4 in my case), is the best way forward to set an overlay that adds sssd as a dependency of glibc, as berdario suggests?

I'd also love to know if there is a better solution than setting LD_LIBRARY_PATH?

I've been using this successfully on RedHat 7.4 for the last 8+ months:
  glibc = super.glibc.overrideAttrs(old: {
    # By default, it only supports LC_ALL=C, not en_US.UTF-8
    installLocales = true;

    # Hack: this adds the RedHat SSSD library in a location where anything using
    # the NixPkgs glibc can find it. Ideally this would depend on
    # ${super.sssd}/lib/ instead of /lib64, since that would keep the
    # dependencies closed in NixPkgs, however adding a sssd dependency in glibc
    # creates a circular dependency. We could add sssd to the stdenv multi-phase
    # bootstrap processes, but doing so would drag a large number of packages
    # into stdenv and is much more complicated to implement.
    postInstall = old.postInstall + ''
      ln -s /lib64/libnss_sss.so.2 $out/lib/libnss_sss.so.2
    '';
  });

As @berdario mentions, the libnss_xxx.so library is a dependency of glibc itself and is needed to resolve uid, gid, etc. lookups; this means just about every package on the system needs a glibc that can find this shared library.  Rather than modifying user and application environments, the above puts a symlink next to the NixPkg glibc.  This obviously is going to blow your build cache for just about everything, but it does let you avoid having to set env vars for basic system utilities to work.
(I noticed that the glibcLocales package wasn't being brought in the way you'd expect, so that's there too.)
If someone has suggestions for a pure solution I'd be eager to hear it!

As suggested by @dezgeg, simply installing and enabling nscd on your distro (and disabling its caching as done in nixpkgs' nscd.conf will cause the glibc used for nix-built packages to use whatever nss modules are available on your system, including nsscache.


Attachment not encrypted with PGP

When writing new email, attachment is not encrypted, only the text. This is a security issue.

I'm using openkeychain as the pgp agent btw.

Thanks for your report. What version of k-9 are you using? If you are not on the alpha channel, this is a known issue that is already fixed in an upcoming release.
(There is a reason we have that template, btw)

I'm using k-9 from Fdroid standard repository, in how long it would be upgraded in this repo? Thanks for your reply @Valodim

You should receive an update from F-Droid once we make an official release (soon).

I think it's related to this issue:
Since the update to v5.200, K-9 doesn't decrypt an email with attachments any more.
The email text stays encrypted and the attachment can be opened.
Before the update, it was successfully decrypted, so a new bug or something must have slipped in 😕

@noplanman: Make sure OpenKeychain is selected as crypto provider and the correct key is configured. If it still doesn't work please open a new issue with exact steps on how to reproduce this.

@cketti Seems like I'm having this issue with just one email that I received and can't seem to reproduce it 😕
If it does happen again, I'll open a new issue.


base_select macro and combine property enhancement

Description & motivation
combine_property_data macro
Switch to use if not should_full_refresh() rather than the is_incremental() macro as the is_incremental does not work in pre-hooks.
Additionally, this allows users to set the base_ga4__events config to use +full-refresh: false in the model config block as cloning on full-refreshes is prone to timing out.
This resolves issue https://github.com/Velir/dbt-ga4/issues/161.
base_select macro
Switch base_ga4__events and base_ga4__events_intraday to use a macro to set the contents of their select statements in order to make them easier to keep in sync and maintain.
documentation
Added documentation recommending an increase to the BigQuery timeout settings when using multi-site to circumvent issue https://github.com/Velir/dbt-ga4/issues/160.
Checklist

[y ] I have verified that these changes work locally
[y ] I have updated the README.md (if applicable)
[ n/a] I have added tests & descriptions to my models (and macros if applicable)
[ y] I have run dbt test and python -m pytest . to validate existing tests

hey @dgitis, I think that's a great idea to have a base_select macro, so that users like me can change how some event_params are selected, right?
I've started to use dbt for an enterprise client and i've taken a lot of inspiration from this package. In our implementation, several event_params can be recorded in different data types (see https://github.com/Velir/dbt-ga4/issues/129). Which means that in my base_ model, I sometimes need to do:
        (select COALESCE(value.string_value, cast(value.int_value as string), cast(value.double_value as string)) from UNNEST(event_params) where key = 'my_event_param') as my_event_param,

Otherwise, I would lose a lot of values, if I selected only value.string_value for example.
To add more complexity, we have several GA4 properties (several sub-domains for example) that we use with dbt. And the implementation for each of these GA4 properties can be different. In one property, ga_session_id is recorded as a STRING in BigQuery; in another property, it's recorded as an INT. Do you think I would be able to handle that, with the base_select macro?


How to convert tensor to cv::Mat or float array?

hi.
I'm working on segmentation task.
I successfully load my pre-trained model and get output tensor that has shape (1, 512, 1024).
I want to convert output tensor to cv::Mat.
Any comments is thanks for me :)

Hi @seungtaek94
You can get your result in an std::vector with tensor::get_data<T>(). Then you can create a cv::Mat and put the data there:
//create Mat from vector
vector<float> output_vector = output_tensor.get_data<float>();
Mat m = Mat(512, 1024, CV_32F);
memcpy(m.data, output_vector.data(), output_vector.size()*sizeof(float));

Change float and CV_32F with your type. I haven't tried this, but I guess it should be something similar.
Hope it works!

@serizba Thanks for your reply.
It works for me with few change. Thanks :)
and another..
How can i make tensor from cv::Mat(CV_8UC3,  3x512x1024)?

Hi, you can create a vector first, and then create a tensor:
// Read image
cv::Mat img = cv::imread("test.jpg", cv::IMREAD_COLOR);
int rows = img.rows; int cols = img.cols; int channels = img.channels();

// Put image in tensor
std::vector<uint8_t > img_data;
img_data.assign(img.data, img.data + img.total() * channels);
auto img_tensor = cppflow::tensor(img_data, {rows, cols, channels});

Something similar to this.
Hope  it helps!

@serizba
thanks, its really helps for me :)

Hi , I am also working on segmenation problem. The model was trained and succecssfully loaded to c++ using the method suggested.  I was tring to threshold my model output to generate a binary image . I want to threshold the pixles to certain value and make all pixles either 1 or 0 based on the thresholding reference.  here is what I tried based on my search  : -
cppflow::model model("model_abdomen");
auto output_tensor = model_abdomen(input);
output_tensor = tf.where(output_tensor >0.5, 1, 0)    -- hoping to threshold my output at 0.5 , i,e if pixle is > 0.5 1 else 0 .
Cany anyone help me to share how to put "output_tensor = tf.where(output_tensor >0.5, 1, 0)" from cppflow , can I simple do cppflow::tensorflow.where ....
In addition , what is the function to change tensorf to image in c++ using the cppflow interfece ..
Thank you.


Two GetString

Describe the bug
when I use the getString function it only lets me receive one. Why when I try to use that same function for the second time it appears in the unknown error serial
Screenshots

I use Esp8266 - 01
My version to arduino is Arduino IDE 2.0.4
How can I solve this problem?

You have problem with your logic. When you call  fbdo.errorReason() without anything error, it will give unknow error.

If any function takes the fbdo as the argument and that function returns true from operation, if you call fbdo.errorReason() in somewhere, it will give the result of last operation that this FirebaseData object was used before.
That's why it shows unknown error as the last use of fbdo was success.
Your program logic on the second inner if clause that checking for Firebase.ready() and millis, if the condition doesn't meet you print the fbdo.errorReason() on serial which gives "unknown error" as the previous use of fbdo has no error.
Do not post this such programming error in the issue topic. You should post on the discussions instead.


I connect to a terminal with tmux and Starship. The Starship prompt does not render correctly as it uses a Nerd Font.
Currently in iPadOS 17 custom fonts do not work via apps like Anyfont, and they’re a suboptimal experience anyway as they require adding an unsigned custom profile
Having a few nerd fonts built in will be better for more advanced users and broaden the overall appeal of the product

Questions:

How are fonts currently loaded in the app today?
Is there any plan to add a Nerd Font already?
Are there any considerations/complications to adding a new font specifically to this app?

Fonts currently only work in the text editor. Custom fonts are loaded by adding entries to the Copy Bundle Resources step in the Xcode project. Then they can be manually referenced in the CSS for the editor and Monaco Editor's api can be called to load the font.

https://github.com/thebaselab/codeapp/blob/9d95220f775f79bd71c0e856cd5868f7535b32d2/Dependencies/monaco-textmate.bundle/index.html#L12-L16
https://github.com/thebaselab/codeapp/blob/9d95220f775f79bd71c0e856cd5868f7535b32d2/CodeApp/Managers/MonacoEditor.swift#L92-L93
2. No
3. The licenses must be compatible to ours.

I think it would great if we can find a way to dynamically load fonts in the editor / terminal without bundling it in Xcode. That way we can allow custom fonts to be installed dynamically by users.

https://developer.mozilla.org/en-US/docs/Web/API/FontFace/FontFace

@bummoblizard we could use something similar to blink shell, which uses a CSS font stylesheet. I’ll also try building with a nerd font loaded in via XCode.

@bummoblizard also, thanks for being really responsive and making a great product. I’ve gone through a lot of them on iPad Pro and am glad to have found this app.

There also some other apps that can load font globally, like Fontinator

There also some other apps that can load font globally, like Fontinator

That's right. Use a font installer app to install additional fonts and it should show up in Code's settings menu. Reference: https://github.com/thebaselab/codeapp/issues/1004. For custom font in terminal, I opened this: https://github.com/thebaselab/codeapp/issues/1037.


Add Sonia's theming for the Game Maker Guide

Cute - I like monkeys.  I think this is fine for now (we're shipping now).  But I think eventually we'll want to think about theming that's more reflective of the games they're building in the skillmap....  I talked to Kiki about maybe splitting this up into a separate "Space Skillmap" where they build various different space games, and a "Platformer Skillmap" where they build a bunch of platformer games.


Unable to create a new repo: 500

When I'm trying to create or migrate a new repository, gogs is showing a big, fat "500" to me. The logs say:
[repo.go:128 CreatePost()] [E] CreatePost: initRepository: open /opt/gogs/conf/content/git-bare.zip: no such file or directory

What repo name, migrate URL did you enter?

It doesn't matter what name or URL I enter. I have tried many different, but the problem occurs with all of them. According to the logs, a zip-file which seems to be needed can't be found. Actually, the content directory mentioned in this logline doesn't exist. I installed Gogs via the Debian package manager.

Which version of gogs are you using?
Why git-bare.zip was not found?

It's <IP_ADDRESS>5 Beta.
And git-bare.zip was not found because actually it's not there.

Totally purging and re-installing it from source code has helped. Sorry for the false alarm...


Feedback for “Theme Configuration”

Hi All,
I followed your guide and tried to add a TOC to the right sidebar like the image below.

I updated the theme.config.js . But I'm not sure how to add the toc.float. Currently the TOC is shown in left sidebar under the page title.
This is my theme.config.js
import { useTheme } from 'next-themes'

export default {
  logo: () => {
    const { theme } = useTheme()

    return (
      <img
        src={theme === 'dark' ? '/images/logo/logo-white.svg' : '/images/logo/logo-grey.svg'}
        alt="Logo"
        style={{ height: '40px' }} /* Adjust as needed */
      />
    )
  },
  toc:true,
    // other configuration options
}

I guess we need to be more clear with the instructions. Maybe I missed something. Hope you can help.

It is recommended that the theme.config file uses either the .jsx or .tsx extension.
Please review the “Theme Configuration” section of the “Docs Theme” again.
https://nextra.site/docs/docs-theme/theme-configuration#table-of-contents
For the toc sidebar, toc.float is enabled by default.
Setting toc: true is not the correct way to configure it.
https://nextra.site/docs/docs-theme/theme-configuration#floating-toc
If additional options are needed, please use the following:
toc: {
    float: true,
    backToTop: true,
    title: props => {
        const { frontMatter } = useConfig();
        return frontMatter.title;
    },
    // other toc options...
}

Additional question: Have you used heading tags within the .mdx file? (For example, using markdown syntax like # or ##.)
If the issue persists even after applying all the changes, please check if the screen width is less than 768px. At that size, the TOC is merged with the sidebar.

I think @oobg sent a good answer, thank you a lot!
@sm1990 feel free to reply if something is still unclear, closing for now

@oobg thank you for your solution. There were some issues with the frontmatter in my MD too. Once I fixed them, everything worked 😀

@sm1990 , I’m glad the issue is resolved. Have a great day! :D


Content collection updates should be applied automatically

When a content collection is updated, new content and channels from the collection should be downloaded automatically and old content should be cleaned up. This is separate from #543 because it deals with content collections, which are our own model for bundles of curated content from different channels.

It's probably worth noting, with the newest Kolibri 0.16 alphas I can get a pretty good analog of what we want by creating two Kolibri instances, where one has classes set up in the Coach plugin and the other is a Learn-only instance. The end result has Kolibri automatically synchronizing assigned lessons (which show up pretty nicely in the Learn plugin) and downloading their content automatically.
In an ideal situation, we could have plenty of functionality ready to go here if we manage to converge more with upstream. At first I was wondering whether it would help if we think about our content collections stuff as a system that integrates with the Coach plugin - generating classes locally and assigning the default user as a learner. (A robot coach). Semantically that makes sense to me, but as it turns out, the new synchronization backend looks very flexible to the point that we probably don't need to do that as long as we integrate properly with these new systems.
For this task, we may want to play with ContentAssignmentManager, as well as ContentRequest. Content download / removal requests are generated for user-initiated downloads, and automatically from active content assignments: https://github.com/learningequality/kolibri/blob/v0.16.0-alpha15/kolibri/core/content/utils/content_request.py#L63-L84. Lessons and exams from the Coach plugin, for instance, generate content assignments. I think content collections could do the same ;)


Make test ordering and fatal errors in CI more obvious

In the following job, two tests failed:

K8sDemosTest
K8sUpdatesTest

https://jenkins.cilium.io/job/Cilium-PR-K8s-1.17-kernel-4.19/75
As it turns out, the updates test failed because of Cilium going into CrashLoopBackoff and fataling. However the CI does not bubble this error up to the top and make it obvious:
2020-12-15T18:54:52.782864835Z level=fatal msg="Unknown IPAM backend hostscope" subsys=ipam

The Updates test is not directly linked under the "Test result" section, so at a glance it doesn't look like that test even failed
Clicking through to the K8sUpdates test failure page does have evidence of the pods in CrashLoopBackoff way down in the page, but it doesn't have any representation of the "fatal" message or "ipam" or similar.

Furthermore, from the main test failure page, the order of tests was not obvious. This made it difficult to pinpoint that:

First, the failure in the k8sUpdatesTest occurred due to the problem above, then
Secondly, because k8sUpdatesTest  failed and did not put the environment back into a clean state afterwards, the second (K8sDemosTest) test failed with other errors that suggested some kind of map upgrade type issue.

It's hard to know where to start with investigating a CI failure like this, but in general it is very useful to start with the first failure and then work forward with that context so that you may know what types of failures occurred in earlier tests and how they may impact later tests.
For what it's worth, I think the fatal error message item here is easily actionable (and @aditighag volunteered to look into it), but I'm less sure how we would make the test ordering type stuff more obvious.

However the CI does not bubble this error up to the top and make it obvious:

Indeed! We seem to be filtering error messages as seen from this comment in the test output -
FAIL: Found 20 Cilium logs matching list of errors that must be investigated
Fatal messages should be highlighted more prominently.

I looked at how we highlight certain errors, and as it turns out, we have a repository of static strings [1] to match these errors. However, there doesn't seem to be any straightforward way (e.g., marker) of distinguishing fatal messages from regular error messages. I'll continue to look into this.
[1] https://github.com/cilium/cilium/blob/master/test/helpers/cons.go#L296

This is no longer an issue today with individual test suites getting their own VMs on GHA. What happens in one suite does not affect the other. Closing as completed.


Travis

Could you please enable this project on travis?
Login on travis and add this repo

@JKhakpour , Could you please enable this project on travis?
Login on travis and add this repo

Done!

Thanks, awesome


Make persisting optional

Summary

breaks getFlags by changing it from getFlags(user) to getFlags({ user })
introduces a persistUser option to useFlags and getFlags and makes persisting users in HappyKit opt-in
introduces an application-wide default setting called persistUsers to configure()

Details
When you send a user to HappyKit with useFlags({ user: {key: "xxx"} }) that user is stored in HappyKit, along with all the provided attributes. This is done so you're able to see the users of your flags in the HappyKit dashboard.
Whether you persist a user or not doesn't affect how that users flags are evaluated. It is purely done to provide more complete data in the HappyKit Flags Dashboard.
Until now all users were always stored in HappyKit Flags automatically. However, sites with high user counts wouldn't want to flood their dashboard with all their users. Instead, they might want to send individual users only (like team members).
To enable this, persistent users are now opt-in. You can set this via configure({ persistUsers: true }) globally, or on a per-user basis via useFlags({ persistUser: true, user: { key: "xxx" } }). For example, you can use this to only persist team members by setting persistUser on a per-user basis: useFlags({ persistUser: isTeamMember, user: { key: "xxx" } }).
getFlags supports the persistUser option too. To enable this, getFlags now accepts an object similar to useFlags.
BREAKING CHANGE

breaks getFlags by changing the API from getFlags(user) to getFlags({ user })

This will be solved differently in the upcoming version of @happykit/flags.
In cas anybody is reading this, persisting users has been disabled in the backend, but will be possible again with the upcoming @happykit/flags.


Numbers of speakers outdated

Currently Hindi is on the 2nd place of the native speakers and not Spanish. On the third place there is English and on the fourth Spanish.
Of course could could also change the numbers to show the total speakers of the language (and not the native ones).

Thanks for letting me know! If you’d like, speakers is the correct place to change that info. I’d rather not use this data in speakers though: using different datasets makes the numbers rather unreliable.
This info is pretty meaningless for franc too, as franc uses it to determine which languages are included in the browser builds, and Hindi and Spanish will both be in every pre-built distribution whether the data is updated or not.
If you can find some source, other than OHCHR, which has as many or more languages I’d love to incorporate newer numbers though!


date_preset value error

Hi @fredericharnois
Many thanks for the code, it will help me a lot.
I have an issue related with the value of date_preset parameter.
I see in the documentation the accepted values are:
today, yesterday, this_month, last_month, this_quarter, lifetime, last_3d, last_7d, last_14d, last_28d, last_30d, last_90d, last_week_mon_sun, last_week_sun_sat, last_quarter, last_year, this_week_mon_today, this_week_sun_today, this_year, but whatever value I use i get the following error:
Exception: Request failed for https://graph.facebook.com returned code 400. Truncated server response: {"error":{"message":"(#100) date_preset is not valid for fields param. please check https://developers.facebook.com/docs/marketing-api/referen... (use muteHttpExceptions option to examine full response). (line 50, file "Code")
My code is:
const TIME_RANGE = 'yesterday';
const facebookUrl = https://graph.facebook.com/v6.0/act_${AD_ACCOUNT_ID}/insights?level=${LEVEL}&fields=${FIELDS}&date_preset=${TIME_RANGE}&access_token=${TOKEN}&time_increment=${TIME_INCREMENT}&limit=5000;
Can you help me with this issue?
Thanks a lot!

Hi @AlexJS-dev
Glad this project can help out!
Could you give me more information as to what is being passed in FIELDS?
Also, just to be sure, in your actual code, are there backticks (`) around the URL?
Thanks!

Hi @fredericharnois ,
Thanks for your reply.
Please see my code below(I will not display here the right value for token and ad account id for security reasons):
// ad account ID
const AD_ACCOUNT_ID = '102042577';
// ad, adset, campaign, account
const LEVEL = 'ad';
// https://developers.facebook.com/docs/marketing-api/insights/parameters#fields
const FIELDS = 'campaign_name, adset_name, ad_name, date_preset, reach, impressions, spend, cpm, inline_link_clicks, inline_link_click_ctr, cpc, conversions, conversion_values, cost_per_conversion, purchase_roas, actions';
// https://developers.facebook.com/docs/marketing-api/insights/parameters#param
const TIME_RANGE = 'yesterday';
// user access token linked to a Facebook app
const TOKEN = 'EAAZBMSK3S'
// number of days from 1 to 90
const TIME_INCREMENT = 1;
// https://developers.facebook.com/docs/marketing-api/insights/parameters#param
const FILTERING = [{'field':'action_type','operator':'IN','value':['offsite_conversion.fb_pixel_purchase', 'value' ,'link_click']}]
// DO NOT MODIFY ANYTHING BELOW //
function requestFacebookReport() {
// Builds the Facebook Ads Insights API URL
const facebookUrl = https://graph.facebook.com/v6.0/act_${AD_ACCOUNT_ID}/insights?level=${LEVEL}&fields=${FIELDS}&date_preset=${TIME_RANGE}&access_token=${TOKEN}&time_increment=${TIME_INCREMENT}&limit=5000;
const encodedFacebookUrl = encodeURI(facebookUrl);
const options = {
'method' : 'post'
};
// Fetches & parses the URL
const fetchRequest = UrlFetchApp.fetch(encodedFacebookUrl, options);
const results = JSON.parse(fetchRequest.getContentText());
// Caches the report run ID
const reportId = results.report_run_id;
const cache = CacheService.getScriptCache();
const cached = cache.get('campaign-report-id');
if (cached != null) {
cache.put('campaign-report-id', [], 1);
Utilities.sleep(1001);
cache.put('campaign-report-id', reportId, 21600);
} else {
cache.put('campaign-report-id', reportId, 21600);
};
Logger.log(cache.get('campaign-report-id'));
}

I discovered the error, i place date_preset as a field. Thanks anyway. i will close the issue

@Alex-git-code Can you please tell me what did you did exactly to make your code work?


Fix refund details on order details page

I want to merge this change because... it:

adds missing refund amount to order history
merge repeated the same order lines in the refunded products section

Feature branch: https://github.com/mirumee/saleor-dashboard/pull/870

PR intended to be tested with API branch:  SALEOR-1723/4-refund-order-lines
https://github.com/mirumee/saleor/pull/6530
Screenshots

Before:

After:

Pull Request Checklist

[ ] All visible strings are translated with proper context.
[ ] All data-formatting is locale-aware (dates, numbers, and so on).
[ ] Translated strings are extracted.
[ ] Number of API calls is optimized.
[ ] The changes are tested.
[ ] Data-test are added for new elements.
[ ] Type definitions are up to date.
[ ] Changes are mentioned in the changelog.

Test environment config

API_URI=https://master.staging.saleor.rocks/graphql/

Task linked: SALEOR-1723 resolver for available lines to refund

Task linked: SALEOR-1720 Update Order Details view for refunds

Task linked: SALEOR-1719 Add new Order History entries for refunds


Fixed formatting problem

Docs Build status updates of commit c9adbe8:
:warning: Validation status: warnings

File
Status
Preview URL
Details

BingMaps/rest-services/locations/find-a-location-by-point.md
:warning:Warning
View
Details

BingMaps/rest-services/locations/find-a-location-by-point.md

Line 8, Column 13: [Warning-ms-service-subservice-invalid] Invalid value for 'ms.service': 'bing-maps'.
Line 348, Column 1: [Warning-hard-coded-locale] Link 'https://msdn.microsoft.com/en-us/library/gg427601.aspx' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 349, Column 1: [Warning-hard-coded-locale] Link 'https://msdn.microsoft.com/en-us/library/gg427607.aspx' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 2, Column 1: [Suggestion-description-missing] Missing required attribute: 'description'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit c9adbe8:
:warning: Validation status: warnings

File
Status
Preview URL
Details

BingMaps/rest-services/locations/find-a-location-by-point.md
:warning:Warning
View
Details

BingMaps/rest-services/locations/find-a-location-by-point.md

Line 8, Column 13: [Warning-ms-service-subservice-invalid] Invalid value for 'ms.service': 'bing-maps'.
Line 348, Column 1: [Warning-hard-coded-locale] Link 'https://msdn.microsoft.com/en-us/library/gg427601.aspx' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 349, Column 1: [Warning-hard-coded-locale] Link 'https://msdn.microsoft.com/en-us/library/gg427607.aspx' contains locale code 'en-us'. For localizability, remove 'en-us' from links to most Microsoft sites.
Line 2, Column 1: [Suggestion-description-missing] Missing required attribute: 'description'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Improve stream capture support

Context: #4567 added basic stream capture support but disabled calls to almost all CUDA libraries during capture (except for cuFFT, cuTENSOR, cuSPARSELt, NCCL). This meta-issue is created to track the support of each CUDA library. (The support status of each library below is recorded as of CUDA 11.5.1.)

[ ] cuBLAS: Most of the routines support stream capture, but some checks (like pointer mode) are required, see https://docs.nvidia.com/cuda/cublas/index.html#CUDA-graphs.
[ ] cuSOLVER: Does not support stream capture
[ ] cuRAND: Does not support stream capture
[x] cuFFT: Fully supported
[ ] cuSPARSE: Most of the routines support stream capture but some require the usage of cudaMallocAsync, see https://docs.nvidia.com/cuda/cusparse/index.html#optimization-notes
[ ] cuSPARSELt: Some routines support capture, see the API reference at https://docs.nvidia.com/cuda/cusparselt/functions.html?highlight=capture
[x] cuTENSOR: All routines support capture except for autotuning that CuPy does not expose, see https://docs.nvidia.com/cuda/cutensor/user_guide.html#cuda-graph-support
[ ] NCCL: Supported since NCCL 2.9, but with some caveats (ex: the capture mode), see https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/usage/cudagraph.html
[ ] cuDNN: The documentation mentions no stream capture, so assumed no support

In terms of CuPy's handling of stream capture, some room for potential improvements:

[ ] Reduce the (tiny) overhead of checking the capture status (see https://github.com/cupy/cupy/pull/4567#issuecomment-1004555831)
[ ] Change is_capturing from a method to a property? (See https://github.com/cupy/cupy/pull/4567#discussion_r778523958)

Note to self: I didn't touch NCCL/cuSPARSELt in #4567 because the way that a stream is passed to the library is different: there, the stream is an argument for all compute routines. It needs some (very minor) refactoring to check the capture status, thus I listed them on the TODO list above.

cuFFT: Fully supported

Note: This is inaccurate. We got lucky because we have a plan cache, otherwise the plan creation can't be captured.


Fix CBC Gem

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
[x] Searched the bugtracker for similar pull requests
[x] Checked the code with flake8

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[x] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
This PR fixes #936. gem.cbc.ca videos, playlists, and livestreams can now be downloaded again. Content that requires login (which is free) can also be downloaded.
I removed CBCOlympicsIE because the domain it was based on doesn't work anymore. I also removed some dead tests from the other classes.
Feel free to @ me for any future CBC issues and I'll work on them when possible.
Thanks a lot for your consistent work and maintenance of yt-dlp!

@pukkandan Made your suggested changes. Please see some of my replies or questions above. The main change left to make is separating into two extractors. I'll ping you once I've done this today.

@pukkandan I've addressed all your comments. Let me know if anything else needs changing.

and fix the valid_urls

@pukkandan

and fix the valid_urls

What do you mean by this?
Otherwise, I've made the requested changes.

and fix the valid_urls

What do you mean by this?

See the failing tests. You have multiple extractors catching the same URL pattern

@pukkandan Fixes made and all tests pass.

Thanks for merging! And for your work on yt-dlp.


Require Java 8 for compilation and execution

This bumps the source level and target to Java 8. As a side-effect, the checks for sun.misc.BASE64* are removed, as we can no longer test them.

Could you explain this a little more?  By compiling with Java 1.8 as a dependency, does this allow @SuppressModernizer to apply to local variables?  Is this all the needs to be done to resolve #155?

@rovarga Could you explain your motivations for this PR?  Does it allow @SuppressModernizer to apply to local variables?  If so can you add a test?

Closing as per https://github.com/gaul/modernizer-maven-plugin/issues/155#issuecomment-1938523448.


Enhance DLQ messages with failure info embedded to the payload

This pull request tries to enhance the DLQ with failure information in a similar way as #253
The difference is that these information is merged with the payload since Kafka 0.10.x doesn't support headers natively.

@aldex32 Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@aldex32 Thank you for signing the Contributor License Agreement!

Commit with polishing for you (and others) to review: https://github.com/garyrussell/spring-cloud-stream-binder-kafka/commit/9cb87e71fd1f7e115d2c08216b5b04c5817aa571

@garyrussell @artembilan Hi guys, what is the next step I should do? Should I bring the changes garyrussell/spring-cloud-stream-binder-kafka@9cb87e7 to my branch in order to have it merged?

@aldex32 There is nothing more for you to do if you approve of my polishing; I will merge.

@garyrussell LGTM! Please merge it :-)

Merged as f4fc9442c7932250728ee990ebb8797a6daa103b


client.text only accepts type str, not unicode

Modern linux distributions allow for unicode paths, but there is strict type checking in the Client.test method for only str type paths.  This gives errors when you have utf-8 encoded paths.
It also gives errors when you are using helper classes for path manipulation like path.py, which subclasses 'unicode' (for the above reason).

:) thanks


Wk/taco 20 reduce reuse recycle

clearing the Client stream mapping before atomically setting available in the pool
ProxyBackendHandler writeAndFlush when message is eos

Coverage increased (+0.1%) to 42.216% when pulling 62f13a94ea6d568e148357f7069959b14cb80349 on wk/TACO-20_reduce_reuse_recycle into 7117b4f5bf9ed2d45f9c738e411c2d52acb21b79 on master.


Open API docs #6

Description
This PR contains swagger-docs for /perf/ endpoint.
This PR fixes #3045
Notes for Reviewers
I wanted to point that in the excel Line 18,19,20 are marked to be consolidate under same url, I am not sure how can we shift three handlers under one. i can see the possibility of merging only 18, 19. Endpoint 20 needs to be separate as it uses both GET and POST for separate purposes
Signed commits

[x] Yes, I signed my commits.

Codecov Report

Merging #3412 (aa3453d) into master (670de3a) will decrease coverage by 1.29%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master    #3412      +/-   ##
==========================================
- Coverage   13.22%   11.93%   -1.30%
==========================================
  Files          35       35
  Lines        2782     2782
==========================================
- Hits          368      332      -36
- Misses       2322     2383      +61
+ Partials       92       67      -25

Flag
Coverage Δ

gointegrationtests
?

unittests
11.93% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

mesheryctl/internal/cli/root/perf/apply.go
53.29% <0.00%> (ø)

mesheryctl/internal/cli/root/system/check.go
1.94% <0.00%> (-34.96%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 670de3a...aa3453d. Read the comment docs.

@kumarabd I wanted to point that in the excel Line 18,19,20 are marked to be consolidated under same URL, I am not sure how can we shift three handlers under one. I can see the possibility of merging only 18, 19. Endpoint 20 needs to be separate as it uses both GET and POST for separate purposes.

@navendu-pottekkat @kumarabd  plus I think /perf/result is supposed to change into  /perf/profile/result/{id} not /perf/profile/{id}/result/{id}

@navendu-pottekkat @kumarabd plus I think /perf/result is supposed to change into /perf/profile/result/{id} not /perf/profile/{id}/result/{id}

We need to get the result with an id from a performance profile with an id, so I think it is correct? Could you check if this is indeed feasible?

@navendu-pottekkat @kumarabd plus I think /perf/result is supposed to change into /perf/profile/result/{id} not /perf/profile/{id}/result/{id}

We need to get the result with an id from a performance profile with an id, so I think it is correct? Could you check if this is indeed feasible?

@navendu-pottekkat I checked the handler which was working with only result-id, no profile-id there.

@dhruv0000 It's fixed! Could you run it locally too?


set institution and external urls in the department profiles

this is similar to issue #8
the website is only displaying the name of the departmet but not the university it belongs, and maybe additional information
would be good
@restrepo something else is needed?

Also in Facultades

pipeline for add extra information https://github.com/colav-playground/hunabku_impactu/commit/6a2cf1306f06125a27364ff391079979fd6557c9


fix: chain provider and test transform

On the main branch, only one transform is ever executed. When both a provider and a test transform are defined, only the test transform is called. After this PR, both transformed are called. First the provider transform is called and then the test transform.

Thank you @fvdnabee for fixing this.


Using sigh gym + match gym causes later gym archive to fail

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I have read the Contribution Guidelines

Issue Description
A couple of days ago our certificate ran out so we decided to check out match.
After getting it up and running everyting was working, until we tried to run our submit lane.
I'm not sure which tool this is an issue with, but I suspect an issue with gym.
We are still dependant on using sigh for enterprise profiles and we submit to your hockey app
a beta build and right after we submit an ipa to apple.
It failed to archive the ipa for appstore.
Complete output when running fastlane, including the stack trace and command used
+-------------------------------------+-----------------------------------------------+
|                               Summary for sigh 1.9.0                                |
+-------------------------------------+-----------------------------------------------+
| username                            |  |
| app_identifier                      | com.plainvanillagames.quizup.beta             |
| skip_install                        | true                                          |
| adhoc                               | false                                         |
| development                         | false                                         |
| force                               | false                                         |
| ignore_profiles_with_different_name | false                                         |
| skip_fetch_profiles                 | false                                         |
| skip_certificate_verification       | false                                         |
+-------------------------------------+-----------------------------------------------+

[09:37:11]: Starting login with user ''
[09:37:15]: Successfully logged in
[09:37:15]: Fetching profiles...
[09:37:18]: Found 1 matching profile(s)
[09:37:18]: Downloading provisioning profile...
[09:37:18]: Successfully downloaded provisioning profile...
/jenkins/workspace/Submit/ios/InHouse_com.plainvanillagames.quizup.beta.mobileprovision
[09:37:18]: Setting Provisioning Profile type to 'enterprise'
[09:37:18]: Cruising back to lane 'ios submit' 🚘
[09:37:18]: ----------------------------------------------------
[09:37:18]: --- Step: Switch to ios submit_ipa_to_apple lane ---
[09:37:18]: ----------------------------------------------------
[09:37:18]: Cruising over to lane 'ios submit_ipa_to_apple' 🚖
[09:37:18]: -------------------
[09:37:18]: --- Step: match ---
[09:37:18]: -------------------

+-----------------------+----------------------------------------------------------------+
|                                Summary for match 0.6.2                                 |
+-----------------------+----------------------------------------------------------------+
| git_url               | git_url |
| app_identifier        | com.plainvanillacorp.quizup                                    |
| type                  | appstore                                                       |
| git_branch            | master                                                         |
| username              |                             |
| keychain_name         | login.keychain                                                 |
| readonly              | false                                                          |
| verbose               | false                                                          |
| force                 | false                                                          |
| shallow_clone         | false                                                          |
| force_for_new_devices | false                                                          |
| skip_docs             | false                                                          |
+-----------------------+----------------------------------------------------------------+

[09:37:19]: Cloning remote git repo...
[09:37:21]: 🔓  Successfully decrypted certificates repo
[09:37:21]: Verifying that the certificate and profile are still valid on the Dev Portal...
[09:37:24]: Installing certificate...
[09:37:25]: Installing provisioning profile...

+----------------------+-------------------------------------------+
|                  Installed Provisioning Profile                  |
+----------------------+-------------------------------------------+
| App Identifier       | com.plainvanillacorp.quizup               |
| Type                 | appstore                                  |
| UUID                 | xxxxxxxx-xxxx-xxxx-xxx-xxxxxxxxxxxxx      |
| Environment Variable | sigh_com.plainvanillacorp.quizup_appstore |
+----------------------+-------------------------------------------+

[09:37:26]: All required keys, certificates and provisioning profiles are installed 🙌
[09:37:26]: 🔒  Successfully encrypted certificates repo
[09:37:26]: Setting Provisioning Profile type to 'app-store'
[09:37:26]: -----------------
[09:37:26]: --- Step: gym ---
[09:37:26]: -----------------
[09:37:26]: Installing provisioning profile...
[09:37:26]: xcodebuild -list -workspace QuizUp.xcworkspace

+---------------------------+----------------------------------------------------------------------+
|                                      Summary for gym 1.7.0                                       |
+---------------------------+----------------------------------------------------------------------+
| scheme                    | QuizUp (App Store)                                                   |
| workspace                 | QuizUp.xcworkspace                                                   |
| clean                     | true                                                                 |
| provisioning_profile_path | /jenkins/workspace/Submit/ios/InHouse_com.plainvanillagames.quizu... |
| export_method             | app-store                                                            |
| destination               | generic/platform=iOS                                                 |
| output_name               | QuizUp                                                               |
| output_directory          | .                                                                    |
| silent                    | false                                                                |
| buildlog_path             | ~/Library/Logs/gym                                                   |

You can see that gym still has a reference to provisioning_porifle_path and uses that profile instead of the profile installed from match. (via the $(sigh_com.plainvanillacorp.quizup.appstore) environmental variable). This caused the archive to fail because the wrong provisioning profile is selected.
Configuration Files
Fastfile:
  lane :submit_ipa do

    ensure_git_branch(branch: "ios-release")

    update_and_install_cocoapods

    # Build and send the beta to hockey
    sigh(username: ENV['ENTERPRISE_USER'],
         app_identifier: "com.plainvanillagames.quizup.beta",
         skip_install: true)
    gym(scheme: "QuizUp Enterprise",
        workspace: "QuizUp.xcworkspace",
        clean: true)
    # NOTE: hockey action will use the latest ipa and latest dsym built
    hockey(
        api_token: ENV['HOCKEY_APP_TOKEN'],
        notes: "The Official QuizUp Beta",
        public_identifier: ENV['HOCKEY_BETA_APP_ID'],
        notify: false)

    clean_build_artifacts

     # Build and send the beta to Apple
    match(git_url: "git_url",
        app_identifier: "com.plainvanillacorp.quizup",
        type: "appstore")
    gym(scheme: "QuizUp (App Store)",
        workspace: "QuizUp.xcworkspace",
        clean: true)

Environment
fastlane version (run fastlane -v):
fastlane 1.97.2 (had to downgrade but this problem also appeared on 1.100.0)
Do you use bundler to execute fastlane (i.e. bundle exec fastlane)?
Yes we use bundler
Do you use a Ruby environment manager (e.g. chruby, rbenv, rvm)?
We use rvm
Workaround
To fix this issue I added the following after clean_artifacts
so the lane now looks like:
  lane :submit_ipa do

    ensure_git_branch(branch: "ios-release")

    update_and_install_cocoapods

    # Build and send the beta to hockey
    sigh(username: ENV['ENTERPRISE_USER'],
         app_identifier: "com.plainvanillagames.quizup.beta",
         skip_install: true)
    gym(scheme: "QuizUp Enterprise",
        workspace: "QuizUp.xcworkspace",
        clean: true)
    # NOTE: hockey action will use the latest ipa and latest dsym built
    hockey(
        api_token: ENV['HOCKEY_APP_TOKEN'],
        notes: "The Official QuizUp Beta",
        public_identifier: ENV['HOCKEY_BETA_APP_ID'],
        notify: false)

    clean_build_artifacts

     # We need to clear the current profile path so the second gym doensn't try to use the beta profile
    # when archiving for app store. That causes the code signing failure as the wrong profile is used
    Actions.lane_context[Actions::SharedValues::SIGH_PROFILE_PATH] = nil

    match(git_url: "git_url",
        app_identifier: "com.plainvanillacorp.quizup",
        type: "appstore")
    gym(scheme: "QuizUp (App Store)",
        workspace: "QuizUp.xcworkspace",
        clean: true)

What is the rule of clearing lane contexts? Would it make sense for gym to clear after building? Having it as an option on gym to clear profile paths?

This might have been due to a bad project/target settings in Xcode. Closing.


Close issues

#304 - incorrect SVD (not a bug)
#247 - looks like not actual
#218, #16 - closed by #318
#250
#183, #51  - c.b. #237, #317
#190, #256  - c.b. #319
#91 - c.b. #322
#194 - c.b. #317
#116

cc @therealprof , @Emilgardis

cc @therealprof

Thanks for the triage (and all the work to resolve issues) @burrbull! I've closed most issues but leaving #16 and #116 open a little longer to ponder if they are fully resolved. But if anyone else on the team feels they can be closed please go ahead.

Oh, and I think #250 still applies - svd2rust-regress still depends on reqwest 0.8, which presumably still brings in an old ssl.


add and import lxml_html_clean

this fixes #49  by importing lxml_html_clean in setup.py and correcting the import statement in base.py.
I did not run any tests but managed to package and successfully run the local code using pip.

Just saw that my auto-formatter made it seem like a lot has been changed.
The changes are line 2 in base.py and line 27 in setup.py


trigger staging cli 0.16

Issue #, if available:
prev release number: https://github.com/aws/eks-anywhere/blob/release-0.15/release/triggers/eks-a-release/development/RELEASE_NUMBER
Description of changes:
Testing (if applicable):
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve


Modifying estimator/learner after fitting

Hi,
First of all, let me say that I really like your library: thank you very much for building it. I am trying to modify an individual estimator/learner (LinearRegression) after calling the 'fit' method. Specifically I have a 3-layer, SuperLearner and in the second layer I am using the following code:
########################################
## 2ND LAYER
# Build the second layer (potentially add more
ests_2 =     [
(‘gbr’, GradientBoostingRegressor()),
(‘rfr’, RandomForestRegressor()),
(‘lrg’, LinearRegression()),
(‘lrr’, LinearRegression()),
(‘mlp’, MLPRegressor()),
(‘knn’, KNeighborsRegressor()),
(‘xgb’, XGBRegressor()),
(‘ada’, AdaBoostRegressor())
]
pars_2_1 = {‘random_state’: seed}
pars_2_2 = {‘max_depth’: 15}
prms_2 = {‘gbr’:pars_2_1,
‘rfr’:pars_2_2}
ensemble.add(ests_2,
folds=10,
proba=False)

In the Ensemble I am doing this:
########################################
## ENSEMBLE
    ensemble.fit(X_train, y_train, estimators=estimators, param_dicts=params, scorer=long_only_scorer)

where estimators is just: estimators = {‘ests_1’: ests_1,
‘ests_2’: ests_2,
‘ests_3’: ests_3}
and after fitting, I am trying to change the 'lrr' linear regression like this:
########################################
## ENSEMBLE
    ensemble.fit(X_train, y_train, estimators=estimators, param_dicts=params, scorer=long_only_scorer)

########################################
## CHANGE CUSTOM REGRESSION HERE
#
    print(‘ensemble.layers[1].learners[3]:\n’,ensemble.layers[1].learners[3])
    lr = ensemble.layers[1].learners[3].estimator
    print(‘ensemble.layers[1].learners[3].estimator:\n’, ensemble.layers[1].learners[3].estimator)
    new_X_train = X_train[:,0,:]
    lr.fit(new_X_train, y_train)
    params = lr.get_params()
    coef = lr.coef_
    intercept = lr.intercept_
    new_coef = np.zeros(len(coef)*1000)
    if len(coef) == 247:
        new_coef[-1] = 1.0
    else:
        new_coef[-3] = 1.0
    print(‘params:\n’, params)
    print(‘coef:\n’, coef, ‘len(coef):\n’, len(coef), ‘type(coef):\n’, type(coef))
    print(‘new_coef:\n’, new_coef, ‘len(new_coef):\n’, len(new_coef), ‘type(new_coef):\n’, type(new_coef))
    print(‘intercept:\n’, intercept)
    new_intercept = 0.0
    print(‘new_intercept:\n’, new_intercept)
    ensemble.layers[1].learners[3].estimator.coef_ = new_coef
    ensemble.layers[1].learners[3].estimator.intercept_ = new_intercept
    ensemble.layers[1].learners[3].estimator = lr

This works, but I don't think that I have actually changed the learner used in the predict method. How can I check? Thank you in advance for your reply.

Meaning that in the code above I made the coef_ length ridiculously long and yet the ensemble is still working (see results below). In addition to the problem above, I would also really like to be able to see what is the input and output shape for each layer if possible (just to check). Thank you again in advance for your reply.

In-place modification on fitted instances is not trivial. Recall that you don't have one estimator, but one clone of the estimator per cv-fold plus one clone for the full training set. Thus, the estimator attribute you are changing has no effect on the fitted clones (it would  take effect if you we're to refit the ensemble).
To make an in-place change, you'd have to access the fitted instances. You can do this via the Learner.learner attribute (returns an iterator): in your code that would be
for fitted_estimator in ensemble.layers[i].learners[j].learner:
   # make your change

If you additionally want to change the fitted clones on the cv-folds:
for fitted_estimator in ensemble.layers[i].learners[j].sub_learner:
   # make your change

Hope that helps!

And to see layer-wise predictions, pass a list of layer names to the return_preds argument in the fit / predict methods (see docs or #108).

Hi Flennerhag,
Thanks for your replies. I really tried to implement your two answers but couldn't get a handle on the fitted regressions (see attached picture) using
for fitted_estimator in ensemble.layers[i].learners[j].sub_learner:
make your change
and using this I couldn't see the regression's coef_ value
for fitted_estimator in ensemble.layers[i].learners[j].learner:
make your change

Lastly even if I put return_preds=[1,2,3] or return_preds = True it doesn't work.

Hi think you solved the learner problem?
Return preds expects a list of layer names, i.e. ['layer-1', 'layer-2', 'layer-3']


DF pipeline msexports_ExecuteETL problems

Hi, we have this error in msexports_ExecuteETL pipeline. Can you help us?

@fgYanina Please deploy v0.3. This is a known issue in the v0.2 release.

I'll keep this open for a week to give you a chance to confirm.

Closing due to inactivity. Let me know if you run into any more issues and we can investigate.


Promote incubating --watch-fs command-line parameter

Summary

WatchFileSystemOption

Checklist

[x] Validate whether we should de-incubate the API in the 7.0 release.

If the removal is not possible, create a follow-up issue and link it in the overview spreadsheet

[x] Update release notes (add API to promoted features)
[x] Check User Manual (it might mention that the API is still incubating)

Think about updating snippets and samples to use this API

[x] Deprecate existing API that is replaced by the new one

If it's not immediately possible, create a follow-up issue with a milestone (e.g. 7.1 RC1 or 8.0 RC1); list for 7.1: #15681

[x] Check Incubation Report on TeamCity (example)
[ ] Mark the story as done in the overview spreadsheet.

We should do this in 6.8.1 instead, because the feature was actually made production ready in 6.8 6.7.

We should do this in 6.8.1 instead, because the feature was actually made production ready in 6.8 6.7.

This is on master now.

This is on master now.


Write tests for PatternAttributes

Reviewer checklist

[ ] Test coverage: stack test --coverage
[ ] Public API documentation: stack haddock

Old test coverage:
Top Level Definitions - 66% | 6/9
Alternatives - 82% | 14/17
Expressions - 65% | 72/110
New test coverage
Top Level Definitions - 77% | 7/9
Alternatives - 100% | 17/17
Expressions - 75% | 83/110
The functions that create proofs are never called because the proofs are not used

This also reminds me that Jenkins is no longer uploading our test coverage reports and documentation...


How to get home page?

How to get home page using path() not an id() filter?
wp.pages().id(2).... works well
wp.pages().path('/').... said wp.pages(...).path is not a function

This looks like a bad documentation issue on our end; path is not listed in the accepted parameters for the core pages endpoint, which suggests that it was removed before we merged the REST API and I did not notice to update the documentation here. Thank you for reporting the issue, we'll validate this is no longer supported and update the documentation.
Unfortunately there is no obvious way I can think of to accomplish what you want. The best I could suggest would be to .search() for the title of the homepage, or use .slug() if you know the slug for the page.

I use this kind of homepage search.
this.homePage = {}; wp.posts().perPage(100).get((error, data) => {     data.map(item => {         this.homePage = (item.sticky)? item : this.homePage;     }) })

You can register custom endpoint and get the homepage from there. See the code they used for  wuxt:
add_action('rest_api_init', 'wuxt_front_page_route');

 function wuxt_front_page_route() {
     register_rest_route('wuxt', '/v1/front-page', array(
         'methods'  => 'GET',
         'callback' => 'wuxt_get_front_page'
     ));
 }

 function wuxt_get_front_page( $object ) {

     $request  = new WP_REST_Request( 'GET', '/wp/v2/posts' );

     $frontpage_id = get_option( 'page_on_front' );
     if ( $frontpage_id ) {
         $request  = new WP_REST_Request( 'GET', '/wp/v2/pages/' . $frontpage_id );
     }

     $response = rest_do_request( $request );
     if ($response->is_error()) {
         return new WP_Error( 'wuxt_request_error', __( 'Request Error' ), array( 'status' => 500 ) );
     }

     $embed = $object->get_param( '_embed' ) !== NULL;
     $data = rest_get_server()->response_to_data( $response, $embed );

     return $data;

 }

Then you can get the homepage by calling WPAPIInstance.namespace('wuxt/v1').homepage()
I hope it helps

Thank you for the example! @panayotoff would you be comfortable with me adding this snippet to the docs as a FAQ item guide?


Calculate column value difference with first row ( or any other ? )

Hi
thanks for great plugin. I'm wondering is it possible to calculate difference, between some column, but in different rows ? For example I want to calculate difference between column 2 in each row, against column 2 in row 0 ( so row 0 will have 0 difference ).

Basically, it is not possible, sorry.
the tip that I can give would be :

do a "Cumulative Sum" metric, where inner metric is your actual "column 2 metric".
then enable "show total" and use "min" total function
finally, in computed column, use "total2" in your formula. It will reference the total of column 2, that is the min value of your "cumulative sum" column. So it is column 2 row 0.

Thanks for the reply and suggestion !


[AutoTVM] Add index boundary check in ConfigSpace.get()

Currently autotvm.task.ConfigSpace.get() can take any number. This PR adds boundary check as well as fixing some typos.

Thanks! @ymwangg @comaniac

Thanks! @ymwangg @comaniac


NotADirectoryError: [Errno 20] Not a directory: '/config/custom_components/alexa_media/translations/en.json'

2020-11-23 21:29:08 ERROR (SyncWorker_4) [homeassistant.util.json] JSON file reading failed: /config/custom_components/alexa_media/translations/en.json
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/util/json.py", line 31, in load_json
with open(filename, encoding="utf-8") as fdesc:
NotADirectoryError: [Errno 20] Not a directory: '/config/custom_components/alexa_media/translations/en.json'

Please fill out the template as it has information I need such as version.

Release 3.2.3
I did the manual installation adding the alexa_media folder from git under custom_components and got the above error in the log file. I was then able to install it from Hacs correctly. The difference i see is that the Git package has only the .translate subfolder while instead Hacs installed either .translate and traslate subfolders

You should use the HACS install as the manual install isn't supported. I guess no one updated the manual install instructions to mention creating both directories (they exist in the repo). The release zip file includes both directories so if you unzipped that file it would've had everything.
Anyway, glad you got it installed with HACS.


Issue #7272 Fixed

Issue #7272 has been fixed

@suraj-webkul
This is working fine, please find the screenshot Here

Resolve conflicts

Commits got mixed, please take help with @akathuria289 and resolve this.

@devansh-webkul Done Sir

@suraj-webkul
This is working fine, Please find the screenshot here


CIBox naming convention

We need write out naming convention that we are using.

Drupal related
all the modules and themes live in

sites/all
sites/all/modules
sites/all/modules/contrib
sites/all/modules/custom
sites/all/modules/features
sites/all/modules/patched
sites/all/modules/patches
sites/all/themes
sites/all/themes/contrib
sites/all/themes/custom

Naming custom modules
PROJECT-SHORTNAME_MODULE-NAME e.g. cibox_docs
Naming custom features
PROJECT-SHORTNAME_MODULE-NAME_feature e.g. cibox_docs_feature
Code sharing
For ability to support code sharing MODULE-NAME should be selected in relation to business logic of the module. It is not good to create modules by abstracting it our of business. All the modules, ejected to drupal.org from our past project were possible to share only because they represents some feature, tied to business.
Like

salespush - pushing data to SalesForce
acrypt - Asymetric crypt alghoritm
ans so on
It is almost impossible to create reusable module when you'll grab alltogether new features and content types, unrelated to them. Or settings, related to only this project. That's why all settings(features in Drupal world) should be splitted out of the module, tied to.
Never put logic into Drupal features. If you have a logic - put it into custom module. In the future that module have a chance to become contrib one.

I think this is enough for first iteration.

Yup, I agree


Adding error to log for unreachable cluster in machineset controller

Signed-off-by: Lalatendu Mohanty<EMAIL_ADDRESS>

/lgtm
thanks!


Using different optimizers on a trained model leads to poor test accuracy.

I have trained a convolutional neural network model using AdamOptimizer. The test accuracy is pretty good. This was expected since the validation loss was decreasing while training.
Now I restored the model weights using saver.restore() method, but this time I built the model with RMSPropOptimizer just for experimenting. Please note that I DID NOT RETRAIN THE MODEL. To my surprise, the test accuracy was horrible with the new optimizer. The accuracy becomes good again when I use the previously used AdamOptimizer.
This is peculiar in the sense that the train_op should not affect the test data results.
Below is the sample code I used for calculating the test accuracy. Please note I did not run the train_op here.
    accuracies = []

    for batchx, batchy in dataLoader.next_validation():
        # Run the graph.
        pred = sess.run(model['prediction'],
                        feed_dict={
                            model['sensor_data']: batchx,
                            model['label']: batchy
                        })

        accuracies.append(np.count_nonzero(pred == label) / pred.shape[0] * 100)

    accuracies = np.array(accuracies)
    print("Min Validation set accuracy: {} %".format(accuracies.min()))
    print("Max Validation set accuracy: {} %".format(accuracies.max()))
    print("Average Validation set accuracy: {} %".format(accuracies.mean()))

Am I missing something here? Or is this a possible bug?

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

Have I written custom code: YES
OS Platform and Distribution: Ubuntu 16.04
TensorFlow installed from pip3
TensorFlow version : 1.6.0
Bazel version: NA
CUDA/cuDNN version: Cuda Toolkit 9.0, cuDNN v7.0
GPU model and memory: GeForce GTX 860M (4GB)
Exact command to reproduce: The code is quite large :(

This question is better asked on StackOverflow since it is not a bug or feature request. There is also a larger community that reads questions there.
If you think we've misinterpreted a bug, please comment again with a clear explanation, as well as all of the information requested in the issue template. Thanks!


Getting "invalid json object"

when the code tries :
auto x = crow::json::load(req.body);
I get this error :
An uncaught exception occurred: invalid json object
Here is the full piece of code :
CROW_ROUTE(app, "/")   .methods("GET"_method, "POST"_method)   ([](const request& req, response &res){     if(req.method == "POST"_method)     {          auto x = crow::json::load(req.body);           cout <<  x["fname"] << " " << x["email"] << endl;     }       else         sendHtml(res, "index");   });
Yes i want to output the POST request body to stdout!

I believe this exception is thrown when your request body is not a proper json string, what request body are you sending?

Hi,
When outputting the req.body string to stdout it is something like:
fname=value&email=value

Hmmm, well a proper json body would be something like
{ 	"fname": "value", 	"email": "value" }
fname=value&email=value sound like URL parameters (your link would be http://website.com/endpoint?fname=value&email=value)
but I don't really know why they would be in your request body.
If you have any control over the client you're using you should either send your parameters with the URL or format them to be like the example above.

Well, this is a POST method.
I was following the example provided by @ipkn in Handling JSON Requests
This is it :
CROW_ROUTE(app, "/add_json") .methods("POST"_method) ([](const crow::request& req){     auto x = crow::json::load(req.body);     if (!x)         return crow::response(400);     int sum = x["a"].i()+x["b"].i();     std::ostringstream os;     os << sum;     return crow::response{os.str()}; });
If my code throws an exception for this then, the provided example also does.

Yes, I know that, the example is throwing an exception because the request body is not in proper json format, this is because your client is sending the body as fname=value&email=value instead of { "fname": "value", "email": "value" }.
What are you using to make the request?

I have an HTML form :
<form id="contact" action = "/" method='POST'>         <fieldset>           <input name = "fname" type="text" tabindex="1" required autofocus>         </fieldset>         <fieldset>           <input name = "email" type="email" tabindex="2" required>         </fieldset>         <fieldset>           <textarea name = "area" tabindex="5" required></textarea>         </fieldset>         <fieldset>           <button type="submit" id="contact-submit" data-submit="...Sending">Submit</button>         </fieldset>       </form>
And it is what makes the POST request in that format.
I have managed to make the form send the data in plain text by adding enctype='text/plain' so it is like this now:
<form id="contact" action = "/" method='POST' enctype='text/plain'>
And it sends the data in this format :
fname=value email=value area=value
Avoiding the URL encoding.
But it is still not a JSON object.

so this means you're sending a form, AFAIK crow doesn't currently support parsing forms, but we're working on it (see https://github.com/mrozigor/crow/issues/4).
But if you want to quickly get your form data, you can split the res.body by & then split each result by = and assign the first item as key and second as value into an unordered_map, this should give you a proper map.
crow::json can only parse strings in json format (usually sent from custom clients rather than web pages), so you shouldn't use it with form data.

That makes sense now.
Thank you .


How do I run the sample program on the Lego EV3 with Brickman without a computer?

ev3dev version: PASTE THE OUTPUT OF uname -r HERE
4.4.32-17-ev3dev-ev3

ev3dev-lang-python version:   ???

Python 3.6.0
Idle 3.6.0
Eclipse Version: Neon2 Release(4.6.2)
Brickmen v0.8.0 2014-2015
Kernal 4.4.32-17-ev3dev-ev3
Lego MindstormSEV3 Programable Brick Revision 0006
MobaXterm Pesonal Edition V9.4
ev3dev Python3.4.2((defalt,oct 8 2014:47:30
#!/usr/bin/env python3
# Above line is needed so program can be run from Brickman

# Plug a touch sensor into any sensor port
from ev3dev.ev3 import *
ts = TouchSensor()

while True:
    if ts.value()==1:   #touch sensor pressed
        Leds.set_color(Leds.LEFT, Leds.RED)
    else:
        Leds.set_color(Leds.LEFT, Leds.GREEN)

I am new to Lego EV3, EV3dev. MobaXterm, MobaTextEditor, SD card, Etcher and Python.  After reading lots of websites everthing seems to work fine.  Except for one thing.  I need to be able to run programs from the brick(Brickman) stand alone away from the computer.  The first example at EV3 Python is for the LEDs, as included here.  The shebang is in place in the first line as stated in the text.  The program runs fine from the computer.  It also seems to run on Brickman, but it does not do anything.  My reading makes me feel that I know everything I need to get started.  But I cannot find what I have missed.  Can someone tell me what else I need to do to run the program on the brick.
I have done:
MobaXterm 'Create File'
MobaTextEditor edit
chmod +x example.py
python3 example.py
  THANK YOU

It's likely that the script is throwing an error immediately, and the error message is just flashing on the screen before Brickman comes back. My best guess on the problem is that your file includes Windows-style line endings, which Linux doesn't respond well to. I'm not sure exactly how MobaXTerm works, but somewhere there should be a "line endings" option; choose "linux-style" or \n.

Take a video of the screen with your phone and see if you can catch the error?

The options in MobaTextEditor are Dos,Unix and Mac.  I thought that the
closest thing to Windows was Dos.  I changed the option to Unix and it
works fine now.  I never thought about checking the documentation for the
editor.
THANKS GUYS
On Mon, Jan 30, 2017 at 4:09 PM, Wasabi Fan<EMAIL_ADDRESS>wrote:

It's likely that the script is throwing an error immediately, and the
error message is just flashing on the screen before Brickman comes back. My
best guess on the problem is that your file includes Windows-style line
endings, which Linux doesn't respond well to. I'm not sure exactly how
MobaXTerm works, but somewhere there should be a "line endings" option;
choose "linux-style" or \n.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rhempel/ev3dev-lang-python/issues/289#issuecomment-276207675,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AV8Div_XJSDNTvvT_VhyO0nqAy0vWx6tks5rXl99gaJpZM4Lx5Dx
.

Yeah, DOS is equivalent to Windows in this case; you are looking for Linux/Unix. Glad it works!
FWIW, we have info on this (admittedly it's a bit buried): http://python-ev3dev.readthedocs.io/en/latest/faq.html


fix: prevent touch events to be executed during swipe

Summary
Fix for issue https://github.com/callstack/react-native-viewpager/issues/164
There are multiple solutions in issue i've tested this one and it works.
It contains also a few improvements like:

remove unnecessary fork of ViewPager2
change storing views approach on android

Test Plan

Compatibility

OS
Implemented

iOS
✅

Android
✅

Checklist

[x] I have tested this on a device and a simulator

https://github.com/callstack/react-native-viewpager/issues/225


Use metro-bundler

Facebook has moved react-native packager to a new repository: https://github.com/facebook/metro-bundler, which is now a dependency of react-native (>=0.46.0-rc.1).
This PR tries to use metro-bundler in its new location, fallbacking to the old location inside react-native, to maintain compatibility with react-native >=0.45

Thanks for the contribution! I will take a look some time in the next couple of days. One thing I noticed right away is that metro-bundler should not be a peer dependency. That would mean that app authors need to have it explicitly listed in their package.json, but it is provided by react-native which is already a peer dependency.

oh, you're right! fixing it

Looks great, thanks! Sorry this took me longer than expected to get around to. I'm going to do a tiny syntax clean up after merging.

Published in 1.1.0 :tada:

Thanks for your work and quick response, @ds300!