cmd/link: error if pass a very long args which contains \n character

What version of Go are you using (go version)?

$ go version
go version go1.15.3 darwin/amd64

Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
darwin
What did you do?
I build with the following command,
go build  -v -ldflags "-X 'qiniu.com/kodotest.regionNb=\'a very long string.....which contains \n characters.....\''"

get go link error.
Then I change the above command with a shorter one,
go build  -v -ldflags "-X 'qiniu.com/kodotest.regionNb=\'a short string.....which contains \n characters.....\''"

no go link error this time.
What did you expect to see?
No go link error if I pass a very long args with \n character inside.
My analysis
go1.14 and go1.13 have no such issue.
I notice that go has introduced response file to pass long args in Windows: https://go-review.googlesource.com/c/go/+/110395/7/src/cmd/go/internal/work/exec.go#2483
and enabled it for other OS in go1.15: https://github.com/golang/go/blob/f7e26467b4e7ee0bb3219c26e71292ff4aac7da9/src/cmd/go/internal/work/exec.go#L3131
response file use \n to separate args will cause this issue.

get go link error.

What error?
Could you share the exact command you run that succeeded with Go 1.14 but failed with Go 1.15? Thanks.

@cherrymui
just show link's usage message, and the return exit code is 2.
we put a INI config file's content(which contains a lot of \n) in the -ldflags.

Can you paste in exact commands you run, and the exact output? Possibly to use go build -x to give extra information.
The command you mentioned above,
go build  -v -ldflags "-X 'qiniu.com/kodotest.regionNb=\'a short string.....which contains \n characters.....\''"

short or long, when I paste it to a shell, never works on my machine with any version of Go.

Here is two example config files:
https://gist.github.com/lyyyuna/ca5e6c7720260180080689373f5e5d62
server-wrong.ini is longer than server.ini with only one extra line: a=a
cmd/link error with go1.15
go build go build -ldflags="-X 'qiniu.com/qtest.sample=`cat server-wrong.ini`'" .

get
# xxxxxxxxx
usage: link [options] main.o
  -B note
        add an ELF NT_GNU_BUILD_ID note when using ELF
  -E entry
        set entry symbol name

build success with go1.15
go build go build -ldflags="-X 'qiniu.com/qtest.sample=`cat server.ini`'" .

On darwin, in bash, I was able to reproduce this with:
uname -a Darwin jfaller-macbookpro2.roam.corp.google.com 19.5.0 Darwin Kernel Version 19.5.0: Thu Apr 30 18:25:59 PDT 2020; root:xnu-6153.121.1~7/RELEASE_X86_64 x86_6
package main

import "fmt"

var str string

func main() {
        fmt.Println(str)
}

The following fails:
go build -ldflags="-X 'main.str=`openssl rand -base64 22342`'" ./

But, this succeeds:
go build -ldflags="-X 'main.str=`openssl rand -base64 22341`'" ./

And for the people following along at home: getconf ARG_MAX = 262144.

@jeremyfaller I understand this issue was meant to be moved to NeedsFix state, is that right? When an issue doesn't have any of NeedsInvestigation, NeedsDecision, or NeedsFix labels, it appears as one that hasn't been triaged.

Sorry, my mistake for not understanding bug life cycles.
It's definitely triaged, and I have a fix. We just need to make a decision if it goes into the 1.16 release.


New Release

The current release on cargo only requires native-tls 0.1. native-tls 0.1 requires openssl 0.9 which does not support openssl 1.1.1. This means any packages depending on lettre do not compile on systems that have the most up-to-date openssl system library.
native-tls has already been updated on master. Publishing a release would allow systems with system library openssl 1.1.1 to compile their projects.

Just ran into that same problem -- the libssl1.0-dev package on Debian testing is incompatible with npm, so I am currently unable to compile anything that still requires old OpenSSL 1.0.

Yea, I would appreciate it as well, lettre just doesn't work at all on Arch because of OpenSSL.

0.8.3 is now published!

Thanks! However, version 0.8.3 still depends on openssl v0.9.24, so it still doesn't work on recent distributions unfortunately.
For now, I am depending on a git snapshot of 0.9.

I have the same problem. I wanted to try out lettre, but it doesn't compile due to an old OpenSSL version. The error message is:
error: failed to run custom build command for openssl v0.9.24process didn't exit successfully:
I have OpenSSL version 1.1.1 from 11-Sep-2018
native-tls is already available as version 0.2 and is using a newer OpenSSL version. Is there any reason why it is not used? Any backwards compatibility maybe? How easy/hard is it to upgrade to native-tls 0.2?

I think master uses native-tls 0.2, so presumably the solution would just be to cut a new relase with a version bump? @amousset is there a current blocker against doing so? The version on crates.io doesnt' build on a bunch of systems now following the release of OpenSSL 1.1.1.

I just published lettre-openssl111 and lettre-openssl111_email for those who need a non-git dependency (e.g., for crates.io publishing). I'll yank them both once this issue is resolved :)

Ping @amousset

0.9.0 has (finally) just been released, closing.

I've yanked my -openssl111 crates :)


add filter parameter operationId

trying to done  #546

schema.parametrize0 add new parameter operationId， operationId can is str or list
when the schema is instantiated, a dict (schema.schema_map) record the mapping relationship between operationid and endpoint
when call get_all_endpoints,  if has operationId than get endpoint from schema_map

Also, we use conventional commits to format commit messages - it is the reason why the check failed.
https://www.conventionalcommits.org/en/
I'll update our contribution docs accordingly

Hi, @Stranger6667
Thank you for putting forward these, which will be very helpful to me.
I'll commit again it as soon as possible.
Cheers

I switch to new way， this like similar way to other filters.
The previous way is to consider that the map efficiency will be higher when there is a unique operationId, but obviously, at present, the efficiency is not the first consideration
about Swagger , will be resolved in next commit

Before， trying to use raw_schema directly,  encountered different  between swagger and opnapi, so  need to deal with them separately.
But now, with the new filtering method, there is no such problem. Swagger and OpenAPI will be supported at the same time,, so I change PR title : )

Thanks once again @dongfangtianyu !
I'll merge it tomorrow


⚠ T:Riza Roblox Proxy has degraded performance

In e5b4600, T:Riza Roblox Proxy (https://rprxy.triza.dev) experienced degraded performance:

HTTP code: 200
Response time: 1210 ms

Resolved: T:Riza Roblox Proxy performance has improved in a319ba4.


Added feedback option.

I have added feedback option at the footer part so as to take reviews from the customer.
issue resolved- #137

Please have a look.

I guess you have not pushed your latest commit. Please check properly and make the changes

Should i make a new PR?

@Kajalmehta29 You can

Please check it i committed it to main.


T8.1.1 Requirements

update procedure

updates are published on the blockchain
wallet BE (?) will recognise a change in version number and inform wallet FE of this
wallet FE initiates the download of the new software installer and then kindly asks the user to close the wallet
a special exit code (of the wallet FE) will be recognised by the launcher to start the installer

see in Wiki: https://github.com/input-output-hk/cardano-shell/wiki/Update-mechanism
Devops contact: @cleverca22

Todo
❓  link to the specification of the block format with the software version
❓  link to the specification of the communication between wallet BE and wallet FE
❓  link to the specification/code of the launcher
-> https://github.com/input-output-hk/cardano-sl/tree/develop/tools/src/launcher
❓  link to the specification/code of the updater
-> https://github.com/input-output-hk/cardano-sl/blob/develop/lib/src/Pos/Network/Update/Download.hs
❓  link to the specification/code of the updater in the new code base

We can omit the specifications for all those things, we have one that is sufficient here - https://github.com/input-output-hk/cardano-shell/blob/master/specs/CardanoShellSpec.pdf
@HirotoShioi can focus on writing the actual update system and we can massage it into the required form, all the info he needs is in the spec and in https://github.com/input-output-hk/cardano-shell/issues/216


add Ed25519 (15) and Ed448 (16) algorithms

Please merge this @matsduf - also see #117

The makefile requires net::dns::sec 0.17 (or higher) but this would probably need bleeding edge net::dns::sec that very well may have broken backwards compat (if support even exists, these algos are insanely new). For this reason I wouldnt merge this before actual support, and non-breakage, has been confirmed properly.

@Stricted, there is one more place that should be updated to keep code in sync. It is not strictly necessary, but it is confusing otherwise. Can you update the PR?
line 73-75 (75-77) in engine/lib/DNSCheck/Test/DNSSEC.pm
     elsif ( $aid >= 13 and $aid <= 122 ) {
         return "Unassigned ($aid)";
     }

It should probably be $aid >= 17.

@matsduf good catch, fixed


[MANOPD-80822] adjust typha toleration settings

Description
By default typha pods cannot be scheduled to master nodes. In some cases it's necessary to allow typha pods to master nodes.
Fixes # (issue)
MANOPD-80822
Solution
Toleration is added for typha pods:
        - key: node-role.kubernetes.io/master
          effect: NoSchedule
        - key: node-role.kubernetes.io/control-plane
          effect: NoSchedule

How to apply
Test Cases
Deploy calico at 4+ nodes cluster, check that typha pods can be scheduled and running at master nodes.
Checklist

[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] Integration CI passed
[ ] Unit tests. If Yes list of new/changed tests with brief description
[x] There is no merge conflicts

Unit tests

Closed in favor of https://github.com/Netcracker/KubeMarine/pull/283


Default weight naming issue in Keras 3 due to 'backslashing'

The following piece of code is only compatible with the SGD optimizer. When using any other keras-type optimizer (such as Adam), the following message appears:
ValueError: Argument 'name' must be a string and cannot contain character '/'. Received: name=my_net/kernel_0_momentum
After checking, the issue seems to be related to an incompatibility of the default naming of the weight-type variables.
Coding specifications:
Python 3.12.2
Keras 3.1.0
Tensorflow 2.16.1
"""
Created on Tue Mar 19 13:37:01 2024

@author: curiarte
"""

import os
os.environ["KERAS_BACKEND"] = "tensorflow"
import tensorflow as tf
import keras
import matplotlib.pyplot as plt
import numpy as np

#keras.config.set_dtype_policy('float64')
keras.backend.set_floatx("float64")
keras.mixed_precision.set_global_policy("float64")
keras.utils.set_random_seed(1234)

# Data for supervised learning:
# x_train: 1000 rows, 28 columns, values betweeen -10 and 10 (uniformly distributed).
# y_true: 1000 rows, 2 columns, values betweeen 0 and 1 (uniformly distributed).
x_train = -10 + (10-(-10))*np.random.default_rng().random(size=[1000,28])
y_true = 0 + (1-0)*np.random.default_rng().random(size=[1000,2])

class my_net(keras.Model):
    def __init__(self, penultimate_layer_width, **kwargs):
        super(my_net, self).__init__()

        self.penultimate_layer_width = penultimate_layer_width

        self.layers_list = list()
        # Hidden layers
        self.layers_list.append(keras.layers.Dense(units=100, activation="tanh", use_bias=True, name="layer1"))
        # self.layers_list.append(keras.layers.Dense(units=100, activation="tanh", use_bias=True))
        # self.layers_list.append(keras.layers.Dense(units=100, activation="tanh", use_bias=True))
        # self.layers_list.append(keras.layers.Dense(units=100, activation="tanh", use_bias=True))
        self.layers_list.append(keras.layers.Dense(units=self.penultimate_layer_width, activation="tanh", use_bias=True, name="penultimatelayer"))

        #Last (linear) layer
        self.layers_list.append(keras.layers.Dense(units=2, activation=None, use_bias=False))

    #Model prediction
    def call(self, inputs):

        x = inputs
        for layer in self.layers_list:
            x = layer(x)

        return x

class my_model(keras.Model):

    def __init__(self, net, **kwargs):
        super(my_model, self).__init__()
        self.net = net
        self.trainable_vars = [v.value for v in self.net.weights]
        self.loss_tracker = keras.metrics.Mean(name="loss")

    def call(self, inputs):

        x_train, y_true = inputs
        y_pred = self.net(x_train)
        loss = tf.reduce_mean(tf.square(y_pred-y_true))
        return loss

    def compile(self, optimizer):
        super().compile()
        self.optimizer = optimizer

    def train_step(self, data):

        x_train, y_true = data

        with tf.GradientTape(watch_accessed_variables=False) as tape:
            tape.watch(self.trainable_vars)
            loss = self(data)

        grad = tape.gradient(loss, self.trainable_vars)
        self.optimizer.apply(grad, self.trainable_vars)

        self.loss_tracker.update_state(loss)

        return {"loss": self.loss_tracker.result()}

net = my_net(penultimate_layer_width=100)
y_pred = net(x_train) #For building 'net'
model = my_model(net)
model([x_train,y_true]) #For building 'model'

#Compilation (uncomment only one). Working only for SGD.
#model.compile(optimizer=keras.optimizers.SGD())
#model.compile(optimizer=keras.optimizers.RMSprop())
model.compile(optimizer=keras.optimizers.Adam())

history = model.fit(x_train, y_true, epochs=2000, batch_size=200)

#Plos of the loss
plt.plot(history.history["loss"])
plt.yscale("log")
plt.xlabel("Epoch")
plt.title("Loss")
plt.show()

Hey there,
I was facing the same problem and found a solution. This might not be the optimal way, but at least it does work for the moment. I changed one line in the add_variable_from_reference function in keras/optimizers/base_optimizer.py by adding .replace("/", "_") to the else block. I still hope the problem will be addressed in an update as I did not check if this change could cause some other problems. Hope this fix helps you as well.
    def add_variable_from_reference(
        self, reference_variable, name=None, initializer="zeros"
    ):
        """Add an all-zeros variable with the shape and dtype of a reference
        variable.
        """
        name = name or "var"
        if hasattr(reference_variable, "path"):
            name = reference_variable.path.replace("/", "_") + "_" + name
        else:
            name = str(reference_variable.name).replace(":", "_").replace("/", "_") + "_" + name
        return self.add_variable(
            shape=reference_variable.shape,
            initializer=initializer,
            dtype=reference_variable.dtype,
            name=name,
        )

Thank you very much!
Hopefully this bug will be fixed soon by the Keras team.

Hi there, just wondering if anyone from Keras team has started working on this issue?

Hi,
I have the same problem only with ADAM (not SGD for example as the OP).
I am using: tf 2.16.1 and python 3.10.

Thanks for the report -- I fixed the issue at HEAD.

Reference commit: https://github.com/keras-team/keras/commit/c5e939d4e5e4b4e53f71b98a58439fbd54cea4b8

Is anyone else also experiencing this issue still? I'm on Python 3.9.19 using Keras 3.3.3.
Trying to use the PyTorch backend since it provides better tooling for exporting models to ONNX later on.
The code I have now is just
import os
os.environ["KERAS_BACKEND"] = "torch"
import keras

print(keras.__version__)  # '3.3.3'

fnn = keras.Sequential(
    keras.layers.Input(shape=(50,)),
    keras.layers.Dense(25),
    keras.layers.Dense(2),
)
fnn.compile()

which gives me ValueError: Argument ``name`` must be a string and cannot contain character ``/``. Received: name=<Dense name=dense_3, built=False> (of type <class 'keras.src.layers.core.dense.Dense'>)

Full traceback

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[11], line 1
----> 1 fnn = keras.Sequential(
      2     keras.layers.Input(shape=(50,)),
      3     keras.layers.Dense(25),
      4     keras.layers.Dense(2),
      5 )
      6 fnn.compile()
File ~/venv/lib/python3.9/site-packages/keras/src/models/sequential.py:68, in Sequential.init(self, layers, trainable, name)
67 def init(self, layers=None, trainable=True, name=None):
---> 68     super().init(trainable=trainable, name=name)
69     self._functional = None
70     self._layers = []
File ~/venv/lib/python3.9/site-packages/keras/src/models/model.py:156, in Model.init(self, *args, **kwargs)
154     functional.Functional.init(self, *args, **kwargs)
155 else:
--> 156     Layer.init(self, *args, **kwargs)
File ~/venv/lib/python3.9/site-packages/keras/src/layers/layer.py:247, in Layer.init(self, activity_regularizer, trainable, dtype, autocast, name, **kwargs)
245 BackendLayer.init(self)
246 self._lock = False
--> 247 Operation.init(self, dtype=dtype, name=name)
248 self.activity_regularizer = regularizers.get(activity_regularizer)
249 input_dim_arg = kwargs.pop("input_dim", None)
File ~/venv/lib/python3.9/site-packages/keras/src/ops/operation.py:21, in Operation.init(self, dtype, name)
19     name = auto_name(self.class.name)
20 if not isinstance(name, str) or "/" in name:
---> 21     raise ValueError(
22         "Argument name must be a string and "
23         "cannot contain character /. "
24         f"Received: name={name} (of type {type(name)})"
25     )
26 self._dtype_policy = dtype_policies.get(dtype)
27 self.name = name
ValueError: Argument name must be a string and cannot contain character /. Received: name= (of type <class 'keras.src.layers.core.dense.Dense'>)"

Isn't the problem that Keras rejects names containing slashes? As such names are regularly created by ONNX it makes importing ONNX-models into Keras difficult.


Visually obvious choice of what to download

I suggest considering changing the interface to solve the problem of some settings not being obvious. Namely, what exactly needs to be downloaded.
As I understand it, yt-dlp basically allows you to download the video itself, audio, subtitles, description and cover. Each content type has its own settings, some types can be represented by more than one object (different resolutions and video formats, different bitrates and audio formats, different subtitle languages). That is, logically, the GUI-settings should represent four levels:

selecting content types to download;
selecting objects of the selected types (and only them, other types should be unavailable)
selecting the saving method (separate or gluing)
selecting the gluing format (available only if gluing is selected in the previous paragraph)

I do not suggest using the wizard. It seems to me that it is better to implement this on one page, as it is now. Or make it look like the foobar2000 converter:

Replace Output format with What to download, Destination with Select languages, resolutions, etc., Processing with Separate or merged? and Other with Save formats and you'll get an idea of what I mean.
These changes will make the interface more logical and remove some inconsistencies when, for example, the user can change download settings that are not applicable to the current download or the settings set. For example, they can set video formats with the Download clean audio, without converting to any format option checked (which should make all video settings unavailable). Or configure the processing of playlists even though the link is not to the playlist.
Related issues: #113 and #295.

Its outside the scope of the project. Its meant to be a quick "paste and download" type of thing, I dont want to overcomplicate things.


Problem with meta and sorting data

Hi,
I have a method that return an array of specific data in descending order (by date_time). So far so good.
Let's call it "dataShocks". This data would allow me to draw some charts.
Now, I would like to return this array in a meta attribute using laravel json api.
Basically, I'm doing this:
public function getPrimaryMeta($resource)
 {
     ...
  $dataShocks=  $data->getDataShocks();
    return [
            'dataShocks' => $dataShocks,
        ];
}

However, when I'm fetching the URL, I get well the dataShock in my meta attribute but the order is not preserved at all. I have double check by doing dd($dataShocks) just before returning it and it is working. But not when I'm using the URL.
Am I missing something ? What can I do ?

Hi! I'm afraid you'll need to debug this in your own application. We don't do anything that would change the order of the value you return from the getPrimaryMeta method, so I can't help explain what would be causing the order to change.


HG operations are not correctly canceled

Commit b1a83cc seems to have introduced a bug when calling HG_Get_output() after a request has been cancelled (or maybe some semantic has changed that I'm not aware of).
The situation is as follows: as we discussed in #261, if a request does not show progress for a certain amount of time (e.g. because the target server is down), we cancel it with HG_Cancel() and repost it to Mercury if a configured number of retries has not been exceeded.
In this situation, the following completion callback works correctly in all commits between 7f7502f (v1.0.0rc1) and b1a83cc...
  1 static hg_return_t
  2 completion_callback(const struct hg_cb_info* cbi) {
  3
  4     auto* ctx = reinterpret_cast<ExecutionContext*>(cbi->arg);
  5
  6     if(cbi->ret == HG_CANCELED) {
  7         switch(ctx->m_status) {
  8             case request_status::timeout:
  9                 {
 10                     DEBUG2("Request timed out, reposting");
 11                     // repost the request:
 12                     post_to_mercury<ExecutionContext>(ctx);
 13
 14                     // post_to_mercury<ExecutionContext>(ctx) will
 15                     // end up calling the following (the handle is reused):
 16                     //
 17                     // hg_return_t ret = HG_Forward(
 18                     //         ctx->m_handle,
 19                     //         completion_callback,
 20                     //         reinterpret_cast<void*>(ctx),
 21                     //         &ctx->m_mercury_input);
 22                     break;
 23                 }
 24
 25             case request_status::cancelled:
 26                 {
 27                     // this can only happen if the request timed out repeteadly
 28                     // and we exhausted the configured retries
 29                     // The only option is to definitely cancel the request and
 30                     // notify the user
 31                     DEBUG2("Request was cancelled");
 32                     if(cbi->info.forward.handle != HG_HANDLE_NULL) {
 33                         HG_Destroy(cbi->info.forward.handle);
 34                     }
 35
 36                     // notification code follows...
 37                     break;
 38                 }
 39
 40             default:
 41                 DEBUG2("Request is in an inconsistent state");
 42                 if(cbi->info.forward.handle != HG_HANDLE_NULL) {
 43                     HG_Destroy(cbi->info.forward.handle);
 44                 }
 45
 46                 // notification code follows...
 47                 break;
 48         }
 49
 50         return cbi->ret;
 51     }
 52
 53     // some other error != HG_CANCELED
 54     if(cbi->ret != HG_SUCCESS) {
 55         DEBUG("Forward request failed: {}", HG_Error_to_string(cbi->ret));
 56         if(cbi->info.forward.handle != HG_HANDLE_NULL) {
 57             HG_Destroy(cbi->info.forward.handle);
 58         }
 59
 60         // notification code follows...
 61
 62         return cbi->ret;
 63     }
 64
 65     // decode response
 66     MercuryOutput output_val;
 67     hg_return_t ret = HG_Get_output(cbi->info.forward.handle, &output_val);
 68
 69     if(ret != HG_SUCCESS) {
 70         throw std::runtime_error(
 71                 std::string("Failed to decode RPC response: ") +
 72                 HG_Error_to_string(ret));
 73     }
 74
 75     ctx->m_output = output_val;
 76
 77     // clean up resources consumed by this RPC
 78     HG_Free_output(cbi->info.forward.handle, &output_val);
 79     HG_Destroy(cbi->info.forward.handle);
 80
 81     return HG_SUCCESS;
 82 };

... but now fails in line 67 with the following error:
# HG -- Error -- /home/amiranda/var/projects/mercury/src/mercury_proc.c:680
 # hg_proc_checksum_verify(): checksum 0x48674BC7 does not match (expected 0x00000000!)
# HG -- Error -- /home/amiranda/var/projects/mercury/src/mercury.c:600
 # hg_get_struct(): Error in proc checksum verify
# HG -- Error -- /home/amiranda/var/projects/mercury/src/mercury.c:2231
 # HG_Get_output(): Could not get output

Further inspection shows that in line 6 cbi->ret == HG_SUCCESS when in previous commits was HG_CANCELED. As far as I understood, the HG_CANCELED error code was set automatically by Mercury whenever HG_Cancel() was used, is this no longer the case?
As a side note, if the client manages to connect to the server, everything works as it should.

Please let me know if everything is good on your end but should be fixed now.


Convert code to Python 3

Make the code Python 3 compatible.

Do we want the code to be compatible with either Python 2.7 or 3, or just pick one or the other?

I don't know. @talumbau what do you suggest?

Taxcalc is compatible with both python 2 and python 3 and run tests in both environments. I'd suggest the same for dynamic unless it presents a major challenge.

It shouldn't be too difficult.  I don't know much about Python 3, but the only things I can think of at the moment that might take extra care will be the times when we wanted to do integer division (for indexing, usually), and now that will no longer be the default.  But those are limited cases, and probably pretty easy to track down.

I think this issue @evan-magnusson raises regarding Python 3 support for OG-USA makes sense given that taxcalc supports Python 3 and B-Tax will shortly.  It would be nice to have the three packages cooperate in conda env's that are 2.7, 3.4, 3.5. @MattHJensen @jdebacker I'll assign this issue to myself.

@PeterDSteinberg Sounds good.  Thanks for taking this on.
A couple thoughts:

Should we wait until the regression testing of 0.5.6 is done?
Could we wait until I fix what I think are a couple bugs in the code (See Issues #284 and #283)?  I'm working on this.  Hopefully have a solution early next week.

@jdebacker Waiting until next week sounds good - it will take me a bit to resolve the B-Tax Python 3 issues today / Monday perhaps.

Most of the steps in converting OG-USA to run with Python 3.5+ are to simply change any print commands to print(). I would be surprised if that constituted less than 90% of the substance. @jdebacker @PeterDSteinberg

Agree with @rickecon,  but want as little to change as possible while I work out these bugs.  It's already been taking me too long!

Closed in just under 3 years (!) with PR #367.


Dark mode

Hi,
Sorry if this has been reported elsewhere….
SwiftUICatalog does not display correctly if the device is set Dark Mode (I’m using iPad Pro series 3).

Thanks Muscobaldi for your report :).
Is true. There is no work at all done for dark mode.
You're invited to join, you can fork the project and make a PR, I'll
happily include it.
On Thu, May 26, 2022 at 9:59 AM Muscobaldi @.***> wrote:

Hi,
Sorry if this has been reported elsewhere….
SwiftUICatalog does not display correctly if the device is set Dark Mode
(I’m using iPad Pro series 3)
—
Reply to this email directly, view it on GitHub
https://github.com/barbaramartina/swiftuicatalog/issues/36, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAGHCDDHGPERRXSDZ3IU5QLVL4VPLANCNFSM5XACFPSQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

@Muscobaldi dark mode is now ON :)


⚠ Bofrost.at has degraded performance

In 235defc, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 866 ms

Resolved: Bofrost.at performance has improved in a9f8c74.


Why Saleor dont use any Database cache enigne?

for example:

https://github.com/Suor/django-cacheops
https://github.com/noripyt/django-cachalot

We prefer to fix wrong SELECT query instead of hiding it under a cache.
Query cache requires us to keep in mind which functions/methods need the newest data from DB and which one can be cached.  It could cause some problems eg: You always want to have a product's quantity up to date.
Instead of DB caching, we should think about caching the response from graphql's resolvers.


Add Docker Desktop (MacOS)

Tool information

Tool name: Docker Desktop (MacOS Docker.app)
Add or update? Add
Desired version: 2.1.*
Approximate size:
If this is an add request:

Brief description of tool: Docker to run containerized applications
URL for tool's homepage: https://www.docker.com/community-edition

Virtual environments affected

[x] macOS 10.15

Can this tool be installed during the build?
While the app installation itself works, initial startup requires runner user's password. This I do not have nor can set via password reset (as explained by  Thomas Baillie from GitHub Developer Support in an support request email, Nov 27, 10:10 AM UTC ).
Docker.app refuses to start with sudo. It must to be started as a regular user and user must provide a password via UI dialog (which could be done with applescript if I had OR could reset the runner user's password).
This is not just adding the Docker.app, but also starting it with correct permissions so that the network settings can be configured. After the initial launch Docker.app can be stopped, and future startups should work fine with no passwords nor sudo's involved.
Project, branch and workflow that is an example of this need (trying to launch a docker-compose -based tool for testing in MacOS):
https://github.com/Exove/local-docker/blob/ci-jobs-initial-test-to-pass/.github/workflows/macos-latest--tests.yml
Are you willing to submit a PR?
Sure  if I only get some instructions how to achieve this.

I'd need some help how to add the Docker as this repository contains merely a list of available binaries, but not the binaries .

Hello @rpsu , thank you for your suggestion!
 Do they cover your use-case?
Docker Desktop looks pretty huge (2GB) and we worry if it can work as expected on VM (without GUI).
It would be great, if you could share a bit more context on your use-case?

My use case is I'd like to be able to have CI test for an app exactly the way end users do it in MacOS. docker is a client, docker-machine seems to need a VirtualBox to function  properly, or have the Docker.app to contain all of that - including the hypervisor.
An alternative option - using docker-machine and Xhyve hypervisor seems not to work (at least I have not found a way yet).
https://github.com/Exove/local-docker/pull/103/checks?check_run_id=574053551
So there are 2 ways I can think of this could be solved:

Have some way to install Drupal Desktop and launch it (which requires runner user's password, not just sudo perms) - scriptable if the password can be reset or is known
Use existing docker (client), docker-compose and docker-machine, which requires a hypervisor compatible with docker (client)

Based on the tests currently launching the docker for the first time requires users password

@rpsu , thank you for provided context.
JFYI: We are installing virtualbox to macOS machines in scope of #433 , changes are already merged. The new image is on way.

thanks!
Is this the correct place to keep eye on to see the new image?
https://github.com/actions/virtual-environments/blob/master/images/macos/macos-10.15-Readme.md

Yep, that is correct location. Also we will update #433 as soon as update is available

@rpsu looks like Docker licensing doesn't actually allow us to put this in the hosted images so we won't be adding it at this time. Thanks for the suggestion!

@alepauly okay, I see. I think I can manage with the Virtualbox providing the VM. I do have some difficulties with bash variables (seemingly not working as they do in desktop), can you point me to someone or some docs how to play with them in macos VM?

@rpsu , Am I right that you need some docs about configuring Docker + Virtualbox on hosted machine?
I think this guide will work for you. virtualbox is already installed to the images. Other software have to be installed in runtime


wayland-proxy-virtwl: unstable-2023-10-27 -> unstable-2023-11-01

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for wayland-proxy-virtwl is: Proxy Wayland connections across a VM boundary
meta.homepage for wayland-proxy-virtwl is: https://github.com/talex5/wayland-virtwl-proxy
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found unstable-2023-11-01 in filename of file in /nix/store/yjqr6yfclijpiazwfd5jccl47p501y38-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-01

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
wayland-proxy-virtwl

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/yjqr6yfclijpiazwfd5jccl47p501y38-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-01 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A wayland-proxy-virtwl https://github.com/r-ryantm/nixpkgs/archive/84ea33bdc1209297e6c57882131d3a2829ddad51.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/84ea33bdc1209297e6c57882131d3a2829ddad51#wayland-proxy-virtwl

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/yjqr6yfclijpiazwfd5jccl47p501y38-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-01
ls -la /nix/store/yjqr6yfclijpiazwfd5jccl47p501y38-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-01/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

wayland-proxy-virtwl

Maintainer pings
cc @alyssais @sternenseemann for testing.

@talex5 I see this update makes some protocol changes.  Currently, breaking changes in Nixpkgs are disallowed as we work on the next stable release.  Would any of the changes here be a breaking change to existing users of wayland-proxy-virtwl?

The proxy needs to be updated at the same time as crosvm because the protocol change isn't backwards or forwards compatible. So if Nix still has the old crosvm then updating the proxy will break things. However, if crosvm has already updated to the new protocol then pasting is already broken and this should fix it.

Thanks.  From what I can tell, the protocol changes were included in crosvm 117, which is already in Nixpkgs.  I'll test later to confirm, though.

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for wayland-proxy-virtwl is: Proxy Wayland connections across a VM boundary
meta.homepage for wayland-proxy-virtwl is: https://github.com/talex5/wayland-virtwl-proxy
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found unstable-2023-11-28 in filename of file in /nix/store/c3wq52z5f2ajz2q7lyx41fmzbss1xxx7-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-28

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
wayland-proxy-virtwl

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/c3wq52z5f2ajz2q7lyx41fmzbss1xxx7-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-28 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A wayland-proxy-virtwl https://github.com/r-ryantm/nixpkgs/archive/75847f555053002721e09cdc43b3fe8603ab47a3.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/75847f555053002721e09cdc43b3fe8603ab47a3#wayland-proxy-virtwl

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/c3wq52z5f2ajz2q7lyx41fmzbss1xxx7-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-28
ls -la /nix/store/c3wq52z5f2ajz2q7lyx41fmzbss1xxx7-ocaml5.0.0-wayland-proxy-virtwl-unstable-2023-11-28/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

wayland-proxy-virtwl

Maintainer pings
cc @alyssais @sternenseemann for testing.


Change escaping for snippets on csv export

1. Why is this change necessary?
The exported file contains wrong escaping for Excel. The End-Separator is missing and the singe quote is also wrong.

2. What does this change do, exactly?
Change the escaping to a double quote and complete the quoting by adding another one after the string.

3. Describe each step to reproduce the issue or behaviour.
Export snippets as "CSV (Excel)" in the snippets manager of the backend
4. Please link to the relevant issues (if any).
5. Which documentation changes (if any) need to be made because of this PR?
6. Checklist

[x] I have written tests and verified that they fail without my change
[x] I have squashed any insignificant commits
[x] This change has comments for package types, values, functions, and non-obvious lines of code
[ ] I have read the contribution requirements and fulfil them.

Hello,
thank you for creating this pull request.
I have opened an issue on our Issue Tracker for you. See the issue link: https://issues.shopware.com/issues/SW-24193
Please use this issue to track the state of your pull request.

Thanks for your Contribution! :blue_heart:


Remove dependency on deprecated conventions API

Project.convention and other conventions API methods have been
[deprecated](https://docs.gradle.org/current/userguide/upgrading_version_7.html#all_convention_deprecation] and will be removed in Gradle 9.0. To make things worse, the
Project.convention.plugins["java"] does not return
DefaultJavaPluginConvention anymore, but instead returns a wrapper
class that issues deprecation warnings. Since the plugin cannot find the
expected class, it stopped working properly (this is probably the cause
of #53).
This pull requests simply replaces the single use of
Project.convention.plugins[] (finding the Java test sourceset) with
Project.extensions.findByType.
Fixes: #42, #53

awesome thanks

@sksamuel just quick question - when new release will came out, including this patch?

Yep this is in the latest release.
On Mon, Jan 1, 2024, 6:08 PM Roeniss Moon @.***> wrote:

@sksamuel https://github.com/sksamuel just quick question - when new
release will came out, including this patch?
—
Reply to this email directly, view it on GitHub
https://github.com/kotest/kotest-gradle-plugin/pull/54#issuecomment-1873536290,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFVSGTFQ6YT46XAE4ZNRXTYMNFX5AVCNFSM6AAAAABBD3KAWGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZTGUZTMMRZGA
.
You are receiving this because you were mentioned.Message ID:
@.***>

Sorry but which version do you mean? I see 0.4.0 only on release page

0.4.11 https://plugins.gradle.org/plugin/io.kotest
Ill upgrade the release tab


[WIP] Nested file types

Rebased to master to decrease diff size.

Coverage decreased (-0.8%) to 98.335% when pulling 58ebb612cfb62ef4d0bceafc4c1ca8436628f0ca on nested-file-types into 3876fe402d18d1f0c8c97015616de934731991a8 on master.

Changes Unknown when pulling ebd202f2ce96cea53dc4fc84bc5ca6f17cd885f4 on nested-file-types into ** on master**.

Coverage decreased (-0.8%) to 98.335% when pulling ebd202f2ce96cea53dc4fc84bc5ca6f17cd885f4 on nested-file-types into 4bdc4e89fd946f97fd9c763c300aa3c804de8294 on master.


BLIP-Diffusion fine-tuned models

Hi @dxli94 , thanks for sharing the code to the community! I'm doing similar research and would like to evaluate blip-diffusion on different settings. Would you be so kind to share the fine-tuned models on DreamBench? Currently I can only find one subject "dog". Thank you.

Hi @dxli94, I noticed that "Check out projects/blip-diffusion/README.md for guidance on fine-tuning" in the notebook. But I can't find the guidance in the README.md. Would it be possible to share the code for fine-tune the model. Thank you.


np.round_() fails at nopython

Hello,
I tried to define a function rounding a vector:
@jit(float64[:](float64[:]),nopython=True)
def rnd(x):
    return np.round_(x)

Based on your website I assumed that this would work, as np.round_ is supported, but it throws the usual error:
TypingError: Failed at nopython (nopython frontend) Can I please ask where the problem might be?
Numba version: 0.36.1
Numpy version: 1.13.1
Thanks in advance for help.

I can confirm I am also seeing this problem.

Thanks for the report. From a quick look at the implementation, I think this is because there is at present no function definition for a signature without an out arg specified. Provision of the 3 arg signature does work:
from numba import jit, njit
from numba.types import float64, int64
import numpy as np

@jit(float64[:](float64[:], int64, float64[:]),nopython=True)
def rnd1(x, decimals, out):
    return np.round_(x, decimals, out)

x=np.arange(10.) + 0.2
print(x)
print(np.round_(x))
y=np.empty_like(x)
print(rnd1(x, 0, y))

gives:
$ python issue2648.py
[ 0.2  1.2  2.2  3.2  4.2  5.2  6.2  7.2  8.2  9.2]
[ 0.  1.  2.  3.  4.  5.  6.  7.  8.  9.]
[ 0.  1.  2.  3.  4.  5.  6.  7.  8.  9.]

Works fine, thanks for help.


feat(cache/unstable): add memoize() and LruCache

Closes https://github.com/denoland/deno_std/issues/4608
Some questions:

Which methods should count as accessing/using an entry stored in an LruCache? Currently, all three of get, set, and has are tracked. In other words, when deleting the "least-recently-used", it means deleting the entry that was least-recently touched by any of get, set, or has.
Is "on-the-fly" usage even worth supporting? It adds a small amount of complexity to the implementation and allows memoize(fn)(arg) to be memoized, with the following gotcha:

const fn = (n: number) => n + 1

// ✅ reference to function
const fn1 = memoize(fn)
const result1 = fn1(42)

// ✅ function literal
const fn2 = memoize((n: number) => n + 1)
const result2 = fn2(42)

// ✅ on-the-fly with reference to function
const result3 = memoize(fn)(42)

// ⚠ on-the-fly with function literal - fails to memoize
const result4 = memoize((n: number) => n + 1)(42)

@iuioiua

options.cache property looks useful, but it might be better as a private property.

Do you mean it can be supplied as an option but not publicly available as a property of the returned function? That would still allow manual manipulation if a reference was maintained, just not to manipulate it from a reference to the function alone. If so, that sounds reasonable.
const myCache = ...
const myFunc = memoize((arg: any) => { /* ... */ }, { cache: myCache })
export { myFunc }
// `myCache` is is no longer available via `myFunc.cache`
export { myCache }
// now it's available via explicit reference

Is options.getKey really needed, except for some edge cases?

I think getKey is essential, otherwise caching with non-primitive arguments is always by reference (the default).
const user: User = { id: 1 }
const sameUser: User = { id: 1 }
const getUserDataByReference = memoize((user: User) => { /* ... */ })

getUserDataByReference(user) // computed once
getUserDataByReference(user) // still computed once
getUserDataByReference(sameUser) // now computed twice

const getUserDataById = memoize((user: User) => { /* ... */ }, { getKey: ({ id }) => id)

getUserDataById(user) // computed once
getUserDataById(sameUser) // still computed once

Is options.truncateArgs needed if it mainly only avoids a small/trivial number of keystrokes in array mapper callbacks (and similar)? Might a simple example suffice instead?

Fair point, I'll remove that and add an example.

Might options.cacheRejectedPromises be fine to omit if we have a reasonable default? We can add in the future if there's demand.

Probably the most sensible default is the current one, i.e. to remove promises from the cache upon rejection (after all, if the function threw synchronously, that result obviously wouldn't be cached either). And it can be worked around easily enough by wrapping the result/rejection of the inner function in something akin to Promise.allSettled's PromiseSettledResult<T>.

I see. So based on your feedback, I suggest we do the following:

Keep the cache option, but remove it from the returned function.
Keep the getKey option.
Remove the truncateArgs option, keeping its default behavior, and instead add an example for said use case.
Remove the cacheRejectedPromises, keeping its default behavior, and instead add an example for said use case.

Does this all sound reasonable? Again, if we see demand for these functionalities in the future, we can add them in a non-breaking manner. WDYT?


⚠ Bofrost.at has degraded performance

In 07e9508, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1068 ms

Resolved: Bofrost.at performance has improved in 0d37b18 after 7 minutes.


Amazon Security Lake integration permission denied on Lambda function

Description
During the internal testing of the Amazon Security Lake integration, it was reported a failure on the AWS Lambda function caused by Access Denied error.
START RequestId: 2a5345ff-6116-422d-a858-713b9216cc86 Version: $LATEST
[ERROR]	2024-05-28T12:15:23.482Z	2a5345ff-6116-422d-a858-713b9216cc86	Failed to read S3 object sample.txt from bucket wazuh-aws-security-lake-raw: An error occurred (AccessDenied) when calling the GetObject operation: Access Denied
LAMBDA_WARNING: Unhandled exception. The most likely cause is an issue in the function code. However, in rare cases, a Lambda runtime update can cause unexpected function behavior. For functions using managed runtimes, runtime updates can be triggered by a function change, or can be applied automatically. To determine if the runtime has been updated, check the runtime version in the INIT_START log entry. If this error correlates with a change in the runtime version, you may be able to mitigate this error by temporarily rolling back to the previous runtime version. For more information, see https://docs.aws.amazon.com/lambda/latest/dg/runtimes-update.html
[ERROR] IndexError: list index out of range
Traceback (most recent call last):
  File "/var/task/lambda_function.py", line 170, in lambda_handler
    parquet_key = get_full_key(src_location, account_id, region, key, 'parquet')
  File "/var/task/lambda_function.py", line 112, in get_full_key
    filename = ''.join(filename_parts[2].split('-'))END RequestId: 2a5345ff-6116-422d-a858-713b9216cc86
REPORT RequestId: 2a5345ff-6116-422d-a858-713b9216cc86	Duration: 201.11 ms	Billed Duration: 202 ms	Memory Size: 512 MB	Max Memory Used: 162 MB	Init Duration: 1350.08 ms

Tasks

[x] Investigate why this is happening, as the User running the Lambda is the owner of the S3 Bucket.
[ ] Improve the code to handle that exception.

During the AWS Lambda configuration, it's needed to grant permissions to the Lambda function to access the S3 bucket, as seen in this guide. That solves the issue.

Improved logging
[INFO]	2024-05-29T10:18:36.787Z		Found credentials in environment variables.
START RequestId: 220ef125-3f94-43f7-a2e2-c6394f49185d Version: $LATEST
[INFO]	2024-05-29T10:18:36.954Z	220ef125-3f94-43f7-a2e2-c6394f49185d	Lambda function invoked due to 20240422_ls.s3.2f062956-5a30-4c2a-b693-a0f5d878294c.2024-04-22T14.20.part39.txt.
[INFO]	2024-05-29T10:18:36.954Z	220ef125-3f94-43f7-a2e2-c6394f49185d	Source bucket name is REDACTED. Destination bucket is REDACTED.
[INFO]	2024-05-29T10:18:36.954Z	220ef125-3f94-43f7-a2e2-c6394f49185d	Reading 20240422_ls.s3.2f062956-5a30-4c2a-b693-a0f5d878294c.2024-04-22T14.20.part39.txt.
[INFO]	2024-05-29T10:18:37.125Z	220ef125-3f94-43f7-a2e2-c6394f49185d	Transforming Wazuh security events to OCSF.
[INFO]	2024-05-29T10:18:37.311Z	220ef125-3f94-43f7-a2e2-c6394f49185d	Uploading data to REDACTED.
END RequestId: 220ef125-3f94-43f7-a2e2-c6394f49185d
REPORT RequestId: 220ef125-3f94-43f7-a2e2-c6394f49185d	Duration: 603.97 ms	Billed Duration: 604 ms	Memory Size: 512 MB	Max Memory Used: 167 MB	Init Duration: 1301.07 ms


Add support for :managed-dependencies

Leiningen 2.7.0 was just released and it includes support for adding a :managed-dependencies vector to project.clj. Please add support for upgrading the dependency versions in this vector.

I worked around the issue by introducing a boot-clj wrapper project, which load the leiningen dependencies. Like https://github.com/ekroon/telehash-clj/blob/master/build.boot It would be better if the leiningen plugin supports :managed-dependencies though.

Release 0.6.12


Add user_questions to front matter

Towards https://github.com/giantswarm/giantswarm/issues/13270
This introduces the user_questions field and fills it in as far as we have it prepared.

LGTM

@Oshratn You have to approve officially.
Please click on Files changed in the top and then use this dialog on the right hand side:

Dear @giantswarm/sig-docs , I would like a review please 🌷


Compatiable for Campus DLC

Just a quick look
1.Need to assign salary to building which itemclass.service is PlayerEducation&Museums&VarsitySports
2.Need to control maintenance of above 3 building types
3.Need to add visit income for PlayerEducation&Museums&VarsitySports
And go on........

https://github.com/pcfantasy/RealCity/commit/13304f035e6a121dd823f6a0da4c4ae7af22224d
done


Document that react-native-spotlight-tour also works on react-native-web

I've been playing around a bit with this on react-native-web and the library seems to work without issue there. This is useful info to anyone looking for a solution that supports ios, android and web, and imho should be highlighted on the home page.

That's awesome news! I think that would be a nice addition to the documentation. Thanks again for the report. PRs are welcome 🙂

Great library! I've been searching for an up-to-date React Native product tour for both native and web, and this works nicely.
(There may be some positional issues; for me, the spotlight tooltip seems to auto position at the top left of the web browser, but I haven't fully implemented it yet, so not sure. Using react-native-spotlight-tour v2.0.0 and react-native-web 0.18.10.)

Documentation has been added and full support for react-native-web is available since v3.0.0 release.


Travis failing possibly due to kubectl version

https://github.com/IBM/Kubernetes-container-service-GitLab-sample/blob/a1bbbddec2a4854cdf37c02b958038b65bd07c08/scripts/install.sh#L17
Related issue: https://github.com/kubernetes/kubernetes/issues/65575
Travis logs:
...
Error from server (NotAcceptable): unknown (get nodes)
No resources found.
Error from server (NotAcceptable): unknown (get services gitlab)
Waiting for pods to be running
No resources found.
Error from server (NotAcceptable): unknown (get pods)
...0 * 10 seconds elapsed...
No resources found.
...

travis passes.  closing issue


Invalid crypted content checksum

I have been working on getting this to work all week and am now stuck at this point. any ideas? for Fortus 400 and 900 machines. Tried using fox ,fox2 for machine type as well. I have the latest version of Python-crypto

uninstalled Python 3 - works :) close ticket!


Issue importing deepface

Sorry if this a newbish question...
When I use
from deepface import DeepFace

I get an "Illegal instruction: 4".
Even when I alter my code to something like
obj = deepface.DeepFace.analyze(img_path=IMG, actions=[ 'age', 'gender', 'race', 'emotion'])

I end up with "module deepface has no attribute DeepFace"
Does this have something to do with my OS (macOS Monterey) or my python version (3.10)?
I wasn't able to locate the exact system requirements.

rename the file you are running. it must not be deepface.


AssertionError with SSD1309

Hi,
I got an "AssertionError" with an SSD1309 Display.
The Situation:
I got a Python Code for the SSD1322 running SSD1322-Code, which is working fine.
Now I wanted to port it to an SSD1309 Display SSD1309-Code, and keep getting an Assertion Error.
Here's the log:
Apr 27 07:28:48 raspberrypi systemd[1]: Started RC2-UI.
Apr 27 07:28:53 raspberrypi rc2ui-nightly[825]: string of image.mode in init.py  1
Apr 27 07:28:53 raspberrypi rc2ui-nightly[825]: string of self.mode in init.py  1
Apr 27 07:28:53 raspberrypi rc2ui-nightly[825]: string of image.mode in init.py  1
Apr 27 07:28:53 raspberrypi rc2ui-nightly[825]: string of self.mode in init.py  1
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: Cannot open file volumio_logo.ppm
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: string of image.mode in init.py  RGB
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: string of self.mode in init.py  1
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: Traceback (most recent call last):
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:   File "/home/pi/RC2-UI/rc2ui.py", line 873, in
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:     show_logo("volumio_logo.ppm", oled)
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:   File "/home/pi/RC2-UI/modules/display.py", line 15, in show_logo
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:     device.display(logoImage)
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:   File "/home/pi/.local/lib/python3.7/site-packages/luma/oled/device/init.py", line 202, in display
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]:     assert(image.mode == self.mode)
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: AssertionError
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: string of image.mode in init.py  1
Apr 27 07:28:54 raspberrypi rc2ui-nightly[825]: string of self.mode in init.py  1
Apr 27 07:28:55 raspberrypi systemd[1]: rc2ui.service: Main process exited, code=exited, status=1/FAILURE
Apr 27 07:28:55 raspberrypi systemd[1]: rc2ui.service: Failed with result 'exit-code'.
My Code has a main-script which tells a submodule to display a logo at startup.
I've tried it with .ppm .bpm and .jpg files, error persists.
To figure out what happend i added 2 prionts in init.py: "string of image.mode" and "string of self.mode" right before line 196 in init.py, to see what is given there.
In my display submodule i start the image processing to luma with:
def show_logo(filename, device):
logoImage = Image.new('RGB', (device.width, device.height))
In the API Documentation is stated that "mode" (1, RGB or RGBA) is supported since Luma 3.1 -> I'm using 3.4.
In the init.py ssd1309 is redirected to ssd1306. ssd1306 has a different opener than ssd1322, which is stated to be a "greyscale" device.
My Hardware:
-PiZeroWH (Raspbian Buster Lite)
-ssd1309 SPI Display (Resistors solderd correctly to use spi)
Maybe anyone has an Idea what I am doing wrong?
Cheers!

from the looks of it the 1309 has no "mode" to be configured or mayybe it has not been added yet and seems to fallback to monochrome in that case

from the looks of it the 1309 has no "mode" to be configured or mayybe it has not been added yet and seems to fallback to monochrome in that case

That seems to be true, but why is it stated in the API to support "modes"?
-> Do you have an idea how i must change my code display.py so that it don't use a mode?
I've installed luma.examples to test the display... Even the examples don't display anything.
But the Error has changed since then:
on3.7/site-packages/luma/oled/device/init.py", line 198, in display
Apr 27 16:00:49 raspberrypi rc2ui-nightly[698]:     assert(image.mode == self.mo                                                                                de)
Apr 27 16:00:49 raspberrypi rc2ui-nightly[698]: AttributeError: 'tuple' object h                                                                                as no attribute 'mode'
The testfile:
python3 3d_box.py --display ssd1309 --interface spi
Version: luma.oled 3.4.0 (luma.core 1.14.0)
Display: ssd1309
Interface: spi
Dimensions: 128 x 64

you can use a mode (although i did not find the point where it is defined by default or could not trace the inherited base class) but you have to go monochrome if it does not support physically RGB i guess
you can always check the mode of the render device object before your issue a rendering of a picture in a certain mode

If you use the display method directly, it is the callers responsibility to set the correct mode (bit depth) that the device supports. The canvas will always construct one which is correct to match the device, but display doesnt.
See here how to convert: https://pillow.readthedocs.io/en/stable/reference/Image.html#PIL.Image.Image.convert
You can get the target mode from device.mode
Also see:

https://github.com/rm-hull/luma.examples/blob/master/examples/invaders.py#L202
https://github.com/rm-hull/luma.examples/blob/master/examples/pi_logo.py#L30

Hey Guys! Thank you for your Reply's!
That my display doesn't show anything -> was my fault, bad cables...
With your advice ".convert"... i was able to solve my problem.
Thank you!!!!


Server not added to dashboard every time

If the interface does not find anything from kafka while running, it should try to go back in the kafka consumer and fetch the latest message instead

I have fixed this in branch: https://github.com/jakobhviid/Dashboard-Interface-Docker/tree/feature/issue-23-overview-bug
However, I believe that some sort of UI change should happen, to specify if the Dashboard server is actually online, or if this is just the last message received from a Dashboard server that is now offline.
Maybe just show a timestamp of when the last update was received?

Requires the implementation from https://github.com/jakobhviid/Dashboard-Server-Docker/issues/13 to not have an "undefined" timestamp.
I've added a small timestamp to the table container, when the table is in "server-mode".

There is no way to tell right now if a server is online or not, so "only" this timestamp has been implemented.


update

Welcome to UESTC Open Source Commnunity 👏

Add a issue link after Fix:, if you have created a issue

/hold


improvement add a specific be config for segment_cache_capacity

Proposed changes
Issue Number: close #xxx
Currently, segment cache capacity is caculated by fd limit * 2/5. It's not flexible to change it since changing fd limit affects others.
Add a specific be config for segment_cache_capacity. If the config >= fd limit * 2/5, set it back to fd limit * 2/5 to avoid open too many files.
Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 50.92 seconds
stream load tsv:          534 seconds loaded<PHONE_NUMBER>9 Bytes, about 133 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size:<PHONE_NUMBER>7 Bytes

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.69 seconds
stream load tsv:          538 seconds loaded<PHONE_NUMBER>9 Bytes, about 132 MB/s
stream load json:         20 seconds loaded<PHONE_NUMBER> Bytes, about 112 MB/s
stream load orc:          64 seconds loaded<PHONE_NUMBER> Bytes, about 16 MB/s
stream load parquet:          31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select:          28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size:<PHONE_NUMBER>6 Bytes


How can a person manually migrate from a m2m to a sortedm2m?

We have some models that aren't in South, and we've forgotten how to make that migration manually.

It should work with using the instructions in the README file: https://github.com/gregmuellegger/django-sortedm2m#migrating-a-manytomanyfield-to-be-a-sortedmanytomanyfield


Can´t enable Addon

In Blender 2.80
When trying to enable the addon this error is shown:
Traceback (most recent call last):   File "C:\Program Files\Blender Foundation\Blender\2.80\scripts\modules\addon_utils.py", line 351, in enable     mod = __import__(module_name)   File "C:\Users\Consalvo\AppData\Roaming\Blender Foundation\Blender\2.80\scripts\addons\io_scene_cgf\__init__.py", line 31, in <module>     from bpy_extras.io_utils import ( ImportError: cannot import name 'orientation_helper_factory' from 'bpy_extras.io_utils' (C:\Program Files\Blender Foundation\Blender\2.80\scripts\modules\bpy_extras\io_utils.py)

Blender 2.8 is not yet support.

@keyhom, I appreciate the work you've done on this so far, any intentions of returning to this project and getting it all updated and running again?


Installation with OpenBLAS instead of MKL

Question
The instructions for installation show that any BLAS work, but when I actually do it, it require that the system must have MKL installed. How can we use open BLAS instead of MKL?
Additional Context
I am trying to install FL on Raspberry Pi and only OpenBLAS is available.

I think we don't support this option cc @jacobkahn

@datduonguva — if you're building Flashlight libraries and the core only, you can build with -DFL_LIBRARIES_USE_MKL=OFF as a CMake option (this isn't documented) which will allow you to use OpenBLAS.
Let me know if you're having difficulties with that.

@jacobkahn Thanks for reply. I think this solves the issue as the previous message is gone. However, I don't think flashlight can run on Raspberry Pi as it requires DNNL 2.0 and that library only runs on 64 Bit Platform.

@datduonguva unfortunately, we don't have other alternatives to DNNL at this time that might run on 32-bit systems (ArrayFire also doesn't work on non-64-bit platforms if memory serves me correctly), but this sort of minimal system setting (i.e. on a Raspberry Pi) is something we're quite interested in supporting in the future. We're currently abstracting away DNNL and ArrayFire components of Flashlight so we can interchange them with libraries which will run on those platforms natively — this is ongoing work that we'll be updating for in future releases.

Hey, checking in on this. Is this still an option? I'm trying to use the asr app. Compiling with -DFL_LIBRARIES_USE_MKL=OFF produces a binary that still depends on MKL, but if I use patchelf to remove the mkl_rt.so.2 dependency, fl_asr_tutorial_inference_ctc runs, but with basically useless accuracy on word detection. Though I'm surprised it runs at all...

Hello, just wanted to report I fixed this, there were...a myriad of problems. I think this diff in particular was what solved this for me: https://gist.github.com/maniyar1/c5034c5d5152a2c8357614693379ec69
I did also have to compile arrayfire and other dependencies with openblas and lapacke beforehand, I have Dockerfiles I need to clean up and then I can share. (Arrayfire depending on mkl_rt.so.2 is why it was still linked).


add example custom formatter

closes #210

Hi @gavv kindly review on my initial PR. Thanks

Coverage: 95.648%. Remained the same when pulling 13323d25712d7838bfa1bdbb0054560307bb30f3 on edwinwijaya94:i_edwin_example_custom_format into 29fd41d071c4cb748d7fe5cd4e155bc94d8ea6cb on gavv:master.

Thanks for PR!
A few comments:

Can we reuse existing fruits server instead of adding a new one?

Can you please make the test failing, and add the following to the beginning of the test:
t.Skip() // remove this line to see test failure

Can you please add second test that is like the first, but also employs SuccessTemplate? To make it working, you'll also need to specify AssertionHandler instead of Reporter. For AssertionHandler, use DefaultAssertionHandler and set it's Logger fields to t. When Logger is set, httpexpect uses SuccessTemplate to format succeeded assertions and sends them to Logger. Please also add to test a comment explaining this detail.

Can you please rebase on fresh master?

Thanks!

Hi @gavv PR updated based on your comments. Also, I want to share that for SuccessTemplate, it will print for every method called.
Examples:
go test -v -timeout 30s -run ^TestSuccessTemplate$ examples
=== RUN   TestSuccessTemplate
    assertion.go:251: [Request("PUT")]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT")]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT") WithJSON()]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT") Expect()]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT") Expect()]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT") Expect() Status()]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    assertion.go:251: [Request("PUT") Expect() NoContent()]
    assertion.go:252:
        Test Success!
                test name: Check_Fruits_List
                request name:
    ...

NOTE: ignore line assertion.go:251, I was debugging the field Path to show how it prints for every method called.
I know this behavior is expected as it prints whenever it calls chain.leave(), I just want to let you know that it might be a bit spammy

Thank you!

I know this behavior is expected as it prints whenever it calls chain.leave(), I just want to let you know that it might be a bit spammy

Yep, that's why it's disabled by default.
This can be useful in two cases:

you can enable it for debugging
you may need it to integrate httpexpect with libs like goconvey (I did not use it, but people had requested this feature exactly for this reason)


introduce idGenerator and globalIdGen

Closes #138 and unblocks #618. This PR introduces:

an interface of an IdGenerator,
a sequential implementation of IdGenerator that is instantiated with newIdGenerator(),
the default global id generator that is accessible via globalIdGen.
In addition, it finally assigns unique ids to the expressions that are produces from the runtime JS values.

By default, the parser is using the global id generator now. This would be useful when we incrementally call the parser. All tests are creating a new id generator, as we assume specific id values.

[ ] Entries added to the respective CHANGELOG.md for any new functionality

We have not discussed this today. IMO this is a simple PR, so it would be good to merge it.

iiuc, for the time being we could just drop the global ID generator and require an ID generator be supplied thru the constructor https://github.com/informalsystems/quint/pull/647/files#diff-6f59f39b1cee888b5d07c01bbbba59ee7dbc42eaf407ac71054d16f3d49ab6f9R371-R373
Would this let us do everything we need at the moment, and postpone the question of whether we need the global mutability?

I have removed the global id generator and added the code to propagate the generator, whenever needed. This seems to work, though the diff is obviously larger. At some point, we would have to think how to deal with the growing number of parameters that are passed around.

Thanks for removing the global id generator! I'm unblocking.
I'm still wondering whether we could re-use the ids from the original expressions in RuntimeValue instead of generating new ones. Have you considered this?

That's an interesting idea. However, I don't know which ids would be considered the original ones. There are plenty of computations going on with runtime values. Moreover, if we start using ids of the original expressions, they stop being unique. Not sure how much that would break.


feat: save benchmark result to database

What problem does this PR solve?
Issue Number: close #xxx
Problem Summary:
What is changed and how it works?
Proposal: xxx
What's Changed:
Related changes

PR to update owner/repo:
Need to cherry-pick to the release branch

Check List
Tests

No code ci-runs-only: [ quick_checks,linters ]

Side effects

Performance regression
Breaking backward compatibility

Release note
None: Exclude this PR from the release note.

#benchmark


added letrika_comgw to stable

missing "," after "energy"
    "type": "energy"
    "version": "0.0.5"

RE-CHECK!

RE-CHECK!

RE-CHECK!


Adhere to Python best practices

The following snippet:
json_data=open("/bin/routine.json").read()
data = json.loads(json_data)

Would be better written as:
data = None
with open("/bin/routine.json") as f:
  data = json.loads(f.readlines())

The with statement ensures that the file is never left open accidentally.

@nmunro thanks for pointing it out.
And i used f.read() instead of f.readlines() as data is in list format.

Wow Code is becoming better and better :)

And by the way @tarunvelli you did such a great job, I am trying to grasp what you did there. I am just beginning to learn python so it's quite confusing for me to understand the whole code. But I am happy that I am able to learn form you :)

Hey the code is pretty hacky, im sure its not the right way to do it. But works fine for now :) do improve on it when you get better implementations

Sure I will look forward making the code better and useful. Thank you again for your time. You did super cool thing :)


Centos build pre-requisites

Hello I'm trying to get pdfium build on Centos7 for future integration within GDAL, however I cannot manage to get it build.
Could you please provide pre-requisites ? Is python3.8++ required ? I get stuck with python-six import at ./build/gyp_pdfium step:
from six.moves import collections_abc ImportError: cannot import name collections_abc
Thanks

Centos7 uses python-six v1.9 where v1.13++ is required to run the script as is.
Indeed Six module change log for v1.13 https://github.com/benjaminp/six/blob/master/CHANGES#L42C1-L43C78 says:
Add six.moves.collections_abc, which aliases the collections  module on Python 2-3.2 and the collections.abc on Python 3.3 and greater.
Therefore from six.moves import collections_abc shall be replaced by import collections within the python scripts.


AMBARI-25711 Resolve broken build by updating import order of HostStateEntity

@jojochuang could you please review this PR?

Confirmed it was a problem with Maven 3.8.x. I had no problem with 3.6.x


Support integer samplers in Shader Model 6.7

Shader Model 6.7 introduces integer samplers: https://microsoft.github.io/DirectX-Specs/d3d/HLSL_SM_6_7_Advanced_Texture_Ops.html#integer-sampling. However, if one tries to transpile this simple GLSL shader to HLSL, even with setting the shader model to 67, they will get the error message Sampling non-float textures is not supported in HLSL.
#version 450

layout(push_constant) uniform UniformBufferObject{
    mat4 viewProj;
} ubo;

layout(location = 0) in vec3 inPosition;
layout(location = 1) in vec3 inNormal;
layout(location = 2) in vec2 inUV;

layout(location = 0) out vec3 fragColor;
layout(location = 1) out vec2 outUV;

void main() {
    mat4 model = mat4(1);

    vec4 worldpos = model * vec4(inPosition,1);

    gl_Position = ubo.viewProj * worldpos;
    fragColor = vec3(1,1,1);
    outUV = inUV;
}

spirv_cross::CompilerHLSL hlsl(bin);

spirv_cross::CompilerHLSL::Options options;
options.shader_model = 67;
return hlsl.compile();    // throws error

With this change, SPIRV-Cross is able to create a HLSL shader with an integer texture and sampler, which compiles successfully with DXC:
Texture2D<uint4> texSampler : register(t0, space0);
SamplerState _texSampler_sampler : register(s0, space0);

static float2 inUV;
static float4 outColor;
static float3 fragColor;

struct SPIRV_Cross_Input
{
    float3 fragColor : TEXCOORD0;
    float2 inUV : TEXCOORD1;
};

struct SPIRV_Cross_Output
{
    float4 outColor : SV_Target0;
};

void frag_main()
{
    float3 sampled = float3(texSampler.Sample(_texSampler_sampler, inUV).xyz) / 255.0f.xxx;
    outColor = float4(sampled, 1.0f);
}

SPIRV_Cross_Output main(SPIRV_Cross_Input stage_input)
{
    inUV = stage_input.inUV;
    fragColor = stage_input.fragColor;
    frag_main();
    SPIRV_Cross_Output stage_output;
    stage_output.outColor = outColor;
    return stage_output;
}

dxc.exe -T ps_6_7 -E main -Fo shader.bin -Fd shader.pdb -Zi .\shader.hlsl

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Block Glich

Hello idk if youre remember me but i am the guy that Submit the first Issue here.
After i tried out youre amazing mod for a few weeks i found a (glich) its not really a glich but when you import a model that has a green texture for example a creeper head then it will start pleacing kelp because its green but then the kelp will also place water its same with other water lockd blocks like the heart of the see. I dont know if you have time to fix but it would be amazing but when not its also ok :D
https://user-images.githubusercontent.com/89296018/136014960-e637b208-71d5-4ee8-8266-4e1f53992d6f.mp4

Oh and here are some Animation that i created not really something special just some random stuff to try out things xD
https://user-images.githubusercontent.com/89296018/136015805-2aec3490-2ede-42fd-9a3f-89f9afcf19ff.mp4
https://user-images.githubusercontent.com/89296018/136015812-ff3e4f2d-9955-45e6-b719-1d801c47af25.mp4
https://user-images.githubusercontent.com/89296018/136015826-1ceb9266-211c-4c42-8487-0f3b5e0ccad9.mp4
https://user-images.githubusercontent.com/89296018/136015838-eaa561a3-d1e3-434b-91fd-86f65704d308.mp4

Nice animations, however the glitch you're talking about should be fixed with the newest version of the mod!

Oh really i dont saw that thank you for youre help xD

One last Question do i still need to use the sequence_merger.py to use multiple object at ones and do i now need farbric api 1.17.1

Oh Closed

If you use the latest version of the script you can export multiple objects at once by selecting them all before pressing voxelize. I'm not sure if you need Fabric API 1.17.1, but you will need to update the Fabric Loader to that version.
You can still comment on this issue, I just closed it because the original issue has been resolved.

Ah ok thank you :D

I tried out the new Version of the script and i have a question when i try to export multiple objects at once how i can select 1 Texture for 1 Object because there is still just 1 slot for the immage texture.

Currently, only one texture is supported. You either have to combine all textures into one and adjust the UVs accordingly, or resort to the merger script again.


Not possible see end home page on Mobile layout before take decision for cookies

Which area(s) of Podkrepi.bg are affected?
Mobile layout
Describe the Bug

To Reproduce

Open https://podkrepi.bg/en on mobile device
Scroll to end of the page
Check is possible to see end of the page before agree with cookies?

Expected Behavior
Changed to see full page after that to see message for cookies on mobile version.
Which browser are you using? (if relevant)
Vivaldi

Isn't this the standart behaviour?
The cookie consent dialog is intentionally on the top of the other elements and is sticked at the bottom of the screen. On desktop it is the same. On some websites the content is even blocked until rhe cooki consent is accepted.
If this behaviour is not longer a wanted, we cound change it into modal or find another solution. I am closing this issue. If some future changes are requested, please feel free to reopen.


Catch typo in the input files

It would be great to suggest a fix to the user when the input file contains an error.
Some fixes I can think of:

[x] Check for \t inside YAML files;
[ ] Give suggestion with typo: hamronic => harmonic
[x] Check types of the data

The first one is easy, the others one require some kind of mechanism to register a keyword and associated data to some kind of linter.

This is mainly outdated by the TOML input file. Typo suggestion (hamronic => harmonic) would still be a nice improvement, but is hard to implement.


can't download playlist of youtube video

youtube-dl --verbose https://www.youtube.com/watch?v=F620ommtjqk&index=1&list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.youtube.com/watch?v=F620ommtjqk&index=1&list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.02.07
[debug] Python version 2.7.12 - Linux-3.19.0-66-generic-x86_64-with-Ubuntu-14.04-trusty
[debug] exe versions: avconv 9.20-6, avprobe 9.20-6
[debug] Proxy map: {'http': 'http://<IP_ADDRESS>:8118', 'https': 'https://<IP_ADDRESS>:8118'}
[youtube:playlist] Downloading playlist PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2 - add --no-playlist to just download video F620ommtjqk
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading webpage
[download] Downloading playlist: Intro to Parallel Programming
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #1
ERROR: Unable to download JSON metadata: '' (caused by BadStatusLine("''",)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 416, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2006, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 429, in open
response = self._open(req, data)
File "/usr/lib/python2.7/urllib2.py", line 447, in _open
'_open', req)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 1048, in https_open
req, **kwargs)
File "/usr/lib/python2.7/urllib2.py", line 1201, in do_open
r = h.getresponse(buffering=True)
File "/usr/lib/python2.7/httplib.py", line 1136, in getresponse
response.begin()
File "/usr/lib/python2.7/httplib.py", line 453, in begin
version, status, reason = self._read_status()
File "/usr/lib/python2.7/httplib.py", line 417, in _read_status
raise BadStatusLine(line)
youtube-dl --version
2017.02.07

I can't reproduce it. The link https://www.youtube.com/watch?v=F620ommtjqk&index=1&list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2 is a single video which works fine to download.
Also downloading the playlist https://www.youtube.com/playlist?list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2 works fine (458 videos).

@ThomasChr
Sorry, my fault, i intend to download all videos from the playlist but copy the wrong url,  the log file is as follows:
youtube-dl --verbose https://www.youtube.com/playlist?list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.youtube.com/playlist?list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.02.07
[debug] Python version 2.7.12 - Linux-4.4.0-62-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: none
[debug] Proxy map: {'http': 'http://<IP_ADDRESS>:8118', 'https': 'https://<IP_ADDRESS>:8118'}
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading webpage
[download] Downloading playlist: Intro to Parallel Programming
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #1
ERROR: Unable to download JSON metadata: '' (caused by BadStatusLine("''",)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 416, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2006, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python2.7/urllib2.py", line 429, in open
response = self._open(req, data)
File "/usr/lib/python2.7/urllib2.py", line 447, in _open
'_open', req)
File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
result = func(*args)
File "/usr/local/bin/youtube-dl/youtube_dl/utils.py", line 1048, in https_open
req, **kwargs)
File "/usr/lib/python2.7/urllib2.py", line 1201, in do_open
r = h.getresponse(buffering=True)
File "/usr/lib/python2.7/httplib.py", line 1136, in getresponse
response.begin()
File "/usr/lib/python2.7/httplib.py", line 453, in begin
version, status, reason = self._read_status()
File "/usr/lib/python2.7/httplib.py", line 417, in _read_status
raise BadStatusLine(line)
And the version is 2017.02.07

Sorry for that, but no problem on my machine:

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.youtube.com/playlist?list=PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.02.07
[debug] Git HEAD: b049757
[debug] Python version 2.7.12 - Linux-4.4.0-59-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.10-0ubuntu<IP_ADDRESS>, ffprobe 2.8.10-0ubuntu<IP_ADDRESS>
[debug] Proxy map: {}
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading webpage
[download] Downloading playlist: Intro to Parallel Programming
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #1
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #2
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #3
[youtube:playlist] PLAwxTw4SYaPnFKojVQrmyOGFCqHTxfdv2: Downloading page #4
[youtube:playlist] playlist Intro to Parallel Programming: Downloading 458 videos
[download] Downloading video 1 of 458
[youtube] F620ommtjqk: Downloading webpage
[youtube] F620ommtjqk: Downloading video info webpage
[youtube] F620ommtjqk: Extracting video information
[youtube] F620ommtjqk: Downloading MPD manifest
[debug] Invoking downloader on u'https://r5---sn-4g57knsy.googlevideo.com/videoplayback?id=17adb4a269ad8ea9&itag=137&source=youtube&requiressl=yes&mv=u&mn=sn-4g57knsy&mm=31&ms=au&pl=20&ratebypass=yes&mime=video/mp4&gir=yes&clen=11178760&lmt=1443263549755353&dur=48.715&signature=6B5BD544B9B07C061116EECBAE588753A6B1F8FE.91FC46B6F8EE8461FD0F4F57C905F7FB3185BFA7&upn=eD-eM6yfZmU&mt=1486650099&beids=[9452307]&key=dg_yt0&ip=<IP_ADDRESS>&ipbits=0&expire=1486671832&sparams=ip,ipbits,expire,id,itag,source,requiressl,mv,mn,mm,ms,pl,ratebypass,mime,gir,clen,lmt,dur'
[download] Destination: Intro to the Class - Intro to Parallel Programming-F620ommtjqk.f137.mp4
[download] 100% of 10.66MiB in 00:00

Ok, got it, i think it's net connection problem. Thks for you quick reply! @ThomasChr


Compile issue with RN 0.41

When compiling the app with RN 0.41, it fails with this error:
clang: error: no such file or directory: '/myapp/node_modules/react-native-zip-archive/ios/RNZipArchive.m'
clang: error: no input files

It was fixed after moving some files around in this package, RNZipArchive.m and RNZipArchive.h need to be directly in ios/. After this the build succeeded again. I'm not sure if this is the correct way to fix it, but I'll submit a PR.

Oh, I see this was fixed in the next branch with 7ccafaae638ab64952a2ea5fca7e8faf41c5616d. Nice!


Added the cutout method to the TargetPixelFile class

I added a method to trim a TPF in the spatial dimensions. The idea is that this will eventually allow us to index tpfs like we can index light curves. Also this is handy for "zooming in" on large tpfs e.g. superstamps.

@christinahedges Did you intend to edit 2.06-identify-rolling-band.ipynb as part of this PR, or is that an accident?

I believe column and row are mixed up in this version of the code.  This PR is good to merge otherwise.

The docstring claims center and size are specified in (column, row).  However using e.g. size=(1, 3) returns a TPF with 3 columns and 1 row.  I was expecting 1 column and 3 rows:

I pushed an extra commit which changes the behavior of tpf.cutout() to interpret the center and size arguments as a tuple of (col, row) instead of (row, col).
Example:


Visualizing emission files using time_space_diagram.py

Hi!
Can you help on how to define the "flow_params" argument?
I tried to the path of "params.json" to the "flow_params" argument. Is this correct?
Here's the error I got:
File "/home/daremapua/flow/flow/utils/rllib.py", line 94, in get_flow_params
for veh_params in flow_params["veh"]:
KeyError: 'veh'

Hi @KeithAnshilo,
What is the flow_params argument?
The usage of the file is as follows:
python time_space_diagram.py </path/to/emission>.csv </path/to/params>.json

I followed that syntax, yet this is the error that I get;
Traceback (most recent call last):
File "flow/visualize/time_space_diagram.py", line 422, in
flow_params = get_flow_params(args.flow_params)
File "/home/daremapua/flow/flow/utils/rllib.py", line 94, in get_flow_params
for veh_params in flow_params["veh"]:
KeyError: 'veh'

Hi @KeithAnshilo sorry for the late response. The parameters of flow_params are passed  flow/utils/registry.py. If you look in that file, you'll see see many references to params with different keys such as params['exp_tag'], params['env_name']. Now, the parameters of flow_params need to match the key names you see in this file. Is this still an issue for you? If it is, can you give me the Flow version number. and I'll gladly look into it.


docs(material/button): update button documentation and examples for M3

Fixes #29130

Ideally we use the same messaging across all inputs - want to follow this up with changing the rest of color inputs?


Makefile unpacking hiccup for 0.10.1

Hi Jared,
I was struggling to get the make command to function properly for me when installing. I didn't have the HDF5 dependency installed on my machine, and the make command failed as follows:
if [ ! -e hdf5-1.8.14.tar.gz ]; then wget https://support.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8/hdf5-1.8.14/src/hdf5-1.8.14.tar.gz; fi
--2018-08-20 15:07:30--  https://support.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8/hdf5-1.8.14/src/hdf5-1.8.14.tar.gz
Resolving support.hdfgroup.org... <IP_ADDRESS>
Connecting to support.hdfgroup.org|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/x-gzip]
Saving to: ‘hdf5-1.8.14.tar.gz’

hdf5-1.8.14.tar.gz                                              [                                              <=>                                                                                ]  11.02M  1.24MB/s    in 9.8s

2018-08-20 15:07:40 (1.12 MB/s) - ‘hdf5-1.8.14.tar.gz’ saved [11558346]

tar -xzf hdf5-1.8.14.tar.gz || exit 255
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Exiting with failure status due to previous errors
make: *** [lib/libhdf5.a] Error 255

It looks like the error occurs at lines 84-90 of the makefile:
#
# If this library is a dependency the user wants HDF5 to be downloaded and built.
#
lib/libhdf5.a:
	if [ ! -e hdf5-1.8.14.tar.gz ]; then wget https://support.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8/hdf5-1.8.14/src/hdf5-1.8.14.tar.gz; fi
	tar -xzf hdf5-1.8.14.tar.gz || exit 255
	cd hdf5-1.8.14 && ./configure --enable-threadsafe --prefix=`pwd`/.. && make && make install

I could completely be mistaken, but perhaps there was just a single letter missing in the unpacking of the .tar.gz file?
I amended the Makefile to unzip then unpack separately, and the installation completed without issue.
lib/libhdf5.a:
        if [ ! -e hdf5-1.8.14.tar.gz ]; then wget https://support.hdfgroup.org/ftp/HDF5/releases/hdf5-1.8/hdf5-1.8.14/src/hdf5-1.8.14.tar.gz; fi
        gunzip hdf5-1.8.14.tar.gz
        tar -xvf hdf5-1.8.14.tar || exit 255
        cd hdf5-1.8.14 && ./configure --enable-threadsafe --prefix=`pwd`/.. && make && make install

Perhaps this was just a quirk of my machine, but I thought I'd pass along the observation in case it helps others.
Thanks very much!

Fun with compute clusters! Might be time to update our tar package... It's from 2011... Perhaps that's the issue.
If I execute tar --version I get the following:
tar (GNU tar) 1.26
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

Written by John Gilmore and Jay Fenlason.

tar should have had gzip support forever so I'm not sure thats the problem. Do you see the entry for the -z option in the man page?

Yes, it's listed in the manual:
Compression options:
       -a, --auto-compress
              use archive suffix to determine the compression program

       -I, --use-compress-program=PROG
              filter through PROG (must accept -d)

       -j, --bzip2
              filter the archive through bzip2

       -J, --xz
              filter the archive through xz

       --lzip filter the archive through lzip

       --lzma filter the archive through lzma

       --lzop

       --no-auto-compress
              do not use archive suffix to determine the compression program

       -z, --gzip, --gunzip, --ungzip
              filter the archive through gzip

       -Z, --compress, --uncompress
              filter the archive through compress

Strange... The only thing I can think of is I've occasionally seen (via other programs) our compute cluster have a broken path to pigz; nevertheless these programs find alternative compression packages. In this case we're specifying tar though, so I don't think that's the culprit.
Thanks for your troubleshooting (and, you know, creating nanopolish)


scroll up button

scroll to up up button is not available on every page .it is only available on home page. please assign this issue to me under gssoc-ext so that i can solve the issue. will be happy to contribute

@Devanshu1603 sure go ahead
make sure to join the discord server for further communication
and also star the repo
complete the task in next 2 days


add<EMAIL_ADDRESS>

npm WARN<EMAIL_ADDRESS>requires a peer of<EMAIL_ADDRESS>but none was installed.

Thx.


Add Tarrant County College | my.tccd.edu

Tarrant County College website: https://www.tccd.edu/
Computer science field of study: https://catalog.tccd.edu/preview_program.php?catoid=7&poid=1176&returnto=584
Computer support specialist: https://catalog.tccd.edu/preview_program.php?catoid=7&poid=1377&returnto=584
The homepage has a login redirect to https://my.tccd.edu found in the top left, "myTCC"
It appears the domain tccd.edu is already approved for teachers, but students use my.tccd.edu which isn't approved.

@Twinki14 I am sorry, the domain my.tccd.edu is blacklisted because the school allows to register an email address there even if you are not a student of the school. If you are the student of this school, please apply with official document (OFFICIAL DOCUMENT tab at https://www.jetbrains.com/shop/eform/students).


Write tests for Do Today feature and its components

Codecov Report

Merging #288 (dec1f3b) into master (603150a) will increase coverage by 2.02%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master     #288      +/-   ##
============================================
+ Coverage     73.93%   75.96%   +2.02%
- Complexity      623      636      +13
============================================
  Files            99       99
  Lines          1884     1885       +1
  Branches        195      195
============================================
+ Hits           1393     1432      +39
+ Misses          419      382      -37
+ Partials         72       71       -1

Impacted Files
Coverage Δ
Complexity Δ

...a/seedu/address/logic/commands/DoTodayCommand.java
82.14% <100.00%> (+59.92%)
7.00 <0.00> (+4.00)

...in/java/seedu/address/logic/parser/ParserUtil.java
97.14% <0.00%> (+2.85%)
27.00% <0.00%> (+1.00%)

...n/java/seedu/address/logic/util/OperationFlag.java
85.71% <0.00%> (+7.14%)
10.00% <0.00%> (+1.00%)

src/main/java/seedu/address/model/TaskTracker.java
81.25% <0.00%> (+8.33%)
20.00% <0.00%> (+2.00%)

...rc/main/java/seedu/address/model/ModelManager.java
91.56% <0.00%> (+12.04%)
38.00% <0.00%> (+4.00%)

...edu/address/logic/parser/DoTodayCommandParser.java
100.00% <0.00%> (+45.45%)
4.00% <0.00%> (+1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 603150a...dec1f3b. Read the comment docs.


Unable to get Windows to read certain deflated files

If I create a zip file with a subdirectory, Windows won't properly read that subdirectory. Any loose files sitting in the root of the archive can be extracted just fine, but trying to extract a file in a subdirectory yields an error.
The following will generate a zip file that reproduces this behavior:
use std::fs::{ OpenOptions };
use std::io::Write;
use zip::{ CompressionMethod, ZipWriter };
use zip::write::FileOptions;

fn main() {
    let archive = OpenOptions::new()
        .create_new(true)
        .write(true)
        .open("temp.zip")
        .unwrap();

    let mut writer = ZipWriter::new(archive);

    let options = FileOptions::default()
        .compression_method(CompressionMethod::Deflated);
    writer.start_file("noproblem.txt", options).unwrap();
    writer.write_all(b"Windows can extract this file just fine.").unwrap();

    let options = FileOptions::default();
    writer.add_directory("subdir", options).unwrap();

    let options = FileOptions::default()
        .compression_method(CompressionMethod::Deflated);
    writer.start_file("subdir/problem.txt", options).unwrap();
    writer.write_all(b"Windows will show an error when trying to extract this file.").unwrap();

    writer.flush().unwrap();
}

And here is the error I'm encountering when trying to drag / drop the subdir/problem.txt file onto my Desktop:

Running Windows 10 Home edition. 7zip extracts this just fine.
I recognize this may be a problem with Windows' built-in zip file support, but then again I've never encountered a zip file that didn't work out of the box with Windows.

This is a very strange issue indeed! I have not been able to find the exact cause just yet, but it does not seem to be a related to it being a file in a subdirectory. If you change the contents of the subdir/noproblem.txt file to
writer.write_all(b"Windows will show an error when trying to extract this file.\r\nHowever, it has no problems with it after this modification.\r\n").unwrap();

then it will extract just fine. The issue also seems to be gone when changing the compression method to Stored.
It seems that it might be a problem with the compression. Some further investigation is definitely needed.

So I have been investigating this issue, and the problem seems to be in the deflate stream of certain small files. I will try to get it resolved with the people of libflate.
Technical info:
It seems that Windows does not like a flate stream with zero distance codes. When manually adding a distance code table without modifying the LZ77 stream the file is perfectly readable on Windows. The RFC does seem to allow an empty distance table, so I am not sure who is at fault.

This should be fixed in version 0.5.1.
Thanks for the report, and if you still have issues feel free to reopen this.

Awesome. Thanks for getting that fixed, and so fast! Fist bump! 🤜 🤛
(and thanks for the library itself)


to/from langchain doc format

add methods for going for converting to/from LangChain documents

thanks!