Remove the "Characteristic" button and the information message

Q
A

Bug report?
[ ]

Feature request?
[ ]

Support request?
[ x ]

hi @cocolabssas ,
I'm going in Cocorico/CoreBundle/Entity/Listing.php:549 to delete the information message to set a feature and at the same time remove the "Characteristic" button .
I deleted :
       $characteristic = 0;
        foreach ($this->getListingListingCharacteristics() as $characteristics) {
            if ($characteristics->getListingCharacteristicValue()) {
                $characteristic = 1;
            }
        }](url)

I deleted, but I had no change.
Thanks :)

Hi,
could you precise what you mean by

to delete the information message to set a feature
Remove the "Characteristic" button

with a screenshot for example

hi @cocolabssas ,
Since I do not inform any characteristics, I would like to remove the button features located on the left buttons and the information sentence to inform the characteristics :
http://www.turbopix.fr/v/hsdksscx3m
Thanks :)

Hi @gonzasylv
It's pretty simple :

for the menu go to Cocorico/CoreBundle/Resources/views/Dashboard/Listing/_nav_side.html.twig:44
and for the notification  got to Cocorico/CoreBundle/Resources/views/Dashboard/Listing/_completion_notice.html.twig:37

Thanks, it's perfecte @cocolabssas


Bug if do backward on symbol mean

For bugs or installation issues, please provide the following information.
The more information you provide, the more likely people will be able to help you.
Environment info
Operating System: Ubuntu 14.04
Compiler: gcc4.8.4
Package used (Python/R/Scala/Julia): Python
MXNet version: Master Latest
Or if installed from source:
MXNet commit hash (git rev-parse HEAD):
If you are using python package, please provide
Python version and distribution: 2.7
If you are using R package, please provide
R sessionInfo():
Error Message:
Please paste the full error message, including stack trace.

Traceback (most recent call last):
File "test.py", line 20, in
mod.backward([mx.nd.array([1.0], dtype=np.float32)])
File "/home/lisabug/.virtualenvs/nnvm/local/lib/python2.7/site-packages/mxnet-0.9.4-py2.7-linux-x86_64.egg/mxnet/module/module.py", line 487, in backward
self._exec_group.backward(out_grads=out_grads)
File "/home/lisabug/.virtualenvs/nnvm/local/lib/python2.7/site-packages/mxnet-0.9.4-py2.7-linux-x86_64.egg/mxnet/module/executor_group.py", line 437, in backward
end=islice.stop)
File "mxnet/cython/ndarray.pyx", line 167, in ndarray._make_ndarray_function.generic_ndarray_function (mxnet/cython/ndarray.cpp:3602)
File "mxnet/cython/base.pyi", line 36, in ndarray.CALL (mxnet/cython/ndarray.cpp:1731)
mxnet.base.MXNetError: [16:15:17] src/operator/tensor/./matrix_op-inl.h:1028: Check failed: (*end <= axis_size) && (*end >= 0) Invalid begin, end, get begin=0, end=3

Minimum reproducible example
if you are using your own code, please provide a short script that reproduces the error.
import mxnet as mx
import numpy as np

data = mx.sym.Variable('data')
data = mx.sym.mean(data)

mod = mx.mod.Module(symbol=data, data_names=('data',), label_names=None)
mod.bind(data_shapes=[('data', (3, 1))])
mod.init_params()
mod.init_optimizer()

x = mx.nd.array([[1.0], [2.0], [3.0]], dtype=np.float32)

batch = mx.io.DataBatch([x], label=None)
mod.forward(batch, is_train=True)
mod.backward([mx.nd.array([1.0], dtype=np.float32)])
mod.update()

Steps to reproduce
or if you are running standard examples, please provide the commands you have run that lead to the error.

What have you tried to solve it?

@lisabug Due to the automatic slicing in the backward.
https://github.com/dmlc/mxnet/blob/master/python/mxnet/module/executor_group.py#L431-L443
The slice is determined by the batch_size, which is assumed to be 3 in this example.
https://github.com/dmlc/mxnet/blob/master/python/mxnet/module/executor_group.py#L210-L211

@sxjscience Yes. The automatic slicing itself caused the problem of backward on mean symbol since the output of mean symbol is a scalar instead of a tensor of size (b,).

Close it now and we suggest using gluon in the future.


Need a way to serialize Spark objects back to eclairjs-node

@billreed63 @bpburns
Trying to port over mllib FP Growth and the issue is that there is a collect() call than returns an array of FreqItemset (which is a nested class).  Since we are calling JSON.stringify currently all we get is an array of values like this:
org.apache.spark.mllib.fpm.FPGrowth$FreqItemset@5026dbbf

What we need is a better serializer that lives in nashorn that would return us something like this:
{__eclairJSClass: mllib.fpm.FPGrowth$FreqItemset}

And then on the Node.js side we would know to create a wrapper of the correct type.
Any thoughts before I go implement this?

How would that help get the values of the FreqItemset back to node? Don't we need to add a toJSON method to the FreqItemset to convert the object contents to JSON?

@billreed63 My thought was to do this in a general way that doesn't need to do JSON conversion.  Basically the Node.js code would generate:
var collection = rdd.collect();
ourStringify(collection)

which would return:
[
{__eclairJSClass: mllib.fpm.FPGrowth$FreqItemset},
...
]

We can then create a FreqItemset object in Node that references collection[0], collection[1], etc.  These would be remote proxies to the collection variable that holds all our FreqItemsets.

We would need to make a request across for each item,
Can we just add:
FreqItemset.prototype.toJSON = function() {
    var json = {};
    json.freq = this.freq();
    json.items = this.items();

    return json;
};

and
List.prototype.toJSON= function() {
    return this.getJavaObject().toString();

};

then
  var x = JSON.stringify(result);

gives us:
[{"freq":3,"items":"[t]"},{"freq":3,"items":"[t, x]"},{"freq":3,"items":"[t, x, z]"},{"freq":3,"items":"[t, z]"},{"freq":3,"items":"[s]"},{"freq":2,"items":"[s, t]"},{"freq":2,"items":"[s, t, x]"},{"freq":2,"items":"[s, t, x, z]"},{"freq":2,"items":"[s, t, z]"},{"freq":3,"items":"[s, x]"},{"freq":2,"items":"[s, x, z]"},{"freq":2,"items":"[s, z]"},{"freq":2,"items":"[p]"},{"freq":2,"items":"[p, r]"},{"freq":2,"items":"[p, r, z]"},{"freq":2,"items":"[p, z]"},{"freq":5,"items":"[z]"},{"freq":3,"items":"[y]"},{"freq":3,"items":"[y, t]"},{"freq":3,"items":"[y, t, x]"},{"freq":3,"items":"[y, t, x, z]"},{"freq":3,"items":"[y, t, z]"},{"freq":2,"items":"[y, s]"},{"freq":2,"items":"[y, s, t]"},{"freq":2,"items":"[y, s, t, x]"},{"freq":2,"items":"[y, s, t, x, z]"},{"freq":2,"items":"[y, s, t, z]"},{"freq":2,"items":"[y, s, x]"},{"freq":2,"items":"[y, s, x, z]"},{"freq":2,"items":"[y, s, z]"},{"freq":3,"items":"[y, x]"},{"freq":3,"items":"[y, x, z]"},{"freq":3,"items":"[y, z]"},{"freq":2,"items":"[q]"},{"freq":2,"items":"[q, t]"},{"freq":2,"items":"[q, t, x]"},{"freq":2,"items":"[q, t, x, z]"},{"freq":2,"items":"[q, t, z]"},{"freq":2,"items":"[q, y]"},{"freq":2,"items":"[q, y, t]"},{"freq":2,"items":"[q, y, t, x]"},{"freq":2,"items":"[q, y, t, x, z]"},{"freq":2,"items":"[q, y, t, z]"},{"freq":2,"items":"[q, y, x]"},{"freq":2,"items":"[q, y, x, z]"},{"freq":2,"items":"[q, y, z]"},{"freq":2,"items":"[q, x]"},{"freq":2,"items":"[q, x, z]"},{"freq":2,"items":"[q, z]"},{"freq":4,"items":"[x]"},{"freq":3,"items":"[x, z]"},{"freq":3,"items":"[r]"},{"freq":2,"items":"[r, x]"},{"freq":2,"items":"[r, z]"}]

For FreqItemset that would work, but what if it had a method that did some calculations?  I was thinking more of a general solution.  Indeed we would have to make a request across for each item.
I guess for collect()/take() that might be enough though to just have toJSON(), but we would have to implement that everywhere

Do we really have a need for a remote invocation model? I don't see Spark as an interactive thing, seems like to is more of a batch thing.

We already have to do this for randomSplit that returns an array of RDDs.  For collect/take though I think returning a JSON blob could be enough.


Throw human readable error on 413 status

Pull Request Test Coverage Report for Build 215

2 of 2 (100.0%)  changed or added relevant lines in 1 file are covered.
4 unchanged lines in 2 files lost coverage.
Overall coverage increased (+2.5%) to 93.623%

Files with Coverage Reduction
New Missed Lines
%

lib/requester.js
1
95.35%

index.js
3
87.58%

Totals

Change from base Build 214:
2.5%

Covered Lines:
226

Relevant Lines:
235

💛  - Coveralls


Subclassing and Realm

I have this class
import ObjectMapper
import RealmSwift

class Base: Object, Mappable {
    dynamic var id: String?
    dynamic var objectType: String?
    dynamic var createdAt: String? // TODO: make sure this gets converted to an NSDate!

    required convenience init?(_ map: Map) {
        self.init()
    }

    func mapping(map: Map) {
        id <- map["id"]
        createdAt <- map["created_at"]
        objectType <- map["_class"]
    }
}

and then I subclass it here:
import ObjectMapper
import RealmSwift

class User: Base {
    dynamic var username: String?
    dynamic var bio: String?

    override func mapping(map: Map) {
        super.mapping(map)
        username <- map["username"]
        bio <- map["bio"]
    }
}

And it won't build. Some reason, I'm getting this error:
<unknown>:0: error: must call a designated initializer of the superclass 'Base'
 worries me >_<
Is there something I'm missing??

Ok, so I figured out that every subclass (we have many) needs to have these requireds
    // MARK: - Requireds
    required init() { super.init() }
    required init?(_ map: Map) { super.init() }
    required init(value: AnyObject, schema: RLMSchema) { super.init(value: value, schema: schema) }
    required init(realm: RLMRealm, schema: RLMObjectSchema) { super.init(realm: realm, schema: schema) }

I get this is probably more a swift question now, and not a realm or objectmapper question, but can someone explain to me why I need to do this in every subclass? Or is there a way to get it from super?  Calling only super.init on everything makes little sense

This shouldn't be necessary if you remove the required from the required convenience init?(_ map: Map) declaration.

Thanks! I will try this. If it works, you just made the code look 1000x cleaner.

Well damn.  Initializer requirement 'init' can only be satisfied by a required initializer in non-final class 'Base'

Unrelated: it's nice to meet a fellow JP.

does any subclass should add Initializer
required convenience init?(_ map: Map) {         self.init()     }
if not,  i got a build error:
must call a designated initializer of the superclass

Any updates on this? Hitting the same error that @jpmcglone was getting about Initializer requirement...

I have exact same error following help me to solve it, i'm not sure if it is correct way but it solves my problem
basically i don't call super.init in child class
//Base class
class CookJson:Object, Mappable {
dynamic var cookID:Int = 0
dynamic var cuts_id:Int = 0
dynamic var doneness:String = ""
dynamic var duration:String = ""
dynamic var tempreature:String = ""
override class func primaryKey() -> String {
return "cookID"
}
required convenience init?(_ map: Map) {
self.init()
}
func mapping(map: Map) {
cookID <- map["id"]
cuts_id <- map["cuts_id"]
doneness <- map["doneness"]
duration <- map["duration"]
tempreature <- map["tempreature"]
}
}
//Child class
class CookbyWeightJson:CookJson {
dynamic var high_weight:String = ""
dynamic var low_weight:String = ""
required convenience init?(_ map: Map) {
self.init()
}
override func mapping(map: Map) {
super.mapping(map)
high_weight <- (map["high_weight"])
low_weight <- map["low_weight"]
}
}

@maasim94 Just tried your code and got this error:
<unknown>:0: error: must call a designated initializer of the superclass 'Entity'
/Users/robbiet480/Repos/HomeAssistant/HomeAssistant/Entity.swift:77:26: note: convenience initializer is declared here
    required convenience init?(_ map: Map) {

Any updates on this topic? I'm getting the same error as @robbiet480

I use the following in my base class (called RBase), and in addition this solves AFAIK the update problem in writing a JSON from within a Realm write:
class RBase: Object, Mappable {
dynamic var filename = ""
dynamic var id = NSUUID().UUIDString
dynamic var idz = "" {
    didSet {
        idz = id
    }
}
dynamic var rType: String = ""

internal override init(value: AnyObject)
{
    super.init(value: value)
    rType = String(self.dynamicType)
}

required init() {
    super.init()
    rType = String(self.dynamicType)
}

required init?(_ map: Map) {
    if let theType = map.JSONDictionary["rType"] {
        if let theString = theType as? String {
            if theString == String(self.dynamicType) {
                super.init()
                return
            }
        }
    }

    return nil
}

required init(value: AnyObject, schema: RLMSchema) {
    super.init(value: value, schema: schema)
    rType = String(self.dynamicType)
}

required init(realm: RLMRealm, schema: RLMObjectSchema) {
    super.init(realm: realm, schema: schema)
    rType = String(self.dynamicType)
}

override class func primaryKey() -> String? {
    return "id"
}

func mapping(map: Map) {
    filename <- map["filename"]
    rType <- map["rType"]
    idz <- map["id"]
    idz <- map["idz"]
}

}

Anyone find a clean solution to this?

We're still just adding the required inits unfortunately. At least I can make it a copy paste solution that goes at the bottom (or top) of the file.  /shrug

ok, looks like ill do that too then, cant find a better alternative

I have just released v1.5.0. This update now allows ObjectMapper to be implemented purely within an extension. Using the updated StaticMappable protocol, you will only need to implement the following two functions:
mutating func mapping(map: Map)
static func objectForMapping(map: Map) -> BaseMappable?

This should make working with Realm significantly easier. Hope this helps!

I'll try it some time this week @tristanhimmelman

Can the 1.5.0 changes be merged into the Swift 3 branch?

@robbiet480 they already have been :)

Whoops, didn't notice, just saw the merge commit. Thanks @tristanhimmelman! I plan to test this out at some point today and will report back.

@tristanhimmelman Looks like this change may have broken AlamofireObjectMapper.

If you are going to go fix that, I'd suggest that https://github.com/tristanhimmelman/AlamofireObjectMapper/pull/137 gets merged beforehand to fix the Alamofire class renaming that occurred in the last few days.

@robbiet480 I have updated AlamofireObjectMapper to work with the latest Alamofire using Xcode 8 GM. Let me know if you are still having problems

@tristanhimmelman Had to make another change to get it working, see https://github.com/tristanhimmelman/AlamofireObjectMapper/pull/143

With that change this issue appears to be fixed for me!

@tristanhimmelman I still need to keep the required inits in. Otherwise I get fixable errors that they are missing. So it appears StaticMappable didn't change anything :(

@robbiet480 StaticMappable and Realm are working fine for me. See the model I am testing for AlamofireObjectMapper
class Forecast: Object, StaticMappable {
    dynamic var day = ""
    dynamic var temperature: Int = 0
    dynamic var conditions = ""

    class func objectForMapping(_ map: Map) -> BaseMappable? {
        return Forecast()
    }

    func mapping(_ map: Map) {
        day <- map["day"]
        temperature <- map["temperature"]
        conditions <- map["conditions"]
    }
}

I'm not sure why you are getting errors wrt the initializers. Perhaps you can post your class so we can help you out.

@tristanhimmelman I got it working! It's because I had a custom init function I wrote in my base Entity class. Once I removed that everything worked. Thanks!

Closing this ticket as the issues should be resolved by using the updated StaticMappable protocol

@tristanhimmelman Still trying to get this working with Realm. I'm using StaticMappable like this:
class Parent: Object, StaticMappable {

    dynamic var uid: String = ""

    static func objectForMapping(map: Map) -> BaseMappable? {
        return Parent()
    }

    func mapping(map: Map) {
        uid <- map["uid"]
    }

}

class Child: Parent {

    dynamic var name: String = ""

    override func mapping(map: Map) {
        super.mapping(map: map)
        name <- map["name"]
    }

}

Everything compiles fine, but mapping these objects fails. After some stepping around, I found that when calling map(), this code in Mappable.swift cannot grab the object. It just returns nil.
...

if var object = klass.objectForMapping(map: map) as? N {
    object.mapping(map: map)
    return object
}

Any ideas?

static func objectForMapping(map: Map) -> BaseMappable? {
    return Parent()
}

My understanding is that objectForMapping should be inspecting the incoming map and determining what child class the object should be and then returning that class.

@robbiet480 Is that the only way? What if the JSON I'm getting is generic (no "type" property).

@mitchtreece the other solution is to override the objectForMapping function in Child:
	override class func objectForMapping(map: Map) -> BaseMappable? {
		return Child()
	}

Note you will have to change static to class

@tristanhimmelman Wow I can't believed I missed that. That's exactly what I needed. Thank you 😄

class RegisteredService: Object, StaticMappable {
    dynamic var service_id: Int = 0
    dynamic var client_id: Int = 0
    dynamic var expiry_date: Date?

    class func objectForMapping(map: Map) -> BaseMappable? {
        return TableShared_Time()
    }

    func mapping(map: Map) {

        service_id <- map["service_id"]
        client_id <- map["client_id"]
        expiry_date <- (map["expiry_date"], YMDDateTransform())

    }

}

class TableShared_Time: Object, Mappable {
    dynamic var creation_time: Date?
    dynamic var last_update_time: Date?
    dynamic var visible: Bool = true

    required convenience init?(map: Map) {
        self.init()
    }

    func mapping(map: Map) {
        creation_time <- (map["creation_time"], YMDTimeDateTransform())
        last_update_time <- (map["last_update_time"], YMDTimeDateTransform())
        visible <- (map["visible"], BoolTransform())
    }

}

hi, could you please help me to find out the solution of this error? Use StaticMapple solved the init problem, but can not access the son's property when get response


reboot: not correctly checking host reachability.

Come across the issue where after that the reboot has completed host was
not yet reachable. This is because the host was still booting hence
refusing SSH connection even if SSH service was up and running. wait_for
is the old way to check host reachability and it produced unreliable
results, because the system needs to be booted and we need to make sure
we can execute command over it before continuing the next task.
wait_for_connection does that pretty automatically, it wait for the host
to be reachable and ensure we can run command on it.
Signed-off-by: Lionel H<EMAIL_ADDRESS>

Hi Lionel
The original code solved that issue by allowing you to set a regex pattern that should be matched in the reply from the server.
The new wait_for_connection module does simplify things and looks like a nice upgrade.
Thank you for your contribution!


Add extra element to redirect_from in cohorts' index.md files

Observed behaviour:
(Hyperlinks are case-sensitive!)
Currently, the element present in the metadata is written as follows:
 redirect_from: /OLS-1
So, it redirects properly when you use:
https://openlifesci.org/OLS-1
Expected behaviour:
The redirection should work with this URL as well:
https://openlifesci.org/ols-1/
So, this PR addresses that issue, by including an additional element as seen below:
redirect_from:
  - /OLS-1
  - /ols-1

Regardless of the external link used, anyone searching for a page will be redirected properly.

Thanks @NPDebs


Failed encrypt with CKKS: BufferError: scalar buffer is readonly

Description
Hello,
I need your help urgently, and I hope you have time.
I am currently working on the project (SeCCA).
https://github.com/SerhatBah/SeCCA-CKKS
The work aims to apply the CKKS scheme to the Cheng and Church algorithm through Pyfhel.
Unfortunately, I am currently stuck with an error message I need help solving...
Thank you very much
Error:
/usr/bin/python3.10 /home/serhat/SeCCA-CKKS/SeCCA (CKKS)/secured_cheng_church_yeast.py
SeCCA Step 2
Number of the Bicluster:1
Traceback (most recent call last):
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/secured_cheng_church_yeast.py", line 20, in
biclustering = secca.run(data)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 120, in run
self._multiple_node_deletion(data, rows, cols, msr_thr, HE, t_enc, t_dec)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 167, in _multiple_node_deletion
msr, row_msr, col_msr = self._calculate_msr(data, rows, cols, HE, t_enc, t_dec)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 231, in _calculate_msr
arr_sub_data[i] = HE.encryptFrac(enc_sub_data[i])
File "Pyfhel/Pyfhel.pyx", line 328, in Pyfhel.Pyfhel.Pyfhel.encryptFrac
File "", line 675, in View.MemoryView.memoryview_cwrapper
File "", line 363, in View.MemoryView.memoryview.cinit
BufferError: scalar buffer is readonly
Process finished with exit code 1
Setup:

OS: Ubuntu 22.04.1 LTS
Python: 3.10
C compiler version: [GCC 11.3.0]
Pyfhel Version:  3.3.1

Hi @SerhatBah. Please fill the bug report appropriately! You just deleted the "Code To Reproduce Error" section, but much like in StackOverflow, I expect bug reports to include the code that is faulty in a way that is reproducible.
Once you have done so, please change the title of this bug error to something meaningful, and not just the placeholders!

Hello @ibarrond ibarrond,
I'm really sorry, I was in such a hurry that I didn't pay attention and also forgot the heading. And thank you for the tips on how to insert everything. I don't have much experience with creating posts and am just learning everything.
I'll try to prepare the code as requested so that you don't have to install everything and I'll send it to you right away.

Code To Reproduce Error
HE = Pyfhel()  # Creating empty Pyfhel object
ckks_params = {
	'scheme': 'CKKS',  # can also be 'ckks'
	'n': 2 ** 14,  # Polynomial modulus degree. For CKKS, n/2 values can be
	#  encoded in a single ciphertext.
	#  Typ. 2^D for D in [10, 16]
	'scale': 2 ** 30,  # All the encodings will use it for float->fixed point
	#  conversion: x_fix = round(x_float * scale)
	#  You can use this as default scale or use a different
	#  scale on each operation (set in HE.encryptFrac)
	'qi_sizes': [60, 30, 30, 30, 60]  # Number of bits of each prime in the chain.
	# Intermediate values should be  close to log2(scale)
	# for each operation, to have small rounding errors.
}

HE.contextGen(**ckks_params)  # Generate context for bfv scheme
HE.keyGen()  # Key Generation: generates a pair of public/secret keys
HE.rotateKeyGen()

data = np.random.randint(0, 5, size=(10, 5))
num_rows, num_cols = data.shape
rows = np.ones(num_rows, dtype=np.bool)
cols = np.ones(num_cols, dtype=np.bool)

 # Encrypting sub_data
        # 1. make sub_data a contiguous array in memory
        # 2. change 2d arrays into 1d
        # 3. Convert plaintext into ciphertext
        # 4. Reshape the array

sub_data = data[rows][:, cols]
sub_data = np.ascontiguousarray(sub_data)
enc_sub_data = sub_data.flatten()
arr_sub_data = np.empty(len(enc_sub_data), dtype=PyCtxt)
for i in np.arange(len(enc_sub_data)):
	arr_sub_data[i] = HE.encryptFrac(enc_sub_data[i])
arr_sub_data = arr_sub_data.reshape(sub_data.shape)

produces:
/usr/bin/python3.10 /home/serhat/SeCCA-CKKS/SeCCA (CKKS)/secured_cheng_church_yeast.py
SeCCA Step 2
Number of the Bicluster:1
Traceback (most recent call last):
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/secured_cheng_church_yeast.py", line 20, in
biclustering = secca.run(data)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 120, in run
self._multiple_node_deletion(data, rows, cols, msr_thr, HE, t_enc, t_dec)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 167, in _multiple_node_deletion
msr, row_msr, col_msr = self._calculate_msr(data, rows, cols, HE, t_enc, t_dec)
File "/home/serhat/SeCCA-CKKS/SeCCA (CKKS)/biclustlib/algorithms/type2.py", line 231, in _calculate_msr
arr_sub_data[i] = HE.encryptFrac(enc_sub_data[i])
File "Pyfhel/Pyfhel.pyx", line 328, in Pyfhel.Pyfhel.Pyfhel.encryptFrac
File "", line 675, in View.MemoryView.memoryview_cwrapper
File "", line 363, in View.MemoryView.memoryview.cinit
BufferError: scalar buffer is readonly

Process finished with exit code 1

I see the error now! enc_sub_data[i] is a single numerical value (of type int if I'm not mistaken). Pyfhel V3+ encodes entire 1D vectors into a single ciphertext to benefit from the SIMD techniques of BFV/CKKS schemes. The single-value encoding that your code is using is no longer part of Pyfhel (for being absurdly inefficient).
To solve the error, encrypt an entire 1D vector using HE.encryptFrac instead of a single value (could be column-wise or row-wise).
arr_sub_data = HE.encryptFrac(enc_sub_data.astype(np.float64))

Beyond this, I strongly suggest you to take a look at Demo_3 to understand how to deal with vectorized operations in CKKS.

Thank you very much for your help. This information has definitely helped a lot, you are absolutely right. We have changed this place, but still have difficulties. We are doing the encryption in a two dimensional and don't know how to go further by a one dimensional array.
We get a reshape error after the change. I really would appreciate your help.
Code
HE = Pyfhel()  # Creating empty Pyfhel object
ckks_params = {
	'scheme': 'CKKS',  # can also be 'ckks'
	'n': 2 ** 14,  # Polynomial modulus degree. For CKKS, n/2 values can be
	#  encoded in a single ciphertext.
	#  Typ. 2^D for D in [10, 16]
	'scale': 2 ** 30,  # All the encodings will use it for float->fixed point
	#  conversion: x_fix = round(x_float * scale)
	#  You can use this as default scale or use a different
	#  scale on each operation (set in HE.encryptFrac)
	'qi_sizes': [60, 30, 30, 30, 60]  # Number of bits of each prime in the chain.
	# Intermediate values should be  close to log2(scale)
	# for each operation, to have small rounding errors.
}

HE.contextGen(**ckks_params)  # Generate context for bfv scheme
HE.keyGen()  # Key Generation: generates a pair of public/secret keys
HE.rotateKeyGen()

data = np.random.randint(0, 5, size=(10, 5))
num_rows, num_cols = data.shape
rows = np.ones(num_rows, dtype=np.bool)
cols = np.ones(num_cols, dtype=np.bool)

 # Encrypting sub_data
        # 1. make sub_data a contiguous array in memory
        # 2. change 2d arrays into 1d
        # 3. Convert plaintext into ciphertext
        # 4. Reshape the array

sub_data = data[rows][:, cols]
sub_data = np.ascontiguousarray(sub_data)
enc_sub_data = sub_data.flatten()
arr_sub_data = np.empty(len(enc_sub_data), dtype=PyCtxt)
for i in np.arange(len(enc_sub_data)):
	arr_sub_data = HE.encryptFrac(enc_sub_data.astype(np.float64))
arr_sub_data = arr_sub_data.reshape(sub_data.shape)

Error
/usr/bin/python3.10 /home/serhat/SeCCA-CKKS/secured_cheng_church_yeast.py
SeCCA Step 2
Number of the Bicluster:1
Traceback (most recent call last):
  File "/home/serhat/SeCCA-CKKS/secured_cheng_church_yeast.py", line 20, in <module>
    biclustering = secca.run(data)
  File "/home/serhat/SeCCA-CKKS/biclustlib/algorithms/type2.py", line 120, in run
    self._multiple_node_deletion(data, rows, cols, msr_thr, HE, t_enc, t_dec)
  File "/home/serhat/SeCCA-CKKS/biclustlib/algorithms/type2.py", line 167, in _multiple_node_deletion
    msr, row_msr, col_msr = self._calculate_msr(data, rows, cols, HE, t_enc, t_dec)
  File "/home/serhat/SeCCA-CKKS/biclustlib/algorithms/type2.py", line 234, in _calculate_msr
    arr_sub_data = arr_sub_data.reshape(sub_data.shape)
AttributeError: 'Pyfhel.PyCtxt.PyCtxt' object has no attribute 'reshape'

Process finished with exit code 1

At this point you can get rid of the reshape! Oh, please open a new issue if you need further help with Pyfhel related errors. Let's keep this issue clean!
If you have doubts on how to implement some math operations efficiently using Pyfhel (as it seems to be the case), you can just open an issue with pure numpy code performing those operations without encryption, and the request on how to efficiently perform them using HE.

I meet a same problem, the code is as follow.
def encode_matrix(HE, matrix):
# Base case: if the matrix is one-dimensional, directly apply encodeFrac to each element.
if matrix.ndim == 1:
return np.array([HE.encodeFrac(x) for x in matrix])
# Recursive case: apply encode_matrix to each sub-array.
else:
return np.array([encode_matrix(HE, sub_matrix) for sub_matrix in matrix])
HE = Pyfhel()
ckks_params = {
"scheme": "CKKS",
"n": 214,
"scale": 240,
"qi_sizes":[60,40,40,40,60]
}
HE.contextGen(**ckks_params)
HE.keyGen()
HE.rotateKeyGen()
HE.relinKeyGen()
a = np.array([[[1,2,3],[4,5,6]],[[2,3,4],[5,6,7]]])
b=encode_matrix(HE, a)
Traceback (most recent call last):
File "", line 1, in
File "", line 7, in encode_matrix
File "", line 7, in
File "", line 7, in encode_matrix
File "", line 7, in
File "", line 4, in encode_matrix
File "", line 4, in
File "Pyfhel/Pyfhel.pyx", line 742, in Pyfhel.Pyfhel.Pyfhel.encodeFrac
File "", line 663, in View.MemoryView.memoryview_cwrapper
File "", line 353, in View.MemoryView.memoryview.cinit
BufferError: scalar buffer is readonly
So how do I solve this issue


Perma diff in EC2 LaunchConfiguration userData causes replaces

Describe what happened
Since version v6.51.0 the userData property of EC2 Launch Configurations shows a diff on every deployment.
The userData property is marked as ForceNew, so this causes replacements.
This can cause downtime, because this can cascade into ASG instances being replaced.
This does not reproduce under v6.50.1 of the provider. My suspicion is that this is caused by the rollout of PlanResourceChange as there were no changes to the LaunchConfiguration resource in the last 3 months (see).
Sample program
import * as pulumi from "@pulumi/pulumi";
import * as aws from "@pulumi/aws";
import * as awsx from "@pulumi/awsx";

const amiId = pulumi.interpolate`/aws/service/eks/optimized-ami/1.30/amazon-linux-2023/x86_64/standard/recommended/image_id`.apply(name =>
    aws.ssm.getParameter({ name }, { async: true })
  ).apply(result => result.value);

const userData = `#!/bin/bash

/etc/eks/bootstrap.sh
`;

const nodeLaunchConfiguration = new aws.ec2.LaunchConfiguration("test",
    {
        associatePublicIpAddress: true,
        imageId: amiId,
        instanceType: "t2.medium",
        userData: userData,
    }
);

Log output
No response
Affected Resource(s)
aws:ec2:LaunchConfiguration
Output of pulumi about
n/a
Additional context
No response
Contributing
Vote on this issue by adding a 👍 reaction.
To contribute a fix for this issue, leave a comment (and link to your pull request, if you've opened one already).

This impacts EKS as well: https://github.com/pulumi/pulumi-eks/issues/1345.

If you're running into this, you can downgrade to v6.50.1 of the AWS provider while we're working on fixing this

I was able to pin-point it to this: https://github.com/pulumi/pulumi-terraform-bridge/issues/2408


Faster (non-blocking) update of processes

On first update, it will determine base number of goroutines and make sure to never get to the point where cmd execution(getProcesses) will be slower than ticking time and flooding with number of goroutines.

Closing this because, as discussed in #8, I think this is probably a general Windows issue.


[FLINK-1844] [ml] Add Normaliser to ML library

[FLINK-1844] Add Normaliser to ML library
Adds a MinMaxScaler to the ML preprocessing package. MinMax scaler scales the values to a user-specified range.

Really good work @fobeligi. The code is really well structured and documented. I had only some minor comments. When you have them addressed, I think it's good to be merged :-)

Note: you might want to rename this to [FLINK-1844] [ml] - Add Normaliser to ML library so that JIRA picks up on the issue.

LGTM. Will merge once Travis gives green light.

The documentation must also change index.html (FlinkML landing site) so that it is linked from somewhere.


Update project list

Please add any new projects that don't exist yet on the list. The list is located in the _pages/projects folder. Please create a branch and a pull request when you have added the project. We might also consider add some projects that are not formally an engineering project (VRE, ibridges, Whisper, etc.) Just add them if you think they are a good addition to the list and we can discuss it in the PR.

[x] Martine
[x] Modhurita
[x] Roel
[x] Maarten
[x] Christine
[x] Parisa
[x] Shiva
[x] Raoul
[x] Dawa
[ ] Jelle

Updated!

@jelletreep We/you might want to finish this PR?


Bump react-native-live-markdown to 0.1.82

Details

This PR bumps the version of live markdown
Fixed Issues

$ https://github.com/Expensify/App/issues/41696
$ https://github.com/Expensify/App/issues/39255
$ https://github.com/Expensify/App/issues/42160
$ https://github.com/Expensify/App/issues/17767
$ https://github.com/Expensify/App/issues/14445
$ https://github.com/Expensify/App/issues/15640
$ https://github.com/Expensify/App/issues/41137
$ https://github.com/Expensify/App/issues/41567
$ https://github.com/Expensify/App/issues/42523
$ https://github.com/Expensify/App/issues/41078
$ https://github.com/Expensify/App/issues/41597
Tests

The best course of action would be to go through each of the issues added above and verify if just the changes in react-native-live-markdown were needed to fix them. If so you can test if they are not happening anymore. Here's a list of some of the issues & testing steps:

https://github.com/Expensify/App/issues/41597
Check if report mentions in non policy rooms are not highlighted
https://github.com/Expensify/App/issues/41078
Check if only valid phone number mentions are allowed
https://github.com/Expensify/App/issues/42523
Check if you are able to type in the composer on android mWeb
https://github.com/Expensify/App/issues/41567
Check if you are able to scroll task description input
https://github.com/Expensify/App/issues/41137
Check if pasting on android mWeb
https://github.com/Expensify/App/issues/17767
Paste text from issue desc and check if it's displayed properly
https://github.com/Expensify/App/issues/39255
Check if you are able to undo copy pasted text
https://github.com/Expensify/App/issues/41696
Check if markdown is treating >test and > test differently (the second one should be a quote, the first one just plain text)

Offline tests

QA Steps

[x] Verify that no errors appear in the JS console

PR Author Checklist

[x] I linked the correct issue in the ### Fixed Issues section above
[x] I wrote clear testing steps that cover the changes made in this PR

[x] I added steps for local testing in the Tests section
[x] I added steps for the expected offline behavior in the Offline steps section
[x] I added steps for Staging and/or Production testing in the QA steps section
[x] I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
[x] I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
[x] I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).

[x] I included screenshots or videos for tests on all platforms
[x] I ran the tests on all platforms & verified they passed on:

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[x] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

[x] I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
[x] I followed proper code patterns (see Reviewing the code)

[x] I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
[x] I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
[x] I verified that comments were added to code that is not self explanatory
[x] I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
[x] I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method

[x] If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:

[x] I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
[x] I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
[x] I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
[x] I verified the JSDocs style guidelines (in STYLE.md) were followed

[x] If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
[x] I followed the guidelines as stated in the Review Guidelines
[x] I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
[x] I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
[x] I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
[x] I verified that if a function's arguments changed that all usages have also been updated correctly
[x] If any new file was added I verified that:

[x] The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory

[x] If a new CSS style is added I verified that:

[x] A similar style doesn't already exist
[x] The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))

[x] If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
[x] If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
[x] If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
[x] If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
[x] If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:

[x] I verified that all the inputs inside a form are aligned with each other.
[x] I added Design label and/or tagged @Expensify/design so the design team can review the changes.

[x] If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
[x] If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native

https://github.com/Expensify/App/assets/41169160/5e3f2da5-6746-4371-b691-d3db41fa7049

Android: mWeb Chrome

https://github.com/Expensify/App/assets/41169160/3bb52893-8249-453c-9ad4-446d4ea7dcee

iOS: Native

https://github.com/Expensify/App/assets/41169160/2d674b78-22b0-4fa4-8984-e4fcfeb3289b

iOS: mWeb Safari

https://github.com/Expensify/App/assets/41169160/f15ddef9-d7b4-4e91-bd46-34a590069ac7

MacOS: Chrome / Safari

https://github.com/Expensify/App/assets/41169160/83684ebf-5d4a-48f4-b4e2-0a152eee7474

MacOS: Desktop

https://github.com/Expensify/App/assets/41169160/60c2d9df-1a6a-44d7-953f-18a941cd708a

cc @luacmartins

cc @tomekzaw @SzymczakJ

https://github.com/Expensify/App/pull/43255#issuecomment-2154906692

Actually, this wasn't supposed to be fixed, I think it's in the PR description by mistake. Thanks for pointing this out.

Thanks @ishpaul777. It seems like https://github.com/Expensify/App/issues/41597 shouldn't be fixed in this PR, so I removed it from the OP. As for https://github.com/Expensify/App/issues/41137, that's no longer a blocker, so I think we can merge this and continue to work on a solution for https://github.com/Expensify/App/issues/41137

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Cherry-picked to staging by https://github.com/luacmartins in version: 1.4.80-14 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

@Expensify/applauseleads please QA this PR and check it off on the deploy checklist if it passes.

Live Markdown treats > space and >nospace equally Failing in mweb , desktop and native apps

https://platform.utest.com/services/links/v1/internal/51620598?.mp4
https://platform.applause.com/services/links/v1/external/f916461c07391fd466e658254fcfb563574b41b84e21b539481ccd655dfeb380
https://platform.utest.com/services/links/v1/internal/51620643?.mp4
https://platform.applause.com/services/links/v1/external/78183abdc52fcd999d20dbe7c331e946b519afcab806a6d18b0b8f384b5def44

[$500] Unable to undo copy and pasted text - Failing in web

https://platform.applause.com/services/links/v1/external/c0c9dbe667126f8e96131d8f41281532421f41efd3242c21a9ff54f5bf240040

Found a blocker Chat - Emoji gets inserted in front of entered text when validating (https://github.com/Expensify/App/issues/14445)

mWeb - Chat-Pasting text in compose box makes page moves up and down failing in mweb https://platform.utest.com/services/links/v1/internal/51618911?.mp4

App crashes after pressing R in metro bundler on iOS simulator can't be retested in staging

Expensify Composer (When moving to another line, the word and emoji are close to each other):
All tests for Issue https://github.com/Expensify/App/issues/14445 are successfull.
The difference of baseline is 1.15 (barely noticeable), maximumLineHeight 20, maximumFontLineHeight 17.69

Before
After

Before
After

The result below is achieved after setting textInputCompose.lineHeight: 40.

baseLineOffset is 11.15
maximumLineHeight is 40
maximumFontLineHeight is 17.69

Before
After

Before
After

Before
After

Issue https://github.com/Expensify/App/issues/14445 requires also Meta team to merge PR https://github.com/facebook/react-native/pull/44614.

🚀 Deployed to production by https://github.com/luacmartins in version: 1.4.81-11 🚀

platform
result

🤖 android 🤖
failure ❌

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅


add test_state_is_readonly

A unit test verifying RunEngine.state is not assignable.
Description
def test_state_is_readonly(RE):
with pytest.raises(AttributeError):
RE.state = 'running'
Motivation and Context
This is in support of #1188.

I took the liberty of making it non-draft and merging it.


Copy over new protobuf definitions

Description
Fixes #4249
This copies the new protobuf definitions from gftools
Checklist

[ ] update CHANGELOG.md
[ ] wait for the tests to pass
[ ] request a review

thanks!


Using to connect to PostgreSQL database

Can this buildpack be used to connect to PostgreSQL (with use of numtel/pg package)

Maybe.  I haven't used numtel/pg before, but please try.
If you're not using mongolab, you'll want to fork this buildpack and remove references to them from the release file: https://github.com/AdmitHub/meteor-buildpack-horse/blob/master/bin/release
If you have other addons that are needed for postgresql you'll need to enable those.  If you need other extra things to be installed on the server (beyond standard meteor packages) you may need to write an "extras" script to pull those in.


hack/generate-manifest.sh has some options does not implement

Describe the bug
There are some options in hack/generate-manifest.sh, which are not implemented.
To Reproduce

Run ./hack/generate-manifest.sh --help to see what is supported:

Usage: ./hack/generate-manifest.sh [--mode (dev|release)] [--encap-mode] [--ipsec] [--no-proxy] [--no-np] [--keep] [--tun (geneve|vxlan|gre|stt)] [--verbose-log] [--help|-h]
Generate a YAML manifest for Antrea using Helm and print it to stdout.
        --mode (dev|release)          Choose the configuration variant that you need (default is 'dev')
        --encap-mode                  Traffic encapsulation mode. (default is 'encap')
        --cloud                       Generate a manifest appropriate for running Antrea in Public Cloud
        --ipsec                       Generate a manifest with IPsec encryption of tunnel traffic enabled
        --all-features                Generate a manifest with all alpha features enabled
        --no-proxy                    Generate a manifest with Antrea proxy disabled
        --proxy-all                   Generate a manifest with Antrea proxy with all Service support enabled
        --endpointslice               Generate a manifest with EndpointSlice support enabled
        --flow-exporter               Generate a manifest with FlowExporter support enabled
        --no-np                       Generate a manifest with Antrea-native policies disabled
        --tun (geneve|vxlan|gre|stt)  Choose encap tunnel type from geneve, gre, stt and vxlan (default is geneve)
        --verbose-log                 Generate a manifest with increased log-level (level 4) for Antrea agent and controller.
                                      This option will work only in 'dev' mode.
        --on-delete                   Generate a manifest with antrea-agent's update strategy set to OnDelete.
                                      This option will work only in 'dev' mode.
        --coverage                    Generates a manifest which supports measuring code coverage of Antrea binaries.
        --simulator                   Generates a manifest with antrea-agent simulator included
        --custom-adm-controller       Generates a manifest with custom Antrea admission controller to validate/mutate resources.
        --hw-offload                  Generates a manifest with hw-offload enabled in the antrea-ovs container.
        --sriov                       Generates a manifest which enables use of Kubelet API for SR-IOV device info.
        --flexible-ipam               Generates a manifest with flexible IPAM enabled.
        --whereabouts                 Generates a manifest which enables whereabouts configuration for secondary network IPAM.
        --help, -h                    Print this message and exit
        --multicast                   Generates a manifest for multicast.
        --multicast-interfaces        Multicast interface names (default is empty)
        --extra-helm-values-file      Optional extra helm values file to override the default config values

Run command  ./hack/generate-manifest.sh --mode dev --encap-mod noEncap

Expected
It is expected  to change encap mode with ./hack/generate-manifest.sh --mode dev --encap-mod noEncap
Actual behavior
Got warning with Unknown option --encap-mod
Versions:
main branch
Please provide the following information:

Antrea version: main branch.

Additional context

The warning has clearly pointed out the problem: Unknown option --encap-mod, there is only --encap-mode


Incorrect usage of Exclude in type declarations

I believe these two should be using Omit<DotOptions, "symbol"> rather than Exclude<DotOptions, "symbol">:
https://github.com/observablehq/plot/blob/7d18179ef5c46db1dc0f463b9e4d0888766cc80d/src/marks/dot.d.ts#L141
https://github.com/observablehq/plot/blob/7d18179ef5c46db1dc0f463b9e4d0888766cc80d/src/marks/dot.d.ts#L144
(Exclude filters out members from unions, whereas Omit filters out properties)

Thanks for the report. Agreed.


CICD: Run nightly builds

Existing PRs seem to fail due to external factors: https://github.com/upkie/upkie/issues/438 .
This PR adds a nightly build schedule for the main branch (default behaviour of schedule:), run at midnight everyday.
Hopefully, we will catch failing builds faster this way, also with less ambiguity (i.e. we'd know it's not the PR itself causing the failure).

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 90.41%

Totals

Change from base Build<PHONE_NUMBER>9:
0.0%

Covered Lines:
2800

Relevant Lines:
3097

💛  - Coveralls


Make update is broken

Applying patch (desired to fix #12735)
example.txt
patch -p1 < example.txt
make update
make clean
make

get the following error
In file included from ssl/ssl_err.c:11:
ssl/ssl_err.c:315:31: error: 'SSL_R_OCSP_CALLBACK_FAILURE' undeclared here (not in a function); did you mean 'SSL_R_CALLBACK_FAILED'?
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_CALLBACK_FAILURE),
                               ^~~~~~~~~~~~~~~~~~~~~~~~~~~
include/openssl/err.h:256:25: note: in definition of macro 'ERR_PACK'
       (((unsigned long)(reason) & ERR_REASON_MASK)) )
                         ^~~~~~
ssl/ssl_err.c:317:31: error: 'SSL_R_OCSP_RESPONSE_IS_INVALID' undeclared here (not in a function); did you mean 'RSA_R_LAST_OCTET_INVALID'?
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_RESPONSE_IS_INVALID),
                               ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
include/openssl/err.h:256:25: note: in definition of macro 'ERR_PACK'
       (((unsigned long)(reason) & ERR_REASON_MASK)) )
                         ^~~~~~
make[1]: *** [Makefile:18658: ssl/libssl-lib-ssl_err.o] Error 1
make[1]: Leaving directory '/home/beldmit/upstream/openssl'
make: *** [Makefile:3126: build_sw] Error 2

The resulting diff of util/libssl.num after make update invocation seems unreasonably huge marking a lot of function as non-existent.

Was it only that patch?  A couple of new SSL_R_ macros shouldn't affect util/libssl.num, at all.

Note that I found a but in OpenSSL::ParseC, fixed in #12882

I just merged the current master branch to my copy without any other changes.
Should I try the fix you refer to?

Tried and got the same error :(

Can you point to an exact starting point?  Repository and commit id?

Repo:
https://github.com/beldmit/openssl
Head:
commit 4343a4187d28d719006642a610afea6e186832bf (HEAD -> master, upstream/master, origin/master, origin/HEAD)
Author: Shane Lontis<EMAIL_ADDRESS>Date:   Wed Sep 16 14:10:23 2020 +1000

So, regarding the compilation problem you get, this is the diff that make update created:
diff --git a/ssl/ssl_err.c b/ssl/ssl_err.c
index 9f47a924f0..ba245bfe09 100644
--- a/ssl/ssl_err.c
+++ b/ssl/ssl_err.c
@@ -9,7 +9,7 @@
  */

 #include <openssl/err.h>
-#include <openssl/sslerr.h>
+#include <openssl/ssl.h>

 #ifndef OPENSSL_NO_ERR

@@ -312,6 +312,10 @@ static const ERR_STRING_DATA SSL_str_reasons[] = {
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_NULL_SSL_CTX), "null ssl ctx"},
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_NULL_SSL_METHOD_PASSED),
     "null ssl method passed"},
+    {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_CALLBACK_FAILURE),
+    "ocsp callback failure"},
+    {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_RESPONSE_IS_INVALID),
+    "ocsp response is invalid"},
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OLD_SESSION_CIPHER_NOT_RETURNED),
     "old session cipher not returned"},
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OLD_SESSION_COMPRESSION_ALGORITHM_NOT_RETURNED),

See the changed #include?    A simple solution would be to have ssl.h include sslerr.h, which is the pattern we have elsewhere.
The reason we haven't seen this for a while?  I guess we haven't added a new SSL_R_ error in a while...
As to the libssl.num problem, I'm still trying to figure that one out.  I assume it's some sort of parsing problem...  it seems to be triggered only when you build in the source tree (I habitually have a separate build tree, so...)

I see the include change. AFAIR, I tried to revert it but still got the same error.

I reverted the #include replacement.
The situation did not become better.
In file included from ssl/ssl_err.c:11:
ssl/ssl_err.c:315:31: error: 'SSL_R_OCSP_CALLBACK_FAILURE' undeclared here (not in a function); did you mean 'SSL_R_CALLBACK_FAILED'?
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_CALLBACK_FAILURE),
                               ^~~~~~~~~~~~~~~~~~~~~~~~~~~
include/openssl/err.h:256:25: note: in definition of macro 'ERR_PACK'
       (((unsigned long)(reason) & ERR_REASON_MASK)) )
                         ^~~~~~
ssl/ssl_err.c:317:31: error: 'SSL_R_OCSP_RESPONSE_IS_INVALID' undeclared here (not in a function); did you mean 'SSL_R_COMPRESSION_DISABLED'?
     {ERR_PACK(ERR_LIB_SSL, 0, SSL_R_OCSP_RESPONSE_IS_INVALID),
                               ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
include/openssl/err.h:256:25: note: in definition of macro 'ERR_PACK'
       (((unsigned long)(reason) & ERR_REASON_MASK)) )
                         ^~~~~~
make[1]: *** [Makefile:18651: ssl/libssl-lib-ssl_err.o] Error 1
make[1]: Leaving directory '/home/beldmit/upstream/openssl'
make: *** [Makefile:3119: build_sw] Error 2

Huh, it seems it doesn't touch include/openssl/sslerr.h...  wonder why

I'll get back on this...  for the moment, I need my mind elsewhere

I found that something seems very wrong...  util/mkerr.pl will suddenly write to include/openssl/foo.h instead of include/openssl/fooerr.h, and for the moment, I can't even see where that file rename before writing is supposed to happen

Fix in #12910.


Is the r-value outputted by scipy.stats.linregress always the Pearson correlation coefficient?

The documentation just says that rvalue is the "Correlation coefficient" but there are many different correlation coefficients, not just the Pearson one. However, it also says that the square of rvalue is the coefficient of determination, and according to Wikipedia:

When an intercept is included, then r2 is simply the square of the sample correlation coefficient (i.e., r) between the observed outcomes and the observed predictor values.[4] If additional regressors are included, R2 is the square of the coefficient of multiple correlation.

Is the output always the Pearson coefficient, or is it sometimes the coefficient of multiple correlation? We should clarify that in the documentation.

In scipy.stats.linregress , r = ssxym / sqrt( ssxm * ssym ) so I think it is Pearson coefficient.

However, it also says that the square of rvalue is the coefficient of determination, and according to Wikipedia:

When an intercept is included, then r2 is simply the square of the sample correlation coefficient (i.e., r) between the observed outcomes and the observed predictor values.[4] If additional regressors are included, R2 is the square of the coefficient of multiple correlation.

Is the output always the Pearson coefficient, or is it sometimes the coefficient of multiple correlation? We should clarify that in the documentation.

According to Wikipedia 1.3 As squared correlation coefficient

In linear least squares multiple regression with an estimated intercept term, R2 equals the square of the Pearson correlation coefficient between the observed {\displaystyle y}y and modeled (predicted) {\displaystyle f}f data values of the dependent variable.
In a linear least squares regression with an intercept term and a single explanator, this is also equal to the squared Pearson correlation coefficient of the dependent variable {\displaystyle y}y and explanatory variable {\displaystyle x.}x.

Here in our linear least-squares regression  scipy.stats.linregress,  the square of rvalue(Pearson coefficient) is equal to  R2 (Coefficient of determination).


PDF/ePub files

Are there any exports of the specification to PDF or ePub files?

There is not, but it might be nice!

:+1: to what @steveklabnik said.
In the mean time, though, there's a good print stylesheet, so if you print the Specification page and save that to PDF, you'll get an ok output (albeit with links formatted for print, rather than for onscreen display). That stylesheet could also probably be the basis of some export-to-pdf script that we could run each time we publish a new version.


Would you support windows 10 desktop app?

Would you plan to support windows 10 desktop app?

Yes, I will work on it this month!

Thanks @gliheng !

Hey, chenshuiluke. Now it should work on windows. I also updated flutter sdk to 1.2.1.   I'll add NSIS distribution sometime this week.


add PR check for apps-maven-builder

closing in favor of https://github.com/kubesmarts/osl-images/pull/3


gnss driver: refactor & add wheelvelocity command support

@fengqikai1414 Could you do a git rebase from upstream before push? Otherwise this would be less easier to be merged back to master.


Remove the feature of multi-language support said by @Akshat Jain bhaiya

I am working on it.

Hey Amartya, a suggestion, actually the aim of the issue which I had created was that if on someone's phone the default language is set to suppose Hindi, then all the content should be displayed in Hindi. There was no need for a select language spinner in the layout. So what you can is, remove the select language spinner from the layout, and then make it compatible for other languages. Currently, I checked by changing my phone's default lang to Hindi and after opening the app the content is displayed in Hindi, but when I checked for Bengali it didn't work. So you work on this, instead of removing the code for multi lang support completely, just remove spinner from layout, and make it compatible to the phone default language.

Also, remove about us page and the background images of the theme.


List is not rendered on $scope.apply()

I managed to get this to work if the data is already available when the template is rendered. However, I receive data asynchronous through socket.io, and broadcast an update on the scope, which I listen to like this:
$scope.$on('update', function (event, data) {
  console.log('captured update', data)
  $scope.x = data.menu.items;
  $scope.$apply();
})

However, this does not trigger a render of the menu, like a regular ng-repeat does. Is there any way to trigger the as-sortable manually, or make it apply changes on external updates like this?

I'm having the same issue, using socket.io to update the items inside ngSortable, it doesn't seem to work neither calling $apply or calling $digest directly.
The digest cycle triggers but it seems to ignore the changes done to the scope, so the view remains the same


Bulkdata connectathon merge

I've merged my connectathon work with the bulk data support present in the master branch.
There are some areas where this code differs from the one in the master branch

I've separated the asynchronous processing from the $export functions on Patient and Group.
The asynchronous processing now works on all get operations. This creates the option to provide status updates for measure and plan definition processing. Killing processes when no longer needed. Something I would like to add in the future.

This version supports patientId based exports.

This version supports DELETE operations

A test class was added that tests the operation.

Thanks for the contributions Bas!
That's a lot of code and will take me some time to review and test everything. As a gentle suggestion: if you could issue smaller pull requests with a more singular focus in the future, that would be appreciated.
My first concern is that you altered the code I had for bulk data $export to return a Bundle? That is not what the operation is supposed to return according to the documentation. Could you explain your reasoning behind that change?

I suggest that this pull request can still be replaced by multiple smaller pull requests if the author is willing.

@duncand  Sure, What subdivision do you have in mind?
@c-schuler  I understand - I'll try to provide smaller updates from now on.
Regarding why I changed the result of $export to a Bundle.
This has to do with the split I made in the implementation. I've separated the asynchronous processing from the logic of doing the $export operation. So $export returns a set of resources - in a Bundle. The asynchronous processing code will take this and split it up if this is requested by the ndjson field.

Closing because the PR is stale. Sorry this didn't ever get merged in. The base HAPI server now support bulk export. The cqf-ruler has not yet added support for async Measure eval.


Fix states not updating after command was sent!

I missed that this had to be done manually when should_pull = False

It has to be done manually because some devices might push the new state back itself when a command is received.

Sure, I understand, just missed it.

CI was broken for a few days, reporting tests pass without actually passing. It seems your dev branch is based on this and so we didn't notice that you introduced some style violations


Dependency updates: egui & ffmpeg

This PR bumps egui to 0.28.0 and ffmpeg-the-thrid to 2.0.1. This makes the project compatible with ffmpeg7.
The input_context().packets() iterator now returns result items, for now I decided to just propagate them with ? as is done elsewhere in the affected functions. Let me know if you think a different approach would be more suitable here.
After the changes I ran the main example in this repo, everything seems to work fine. Tested on Arch with ffmpeg 7.0.1 installed.
From my understanding, the crate should still be compatible with ffmpeg6, but note that I haven't actually tested that.

thanks so much for this and sorry for the late merge


ARM is not included in Electron targets

Currently the targets list does not include ARMv7, even though Electron releases builds for this architecture (and VS Code supports it).  This is fine if building on ARMv7 directly, but inhibits cross-compilation.
https://github.com/Microsoft/vscode/blob/3e27c42d7a832f49e569b9d20d0aeb1911db6b37/build/gulpfile.vscode.js#L171-L173
Suggest adding an electron-arm target to this list.

#6442


custom agent "big circle" is filling with "target color"

when you want to create a custom agent with shape=big circle in order to better see its range (like the built-in big circles for eoe, qz, winnow), then when you target it, its whole big circle becomes shaded with your target edge color (default yellow), and it becomes hard to see anything else in that big circle.
for the built-in big circles for eoe/qz/winnow, this doesn't happen. the only thing that changes to your target color is the edge of the actual small eoe/qz/winnow in the middle. is there a way to use this behavior for all custom big circles?

Fixed for next release, ta


Add user robots count to org list table

It's working, but feels slow. Since these all fire after /api/v1/users we should load the table and include skeletons in a future PR.


Scenario Selector - Handle "Delete" of primary scenarios

Issue
It is possible to click on the button to delete a primary scenarios. This will raise an error and show a string below the visual element.
Error deleting Scenario. Scenario SCENARIO_scenario_46baaf71-5290-4d8d-99db-05fb54614482, which has config id scenario, is primary and there are other scenarios in the same cycle.
Expected behaviour
It should not be possible to delete primary scenarios in Scenario Selector.
Version
Taipy: 2.3.0 Draft

A scenario can be deleted if and only if
(it is not primary) or (it is the only scenario of its cycle).
Otherwise, the deletion raises an error.
We probably want to implement the same rule in the Scenario selector. The business logic should remain in taipy-core. Maybe an API should be opened on taipy-core (is_scenario_deletable) that returns true if the scenario can be deleted.
I drop the code that deletes the scenario here, so the rule is understandable:
def _delete(cls, scenario_id: ScenarioId):
        scenario = cls._get(scenario_id)
        if scenario.is_primary:
            if len(cls._get_all_by_cycle(scenario.cycle)) > 1:
                raise DeletingPrimaryScenario(
                    f"Scenario {scenario.id}, which has config id {scenario.config_id}, is primary and there are "
                    f"other scenarios in the same cycle. "
                )
            _CycleManagerFactory._build_manager()._hard_delete(scenario.cycle.id)
            return
        entity_ids_to_delete = cls._get_children_entity_ids(scenario)
        entity_ids_to_delete.scenario_ids.add(scenario.id)
        cls._delete_entities_of_multiple_types(entity_ids_to_delete)
        return


Build pipeline

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: fernandocollova-endava sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


[Issue] azd init hangs inside WSL

[x] Make sure you've installed the latest version using instructions in the wiki

Output from azd version
Run azd version and copy and paste the output here:
azd version 0.1.0-beta.3 (commit 77ab01c3bcf40d12852d543506ecbb935a779f81)
Output from az version
Run az version and copy and paste the output here (minimum required version is 2.38.0):
{
"azure-cli": "2.38.0",
"azure-cli-core": "2.38.0",
"azure-cli-telemetry": "1.0.6",
"extensions": {}
}
Describe the bug
When the user isn't logged into azure CLI, running azd init hangs on az login.
To Reproduce

In WSL, run az logout
Run azd init in an empty folder
Specify a template (if needed) and an environment name
azd hangs forever

Expected behavior
azd should print out the device code since there isn't autolaunch browser support in WSL.
Environment
Information on your environment:
* WSL Ubuntu 22.04
Additional context

I can't repro this anymore. Does this still persist for you @weikanglim?

IIRC, we are not failling if we run any command (like init or up) and we did not log in first.

This is mostly fixed with the azd login changes to not depend on az


implement new subscription, ci/cd and terraform

Description

References

#0000

.github/templates/azure-function-cd-template.yml and .github/templates/azure-function-ci-template.yml can be deleted as well

.github/templates/azure-function-cd-template.yml, .github/templates/azure-function-ci-template.yml, .github/actions/dotnet-build-and-test/action.yml can be deleted as well

Fixed

could you add the following to CODEOWNERS
/.github/ @renetnielsen @djorgensendk @dstsyst
/build/ @renetnielsen @djorgensendk @dstsyst


Not working

I am trying to include html page inside the html page it is not taking any thing.
I have added your CSI.js at the top and also i tried all possible ways no luck/

Main

Naveen

You should include more info in this issue;

browser
OS
Any errors in error console?
Trimmed down pastebin of your code

@uxdesignz if you can supply more information as suggested, I am happy to try to help.

Hi @mikemarr !
I have not the same problem but similar:
in local, everything is okay, the include appear and the content inside too, but when I build my project, I just have the data-include in my index page but not the content instead!
I don't understand why, in the readme it says the data-include was replace by the content and... not... nothing, like in my local, i want to use it for making newsletter, i don't know what I miss.
by the way, my deposit works with gulp, not grunt, maybe it just that? Any help will be appreciated
Have a nice day

Thanks for making this script! I hope I can get it working.
I'm opening the file through the filesystem in Safari 12.0 on MacOS Mojave, and getting the following errors in the JS console when trying to data-include a "header.html" file:

Cross origin requests are only supported for HTTP.
XMLHttpRequest cannot load file:///Users/Dave/Desktop/html/header.html due to access control checks.

These errors are for the fragment "xmlhttp.send();"
Thanks in advance for any help you may be able to give with this! 😄

I got apache running and the script is working as expected when loaded via http, just not when loaded through the filesystem.


Multithread with rclone mount?

I'm using latest rclone to work with dropbox
The problem is that when one process runs copying of big file another process can't read directories/files.
I there any way to increase threads so it can do multiple uploads/downloads at same time?

rclone mount is already multithreaded.
Can you describe what you are doing in greater detail please and write the flags you are using for rclone mount - thanks.

--dir-cache-time 1m --vfs-read-chunk-size 200M
The problem is that i have slow upload, can i somehow to limit simultaneous file uploads to leave some threads for file reading? That might solve issue. Also file uploads are too slow, download speed fixed with --vfs-read-chunk-size

--dir-cache-time 1m --vfs-read-chunk-size 200M

Are you using --vfs-cache-mode?
How are you copying files to the mount?
How are you listing files on the mount?

soft works well with --vfs-cache-mode off
cp /home/mediat/public_html/upload/propertys/48138/652656.jpg /home/mediat/public_html/upload/propertys/48138/652657.jpg /home/mediat/public_html/upload/propertys/48138/652658.jpg /home/mediat/public_html/upload/propertys/48138/652659.jpg /home/mediat/public_html/upload/propertys/48138/652660.jpg /home/mediat/public_html/upload/propertys/48138/652661.jpg /home/mediat/public_html/upload/propertys/48138/652662.jpg /home/mediat/public_html/upload/propertys/48138/652663.jpg /home/mediat/public_html/upload/propertys/48138/652664.jpg /home/mediat/public_html/upload/propertys/48138/652665.jpg /home/mediat/public_html/upload/propertys/48138/652666.jpg /home/mediat/public_html/upload/propertys/48138/652667.jpg /home/mediat/public_html/upload/propertys/48138/652668.jpg /home/mediat/public_html/upload/propertys/48138/652669.jpg /home/mediat/public_html/upload/propertys/48138/652670.jpg /home/mediat/public_html/upload/propertys/48138/652671.jpg /home/mediat/public_html/upload/propertys/48138/652672.jpg /home/mediat/public_html/upload/propertys/48138/652673.jpg /home/mediat/public_html/upload/propertys/48138/652674.jpg /home/mediat/public_html/upload/propertys/48138/652675.jpg /home/mediat/public_html/upload/propertys/48138/652676.jpg /home/mediat/public_html/upload/propertys/48138/652677.jpg /home/mediat/public_html/upload/propertys/48138/652678.jpg /home/mediat/public_html/upload/propertys/48138/652679.jpg /home/mediat/public_html/upload/propertys/48138/652680.jpg /home/mediat/public_html/upload/propertys/48138/652681.jpg /home/mediat/public_html/upload/propertys/48138/652682.jpg /home/mediat/public_html/upload/propertys/48138/652683.jpg "/home/mediat/Dropbox/Media/Ready/22 Grantbrook Court Brampton, Ritchie Khroud/web/";
Reading files using php glob($dropbox.'/Media/*')
Now it works like that

It's better to use a rclone copy command as you can control the --transfers and such directly.

I'm seeing the same, when the write cache is uploading a large file (50GB) it will IO Block all other processes trying to write to separate files. due to our current workload, we have to use a vfs mount (Rsync server for inbound data)
/usr/bin/rclone mount incoming: /mnt/rclone \
   --allow-other \
   --buffer-size 256M \
   --dir-cache-time 1h \
   --drive-chunk-size 64M \
   --umask 000 \
   --vfs-read-chunk-size 128M \
   --vfs-read-chunk-size-limit off \
   --vfs-cache-mode writes \
   --cache-dir /var/cache/vfs/$i \
   --vfs-cache-max-age 10m \
   --low-level-retries 100 \
   --checkers=300 --transfers=300 --drive-chunk-size=64M --fast-list -v --attr-timeout 1m

@JRWR  That's a different issue. You can see it's tracked here -> https://github.com/ncw/rclone/issues/2811

I'm seeing the same, when the write cache is uploading a large file (50GB) it will IO Block all other processes trying to write to separate files. due to our current workload, we have to use a vfs mount (Rsync server for inbound data)

What do you mean IO block?  That it uses all the IO? Disk or network? Or that rclone doesn't upload any more files?

I have the same issue with rclone 1.46 on Windows 10 with gdrive.
Mount command:
rclone mount gcrypt: G: --allow-other --bind <IP_ADDRESS> --dir-cache-time 72h --fast-list --cache-chunk-path=X:\rclone-cache --cache-db-path=X:\rclone-cache --log-level INFO --vfs-cache-mode writes --cache-tmp-upload-path=X:\rclone-upload --cache-dir=X:\rclone-cache -P --drive-chunk-size 32M --buffer-size 256M --vfs-read-chunk-size 128M --vfs-read-chunk-size-limit off --rc
(I know some of those flags might be redundant when I'm just using normal crypt+drive vfs, but don't think they'd be the problem)
So I have the same issue as OP. I have my stuff download into a temporary folder from Sonarr, then be moved into the GDrive mount when it has finished downloading. Then Plex streams from the GDrive mount. When Sonarr is doing any uploads (particularly if there are many files uploading at once), almost always you won't be stream anything on Plex, nor even look inside the mount on Windows - it all gets locked up until the uploads finish.
Is there any real workaround (I would prefer to avoid hacking up something to use rclone copy with Sonarr) for this or something I could try? I have 1000/50 connection, so it can become quite bogged down when uploads happen -- but everything else works amazing. Thanks!

@MikeLund - perhaps best to start a new issue as it's not the same as the OP was talking about. There was an issue already solved so best to make sure you are own the new version and open an issue if you are having a problem as your behavior should have been fixed in 1.46.

Hm, but OP's issue doesn't look like it was about the deadlock (which I also had, but was thankfully fixed in 1.46)?

@MikeLund  - yes. if you are seeing a problem, I'd open up a new issue as it was fixed in  -> https://github.com/ncw/rclone/issues/2811

This looks to be solved. If you still have a question, please ask on the forums and we are happy to help.


Adding a dependency on the Kotlin plugin mess up org.jetbrains:annotations dependency

I tried adding a dependency on the Kotlin plugin:
intellij {
  plugins = ['Kotlin']
}

then there is a compilation on one of my class extending Configurable:

This is because the Kotlin plugin embed its own (outdated?) copy of annotations:

Maybe you could move annotations before plugins in the classpath?

We have this issue too, I guess annotations:13.0 comes from https://github.com/JetBrains/kotlin/blob/master/libraries/stdlib/jvm/build.gradle#L57


JS SDK MAPI VNext verification

Testing the new vNext version of  MAPI SDK - 1.0.0-next.0.

I don!T know how to solve the issue:
Could not find a declaration file for module '@kentico/kontent-management'. <EMAIL_ADDRESS>implicitly has an 'any' type.
 Try `npm i --save-dev @types/kentico__kontent-management` if it exists or add a new declaration (.d.ts) file containing `declare module '@kentico/kontent-management';`

Command npm i --save-dev @types/kentico__kontent-management fails, because there is no such package -  so the MAPI JS SDK package itself should probably include the declaration file

@Simply007  thank you :) I've fixed typings & modules in the 1.0.0-next.3. Should be working now ;)

@Enngage  - I don't know why but when I extract builder for Migration 01 and 03 the builder types seems to be incompatible with ContentTypeElementsBuilder.
https://github.com/Kentico/kontent-migrations-boilerplate/pull/3/checks?check_run_id=2795036971#step:6:8

@Enngage - I don't know why but when I extract builder for Migration 01 and 03 the builder types seems to be incompatible with ContentTypeElementsBuilder.
https://github.com/Kentico/kontent-migrations-boilerplate/pull/3/checks?check_run_id=2795036971#step:6:8
The error states also:
The types returned by 'contentGroup(...)' are incompatible between these types.
        Property 'type' is missing in type
'import("c:/projects/kontent-migrations-boilerplate/node_modules/@kentico/kontent-cli/node_modules/@kentico/kontent-management/_commonjs/models/content-types/content-type-elements.builder").ContentTypeElements.IElementInContentType'
but required in type
'import("c:/projects/kontent-migrations-boilerplate/node_modules/@kentico/kontent-management/dist/cjs/models/content-types/content-type-elements.builder").ContentTypeElements.IElementInContentType'

I my opinion, the Kontent-management SDK might be the peer dependency of Kontent CLI.

Let's make MAPI JS SDK a peer dependency and release a beta and test it out.

@Enngage - I have used Kontent CLI with Mapi SDK as Peer dependency (and using next version here).
There are still some CI errors - the most interesting is this one: https://github.com/Kentico/kontent-migrations-boilerplate/pull/3/checks?check_run_id=2876540519#step:6:13
Error: node_modules/@kentico/kontent-cli/lib/types/index.d.ts(4,20): error TS2314: Generic type 'IManagementClient<TCancelToken>' requires 1 type argument(s).
We have used ManagementClient as a Module parameter`- do you thing it might cause this issue?

@Enngage you should use ManagementClient class instead of the interface across the project :) The error you mentioned should be fixed here -> https://github.com/Kentico/kontent-cli/blob/feature/21/src/types/index.ts#L5

@Enngage you should use ManagementClient class instead of the interface across the project :) The error you mentioned should be fixed here -> https://github.com/Kentico/kontent-cli/blob/feature/21/src/types/index.ts#L5

Fixed

I will go through the sample migration and test some other scenarios.

Scenarios work well.
Wait for https://github.com/Kentico/kontent-cli/pull/24 before the merge.


Two new A1111 installs (Linux) one but does not show on one

I have two new A1111 installs (Linux) but on one machine, Config-Presets does not show up beneath the image preview area, but the other machine does.  Any idea why this might be happening?

Are you using the A1111 'dev' branch by any chance?  As soon as I started using it, I see a bunch of errors in the logs:
[ERROR][Config Presets] The txt2img component 'txt2img_restore_faces' could not be processed. This may be because you are running an outdated version of the Config-Presets extension, or you included a component ID in the custom tracked components config file that does not exist, no longer exists (if you updated an extension), or is an invalid component (if this is the case, you need to manually edit the config file at /home/anon/stable-diffusion-webui/extensions/Config-Presets\config-txt2img-custom-tracked-components.txt or just delete it so it resets to defaults). This extension will not work until this issue is resolved.
[ERROR][Config Presets] The img2img component 'img2img_restore_faces' could not be processed. This may be because you are running an outdated version of the Config-Presets extension, or you included a component ID in the custom tracked components config file that does not exist, no longer exists (if you updated an extension), or is an invalid component (if this is the case, you need to manually edit the config file at /home/anon/stable-diffusion-webui/extensions/Config-Presets\config-img2img-custom-tracked-components.txt or just delete it so it resets to defaults). This extension will not work until this issue is resolved.

I've tried the suggested remedy, but it didn't work.  I don't think there is a 'restore face' in the new UI.
See A1111 v1.6.0-RC-55-g04b90328

This should be resolved now.


Atom Generics (except A and Q) disappear from structure after saving in CML format

Steps to reproduce

Create any structure, for example, chain.
Click Periodic table.
Open Extended tab.
Click the "AH" button in the Atom Generics section, click the OK button and click any structure atom.
Click "Save as" button. Select CML format. Click OK.
Clear the canvas.
Open the structure saved at 5th step.

Expected result:
Atom Generics should stay at the structure after saving and display in the same way as before saving.
Actual result
The AH atom Generic disappears from the structure in spite of presence AH in the CML formula in the "Open" window.

FYI, A and Q stay at the structure after saving.
If at the structure there are a or Q and any other atom generics (that dissapeared when present at the structure alone), in this case the both atom generics stay at the structure after saving.
If at the structure there are several atom generics except A and Q, in this case all atom generics dsappears from the strcture after saving.

The bug occurs due to this issue: https://github.com/epam/Indigo/issues/338


[WFLY-17166] Correct use of MSC Service Registry in Micrometer Extension

Provide suppliers to subsystem code that they can use to access objects installed by the subsystem.
Remove use of the deprecated org.jboss.msc.service.Service
Use CapabilityServiceTarget to install services.
While I was at it I reduced visiblility of classes and methods in the root org.wildfly.extension.micrometer package and cleaned up a few minor IDE warns.
https://issues.redhat.com/browse/WFLY-17166

I put the hold label on this because LayersTestCase failed.
Once again, I find myself hoist by my own petard.


Drag and Drop Interaction passing file content as ArrayBuffer to support custom formats

Is your feature request related to a problem? Please describe.
Allow custom formats requiring ArrayBuffer (e.g. KMZ, or zipped SHP + DBF) to be integrated in the sequence of formats for the Drag and Drop interaction.
Describe the solution you'd like
This would require the interaction (either optionally or by default) to pass an ArrayBuffer to the readFeatures methods, and for formats which support String to check for ArrayBuffer and decode it.

This can be done entirely in the interaction by calling each format's getType() method.  Developers of custom formats may need to override the inherited getType() so can it be documented in the API?  It would also be useful if the interaction could take constructed formats as well as constructors where for KML, WFS, GML, etc. options may need to be set.

In my case I need to drop a shape format,
This change #11300  made it only can get data from addfeatures event with certain formats.

@MukeZ Before #11300 It was incorrectly firing the addfeatures event when it had no features.  Are you using a custom format where getFeatures() is asynchronous?  If you are parsing from text or an array it should be possible to do it synchronously (but many third party shapefile parsers are asynchronous).

@mike-000 Sorry for the delayed response,
I just use  dragAndDropInteraction.on('addfeatures', function (event) {}) to listen the event, then if it is a shape file, I will use a third party shapefile parser to do something, but I can't get the shp format in the event after #11300 , I think it only accepts formats in formatConstructors

The documents describes addfeatures as "Triggered when features are added" so I would not expect it to fire without features, and if it does the application code would need to handle no features instead of throwing an error (and the event should have a more appropriate name)
You could define your own format.  Simple example here https://codesandbox.io/s/nameless-star-8i9w3?file=/main.js uses shp2geojson (there are probably better parsers available but I used that because it reads buffer input synchronously) to parse zipped shp then creates features from the geojson.  Download zipped shp data from https://www.nhc.noaa.gov/gis/ to test.  Most of the codesandbox consists of the drag and drop code patched to handle arraybuffer as well as text.

OK I see,  the shp2geojson only work with the zip file, I use shapefile can work with the shp type file, but it will use path to open file, which I used to catch it from event

Sources and formats needing multiple urls would not fit easily into the current source and format design.
Are you using the Drag and Drop interaction for other formats?  If so having a file dropped but no features parsed might still be useful.  But if not it would be more efficient to add a your own listener in javascript (and it could also work alongside the current Drag and Drop interaction):
  map.getViewport().addEventListener('dragover', function(event) {
    event.preventDefault();
  });

  map.getViewport().addEventListener('drop', function(event) {
    event.preventDefault();
    const files = event.dataTransfer.files;
    for (let i = 0, ii = files.length; i < ii; ++i) {
      const file = files.item(i);
      ...

    }
  });

Thanks, I do use the Drag and Drop interaction for other formats, and add a own listener to get shape type can resolve my issue.


[docs] Navigation (secondary) docs need review/cleanup

Please review sections and ensure docs are complete.
Current tabs: Overview, Style, Guidelines, Behavior, Code, Accessibility. “Overview” heading in the Code tab has no additional description beyond the name of the element.
Previous IA Docs update issue: #827
Tag @coreyvickery for final design review.

Code tab clean up was done here: https://github.com/RedHat-UX/red-hat-design-system/pull/964
Picking up this issue as a separate PR to go through the checklist.

XD: https://xd.adobe.com/view/75edef5f-3cfa-4cc3-b12e-a1e3d5d37b5b-20be/
Content doc: https://docs.google.com/document/d/1Xd1sQl1fP1ivDQLPgV_D1Eadm456KmkJiW6ArcLie7o/edit#
Images: https://www.dropbox.com/sh/7lowxxd9e4aojr7/AADhM6fxgkVQQ1MSQUxjEbkba?dl=0


Vulnerability Roundup 20

The twentieth roundup! We have, together, examined 1,293 issues. A feat to be proud of, to be sure. Thank you, everyone!

Here are all the vulnerabilities from https://lwn.net/Vulnerabilities
since our last roundup.
cc: @7c6f434c @NeQuissimus @bachp @vcunat @FRidh.
Note: The list of people CC'd on this issue participated in the last
roundup. If you participate on this roundup, I'll cc you on the next
one. If you don't participate in the next one, you won't be CC'd on
the one after that. If you would like to be CC'd on the next roundup,
add a comment to the most recent vulnerability roundup.
Permanent CC's: @joepie91, @phanimahesh, @the-kenny, @7c6f434c, @k0001
@NixOS/security-notifications
If you would like to be CC'd on all roundups (or removed from the
list), open a PR editing
https://github.com/NixOS/security/blob/master/lwnvulns/src/bin/instructions.md.
Notes on the list

The reports have been roughly grouped by the package name. This
isn't perfect, but is intended to help identify if a whole group
of reports is resolved already.
Some issues will be duplicated, because it affects multiple
packages. For example, there are sometimes problems that impact
thunderbird, and firefox. LWN might report in one vulnerability
"thunderbird firefox". These names have been split to make sure
both packages get addressed.
By each issue is a link to code search for the package name, and
a Github search by filename. These are to help, but may not return
results when we do in fact package the software. If a search
doesn't turn up, please try altering the search criteria or
looking in nixpkgs manually before asserting we don't have it.
This issue is created by https://github.com/NixOS/security

Instructions:

Triage a report: If we don't have the software or our version isn't
vulnerable, tick the box or add a comment with the report number,
stating it isn't vulnerable.
Fix the issue: If we do have the software and it is vulnerable,
either leave a comment on this issue saying so, even open a pull
request with the fix. If you open a PR, make sure to tag this
issue so we can coordinate.
When an entire section is completed, move the section to the
"Triaged and Resolved Issues" details block below.

Upon Completion ...

[ ] Run the issue through reformat one last time
[ ] Review commits since last roundup for backport candidates
[ ] Send an update e-mail to<EMAIL_ADDRESS>[ ] Update the database at https://github.com/NixOS/security

Without further ado...
Assorted (7 issues)

[x] #713059 (search, files)  389-ds-base: denial of service
[x] #591371 (search, files)  asterisk: two vulnerabilities
[x] #712801 (search, files)  chromium-browser: multiple vulnerabilities
[x] #713054 (search, files)  ghostscript: denial of service
[x] #712664 (search, files)  ming: multiple vulnerabilities
[x] #713145 (search, files)  nagios: command execution
[x] #713148 (search, files)  ruby-archive-tar-minitar: file overwrites

7 remaining, 36 completed

    CLICK TO EXPAND Show all 36 triaged and resolved issues

Assorted (23 issues)

[x] #713146 (search, files)  libarchive: denial of service
[x] #713050 (search, files)  libgd2: two vulnerabilities
[x] #713153 (search, files)  virtualbox: multiple vulnerabilities
[x] #713055 (search, files)  ffmpeg: two vulnerabilities
[x] #713043 (search, files)  lib32-openssl: three vulnerabilities
[x] #712803 (search, files)  libxpm: code execution
[x] #712499 (search, files)  oracle-jre-bin: insufficient sandboxing
[x] #713062 (search, files)  shadow-utils: two vulnerabilities
[x] #713051 (search, files)  tiff3: invalid tiff files
[x] #712666 (search, files)  tigervnc: code execution
[x] #713052 (search, files)  zoneminder: information leak, authentication bypass
[x] #592675 (search, files)  a2ps: multiple vulnerabilities
[x] #712493 (search, files)  boomaga: wrong permissions
[x] #712494 (search, files)  fedmsg: insufficient signature validation
[x] #713053 (search, files)  flatpak: sandbox escape
[x] #713049 (search, files)  imagemagick: multiple vulnerabilities
[x] #712802 (search, files)  puppet-swift: information disclosure
[x] #651775 (search, files)  squashfs-tools: two vulnerabilities
[x] #712501 (search, files)  systemd: privilege escalation
[x] #712496 (search, files)  w3m: unspecified
[x] #712498 (search, files)  xemacs-packages-extra: unspecified
[x] #713061 (search, files)  mbedtls: two vulnerabilities
[x] #713047 (search, files)  tcpdump: multiple vulnerabilities

ansible (2 issues)

[x] #712658 (search, files)  ansible: code execution
[x] #712665 (search, files)  ansible: password change botch

firefox (2 issues)

[x] #713036 (search, files)  mozilla: multiple vulnerabilities
[x] #712491 (search, files)  mozilla: multiple vulnerabilities

kernel (2 issues)

[x] #713154 (search, files)  kernel: two vulnerabilities
[x] #713150 (search, files)  kernel: multiple vulnerabilities

openssl (3 issues)

[x] #713046 (search, files)  openssl: two vulnerabilities
[x] #713043 (search, files)  lib32-openssl: three vulnerabilities
[x] #666889 (search, files)  openssl: multiple vulnerabilities

seamonkey (2 issues)

[x] #713036 (search, files)  mozilla: multiple vulnerabilities
[x] #712491 (search, files)  mozilla: multiple vulnerabilities

thunderbird (2 issues)

[x] #713036 (search, files)  mozilla: multiple vulnerabilities
[x] #712491 (search, files)  mozilla: multiple vulnerabilities

Systemd CVE #712501 is affecting v228 and fixed in v229. Since we use v231. We are then not impacted.

We have fresh firefox and thunderbird, inlcuding -bin, on both branches.
We don't really have Seamonkey in NixPkgs, the hit is a false positive («Synchronise all profiles looking like Mozilla» contains a list including Seamonkey).

CVE-2016-8610: OpenSSL considers it non-security-critical, has quietly fixed it last September.
CVE-2016-7056: Seems to be about 1.0.1 but not 1.0.2 and 1.1.0, but I am unsure. Patch is simple enough: http://seclists.org/oss-sec/2017/q1/68 Debian seems to use it only for 1.0.1
CVE-2017-3731: we have the fixed versions
CVE-2016-7055: ditto
CVE-2017-3732: ditto
2015-year advisory with a minor fresh update seems ignorable.

Ansible was already updateed to <IP_ADDRESS> in 16.09 https://github.com/NixOS/nixpkgs/commit/9b02319ed7a34df2827354f9b9471f26f7a54faa

BTW, today I dealt with a minor security problem, fixed by c3ec88864. There's no CVE, at least not yet. (NixOS is probably the first distro to get the update.)

@bachp did we manage to get ansible merged for master?

@DerTim1 should we upgrade Asterisk to 14.2.1? I think we're good on Asterisk, but if it needs an update, might as well.

389 should be upgraded to <IP_ADDRESS>. With that deep of a version number, it must be safe to backport, too ;) I think the hard part (please help with this) is identifying the security related issues in those diffs. Also, do try and apply the patch from the LWN link.

imagemagick fixed in 5e753c1a65e106ffaeb71ad3fa66a13b2dfaf5d5 & 4dae4f86faed8150a922dd9ee618d7d937b155ac.

ffmpeg was already up to date on 16.09, needed a bump on master.

@peterhoeg (fpm), @offlinehacker (panamax), @Szczyp (rhc) the ruby gem archive-tar-minitar is vulnerable to directory traversal attacks (https://lwn.net/Alerts/713254/) can you'll take a look at your packages to see if we can apply a patch? (found via https://search.nix.gsc.io/?q=archive-tar-minitar)

@bachp did we manage to get ansible merged for master?
@grahamc, yes we did.

ruby gem archive-tar-minitar is vulnerable to directory traversal attacks

I'll fork it now, apply the fix from debian and reference that as a test for fpm. Assuming that works, we can apply the same fix to the other ruby packages.

I'll update rhc this weekend as this version is about 2 years old now.
I'll use your minitar fork.

shadow: real vulnerability, new upstream is at github, updated to 4.4, d6710e3d66c09c0a7485b2079d6e0d01c14faf07, cherry-picked
libXpm: real vulnerability, updated via overrides, 4675cb78cb5fbadb7aab67b125cd450322dcf3d1, cherry-picked

I've got a patch for tigervnc on its way.

I updated virtualbox on master (https://github.com/NixOS/nixpkgs/pull/22383) to fix an unrelated issue. Not sure what to do for 16.09. Maybe just update the version too?

Both kernel issues are covered by what we have

thank you, @NeQuissimus!
@bachp, what is latest virtualbox vs. what is on stable?

About that see https://github.com/NixOS/nixpkgs/pull/22274#issuecomment-277530565

:)

tigervnc fixed in stable in 36ffe58

👍 thank you! :D

@wkennington do you have opinions on the safety of upgrading 389 from <IP_ADDRESS> to <IP_ADDRESS> on stable?

We are affected by the ming issues: https://blogs.gentoo.org/ago/2016/12/01/libming-listswf-heap-based-buffer-overflow-in-parseswf_rgba-parser-c/

Regarding 389-ds-base, the person who discovered it disagrees that it's really a security issue:

This [the CVE description] is incorrect. Only an authenticated user, with write access to cn=config, specifically the uiduniq plugin configuration can trigger this. In a default install this is only directory manager. If you are directory manager, you can do so many other things, there is no need to trigger an exploit. This is why I deemed this a stability issue, not a security issue. Users who are anonymous or bound from a backend do not have access to trigger this.

From https://fedorahosted.org/389/ticket/48986.

Re: ghostscript, per https://bugs.ghostscript.com/show_bug.cgi?id=697457, they do not expect to make a new release until march. Until then perhaps we can somehow apply http://git.ghostscript.com/?p=jbig2dec.git;a=commit;h=e698d5c11d27212aa1098bc5b1673a3378563092, which is supposed to address the issue (per the previously linked bug).

nagios 4.2.4 is already patched https://www.nagios.org/projects/nagios-core/history/4x/ https://lwn.net/Alerts/713125/

Think I found the ming patches, let me verify and try to apply

But possibly we should consider removing it, it's unmaintained and debian's dropped it for example

I'd be 👍 on removing from unstable, and probably a mark-as-broken for stable.

Alright I'll just do that, I don't have all the patches I don't think (and they're on top of 0.4.4)

Just checked: nothing depends on ming.

ming handled in ff7777b22492dc126a0de4f50cdbf2a3c427ef21 and 41ba205dda86ce99dfdd58976dc845524d1d9933

I think the ghostscript issue would be resolved by https://github.com/NixOS/nixpkgs/pull/22509

We also need release-16.09. I say we just take the version bump there too, if someone needs the old version they can help secure it ;)

A few builds failed after upgrading, I'll try and find my list. Maybe they were broken before. Thank you so much for your help on these last few.

After removing ming, perhaps gnash could be removed as well. Not security related per se, but it's been abandoned for a while, I think, and was the only reverse dependency of ming.

Sure enough, gnash needs to be removed as well from unstable. Removed in 8608f91.

Shit:

anonymous function at /home/grahamc/.nox/nixpkgs/pkgs/applications/networking/browsers/firefox/wrapper.nix:1:1 called without required argument ‘gnash’, at /home/grahamc/.nox/nixpkgs/lib/customisation.nix:56:12

Just remove it and the enableGnash option

Finished. 😂 Thank you!

Thanks for all your hard work @grahamc!