Column for note in IP filter

Description of problem
If you add IP addresses to the IP filter you can not add a note why you added that IP. So, after a couple of months, there is a bunch of IP's and you have no idea if they are still needed. For instance an IP from someone's home address but they have moved.
Description of solution
When adding an IP address I'd like te add a note which will be visible in the IP filter list.

As an active agency with a lot of projects, I would rate this as a VERY HIGH need and requirement. Thank you in advance to the person that adds this!!

@skamphuis : What does it cost if you would fix this one?

unstale

Van: stale[bot] @.>
Verzonden: woensdag 2 juni 2021 19:05
Aan: dnnsoftware/Dnn.Platform @.>
CC: Tycho de Waard @.>; Author @.>
Onderwerp: Re: [dnnsoftware/Dnn.Platform] Column for note in IP filter (#4140)
We have detected this issue has not had any activity during the last 90 days. That could mean this issue is no longer relevant and/or nobody has found the necessary time to address the issue. We are trying to keep the list of open issues limited to those issues that are relevant to the majority and to close the ones that have become 'stale' (inactive). If no further activity is detected within the next 14 days, the issue will be closed automatically.
If new comments are are posted and/or a solution (pull request) is submitted for review that references this issue, the issue will not be closed. Closed issues can be reopened at any time in the future. Please remember those participating in this open source project are volunteers trying to help others and creating a better DNN Platform for all. Thank you for your continued involvement and contributions!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/dnnsoftware/Dnn.Platform/issues/4140#issuecomment-853225746, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACFLXHPSZRZF6HIGGLQ36PDTQZQE3ANCNFSM4R4XXZIA.

Waiting for estimate

Van: stale[bot] @.>
Verzonden: vrijdag 3 september 2021 03:13
Aan: dnnsoftware/Dnn.Platform @.>
CC: Tycho de Waard @.>; Author @.>
Onderwerp: Re: [dnnsoftware/Dnn.Platform] Column for note in IP filter (#4140)
We have detected this issue has not had any activity during the last 90 days. That could mean this issue is no longer relevant and/or nobody has found the necessary time to address the issue. We are trying to keep the list of open issues limited to those issues that are relevant to the majority and to close the ones that have become 'stale' (inactive). If no further activity is detected within the next 14 days, the issue will be closed automatically.
If new comments are are posted and/or a solution (pull request) is submitted for review that references this issue, the issue will not be closed. Closed issues can be reopened at any time in the future. Please remember those participating in this open source project are volunteers trying to help others and creating a better DNN Platform for all. Thank you for your continued involvement and contributions!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/dnnsoftware/Dnn.Platform/issues/4140#issuecomment-912175677, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACFLXHL3UDY7FZIOK3X7H3LUAAOMZANCNFSM4R4XXZIA.

Still relevant.

Still a great idea. Hope yo get a quote
Outlook voor iOShttps://aka.ms/o0ukef downloaden

Van: stale[bot] @.>
Verzonden: Wednesday, March 30, 2022 7:31:06 AM
Aan: dnnsoftware/Dnn.Platform @.>
CC: Tycho de Waard @.>; Author @.>
Onderwerp: Re: [dnnsoftware/Dnn.Platform] Column for note in IP filter (#4140)
Closed #4140https://github.com/dnnsoftware/Dnn.Platform/issues/4140.
—
Reply to this email directly, view it on GitHubhttps://github.com/dnnsoftware/Dnn.Platform/issues/4140#event-6331944321, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ACFLXHI2OCVQBIACGXVCGA3VCPRJVANCNFSM4R4XXZIA.
You are receiving this because you authored the thread.Message ID: @.***>

@valadas Did you get a chance to take a look at this one?

Not yet but I pinned it higher up my open source priorities list, so I'll get to it soonish...

I'll handle this shortly, been kinda busy on the open-source side of things with the new resource manager...


Unclear "error" message when type parameter satisfying alias

alias Foo => String|Integer;
void foo<T>(T t) given T satisfies Foo {}

.. gives the "error" for Foo on line 2:

Satisfies a type alias: 'Foo'

This is unclear and does not tell:

why it's wrong
what can be done

Also, it wouid be handy if it actually wasn't an error :)


FlakyTest:OffsetNotFoundIT

testConsumeStopAndResume(org.apache.rocketmq.test.offset.OffsetNotFoundIT)
java.lang.AssertionError: expected:<10> but was:<0>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.rocketmq.test.offset.OffsetNotFoundIT.testConsumeStopAndResume(OffsetNotFoundIT.java:100)

FAILURES!!!
Tests run: 2,  Failures: 1

looks interesting i want to try

This problem is because rpcHook delays triggering when the consumer calls waitForMessageConsume. Maybe we should use a semaphore or countDownlatch to control the listener callback.

@complone Welcome to submit a patch to fix it.

@complone欢迎提交补丁来修复它。

@lizhanhui  I'm trying, maybe it's taking a long time


Add version: univrsal.input-overlay version 5.0.2

- [X] Have you signed the Contributor License Agreement?

[ ] Have you checked that there aren't other open pull requests for the same manifest update/change?

[ ] Have you tested your manifest locally with winget install --manifest <path>?
[X] Does your manifest conform to the 1.4 schema?

Microsoft Reviewers: Open in CodeFlow

x86 Automatic Validation ended with:

x64 appears to have completed normally.

x64 appears to have completed normally.

I'm confused. Since the latest commit, I get this now

Automatic Validation ended with:

Very confusing - it appears that the 64-bit installer can't run on 64-bit Windows. I'm unsure if they're expecting users to dual-boot 32-bit and 64-bit OSes, or install through another means:

Closing PR as stale.


No compression validation for META-INF/manifest.xml

All files listed in the manifest are checked for compression and must be stored or deflated (PKG-2) But files not listed in the manifest (such as the manifest itself) are not validated for compression.
Example file:
AT039.ods
This file generates the following log the validator (CLI):
C:\odf\odf-validator-main>odf-validator.bat -p "C:\Users\maria\Desktop\2024-07\AT039\AT039.ods"
APP-1: [INFO] Validating C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
APP-5: [INFO] DNA ODF Spreadsheets Preservation Specification Profile report for C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
DOC-3: mimetype [INFO] OpenDocument MIMETYPE application/vnd.oasis.opendocument.spreadsheet detected
POL_5: content.xml [INFO] External data check | Table formula detected.
VALID, no errors, no warnings and 2 info message found.
C:\odf\odf-validator-main>odf-validator.bat "C:\Users\maria\Desktop\2024-07\AT039\AT039.ods"
APP-1: [INFO] Validating C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
APP-4: [INFO] Validation report for C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
DOC-3: mimetype [INFO] OpenDocument MIMETYPE application/vnd.oasis.opendocument.spreadsheet detected
VALID, no errors, no warnings and 1 info message found.
I validated using odfvalidator.org as well, and here it fails:
The document is NOT conformant ODF1.3!
Details:
AT039.ods: Info: ODF version of root document: 1.3
AT039.ods[-1,-1]: Error: The compression method of the ZIP entry 'META-INF/manifest.xml' is not allowed within the 'AT039.ods' ODF package file!
internal:/schema/odf1.3/OpenDocument-v1.3-manifest-schema.rng: Info: parsed.
AT039.ods/META-INF/manifest.xml: Info: no errors, no warnings
AT039.ods/mimetype: Info: no errors, no warnings
AT039.ods: Info: Media Type: application/vnd.oasis.opendocument.spreadsheet
internal:/schema/odf1.3/OpenDocument-v1.3-schema.rng: Info: parsed.

AT039.ods: Info: 1 errors, no warnings

This works now and can be closed. See log below:
C:\odf\odf-validator-main>odf-validator.bat -p "C:\Users\maria\Desktop\2024-07\AT039\AT039.ods"
APP-1: [INFO] Validating C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
APP-5: [INFO] DNA ODF Spreadsheets Preservation Specification Profile report for C:\Users\maria\Desktop\2024-07\AT039\AT039.ods.
DOC-2: [INFO] package OpenDocument version 1.3 detected.
DOC-3: [INFO] mimetype OpenDocument MIMETYPE application/vnd.oasis.opendocument.spreadsheet detected
PKG-2: [ERROR] META-INF\manifest.xml All files contained in the Zip file shall be non compressed (STORED) or compressed using the "deflate" (DEFLATED) algorithm. Zip entry META-INF/manifest.xml is compressed with an unknown algorithm.
POL_2: [ERROR] AT039.ods Standard Compliance | Package does not comply with specification. The file MUST comply with the standard "OASIS Open Document Format for Office Applications (OpenDocument) v1.3".
NOT VALID, 2 errors, 0 warnings and 2 info messages.

Good to have this confirmed.


Update documentation for BN

The documentation code to update moving_mean and moving_variance for BN raise an error with TF 1.0:
AttributeError: module 'tensorflow' has no attribute 'control_flow_ops'

It seems the new way to add dependencies between ops is to use the tf.control_dependencies.
I also attached the updates_op to the train_op instead of total_loss to be more coherent with the associated warning: [...] they need to be added as a dependency to the train_op, example:. It also make more sense as we don't want to update moving_mean when computing the loss on the testing set.

Can one of the admins verify this patch?

Jenkins, test this please.


Fracturing improve

Improve crack mode in order to

[x] Work with periodic boundary conditions (PBC)
[x] Crack floes as a result of a shock
[x] Crack floes as a result of pressure (= many micro-impulses from LCPs over a short period of time)
[x] Take contact points and energy into account in the crack path search

Voir la video ici :
https://ige-meom-opendap.univ-grenoble-alpes.fr/thredds/catalog/meomopendap/extract/SASIP/floedyn/videos/catalog.html?dataset=meomscanpublic/SASIP/floedyn/videos/canal_circles_pbc_max_10.mp4


Spider crawling

Instead of putting this into the package we decided that it's better to use external tools and crawl a sitemap every hour or so with throttling.

One tool for doing that with XML sitemaps is https://github.com/pmylund/ocp


Flash booted state

Added flash booted state as well as capability to boot a device into bootloader (cross platform)

@alex-luxonis yes - in the works in branch device_search_improvements :)
Right now it took a too wide turn with refactoring - removed all Windows specific stuff and tried going with libusb only, but libusb doesn't have nice integration options available (no CMake, only VS solutions for Windows), so will rather keep Windows WinUSB and libusb for UNIX.


v 4+ 'SciStarter' logo is clipped - use different logo

Tested v 4.1.6 (84) on an iphone 6 and noticed the scistarter logo is clipped. Needs to be moved further away from the right margin and probably should swap out with the below logo (not this screen capture).

I recommend we try using this attached logo. (from Caroline on g-drive here: https://drive.google.com/drive/folders/1_T8gpsdp2ipzxbBo-gmdA33oKQ9POPYq). Also attached below
SciStarter_logo_white_tag.pdf

Hi, @TreeMama
There are so many logo files in your G-drive link.
Which file should I use exactly? lol

no, I can't. I need .png format file.

bottom letters don't appear, because that has white color.

@bestw07 ok - well I don't want the bottom letters to appear - they are too small to read anyway.
I cropped the png - does this work better? Also - can we MOVE the logo more left?

@bestw07 haha well that's a little too big - is there a size between that (and the smaller one)?

ok just go with the bigger one. It's the only one I can read without glasses (the one you showed before this last one).

ok Lol :)

closing


[ONNX CI] CI Speedup

Not using cached nGraph master to build PR branch. Master get's updated often enough that caching it is a liability.

TEST NOW

TEST NOW

TEST NOW


Set the weights in tf.layers with other variables but not as initializers.

System information

Have I written custom code: N/A (There is no example of meta learning with tf.layers)
OS Platform and Distribution: Linux Ubuntu 16.04
TensorFlow installed from: Installed tf-nightly with pip
TensorFlow version: v1.8.0-rc1-934-g291d85be42 1.9.0-dev20180426
Python version: 3.5.2
Bazel version: N/A
GCC/Compiler version: N/A
CUDA/cuDNN version: N/A
GPU model and memory: N/A
Exact command to reproduce: N/A

Describe the problem
Nowadays, with advances in deep learning, the researchers sometimes need to set the weights of their model based on some formula (not initialize them but initialize something which calculates that formula) and then use that to backpropagate through the variables which computed that formula. For example in meta learning, I have a model, let's say it is just one layer tf.layers.dense(). I want to compute gradients and then use that gradients to build updated model graph and compute gradients on that. The backpropagation should tell me how should I update my first model weights to adapt well. Look at the code below:
Source code / logs
train = tf.placeholder(dtype=tf.float32, shape=(None, 4), name='train')
train_out = tf.placeholder(dtype=tf.float32, shape=(None, 1), name='train_out')

validation = tf.placeholder(dtype=tf.float32, shape=(None, 4))
validation_out = tf.placeholder(dtype=tf.float32, shape=(None, 1))

with tf.variable_scope('model'):
    model_out = tf.layers.dense(train, 1, activation=tf.nn.relu)

with tf.variable_scope('loss'):
    loss = tf.square(model_out - train_out)

with tf.variable_scope('gradients'):
    optimizer = tf.train.AdamOptimizer()
    grads = optimizer.compute_gradients(loss)

with tf.variable_scope('updated_model'):
    updated_vars = {
        grad_info[1].name[6:]: grad_info[1] - 0.1 * grad_info[0] \
        for grad_info in grads if grad_info[0] is not None
        }

    # meta_out = tf.nn.relu(tf.matmul(validation, updated_vars['dense/kernel:0']) + updated_vars['dense/bias:0'])
    meta_out = tf.layers.dense(validation, 1, activation=tf.nn.relu,
kernel_initializer=updated_vars['dense/kernel:0'], bias_initializer=updated_vars['dense/bias:0'])

with tf.variable_scope('meta_loss'):
    meta_loss = tf.square(meta_out - validation_out)

with tf.variable_scope('meta_optimizer'):
    model_vars = tf.get_collection(tf.GraphKeys.GLOBAL_VARIABLES, scope='model')
    meta_optimizer = tf.train.AdamOptimizer()
    meta_train_op = meta_optimizer.minimize(meta_loss, var_list=model_vars)

In this code, I have commented one line. In that line, I did not use tf.layers but instead implemented what should happen in that layer myself. I think we need to be able to do that with tf.layers as well.
Please notice that we cannot use initializer because initializers should be set when we run tf.global_variables_initializer() and have another meaning(Which is to set the value of a variable). Here we do not want to initial those weights of layers with values but just with variables which we calculated in some other way and be able to backpropagate through them.
I think one way to solve this is to allow creating tf.layers' models with setting kernel and bias directly instead of using initializers. I would be more than happy if I could help with this issue.

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

Sorry about that. I think I missed the form. I have completed the required information now.

@fchollet , thoughts on returning more information from layers as requested here?

So you want the ability to set layer's weights as custom tensors?
When we talk about "layer's weights", there are two components:

Layer attributes such as self.kernel, self.bias.
List of weights that are used in backpropagation (self.trainable_weights) or used for saving (self.weights).

It seems you want to:

Explicitly create your own weight variables
Transform them through a formula
Use the output of that as the self.kernel (for instance) attribute on your layer
Still be able to update the original variables that you created, via backprop when training your model

Is that right?
It sounds like you should subclass the layer you're looking at (e.g. Dense) and write your own build methods (the method that creates the weights).

Yes. That is exactly what I wanted. Maybe that is a better workaround to subclass them. I also did almost the same thing to solve my problem. However, it seems kind of intuitive to me that I should be able to create those layers with whatever variable I want as weights and bias. As a result, I do not need to go to lower-level API whenever I want to do something like this and can use these higher-level APIs easily. What are your thoughts about this?

Nagging Assignees @karmel, @fchollet: It has been 21 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 37 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 52 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 67 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 82 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 97 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Hi,
I have built a wrapper around tf.layers.Conv2D. I want to define the layer weights explicitly in the graph as a tensor and then add it to the layer. I want to use this variable multiple times during the training phase.
Something like:
`
layer_weights = tf.get_variable(name,shape)
x = my_custom_layer(x, weights, args..)
`
I want to know what should I write in the build function of the custom layer to set the layer weights to a pre-defined tensor. Please Help.

Nagging Assignees @karmel, @fchollet: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 29 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 45 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 59 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 75 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 90 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignees @karmel, @fchollet: It has been 105 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

The same problem when implement LambdaOpt，to set layer's weights as custom tensors.

@siavash-khodadadeh In TensorFlow 2.x, there is no placeholder. Please take a look at the official doc on converting your TF1.x code to TF2.x. and try with the latest TF version 2.9.0 as older versions are not actively supported.
Thank you!


Question - WriteFile include Path

Everything in my programmer mind is saying duh if this was allowed anyone could create simple malware/virus programs but I have to ask to make sure I have tried everything.
I basically have a local standalone browser application a co-worker is requesting.  In the end basically it needs to open an Excel file update some data and close it.  I have seen in other posts modification is not part of the Community side only read and write new.  I have three questions:

Is modification client side completely working in Pro version in that in a stand alone local (offline) environment the local javascript code would be able to open, modify and save changes to an excel file?

Is there away in the Community version when doing WriteFile to specificy a location to write?  I had thought of a possible work around but  when I do writefile it continues to create new files in download folder - I had hoped that I could use writefile and replace the existing file.

Does anyone have any other work around thoughts - I would think someone in the community has needed to do something similar to modifying data in a Excel vs creating a new file each time, and if a new file has to be created having a way to replace the old with the new.

Thanks
Debby

The fundamental problem is that the web Browser is sandboxed.   You can read files, modify and generate new files, but you can't edit files in place (that would violate the security sandbox).
For IE6-9 on Windows XP and Windows 7, there's a way to bypass the sandbox with a VBScript call to the Scripting.FileSystemObject control.  The internet explorer demo https://github.com/SheetJS/js-xlsx/tree/master/demos/oldie#activex-based-download discusses this further.  The shim inserts a helper function:
Function IE_SaveFile_Impl(FileName, payload)
  Dim data, plen, i, bit
  data = CStr(payload)
  plen = Len(data)
  Set fso = CreateObject("Scripting.FileSystemObject")
  fso.CreateTextFile FileName, True
  Set f = fso.GetFile(FileName)
  Set stream = f.OpenAsTextStream(2, 0)
  For i = 1 To plen Step 3
    bit = Mid(data, i, 2)
    stream.write Chr(CLng("&h" & bit))
  Next
  stream.Close
  IE_SaveFile_Impl = True
End Function

The shim also includes a similar method for reading from a file input: by attaching to the change event, you can get the filename and set up FSO to read bytes from that specified file name.


[Feature] Improve the user management module

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation
Improve the user management module
re #80
Solution
No response
Anything else?
No response
Are you willing to submit a PR?

[X] I'm willing to submit a PR!

I will submit a PR later and then I can close the issue.


Fixed typo in docs [skip ci]

Actually according to dictionary form without h is also acceptable but less widespread.

Thank you


How to access this with sqlPlus once running?

I want to log into this container from another container running sql*plus but I do not know the correct command. I just need to do basic things like Create and Alter tables for a class on my Macbook.

@skiwheelr you can run instant client to run sqlplus take a look at the image https://github.com/oracle/docker-images/tree/master/OracleInstantClient.

You can just use SQL*Plus from the same running container, if all you need is a SQL connection.
Just run docker exec -ti <container name> sqlplus / as sysdba.
For more information check the ReadMe section [Running Sql*Plus in a Docker container].(https://github.com/oracle/docker-images/tree/master/OracleDatabase/SingleInstance#running-sqlplus-in-a-docker-container)


[test] Sanity check basic tests

Hello @ChristopherBignamini, Thank you for submitting the Pull Request!

In the file cscs-checks/system/basic/file_system_check.py:

Line 23:38: E128 continuation line under-indented for visual indent
Line 65:1: W293 blank line contains whitespace
Line 66:55: E261 at least two spaces before inline comment
Line 66:55: E262 inline comment should start with '# '
Line 66:80: E501 line too long (89 > 79 characters)
Line 69:53: E261 at least two spaces before inline comment
Line 69:53: E262 inline comment should start with '# '
Line 69:80: E501 line too long (94 > 79 characters)
Line 79:1: E122 continuation line missing indentation or outdented
Line 80:1: E122 continuation line missing indentation or outdented
Line 81:19: E203 whitespace before ':'
Line 81:67: E261 at least two spaces before inline comment
Line 81:80: E501 line too long (118 > 79 characters)
Line 81:119: W291 trailing whitespace
Line 84:1: W293 blank line contains whitespace
Line 85:46: W291 trailing whitespace
Line 89:51: W291 trailing whitespace
Line 99:10: W291 trailing whitespace

Do see the ReFrame Coding Style Guide

Codecov Report

Merging #1629 (52b4d9b) into master (6907788) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1629   +/-   ##
=======================================
  Coverage   87.67%   87.67%
=======================================
  Files          44       44
  Lines        7277     7277
=======================================
  Hits         6380     6380
  Misses        897      897

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6907788...52b4d9b. Read the comment docs.

Codecov Report

Merging #1629 (05364a6) into master (d40f8b1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1629   +/-   ##
=======================================
  Coverage   87.90%   87.90%
=======================================
  Files          50       50
  Lines        8620     8620
=======================================
  Hits         7577     7577
  Misses       1043     1043

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d40f8b1...05364a6. Read the comment docs.

Closing this PR as discussed offline.


MaterializedView from Kafka Engine with Native format

Hello.
I have the next schema:
Kakfa -> Table with Kafka Engine and Native format -> Materialized View to table -> Table with MergeTree Engine.
On Clickhouse version 19.9.2 such schema works, but on version 19.13.3 it stopped working. Got such error:
2019.08.29 16:02:22.127282 [ 70 ] {} <Error> void DB::StorageKafka::streamThread(): Code: 9, e.displayText() = DB::Exception: Sizes of columns doesn't match, Stack trace:

0. /usr/bin/clickhouse-server(StackTrace::StackTrace()+0x30) [0x7f6b5f0]
1. /usr/bin/clickhouse-server() [0x3944050]
2. /usr/bin/clickhouse-server(DB::SquashingTransform::add(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn> > >&&)+0x2c) [0x6c2e18c]
3. /usr/bin/clickhouse-server(DB::SquashingBlockOutputStream::write(DB::Block const&)+0x2ab) [0x7363f3b]
4. /usr/bin/clickhouse-server(DB::AddingDefaultBlockOutputStream::write(DB::Block const&)+0x8f) [0x72f057f]
5. /usr/bin/clickhouse-server(DB::CountingBlockOutputStream::write(DB::Block const&)+0x2c) [0x730ce3c]
6. /usr/bin/clickhouse-server(DB::copyData(DB::IBlockInputStream&, DB::IBlockOutputStream&, std::atomic<bool>*)+0x105) [0x6c2e4b5]
7. /usr/bin/clickhouse-server(DB::StorageKafka::streamToViews()+0x616) [0x729c6c6]
8. /usr/bin/clickhouse-server(DB::StorageKafka::streamThread()+0x1d7) [0x729cd97]
9. /usr/bin/clickhouse-server(DB::BackgroundSchedulePoolTaskInfo::execute()+0xf9) [0x72bd329]
10. /usr/bin/clickhouse-server(DB::BackgroundSchedulePool::threadFunction()+0x6a) [0x72bdb7a]
11. /usr/bin/clickhouse-server() [0x72bdbfa]
12. /usr/bin/clickhouse-server(ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>)+0x1a6) [0x3c760f6]
13. /usr/bin/clickhouse-server() [0xba3e1a0]
14. /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3) [0x7f4868fcafa3]
15. /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7f4868d734cf]
 (version <IP_ADDRESS> (official build))

Also need to say that select query from table with Kafka Engine at the same time working properly. And insert into select query also working properly.
Tables metadata:
create table db.testnativekafka (Date Date, Id Int32, Name String) ENGINE = Kafka() SETTINGS kafka_broker_list = 'kafka.example.com:9092', kafka_topic_list = 'testnative', kafka_group_name = 'testnative', kafka_format = 'Native', kafka_num_consumers = 1, kafka_skip_broken_messages = 1
create table db.testnativetable (Date Date, Id Int32, Name String) ENGINE = MergeTree() Partition by (Date) Order By (Date)
create materialized view db.testnativemv to db.testnativetable (Date Date, Id Int32, Name String) as select Date, Id, Name from db.testnativekafka

So you put a messages in Native format in the Kafka? How many rows at once?
Can you check if names & order of columns you put in the Kafka Native stream matches exactly the create statement of Kafka table?

Yes, from our custom service we insert data in Native format to the Kafka. In single message we have 3 rows (our tests).
For generating insert order we get metadata from the end table db.testnativetable  in which order is the same as order in table with Kafka Engine. We get order of columns from such query (Insert into adms2.testnativetable(Date, Id, Name) VALUES) via tcp protocol.

And do column names also match (inserted stream = Kafka table definition = MV definition) ?

Yes. All column names are identical.
We checked simple MV and MV to Table - result the same.
If we run select query (select part from creating MV query) from table with Kafka Engine - all works.

Reproduced, was broken after introducing virtual columns.
https://github.com/ClickHouse/ClickHouse/pull/5382/
Will address that soon.


SideMenu will not dismiss if swiped open

I have read the guidelines for contributing and I understand

[x] My issue is happening in the latest version of SideMenu (older versions are no longer maintained).
[x] My issue was not solved in the README.
[x] My issue can not be answered on stackoverflow.com.
[x] My issue is not a request for new functionality that I am unwilling to build and contribute with a pull request.
[ ] My issue is reproducible in the demo project.

Describe the bug
Note: this is only reproducible on a physical device so far
Note: we use the library programmatically
When the SideMenu is swiped open, and an item on the menu is tapped, the menu UI will not close however when connecting to the UI debugger, the menu appears to be dismissed.
I'm assuming there's something in our project that could be causing an issue, but I'm not sure where to start looking. I have tried pushing the dismissal to the main thread, etc, and haven't found a fix yet.
So far the only way to dismiss it without killing the app is to minimize the app and bring it back to the foreground after ~1 second. Then you can swipe to dismiss the menu again.
To Reproduce
Steps to reproduce the behavior:

Swipe open the menu
Tap a menu item

Expected behavior
I expect the menu to dismiss the same way it does if I tap the icon to show the menu.

@matcartmill this is the first report of this issue. Unfortunately, unless this is reproducible in the demo project I'm led to believe this is a project specific issue. If you're able to repro it in the demo project feel free to reopen this ticket with the additional details.

Fixed in 6.1.2.

Verifying. Will report back asap.

@jonkykong Gave it a shot and it's still behaving the same. I'm not seeing any methods getting fired on either the viewWillDisappearor viewDidDisappear lifecycle methods. I will set up a demo project that closely resembles how my team is using SideMenu so you can check it out.

@jonkykong Never mind, seems to work. Had a weird caching issue with the Pod. Appreciate you getting this sorted so quickly.


We were rethinking if it was useful and if so how to do it. Sorry for the no user friendly message 😅 It should say something like "Not supported yet".
Added it to the planning to work on it soon :)

From some experience, the destroy command should:

stop and remove docker containers
pipenv --rm to remove the virtualenvironment

pipenv --rm needs further testing. What happens if you are in an already activated env. Does it destroy it too?


Adding information about the to.image attribute

This is a PR to help with the issues  #2237 #3330 #3346 #3528 and many more

Thanks for your contribution. Please sign the CLA so that we can accept your work.


Updating UI for charisma

@loothero has made some nice changes to factor charisma into gameplay. We need to add tracking for charisma level and factor in that their minimum bid reduces to 2 if they have at least 1 point.
This will be a quick modification to the bid box in that base price will reduce to 2.
It should not be made until contracts have deployed!

Closed by #22


Position: add security board and code

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (eb2a4bd) 61.32% compared to head (fecd8b2) 61.62%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master      #13      +/-   ##
==========================================
+ Coverage   61.32%   61.62%   +0.29%
==========================================
  Files           1        1
  Lines         256      258       +2
==========================================
+ Hits          157      159       +2
  Misses         94       94
  Partials        5        5

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


^see additional file anm_problems.txt  for animations i had to remove because of limit

^see additional file anm_problems.txt

do we need to fix this ?


SQLSTATE[22007]: Invalid datetime format: 1292 Incorrect datetime value

SQLSTATE[22007]: Invalid datetime format: 1292 Incorrect datetime value.
I got this error when I uncomment Stancl\Tenancy\Features\Timestamps::class
Here is my custom columns config:
'custom_columns' => [
                'plan_id',
                'customer_id',
                'created_at',
                'updated_at'
            ],

It seems like the Storage Driver (Database) uses the wrong DateTime format for Laravel 7.

What type is that column? You can customize the format used by that Feature, look into the source code.


springcloud-gcp-starter-pubsub can's sbscribe topic

springboot: 2.3.6.RELEASE
springcloud: Hoxton.SR8
spring-cloud-gcp-starter-pubsub: 1.2.5.RELEASE
it can not subscripe topic , error:

It may help to run one of the Pub/Sub sample applications and check whether that works for you, then to compare differences in application setup if it does. If you can't identify the issue, please provide a minimal reproducible sample application, and we'll troubleshoot.
Also note that 1.2.5.RELEASE is very old and is on an out-of-support release train.
The latest version of Spring Cloud GCP is 2.0.7, and it's maintained in a new repository -- https://github.com/GoogleCloudPlatform/spring-cloud-gcp


Setup poetry

Now, the project can be installed as python module and you can publish it on pypi

Great 🎉


matmul issue with test sites

Hi
I've been trying to get phishpedia to work with the provided test sites for a while but unfortunately I couldn't. I followed the installation steps outlined in the repo's README.md but every time I try to run the script it throws an exception in file phishpedia.py line 157. Here is the output
(phishpedia) root@041371539a6d:~/phish/Phishpedia# ls datasets/
.DS_Store     overview.png  test_sites/
(phishpedia) root@041371539a6d:~/phish/Phishpedia# ls datasets/test_sites/accounts.g.cdcde.com/
info.txt  shot.png
(phishpedia) root@041371539a6d:~/phish/Phishpedia# python phishpedia.py --folder ./datasets/test_sites/
The checkpoint state_dict contains keys that are not used by the model:
  pixel_mean
  pixel_std
Load protected logo list
Length of reference list = 0
  0%|                                                                                | 0/1 [00:00<?, ?it/s]Entering phishpedia
Entering siamese
number of logo boxes: 2
  0%|                                                                                | 0/1 [00:01<?, ?it/s]
Traceback (most recent call last):
  File "phishpedia.py", line 157, in <module>
    logo_recog_time, logo_match_time = phishpedia_cls.test_orig_phishpedia(url, screenshot_path)
  File "phishpedia.py", line 73, in test_orig_phishpedia
    pred_target, matched_domain, matched_coord, siamese_conf = check_domain_brand_inconsistency(logo_boxes=pred_boxes,
  File "/root/phish/Phishpedia/logo_matching.py", line 36, in check_domain_brand_inconsistency
    matched_target, matched_domain, this_conf = pred_brand(model, domain_map,
  File "/root/phish/Phishpedia/logo_matching.py", line 166, in pred_brand
    sim_list = logo_feat_list @ img_feat.T  # take dot product for every pair of embeddings (Cosine Similarity)
ValueError: matmul: Input operand 1 has a mismatch in its core dimension 0, with gufunc signature (n?,k),(k,m?)->(n?,m?) (size 2048 is different from 0)

Hi,
Can you check whether this folder models/expand_targetlist exists, if not please unzip the models/expand_targetlist.zip.

Hi, Can you check whether this folder models/expand_targetlist exists, if not please unzip the models/expand_targetlist.zip.

Thank you! It works. Looks like I didn't have zip installed in the docker image.


how to enable quic like in old nginx-quic repository?

Hey devs,
how i can enable quic like in old repository with
--with-http_v3_module
--with-stream_quic_module <–-----
How to enable at configure level?
Thanks and
Best regards

Support for QUIC in stream module was removed in nginx and that branch as well, see: https://hg.nginx.org/nginx/rev/113e2438dbd4
Could you explain the use case?

At the moment i thought every function is needed by http3.
.

I thought quic is for datagram http3.
Isnt it?

I want datagram socket instead of stream sockets

Stream module is for streaming L4 data, which can be datagram (UDP) or TCP.
For proxying HTTP/3 you can use QUIC + HTTP/3 support in the HTTP module.

Ok, thanks you very much.


include navigation bar and other sites

Value proposition
As a user
I want to click on buttons
so that i can navigate through additional sites
Description

Acceptance criteria

[ ] styled navigation bar
[ ] functional buttons in the nav bar
[ ] able to see and click the bar from every site of the app

Tasks

[ ] Create navigation component
[ ] using routes to manage the sites
[ ] implement different header logos (SkillBro, Erstellen, Lexikon, Profil)

Hi Gustl,
as far as I can see, there are no other pages where you can link to yet. Within an iterative workflow, it's not useful to create an navigation "because this is how it will look in two weeks". We are building an app which is completely (!) useful for the user at the very right moment, and links to more or less empty pages do not fit into this concept.
Please make sure to choose the (one) page you want to add to your app next; build this page, add a small navigation for the two pages you have right now. In further user stories, add more navigational buttons as soon as (but not before) you will need them.


Derive macro FromDataPoint not working for nested types?

The following usage of the FromDataPoint derive macro yields an error:
#[derive(Debug, Default, Clone, PartialEq, Eq, FromDataPoint)]
pub struct Record {
    pub metadata: Metadata,
    pub releases: Vec<Content>,
}

#[derive(Debug, Default, Clone, PartialEq, Eq, FromDataPoint)]
pub struct Metadata {
    pub version: String,
}

#[derive(Debug, Default, Clone, PartialEq, Eq, FromDataPoint)]
pub struct Content {
    pub name: String,
    pub values: String,
}

gives
error: proc-macro derive panicked
 --> src/record.rs:6:48
  |
6 | #[derive(Debug, Default, Clone, PartialEq, Eq, FromDataPoint)]
  |                                                ^^^^^^^^^^^^^
  |
  = help: message: Metadata is not handled

Is there a special way to handle nested values such as these? Thank you.

Please do forgive me for chiming in, but as far as I understand all influx 2 queries return tables (one or more). It might help if you specified which query (roughly) you are running that you'd expect to return a nested result

I am new to InfluxDB, so it's entirely possible I'm misunderstanding the problem.
We have telegraf ingesting json_v2 data into the given bucket, so the intention here is to query for the structured JSON conformant to the struct we've defined.


feat(vscode): Added Dynamic C# File Generation and Unit Test SDK Support

Requirement Checklist

[x] The commit message follows our guidelines
[x] Tests for the changes have been added (for bug fixes or features)

Type of Change

[ ] Bug fix
[x] Feature
[ ] Other

Current Behavior
The current implementation does not support a floating version for the Microsoft.Azure.Workflows.WebJobs.Extension package in the project files. Users are required to specify exact versions, which limits flexibility when it comes to updates.
Additionally, placeholders like <%= LogicAppName %>, <%= UnitTestName %>, and <%= WorkflowName %> in the C# unit test templates were not dynamically replaced with actual values. This required manual changes to the generated files.
The project file also did not yet include the necessary references to the unit test SDK that is being developed for backend unit testing.
New Behavior

Implemented wildcard support for the Microsoft.Azure.Workflows.WebJobs.Extension package, allowing the use of floating versions like 17.10.*. This ensures that the highest available version within the range is automatically resolved. [Link to work item for wildcard version]

Dynamically replaced placeholders like <%= LogicAppName %>, <%= UnitTestName %>, and <%= WorkflowName %> in the C# unit test files with actual values during generation. The createCsFile method handles this by reading the template, performing the replacement, and writing the final file.

Updated the project file to include the necessary dependencies for the unit test SDK being developed on the backend for unit testing purposes. Link to work item for unit test SDK support

Cleaned up the UX for the unit test generation in the following ways:

Hidden the "Create unit test from scratch" button.
Removed wiring for the unit test edit and management from the codeless approach to better align with the SDK-based approach.
Ensured the extension no longer opens the designer to author unit tests, avoiding the previous codeless editing behavior.
Cleaned up UX gestures for the codeless experience in VS Code, including unlinking test explorer initialization on extension startup and hiding unnecessary elements. Link to work item for cleaned up UX

Impact of Change

[ ] This is a breaking change.

This update should not introduce any breaking changes for downstream consumers. It only adds flexibility with floating version support, introduces dynamic template replacements in C# unit test generation, and improves the user interface.

@ecfan I’ve implemented your suggestions and responded to your questions. Please let me know if you have any additional feedback or comments.


Insallation easy way please )

Hello!
Thank you for very useful utility. But I am not a geek, help me please (
Can I use this for installation?
http://www.winhelponline.com/blog/previewconfig-tool-registers-file-types-for-the-preview-pane-in-windows-vista/

Hi @sv-dev,
Unfortunately there is no simple yes-yes-yes type of installer, but with the Sharpshell Server Registration Manager, which you can download at: https://github.com/dwmkerr/sharpshell/releases/ (choose ServerManager.zip), it's pretty close: you open the registration manager, select the dll you have extracted (MarkdownPreview.dll), click Install Server (x86) and Register Server (x86).
See: https://github.com/Atrejoe/MarkdownPreview/issues/2#issuecomment-249137122 for screenshots.
Good luck!

You might have to restart explorer.exe, either by killingit and starting it manually or rebooting :(

This doesn't seem to recognize / correctly process the previewer.  I'm using your 0.3 package and  ServerManager version <IP_ADDRESS>

Also, there's an unhandled exception when attempting to install from the command line:
C:\Users\ewa\Downloads\MarkdownPreview.0.3>..\ServerManager\srm\srm.exe install
MarkdownPreview.dll

========================================
SharpShell - Server Registration Manager
========================================

An unhandled exception occured when loading the SharpShell
Server Types from the specified assembly. Is it a SharpShell
Server Assembly?

Unhandled Exception: System.NullReferenceException: Object reference not set to
an instance of an object.
   at ServerRegistrationManager.Application.InstallServer(String path, Registrat
ionType registrationType, Boolean codeBase)
   at ServerRegistrationManager.Application.Run(String[] args)
   at ServerRegistrationManager.Program.Main(String[] args)

@ewa Are you on a x64 machine?
I have had the same issue using the command prompt on my x64 machine, but with the server manager I usually was successful. But now I use the packaged version downloaded from Github, I'm unsuccessful too.
I just compiled this in debug/any cpu mode and this seems to work fine, can you try if this works for you too? (see attachment)
MarkdownPreview.zip


Does not launch 3rd party file manager

Microsoft PowerToys version
"0.37.2"
Running as admin

[X] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce

Install the files app (or likely any other third party file manager)
update registry to launch 3rd party file manager with instructions here (works for win + e, open file location etc)
use power tools run to open a file

✔ Expected Behavior
The file to open in the file manager set in the registry
❌ Actual Behavior
File opened in explorer.exe
Other Software
Files v1.5

Tracked in #9865

Thanks for the report!


Update translation.json

I edited the Russian-language content file, supplemented it with missing word translations and improved the existing ones to make them sound more harmonious.

Very nice translation, thank you a lot

@hydrasources could you just fix the lint error? other than that, LGTM


2nd container with same parameters doesnt connect

(karthik has enough context on the issue alex)

Ok, what's the point of switching from one connection to another which is identical to the first one?

Repro steps:

Connect to container 1.
Create container 2 (you will see a error message indicating port is busy)
Stop container 1
Start container 2.
Now when you try to connect to container 2, you will see the above message.

Got it.


Environment variables will work with mod_wsgi

Graham Dumpleton tells me that the claim environment variables will not work with mod_wsgi is incorrect.

Hi all!
I just marked the ticket @pydanny opened as needsinfo because it's not clear what action is being requested from Django. If anyone can help clarify that, the ticket is at https://code.djangoproject.com/ticket/24326 - feel free to reopen if you can provide some clarity.
I'm not entirely sure what @ncoghlan was referring to in terms of the default Django wsgi.py file being "incomplete", nor am I clear why @grahamdumpleton 's gist recommends creating a new WSGI application file next to it, rather than editing the default one. The main issue I'm aware of where Django's default wsgi.py file interacts poorly with mod_wsgi is described in https://code.djangoproject.com/ticket/18518 (and related https://code.djangoproject.com/ticket/18559). This issue is already discussed in detail in our "hosting with mod_wsgi" docs: https://docs.djangoproject.com/en/1.7/howto/deployment/wsgi/modwsgi/

Closing as it's being handled in Django itself, which is a more appropriate location for the discussion.


Mapbox access token invalid

It was reported on the forum that the default Mapbox imagery (streets or satellite) doesn't load.
When selecting either of the providers, network requests error out with "{"message":"Not Authorized - Invalid Token"}", so it's probably time to renew the default token included in Cesium.

Thanks @erikmaarten, this was just fixed in #4741
However, people should be setting their own tokens.  They're only allowed to use ours in development, not in production.


browser filed is missing on package.json

Hi all,
It seems the browser field is missing on the package.json
"browser": "dist/sanitize-html.js"
The problem is in my prodject, as it's not specified, webpack is using the "main" field (dist/index.js) and this one is not doing the babel transpilation of es6 methods.
So I've a build crash due to this.
If you specify the browser attribute, webpack will be able to use it insead of main field.
Thanks

I've create a PR for this here: https://github.com/punkave/sanitize-html/pull/226
Can you merge it?
Thanks


:lady_beetle: dbt v1.5 deprecated/renamed dbt_state_artifact_path and dbt_defer_to_state env vars

Describe the bug
dbt 1.5 has renamed the environment variables for defer and state artifact usage. This means palm throws warnings on every dbt command that utilizes state or run_results
Your environment

palm version: 2.5.3
OS: Mac OS
Docker version:
Other dependencies & versions: dbt V1.5.2

How to reproduce
Upgrade to dbt 1.5+ and run palm
Expected behavior
Palm doesn't rely on deprecated features and runs without verbose warnings
Actual behavior
Every palm command run produces warnings from dbt
Screenshots
None
Additional context
N/A

Thanks for the bug report. Can you share the output of the warning that you are seeing?

This is absolutely something we want to address. We need to implement dbt version detection in the plugin as part of this work. Currently, we don't have a good way to do that.


zls binary is deleted while installing it for zig 0.12.1

Hi,
I observed that zls 0.12.1 isn't present for zig 0.12.1
When trying to install zls for zig 0.12.1 vs code extension deletes the exisiting 0.12.0 zls binary and shows the error that there's no corresponding binary.
Until error is fine but why the exisiting zls binary is deleted ?

Until error is fine but why the exisiting zls binary is deleted ?

Small oversight, the old version is deleted before the new one has been downloaded:
diff --git a/src/zls.ts b/src/zls.ts
index 57f8d65..f560247 100644
--- a/src/zls.ts
+++ b/src/zls.ts
@@ -293,15 +293,6 @@ async function installVersion(context: vscode.ExtensionContext, version: semver.
             location: vscode.ProgressLocation.Notification,
         },
         async (progress) => {
-            const installDir = vscode.Uri.joinPath(context.globalStorageUri, "zls_install");
-            if (fs.existsSync(installDir.fsPath)) {
-                fs.rmSync(installDir.fsPath, { recursive: true, force: true });
-            }
-            mkdirp.sync(installDir.fsPath);
-
-            const binName = `zls${isWindows ? ".exe" : ""}`;
-            const zlsBinPath = vscode.Uri.joinPath(installDir, binName).fsPath;
-
             progress.report({ message: "downloading executable..." });
             let exe: Buffer;
             try {
@@ -333,6 +324,15 @@ async function installVersion(context: vscode.ExtensionContext, version: semver.
                 }
                 throw err;
             }
+            const installDir = vscode.Uri.joinPath(context.globalStorageUri, "zls_install");
+            if (fs.existsSync(installDir.fsPath)) {
+                fs.rmSync(installDir.fsPath, { recursive: true, force: true });
+            }
+            mkdirp.sync(installDir.fsPath);
+
+            const binName = `zls${isWindows ? ".exe" : ""}`;
+            const zlsBinPath = vscode.Uri.joinPath(installDir, binName).fsPath;
+
             fs.writeFileSync(zlsBinPath, exe, "binary");
             fs.chmodSync(zlsBinPath, 0o755);


Implement a feed generator for Amazon

https://images-na.ssl-images-amazon.com/images/G/01/rainier/help/XML_Documentation_Intl.pdf

Here I've just gathered a bunch of info and resources about Amazon product feed.
Currently Amazon provides two different integration for Product feeds:
Marketplace Web Service (MWS) API
Consider Amazon is migrating from MWS to SPI. As mentioned in Selling on Amazon Guide

the legacy Amazon MWS APIs will be deprecated in the future. We do not yet have an established date, but will let you know and provide both time and tools to support migration of existing Amazon MWS integrations.

Product feeds should be sent on Amazon using XML file format as specified in the Amazon Marketplace Web Service (Amazon MWS) Documentation. A more detailed guide on how to generate XML is the "Selling on Amazon ~ Guide to XML".
In Ruby ecosystem there are some gems providing the integration with MWS but the most significant in my opinion is Peddler which is very popular and well maintained. As its README says:

Amazon is migrating to the newly-launched Selling Partner API (SP-API). There is no date yet for when MWS APIs will be deprecated. I will add support in Peddler in due course.

Selling Partner (SPI) API
The Selling Partner API is a REST-based API that builds on the functionality of Amazon Marketplace Web Service (Amazon MWS), but provides features to improve usability and security for developers and the seller partners they work with. With the Selling Partner API.
This is the Developer API Guide which contains step-by-step informations needed to start a development of an integration for an Amazon seller, while here's the guide for Amazon vendors.
Informations about the API can be found on Selling Partner API Models which contains Swagger models for developers to use to create software to call Selling Partner APIs. The API is really new and AFAIK seems no Ruby clients are present, anyway «developers can use swagger codegen to generate client libraries from these models». SPI Api also provides a sandbox environment to test your application.
One of main features of SPI is the possibility to create hybrid applications that make calls both to the Selling Partner API and to Amazon MWS. As far as I understood it could be possible to start the development of Amazon MWS and then migrate t SPI.

Use a hybrid application when your solution requires functionality from both services. When a seller authorizes your hybrid Selling Partner API application, they are (1) authorizing your Amazon MWS developer ID to make calls to Amazon MWS on their behalf, and (2) authorizing the application to make calls to the Selling Partner API on their behalf. If a selling partner has authorized you to make calls to Amazon Marketplace Web Service on their behalf, you can use the Authorization API to migrate that authorization to a hybrid Selling Partner API application. This eliminates the need to request authorization from the selling partner again. For more information, see the Authorization API User Guide.

We then decided to not implement this feature on a first round, because of the effort required and higher priority of others. For this reason I close this issue, taking care of removing any reference of Amazon feed from the README.

We then decided to not implement this feature on a first round, because of the effort required and higher priority of others. For this reason I close this issue, taking care of removing any reference of Amazon feed from the README.


[fixed] Task status messages

This PR is a fixed version of PR #1621 which has a faulty commit history.

This PR adds status messages to tasks which are also visible on the scheduler GUI.
Examples:

Status messages are meant to change during the run method in an opportunistic way. Especially for long-running non-Hadoop tasks, the ability to read those messages directly in the scheduler GUI is quite helpful (at least for us). Internally, message changes are propagated to the scheduler via a _status_message_callback which is - in contrast to tracking_url_callback - not passed to the run method, but set by the TaskProcess.
Usage example:
class MyTask(luigi.Task):
    ...
    def run(self):
        for i in range(100):
            # do some hard work here
            if i % 10 == 0:
                self.set_status_message("Progress: %s / 100" % i)

I know that you don't like PR's that affect core code (which is reasonable =) ), but imho this feature is both lightweight and really helpful.

Todo's from discussion in #1621:

Remove status_message cache variable
Add pydocs

Cool. This looks totally merge-worthy. Feel free to fix the minor doc-comment.

Done ;)

Nice!

can you resolve the failing tests? https://travis-ci.org/spotify/luigi/jobs/120027335

Yep, working on it

Ok, this is a tough one.
update_status_message is created at worker-level because it needs information on the scheduler. It is then passed to the task process where it is stored as _status_message_callback in the task itself. This is the reason why it can't be pickled.
This is not the case with tracking_url_callback since it's not saved in the task, but rather passed to its run method in TaskProcess._run_get_new_deps. I afraid that the status message callback should use the same mechanism here.
Here is a suggestion for changes in worker.py that would cleanup this mechanism in order to cope for other callbacks (like update_status_message) as well (and would solve the "problem" that @Tarrasch mentioned here):
from inspect import getargspec

class TaskProcess(multiprocessing.Process):

    def __init__(self, <current kw/args except tracking_url_callback>, run_callbacks=None):
        ...
        if run_callbacks is None:
            run_callbacks = {}
        self.run_callbacks = run_callbacks

def _run_get_new_deps(self):
    run_spec = getargspec(self.task.run)
    if run_spec.keywords:
        run_kwargs = self.run_callbacks.copy()
    else:
        run_kwargs = {key: cb for key, cb in self.run_callbacks.items() if key in run_sepc.args}

    task_gen = self.task.run(**run_kwargs)

    if not isinstance(task_gen, types.GeneratorType):
        return None
    ...

This way, the code in Worker._create_task_process becomes:
def _create_task_process(self, task):
    ...
    run_callbacks = {
        "tracking_url_callback": update_tracking_url,
        "status_message_callback": update_status_message
    }

    return TaskProcess(
        task, self._id, self._task_result_queue,
        random_seed=bool(self.worker_processes > 1),
        worker_timeout=self._config.timeout,
        run_callbacks=run_callbacks
    )

I'm not a fan of using inspect too much myself, but in this case it's quite robust. I can add this to the PR if you want.

I remember running into similar issues before
What's the reason we pickle the Tasks in the first place?

I think parallel scheduling requires that tasks can be pickled. At least it's mentioned in the docs at "parallel-scheduling".
Many contrib tasks also make using of it, e.g. in contrib/spark.py.

Hm right makes sense. Tasks are in theory interchangeable given the same name and parameters so instead of pickling you could just de/serialize it using that mechanism (that's how the assistant works). It would be quite easy to fix in worker.py
But you are right that some tasks use pickling (eg Hadoop mapreduce) so it would be mess to avoid pickling everywhere.
Wouldn't your suggestion with inspect run into the same issue when contrib tasks use pickle?

Wouldn't your suggestion with inspect run into the same issue when contrib tasks use pickle?

The run_callbacks would be owned by the TaskProcess instance, the task itself still doesn't know anything about the callbacks. I just ran the tests, looks good.

Actually the use of inspect has another advantage. Users might use decorators on Task.run, which are called twice in the current implementation if tracking_url_callback is missing in the signature of run.

Due to the changes in worker.py, do any of its tests need to be added/updated?

LGTM. test_tracking_url and test_type_error_in_tracking_run seem to be the only tests that make use of tracking_url_callback. The changes to TaskProcess and Worker should be pretty much covered by many other test cases.

We do also have a set of scheduler tests (they are disabled in Travis for flakiness reasons), but can you add a that case there to and make sure it passes locally?

I appreciate that you introduce inspect to make @decorators not be called twice. But may feel free to skip that change for a different PR if that simplifies things. Such a change for example requires tests that indeed show that decorators are only called once.
what about making the dict callable as I suggested in an inline comment? We would keep it to only one positional parameter for run then. Less magic, no inspection of argument-name.

Ok. How about this solution:
class TaskProcess(multiprocessing.Process):

    def __init__(self, ..., tracking_url_callback=None, status_message_callback=None):
        ...
        self.tracking_url_callback = tracking_url_callback
        self.status_message_callback = status_message_callback
        ...

    def _run_get_new_deps(self):
        self.task.set_tracking_url = self.tracking_url_callback
        self.task.set_status_message = self.status_message_callback

        def deprecated_tracking_url_callback(*args, **kwargs):
            warnings.warn("tracking_url_callback in run() args is deprecated, use "
                          "set_tracking_url instead.", DeprecationWarning)
            self.tracking_url_callback(*args, **kwargs)

        run_again = False
        try:
            task_gen = self.task.run(tracking_url_callback=deprecated_tracking_url_callback)
        except TypeError as ex:
            if 'unexpected keyword argument' not in str(ex):
                raise
            run_again = True
        if run_again:
            task_gen = self.task.run()

        self.task.set_tracking_url = None
        self.task.set_status_message = None
        ...

The callbacks are set right before run() is called, and then reset. This way pickling is not affected, it's backward compatible, and at some point the try-except block can be refactored.

Sure. But maybe lets hear from @daveFNbuck first, perhaps there were other reasons he opted for the extra-arg in run().
Though I'm very positive to this. It feels a bit hasted now to have introduced that extra arg in run().

Also, of course you'll have to change the places in the code-base that uses run(tracking_url_callback) already, but it seems like your new suggested interface is pretty easy to use. :)

Yep, already done that, mainly in hadoop, hadoop_jar, hive and scaling) =) I'm preparing the commits right now.

I changed hadoop.JobTask.dump to disregard callbacks, as they're not need in the deserialized job anyway. E.g. the tracking url is not set actively but parsed from the hadoop job stderr.
All tests pass now.

This looks like a good alternative to my solution, and more scalable. I see that the example attached here is of a progress percentage. If this is the main use case, I've been thinking it would be nice to add an optional progress bar that can be automatically displayed in the visualizer. That would be a bit better than having a popup to show a single number.

it would be nice to add an optional progress bar that can be automatically displayed in the visualizer

Good idea. Maybe I can add an additional PR that implements a progress bar. However, I think there are more use cases than just sending the progress. We use it for important intermediate output and to some extent for a summary of final results. Maybe one can parse the status message with a regexp (e.g. new RegExp('^progress\:\s(\d+)\%.*$', 'i')) to decide whether to show a progress bar or a pop up.

This looks very good. Thank you so much for doing this! Just see my inline comment/worry.
Other than that. This is good to merge right?

Can't we somehow guarantee that it's always present?

Yep, Worker._create_task_process is the only place where TaskProcesses are created, and the callbacks are always present/created here. I made some changes to reflect that. Of course, outside the run() scope, users will get an exception when a callback is used, but I think that's fine/wanted.

@riga, ok, is this "fine to merge" now you think?

Yes =)

Ok. Let's wait for test results and then I'll merge. :)

@Tarrasch Looks good, glad I could help.

@riga @Tarrasch
Hey, sorry for notifying you in something that old. I don't want to open a new issue since I'm not sure if anything is wrong but...
where can I see a status message that I set using self.set_status_message('msg')? Can't find it in the scheduler GUI...

Hi @michcio1234 ,
the status messages are visible in the scheduler GUI. You just have to click on the chat/message icon in the "Actions" column in the task table. If a task has no status message, that icon won't be visible.


Already on 'master'
From http://git-wip-us.apache.org/repos/asf/flink

branch            master     -> FETCH_HEAD
Already up-to-date.
Running ./tools/qa-check.sh
_qa_workdir doesnt exist. Creating it
There is no flink copy in the workdir. Cloning flink
./tools/qa-check.sh: line 55: git: command not found
./tools/qa-check.sh: line 58: cd: flink: No such file or directory
./tools/qa-check.sh: line 60: git: command not found
./tools/qa-check.sh: line 61: git: command not found
./tools/qa-check.sh: line 67: cd: flink: No such file or directory
Computing Flink QA-Check results (please be patient).
./tools/qa-check.sh: line 90: mvn: command not found
./tools/qa-check.sh: line 109: mvn: command not found
./tools/qa-check.sh: line 131: mvn: command not found
./tools/qa-check.sh: line 96: mvn: command not found
:+1: The number of javadoc errors was 0 and is now 0
./tools/qa-check.sh: line 114: mvn: command not found
:+1: The number of compiler warnings was 0 and is now 0
./tools/qa-check.sh: line 137: mvn: command not found
:+1: The number of files in the lib/ folder was 0 before the change and is now 0
:-1: The change contains @author tags
QA-Check finished.
Overall result: :-1:. Some tests failed. Please check messages above

run qa

Tested pull request but QA script returned errors.Result:
Running ./tools/qa-check.sh
run.sh: line 56: 23264 Killed                  timeout -s SIGKILL 2h docker run -v pwd:/mnt/ qa-bot bash -c "cd /mnt/ && ./tools/qa-check.sh" &>/dev/null
Running the QA-Check failed.
dd7e9b86ff47
dd7e9b86ff47

run qa

Tested pull request.Result:
Running ./tools/qa-check.sh
real	192m36.002s
user	0m0.112s
sys	0m0.000s
Computing Flink QA-Check results (please be patient).
:+1: The number of javadoc errors was 185 and is now 179
:+1: The number of compiler warnings was 660 and is now 659
:+1: The number of files in the lib/ folder was 2 before the change and is now 2
:-1: The change contains @author tags
QA-Check finished.
Overall result: :-1:. Some tests failed. Please check messages above
997e1a821a55
997e1a821a55


Add support for JSON Tracab data

Goal
Add support to serialize tracking data from Tracab, where both the meta and the raw data are in JSON format.
Description
Refactored the code, so we can both serialize tracking data from Tracab, if a) the meta data is XML and raw data .dat or b) the meta data is JSON and raw data JSON.
I've refactored the code to support two versions of input data similar to how we handle it for the Wyscout v2 and v3 event data models.
Questions
I'm uncertain about the implementation, which determines the orientation for my Tracab JSON deserializer. I'm confused again on HOME_TEAM / AWAY_TEAM / FIXED_HOME_AWAY.
In the meta data it is defined whether home or away team plays from left to right in the different periods. In the example file we have in our tests, we can read in the meta data that: "Phase1HomeGKLeft": false & "Phase2HomeGKLeft": true. This means that the home team GK has approx "X": 5000 at the start of the first half and approx "X": -5000 at the start of the second half, in the raw data.
What should the orientation then be? Should it be AWAY_TEAM for this example?

Based on @probberechts' table in #190, I presume the orientation in this particular example should be FIXED_AWAY_HOME or AWAY_HOME once #190 is merged.

Based on @probberechts' table in #190, I presume the orientation in this particular example should be FIXED_AWAY_HOME or AWAY_HOME once #190 is merged.

That's right.

Any updates @JanVanHaaren @koenvo ?

Github tells me there is a merge conflict. Can you please make sure to merge the master in?
I really like the auto identification of the format to make it easier for users! Great work.
@JanVanHaaren I prefer serialization_format over data_version. What do you think? The version makes me think there can be different versions with different data in it, but it's only the format that changes, right?

Thanks for the feedback @koenvo, should be good now!

I've noticed a small bug in this PR. Kloppy allows specifying the data source as a FileLike object but now it only works with a Path. For example with a string:
from kloppy import tracab

dataset = tracab.load(
    meta_data="kloppy/tests/files/tracab_meta.xml",
    raw_data="kloppy/tests/files/tracab_raw.dat",
)

It gives the following error: AttributeError: 'str' object has no attribute 'name'


Add Mapper block

A simple block to map one type to another, assuming it implements Into trait.

following implementations seems to be missing:
implementation of Deserialize in file block_config.rs
as_str, from_str and blockinstantiaion trait implementation in block_tag.rs
build_stdio_system method in file lib.rs
StdioSystem trait implementation for Mapper block.

Not sure if this is a 'core' block or 'flow' block. let's ask to @artob


BITMAKER-2237: Modify estela application to install external Django apps

Description
Issue

Issue ID.

Checklist before requesting a review

[x] I have performed a self-review of my code.
[x] My code follows the style guidelines of this project.
[x] I have made corresponding changes to the documentation.
[x] New and existing tests pass locally with my changes.
[x] If this change is a core feature, I have added thorough tests.
[x] If this change affects or depends on the behavior of other estela repositories, I have created pull requests with the relevant changes in the affected repositories. Please, refer to our official documentation.
[x] I understand that my pull request may be closed if it becomes obvious or I did not perform all of the steps above.

@Adriana618, it is ready.

they are not related


feature: Comment/uncomment code

Fixes #9

Thankyou for working this solution together. Although, the templ commenting is a bit more nuanced than this, please see https://templ.guide/syntax-and-usage/comments/
Comments within templates are html style.

I did notice. But it seems the LSP didn't complain about it, which is why I submitted.


gitu --help results in stair-stepping

Installed using 'cargo install gitu --locked'.

Once the stair-stepping starts, the shell has to be killed to get rid of it.

Hi! I tried reproducing this with the latest 0.2.0 gitu in Alacritty / Gnome terminals on Fedora 39, but to no avail. Curious as to what is causing it.
This info is printed pretty early.

This is indeed gone in the version I just sources I just pulled from github and built locally. Seems the crate needs to be updated.

I made another release now!


[Bug]: test run before testcontainers elastic container is finished starting/healthy

Testcontainers version
Elastic package - 3.3.0
Using the latest Testcontainers version?
Yes
Host OS
Windows
Host arch
x86
.NET version
6
Docker version
4.20.1

Docker info
Client:
 Version:    24.0.2
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.10.5
    Path:     C:\Program Files\Docker\cli-plugins\docker-buildx.exe
  compose: Docker Compose (Docker Inc.)
    Version:  v2.18.1
    Path:     C:\Program Files\Docker\cli-plugins\docker-compose.exe
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-dev.exe
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.19
    Path:     C:\Program Files\Docker\cli-plugins\docker-extension.exe
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v0.1.0-beta.4
    Path:     C:\Program Files\Docker\cli-plugins\docker-init.exe
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-sbom.exe
  scan: Docker Scan (Docker Inc.)
    Version:  v0.26.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-scan.exe
  scout: Command line tool for Docker Scout (Docker Inc.)
    Version:  v0.12.0
    Path:     C:\Program Files\Docker\cli-plugins\docker-scout.exe

Server:
 Containers: 14
  Running: 2
  Paused: 0
  Stopped: 12
 Images: 28
 Server Version: 24.0.2
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 3dce8eb055cbb6872793272b4f20ed16117344f8
 runc version: v1.1.7-0-g860f061
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
 Kernel Version: <IP_ADDRESS>-microsoft-standard-WSL2
 Operating System: Docker Desktop
 OSType: linux
 Architecture: x86_64
 CPUs: 8
 Total Memory: 7.598GiB
 Name: docker-desktop
 ID: 83bf66ce-9214-48cd-af7c-95a908e1215e
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5555
  <IP_ADDRESS>/8
 Live Restore Enabled: false

WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support

What happened?
I am trying to start this elastic search container and wait for it to be healthy. Elastic typically needs 1-2 minutes before being available since requests are make to it via http:
            elasticsearchContainer = new ElasticsearchBuilder()
                .WithImage("docker.elastic.co/elasticsearch/elasticsearch:8.8.1")
                .WithPortBinding(9200)
                .WithEnvironment("xpack.security.enabled", "false")
                .WithWaitStrategy(
                    Wait.ForUnixContainer()
                    .UntilContainerIsHealthy()
                    )
                .Build();

However, tests start immediately and as a result, fail when they are not supposed to. If I start this same image with the same parameters and wait for elastic to run healthy, it works without an issue. This could be a bug with the elastic package, or maybe I am just doing something wrong?
Relevant log output
No response
Additional information
No response

I've tried both the until health and until http success on "/"

This may be due to your defined wait strategy, i.e. UntilContainerIsHealthy. This does not consider the status of anything inside the container but rather looks at the health of the container itself (using Docker's HEALTHCHECK capability). See relevant documentation here.
I would just remove your usage of the .WithWaitStrategy() extension method and let the default strategy as part of the ElasticsearchBuilder be used instead; which you can find here.

@jacobjmarks Same issue occurs, which is why I tired to implement my own wait strategy. Test finish and fail before elastic even finishes starting...

I've done some more digging. I've used the following program to assert the HTTPS endpoint is available after the container starts.
using System.Text;
using Testcontainers.Elasticsearch;

var container = new ElasticsearchBuilder()
    .WithImage("docker.elastic.co/elasticsearch/elasticsearch:8.8.1")
    // .WithEnvironment("xpack.security.enabled", "false")
    .Build();

await container.StartAsync();

var esHttpsEndpoint = container.GetConnectionString();

Console.WriteLine($"Pinging {esHttpsEndpoint} ...");

using var httpClient = new HttpClient(new HttpClientHandler
{
    // bypass SSL issues
    ServerCertificateCustomValidationCallback = (_, _, _, _) => true,
});

// configure basic authentication
var credentials = $"{ElasticsearchBuilder.DefaultUsername}:{ElasticsearchBuilder.DefaultPassword}";
httpClient.DefaultRequestHeaders.Authorization = new("Basic", Convert.ToBase64String(Encoding.UTF8.GetBytes(credentials)));

using var response = await httpClient.GetAsync(esHttpsEndpoint);
response.EnsureSuccessStatusCode();

var responseContent = await response.Content.ReadAsStringAsync();
Console.WriteLine(responseContent);

What I have observed (with both the default 8.6.1 and 8.8.1 images) is that setting the environment variable `` to false caused the following error when making the HTTPS request (observed via Postman):
Error: write EPROTO 67057928:error:100000f7:SSL routines:OPENSSL_internal:WRONG_VERSION_NUMBER:../../../../src/third_party/boringssl/src/ssl/tls_record.cc:242

cc @HofmeisterAn
@LGmatrix13 I would try — at the least — removing your .WithEnvironment("xpack.security.enabled", "false") call.

I would also, in general, ensure your tests are suitably waiting for await elasticsearchContainer.StartAsync() to complete before running.

@jacobjmarks I'm using nunit and starting the container with an OneTimeSetup and stopping it with OneTimeTeardown. Theoretically, nunit should start OneTimeSetup at the beginning, wait, then continue. But maybe it is not? I'm also running my tests in parallel, but I get the same results if I turn that off.

If it's within NUnit's OneTimeSetup that should be fine. How are your tests attempting to communicate with the ES instance and what is the specific error message you are getting when they attempt to do so? A more complete example will be useful.

The tests try to test the full lifestyle, so I make an http request to various endpoints that makes nest queries to elastic. There's no exceptions, but whenever I write to elastic via my api endpoints, the data doesn't get saved. I've added print statements between when I write/read and elastic is is telling me there's 0 shards to work with...
Maybe I could provide something more detailed in the morning. Thanks for the help!

I agree with @jacobjmarks comments. Usually, overriding the default module configuration is not necessary. I do not think the Elasticsearch image utilizes Docker's health check API. Please stick to the default module configuration (pinning the image version is fine).
_ = new ElasticsearchBuilder().Build();

Testcontainers for .NET does not extract the SSL certificate from the container like Java. Therefore, your client must accept untrusted certificates.

Maybe I could provide something more detailed in the morning. Thanks for the help!

I think more information or a reproducer is necessary. I do not see an issue with the configuration of the module yet.

@HofmeisterAn Here's an example:
It's just using new ElasticsearchBuilder().Build()
[Test]
        public async Task WriteToElasticThenRead()
        {
            ElasticClient elasticClient = new ElasticClient(new ConnectionSettings());

            await elasticClient.UpdateAsync<Post>("1", u => u
                .Index("Posts")
                .Doc(new Post
                {
                    name = "Name",
                    age = 20
                })
                .DocAsUpsert()
            );

            var response = await elasticClient.GetAsync<Post>("1", u => u
                .Index("Posts")
            );

            var post = response?.Source;

            Assert.AreEqual(post.name, "Name");
            Assert.AreEqual(post.age, 20);
        }

I'm geting a System.NullReferenceException : Object reference not set to an instance of an object. since post is null because elastic couldn't actually save the data in the query before the get. If I run this same test with an elastic instance that has been running, it works... Honestly not sure what could be wrong here 😅

Honestly not sure what could be wrong here 😅

It is null because your code does not add the object to Elastic. If you look into the update response value, you will notice:
invalid_index_name_exception Reason: "Invalid index name [Posts], must be lowercase"

My test runs fine with a lowercase index. This issue does not relate to tc-dotnet.

Okay, makes sense! But I don't have access to ElasticsearchClientSettings. So I'm doing it this way:
            ElasticClient elasticClient = new ElasticClient(new ConnectionSettings().ServerCertificateValidationCallback(CertificateValidations.AllowAll));
            await elasticClient.UpdateAsync<Post>(Guid.NewGuid().ToString("D"), u => u
                .Index("posts")
                .Doc(new Post
                {
                    name = "Name",
                    age = 20
                })
                .DocAsUpsert()
            );

            await elasticClient.Indices.RefreshAsync();

            var response = await elasticClient.GetAsync<Post>(Guid.NewGuid().ToString("D"), u => u
                .Index("posts")
            );

            var post = response?.Source;

            Assert.AreEqual(post.name, "Name");
            Assert.AreEqual(post.age, 20);

I'm only using the regular NEST package. Looked at the logs on docker and it's closing the connection do to an untrusted certificate... so that appears to be the issue. I'm binding the container to port 9200 without random hosts, so I don't think I need to pass a connection string. The logs show the request is going through, anyways... Does anything look wrong on my connection settings? Thanks for you help btw, I really appreciate it!

Okay, changed my ElasticBuilder to the following, and now everything works:
            var elasticContainer = new ElasticsearchBuilder()
                .WithEnvironment("xpack.security.transport.ssl.enabled", "false")
                .WithEnvironment("xpack.security.enabled", "false")
                .WithImage("docker.elastic.co/elasticsearch/elasticsearch:8.8.1")
                .WithPortBinding(9200)
                .Build();

Disabling ssl was the key, I think. I'm going to sick with this for now so I don't have to inject a new elastic singleton into the API I'm testing. Thanks again for your guidance @jacobjmarks and @HofmeisterAn!

I'm only using the regular NEST package

I am not familiar with the package, but your client must accept untrusted certificates. Otherwise, you can extract the certificate from the container (like Java does) to configure your client, but that is more complex. According to https://github.com/elastic/elasticsearch-net NEST is "outdated" too.

I'm binding the container to port 9200 without random hosts [...]

This is considered as a bad practice, we do not recommend it.

I don't think I need to pass a connection string

I think you need to use the connection string, since it contains credentials (username and password).


Make plugin run on 2024.3

What would you like to be added
I would like to have this plugin installable for 2024.3
Why is this needed
Plugin is disabled because it is only allowed to run up to build 242.* but new IntellliJ is 243.*
Implementation details

Should just be changing untilBuild=243.*
but I haven't tested if it is still compatible and does not crash.

Im working on it. This time there is more work to do ...


improvement: Fix some typos and grammar issues

Fix some typos like "feedbacks" and grammar issues raised by Grammarly.

@Lee-W

Codecov Report

Merging #653 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #653   +/-   ##
=======================================
  Coverage   73.62%   73.62%
=======================================
  Files          72       72
  Lines        2673     2673
=======================================
  Hits         1968     1968
  Misses        705      705

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c6db13a...9899f64. Read the comment docs.

There are conflicts between this one and https://github.com/pycontw/pycon.tw/pull/649. @Lee-W can you help merging this? I took a look and supposed that typos and grammar issues should be applied to commits from https://github.com/pycontw/pycon.tw/pull/649 since there are some changes (unified 90min -> 1hr 30min) and additional parts (venue).

@yychen Sure 🙂 I just fixed it. Thanks!


IPT Tracing Error

I compiled my WinAFL binaries using the intel PT flag and im trying to use the example in the docs but I cannot seem to get it to work, I keep getting:
C:\WinAFL\winafl\build64\bin\Release>afl-fuzz.exe -i ..\..\..\testcases\others\elf -o ..\..\out -P -t 20000 -- -coverage_module test_gdiplus.exe -target_module test_gdiplus.exe -target_method main -nargs 2 -- test_gdiplus.exe @@
WinAFL 1.16b by<EMAIL_ADDRESS>Based on AFL 2.43b by<EMAIL_ADDRESS>IPT service enebled
[+] You have 8 CPU cores and 0 runnable tasks (utilization: 0%).
[+] Try parallel jobs - see docs\parallel_fuzzing.txt.
[*] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[+] Process affinity is set to 1.

[*] Setting up output directories...
[+] Output directory exists but deemed OK to reuse.
[*] Deleting old session data...
[+] Output dir cleanup successful.
[*] Scanning '..\..\..\testcases\others\elf'...
[+] No auto-generated dictionary tokens to reuse.
[*] Creating hard links for all input files...
[*] Attempting dry run with 'id_000000'...

[-] PROGRAM ABORT : ipt tracing error

         Location : run_target_pt(), c:\winafl\winafl\winaflpt.c:1455

I'm getting this on every single example.

Which Windows version, which CPU and are you running inside a VM?

Which Windows version, which CPU and are you running inside a VM?

btw, what is architecturally preventing it from running inside of a VM?

I’m running on a physical Windows 10 machine, 64 bit,  i7 Core processor

I had to resort to using Intel PT because apparently dynamoRIO doesn’t work on 16Gbs of RAM. I guess even that’s not enough. But now PT doesn’t even work. I’m so lost on how some folks get AFL to work

which gen of i7?

Core i7 vPro 7th Gen

PROCESSOR_ARCHITECTURE=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 158 Stepping 9, GenuineIntel

Dynamo rio works fine on 16gb ram. Why it’s not working for you?
On Sat, 18 Apr 2020 at 11:49 PM, ryancor<EMAIL_ADDRESS>wrote:

PROCESSOR_ARCHITECTURE=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 158 Stepping 9, GenuineIntel
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/googleprojectzero/winafl/issues/244#issuecomment-615919095,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AFL3IMETRD7ZQLJMGR2HRBTRNHVKRANCNFSM4MLC5QPQ
.

--
-Hardik Shah

I’m using the exact example command using gdi_plus.exe as the Target binary. I’m constantly getting either “Test case timed out” even using the -t (+) option or I’m getting “Program out of memory”.

Regarding Intel PT:
Intel PT support in WinAFL is based on https://github.com/ionescu007/winipt, can you compile that and check if it works for you? You didn't write which version of Windows 10 you were using, note that Intel PT driver is only present on 1809 and up.
@expend20 I can only tell you that the VM software must explicitly support Intel PT, but don't know the low level details, which I assume is what you're interested in, sorry!
Regarding DR:
"Test case timed out" can mean different things in WinAFL if the setup is incorrect, this is why you should always run the debug mode as described in https://github.com/googleprojectzero/winafl/blob/master/readme_dr.md and check your debug log before trying to run a fuzzing session. 16gb should definitely not be a problem for test_gdiplus.exe.

PT: And can you also check if the WinAFL precompiled binaries work for you? I didn't compile it anew, but I just confirmed that precompiled binaries still work correctly on 1909.

C:\WinAFL\winafl\build64\bin\Release>afl-fuzz.exe -i ..\..\..\testcases\images\gif -o out -D C:\WinAFL\DynamoRIO\bin64 -t 20000 -- -coverage_module gdiplus.dll -coverage_module WindowsCodecs.dll -fuzz_iterations 5000 -target_module test_gdiplus.exe -target_method main -nargs 2 -- test_gdiplus.exe @@
WinAFL 1.16b by<EMAIL_ADDRESS>Based on AFL 2.43b by<EMAIL_ADDRESS>[+] You have 8 CPU cores and 0 runnable tasks (utilization: 0%).
[+] Try parallel jobs - see docs\parallel_fuzzing.txt.
[*] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[+] Process affinity is set to 1.

[*] Setting up output directories...
[*] Scanning '..\..\..\testcases\images\gif'...
[+] No auto-generated dictionary tokens to reuse.
[*] Creating hard links for all input files...
[*] Attempting dry run with 'id_000000'...

[-] The program took more than 20000 ms to process one of the initial test cases.
    Usually, the right thing to do is to relax the -t option - or to delete it
    altogether and allow the fuzzer to auto-calibrate. That said, if you know
    what you are doing and want to simply skip the unruly test cases, append
    '+' at the end of the value passed to -t ('-t 20000+').

[-] PROGRAM ABORT : Test case 'id_000000' results in a timeout @ifratric
         Location : perform_dry_run(), c:\winafl\winafl\afl-fuzz.c:3005

Dynamo does not work for me and I built AFL with the version I have. Now I will attempt to show my use of Dr.Run using the debug flag
C:\WinAFL\winafl\build64\bin\Release>C:\WinAFL\DynamoRIO\bin64\drrun.exe -c winafl.dll -debug -target_module test_gdiplus.exe -target_method main -fuzz_iterations 10 -nargs 2 -- test_gdiplus.exe ..\..\..\testcases\images\gif\not_kitty.gif
<Out of memory.  Program aborted.>

Here is my windows build information Version 1803 (OS Build 17134.1246)

Hmm well the Windows version explains why Intel PT isn't working, but this is the first time I'm seeing an out-of-memory error on a small example like that. Which DR version are you using? You can also try to disable any antivirus/antimalware software you are running as it can interfere with DR.

I'm currently updating my Windows OS build to 1903, so I will check back on that once that is done. I have disabled all my AV's, how do i check which DR version I have?

Update on Intel PT, its running now but the output looks like this
cant't sync
cant't sync
               WinAFL 1.16b based on AFL 2.43b (test_gdiplus.exe)
cant't sync
+- process timing -------------------------------------+- overall results ----+
|        run time : 0 days, 0 hrs, 0 min, 30 sec       |  cycles done : 35    |
|   last new path : none yet (odd, check syntax!)      |  total paths : 1     |
| last uniq crash : none seen yet                      | uniq crashes : 0     |
|  last uniq hang : none seen yet                      |   uniq hangs : 0     |
+- cycle progress --------------------+- map coverage -+----------------------+
|  now processing : 0 (0.00%)         |    map density : 0.00% / 0.00%        |
| paths timed out : 0 (0.00%)         | count coverage : 1.00 bits/tuple      |
+- stage progress --------------------+ findings in depth --------------------+
|  now trying : havoc                 | favored paths : 1 (100.00%)           |
| stage execs : 18/25 (72.00%)        |  new edges on : 1 (100.00%)           |
| total execs : 1481                  | total crashes : 0 (0 unique)          |
|  exec speed : 93.00/sec (slow!)     |  total tmouts : 0 (0 unique)          |
+- fuzzing strategy yields -----------+---------------+- path geometry -------+
|   bit flips : 0/32, 0/31, 0/29                      |    levels : 1         |
|  byte flips : 0/4, 0/3, 0/1                         |   pending : 0         |
| arithmetics : 0/224, 0/0, 0/0                       |  pend fav : 0         |
|  known ints : 0/26, 0/100, 0/39                     | own finds : 0         |
|  dictionary : 0/0, 0/0, 0/0                         |  imported : n/a       |
|       havoc : 0/952, 0/0                            | stability : 100.00%   |
|        trim : 98.77%/13, 0.00%                      +-----------------------+
cant't sync-------------------------------------------+             [cpu:  0%]
cant't sync
cant't sync
cant't sync

Using the same command from the first comment on the ticket


Bounties contract is not implemented

About
A bounty contract is needed to reward users for their bounty completion
rewards
$bonk:100000$

@axelofwar


mod: bump neutrino to testing version

This is the sister PR to the neutrino PR here: https://github.com/lightninglabs/neutrino/pull/300

I think it's just the coverage test that fails. But I'm not sure why. I could try retriggering it though.

ah! indeed - my bad

@djkazic  - mind just rebasing on master - a fix was pushed last week that should remove the flake that has been occuring in the neutrino test (which it turns out isnt just a coverage test)


Update for Hub V2 enhancements

@msp1974 I have updated the PR 12 ( base on your dev branch).

I move the led_indicator for lights...

I try to create a new feature for Over or under power notification, I fail  as I'm blind I call you for help!
I think that It's due to the arguments...

I also begin to develop a new type "automation" : these automations are configured in the Wiser app and they can be enabled or disabled by the user...

there is also another enhancement on the schedules :

Schneider introduice a new type of schedule, onoffcost that follow the peak and offpeak schedule to reduice your cost

There is also a Smart

Here are 2 diag file for these features
config_entry-wiser-04b54a69ee02ea23d613b96cb315965b.json
config_entry-wiser-01J9GY85J14RYV4RNX47XWHBER.json

@msp1974 I have generate a PR for my last enhancements proposal.


Feat: Add support for channel types on channel options

Please describe the changes this PR makes and why it should be merged:
Co-requisite with:

https://github.com/discordjs/discord-api-types/pull/198

Ref:

https://github.com/discord/discord-api-docs/pull/3825

Status and versioning classification:

Code changes have been tested against the Discord API, or there are no code changes
I know how to update typings and have done so, or typings don't need updating
This PR changes the library's interface (methods or parameters added)

Codecov Report

Merging #41 (832fba1) into main (7723ad0) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##              main       #41   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           18        19    +1
  Lines          233       242    +9
  Branches        33        33
=========================================
+ Hits           233       242    +9

Impacted Files
Coverage Δ

src/interactions/slashCommands/options/channel.ts
100.00% <ø> (ø)

...s/slashCommands/mixins/CommandChannelOptionBase.ts
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7723ad0...832fba1. Read the comment docs.

When will this be merged