Add multi-file, one line option, non-graphical formatting to examples/ZXingReader

Adds multi-file handling and -1 one line option to example/ZXingReader, and formats any non-graphical characters in the text into angle brackets (e.g. a linefeed becomes <LF>).
Also renames Extension -> Add-on (the standard name) and puts the actual value in quotes, with the formatted value appended (as interpretation can vary).
Removes the _hints.requireEanAddOnSymbol() check from ODMultiUPCEANReader when setting UPC_EAN_EXTENSION metadata so that it gets set if present anyway. I notice the check was added here but it doesn't appear to be necessary.

That ODMultiUPCEANReader looks like a true bug-fix, nice.
I get the value of the multi-file support (I was using the ReaderTest binary for that...)
I was first skeptical of the -1 choice, but the man page of ls convinced me ;)
I'm (still) skeptical of the value of the FormatText function. I'd like to keep that file as simple as possible (it is a demo tool to show the API). What do you need that for? Is that the 'standard' way to do it (where is that code coming from)?
Why modify the locale?
That '+'  approach seems non-standard to me. Any prior art for that?

Re FormatText, it's needed to make the one line option work. Also printing invisible characters to the console is not very useful.
There's no standard way I know of of showing non-graphics, the choice here was based on that used in the GS1 General Specifications for group separators, <GS>. Alternative suggestions welcome.
The code is my own, the names of the ASCII chars are the standard abbreviations.
Re locale, it's needed to make iswgraph() work, as the default is "C" (I'll add a comment stating this).
Re"+", again there's no standard that I know of. "+" is used by Zint. BWIPP uses a space. TEC-IT uses nothing (separate symbology). Zint's "+" seems like a natural choice to me, suggesting "add-on". Alternatives welcome.
Re keeping it simple, the motivation here is to make it a useful diagnostic tool, which is what I use it for. I don't think this makes it particularly bloated, but if you like I can split it off into e.g. "examples/ZXingReaderDiagnostic".
Thanks for reviewing, appreciate it.

Re FormatText, it's needed to make the one line option work. Also printing invisible characters to the console is not very useful.

But you are calling FormatText also in the multi-line/default output. Also, I'd argue that printing a CR/LR character on the console is indeed very useful (thinking of those QRCodes with vCard data). What type of input do you have that actually contains text with non-printable characters?

There's no standard way I know of of showing non-graphics, the choice here was based on that used in the GS1 General Specifications for group separators, <GS>. Alternative suggestions welcome.
The code is my own, the names of the ASCII chars are the standard abbreviations.

Thanks for the explanation. I don't have a better suggestion.

Re locale, it's needed to make iswgraph() work, as the default is "C" (I'll add a comment stating this).

According to the spec (https://en.cppreference.com/w/cpp/string/wide/iswgraph) the locale influences the behavior but it is not required to be set to something specific to make iswgraph work. I guess you'd like to see printable utf8 characters on your console? Is there a sample in our testing set that shows the issue?

Re"+", again there's no standard that I know of. "+" is used by Zint. BWIPP uses a space. TEC-IT uses nothing (separate symbology). Zint's "+" seems like a natural choice to me, suggesting "add-on". Alternatives welcome.

I see. I would have gone for a simple ' ', I guess, because that is how you'd read it printed on the symbol. Do you require this add-on text in your one-line output?

Re keeping it simple, the motivation here is to make it a useful diagnostic tool, which is what I use it for. I don't think this makes it particularly bloated, but if you like I can split it off into e.g. "examples/ZXingReaderDiagnostic".

I'd suggest to add another command line parameter (e.g. '-escape') that explicitly enables the FormatText functionality and also move that code over to the TextUtfEncoding namespace either into an extended std::string ToUtf8(const std::wstring& str, bool escapeNonGraphicalChars = false); or a separate std::string ToUtf8(const std::wstring& str, bool escapeNonGraphicalChars);

Thanks for reviewing, appreciate it.

Thanks for helping improve the code :).

Re non-printable chars, good point about vCards, have made it an option -escape as suggested, with the exception that -1 always escapes.
Non-printables occur in a number of situations, the most obvious being GS1 data with <GS> separators, and Maxicodes using ANSI MH10 Format "01" Version "96" [)><RS>01<GS>96...<EOT>.
Re FormatText have moved it as suggested to TextUtfEncoding::ToUtf8(const std::wstring& str, const bool angleEscape) and added a unit test for it re std::isgraph() - discovered a bug (off-by-one index) in the original version in the process.
Re add-on text, have changed the separator to space. It's not required, just nice info to have.
P.S. I see the test is failing on Windows/Mac - will fix it up tomorrow.

Nice touch with the unit test :). Please feel free to comment on my new Add-on handling issue/question.

Not sure what's happening on Windows but have just #ifdefed around the issues (would need to use something other than std::iswgraph() to do it properly).
Have also put my local hacked version on https://github.com/gitlost/zxing-cpp/tree/diagnostics so you can see what I'm aiming for re diagnostics (also some bug fixes). Future PRs will be cleaned up versions of the code there.

You seem to be seriously engaged in diagnosing issues with the decoders? Are there specific issues you are having?
I appreciate your interest in improving the code. That said, your diagnosis infrastructure seems relative invasive. I have not looked at it enough to fully understand what you are trying to achieve but it seems, you'd like to have a kind of fancy "printf debugging" that can be enabled at runtime (in a release build). I don't see the value of that compared to something like the existing preprocessor based PRINT_DEBUG code that I use for debugging/development (yet). I definitively believe that code introspection and debugging facilities are well placed in code that is removed in release builds.
If you'd be interested in chatting about your plans and goals with the project, maybe we can schedule a phone call? I'm based in Germany, so UTC+1.

It's not issues I'm having really, it's just that I'm using it as an excellent tool to determine differences in encodation when comparing Zint's output to that of other barcode generators and to examples in standards etc.
I'm fine with leaving out the diagnostics which is very invasive as you say. I'll just PR the additional handling (Structured Append, Reader Initialization, ECI) and any bug fixes.
Thanks for offering to chat, feel free to email me.

After my recent change regarding Structured Append, I remembered that you had prepared something for the DataMatrix decoder in your branch. I just had another look at your code and wanted to ask whether you still plan on providing that as a separate PR?
I noticed that you introduced a std::string "id" field. I thought about as well because of the PDF417 decoder but was not sure the "fileId" was supposed to be that. Was that also your guess or do you have some definitive information? In that case I'd like to merge the parity with the id field and make it a string. For the QRCode this would be the equivalent field, even if it happens to have some more meaning.
About the eci field: if the code-page is switched somewhere in between, then the client code would need to do the whole decoding again based on the rawBytes after all symbols are detected, right? That would be pretty impractical...

Hi yes I still have plans on providing a number of PRs but got distracted by other things. Also wasn't sure of what the intention regarding metadata was and looking at the recent changes I see it's to replace it mostly with direct Result fields, which is great.
Re making Structured Append "id" a string, this was driven primarily by Aztec Code, which uses an alphanumeric id. PDF417's "fileId" is numeric only, but of variable length (base 900 according to spec, so the current decoding here and upstream needs changing) so is also best represented as a string. So merging the parity (QR specific) with id and making it a string sounds good to me.
Re Structured Append eci field, any spec I've seen which supports both ECI and Structured Append states that the ECI can span symbols, which is problematic as you say, and any client code would have to set the initial ECI on affected symbols and re-decode if scanned out of sequence. Perhaps some extra info and/or helper functions could be added to assist with that...
(By the by my preference for the field names would be to drop the "symbol" prefix and use id, sequenceNumber and totalNumber.)

Re ECI spanning symbols, was wrong about it always being the case - QR requires each symbol to have an ECI after the Structured Append (ISO/IEC 18004:2015 <IP_ADDRESS>), so that's fine. ECI spanning applies to Aztec, Data Matrix, MaxiCode and PDF417 of the supported barcodes (DotCode is another example).

Re StructuredAppend id: I'll do that then soonish. Best to wait with your DM PR with this regard. I did also some code cleanup and additional tests in DMDecoder.cpp (inspired by your branch), which will conflict with your changes.
Re StructuredAppend ECI: would you please add this information about QR vs. all other codecs in a comment at an appropriate place? It's so annoying that those specs are not public...
Re sequenceNumber is that term something 'official' coming up in the specification?

Re StructuredAppend ECI info, yes, will do so. Need to do a fully worked example of dealing with out-of-sequence symbols with spanning ECIs, to see how feasible this all is, so will be a bit of a way off... also will be adding ECI support to Aztec and PDF417 first...
Re sequenceNumber it's not really official, though it seems to be a more common term. Also I think it would be best if it is 1-based, which sequence number suggests, whereas index suggests 0-based. Not that important obviously...

I'm done with the mentioned DMDecoder and StructuredAppend/Id changes.
The naming is indeed not quite straight forward. I felt the urge to give the 3 properties some connection. I considered

having a StructuredAppendInfo Result::structuredAppend() member, which I found unnecessarily complicating the interface
naming them structruredAppendIndex, etc., which I found too verbose
using the symbol prefix, which is also not obviously the 'correct' choice...

Since this is an API (not a user application) I'd argue that index starting at 0 as opposed to sequenceNumber is the right choice here.

Yes "Structured Append" is tediously verbose. How about "sequence"? Then sequenceId, sequenceIndex (agree that 0-based more C++y), and sequenceSize (instead of "count" by analogy with std:string etc).

I had a look at the specs: DM and QR call the index part "position of the symbol" and the count part "total number of symbols", PDF calls it "Segment Index" and "Segment Count".
The index part is clearly a property of the symbol, the id/parity part is a property of the sequence and the count can be either or depending on the term (count vs size). Putting all 3 in the same 'namespace' clashes either way. Maybe my urge to 'connect' them is the wrong priority. I also added the isStructuredAppendSymbol() which already left the namespace (because I saw no way to make that also fit...).
Thinking more about it, I see now these 3 alternatives:

symbolIndex, symbolCount, symbolId, isStructuredAppendSymbol, isLastStructuredAppendSymbol (current code)
sequenceIndex, sequenceSize, sequenceId, isPartOfSequence, isLastInSequence
symbolIndex, symbolCount, sequenceId, isPartOfSequence, isLastInSequence

And even though sequenceIndex feels wrong, I have to admit that 2) 'looks' nicest.... arghhh. Your chance to double down on your 'sequence' suggestion. If anyone else want's to chime in, now is the time...

Ha I'd like to double down on "sequence" (which I got from the Aztec spec) but keep "StructuredAppend"  for the helpers so

sequenceIndex, sequenceSize, sequenceId, lastECI, isStructuredAppendSymbol, isLastStructuredAppendSymbol

This splits the namespace like 1 and 3 but unless structuredAppend is used throughout I don't see a way around that.
	/**
	 * @brief sequenceSize number of symbols in a structured append context.
	 *
	 * If this is not part of a structured append set of symbols, the returned value is -1.
	 * If it is a structured append symbol but the total number of symbols is unknown, the
	 * returned value is 0 (see PDF417).
	 */
	int sequenceSize() const { return _sai.sequenceSize; }

	/**
	 * @brief sequenceIndex the 0-based index of this symbol in a structured append set of symbols.
	 */
	int sequenceIndex() const { return _sai.sequenceIndex; }

	/**
	 * @brief sequenceId id to check if a set of symbols belongs to the same structured append set.
	 *
	 * If the symbology does not support this feature, the returned value is empty (see MaxiCode).
	 * For QR Code, this is the parity integer converted to a string.
	 * For PDF417, this is the "fileId" numeric string.
	 */
	std::string sequenceId() const { return _sai.sequenceId; }

	/**
	 * @brief lastECI Character set ECI in effect at end of symbol if part of a structured append set.
	 */
	std::string lastECI() const { return _sai.lastECI; }

	bool isLastStructuredAppendSymbol() const { return sequenceSize() == sequenceIndex() + 1; }
	bool isStructuredAppendSymbol() const { return sequenceSize() > -1; }

	/**
	 * @brief symbologyIdentifier Symbology identifier "]sm" ("s" is symbology, "m" modifier).
	 */
	const std::string& symbologyIdentifier() const {
		return _symbologyIdentifier;
	}

	/**
	 * @brief readerInit Set if Reader Initialisation/Programming symbol.
	 */
	bool readerInit() const {
		return _readerInit;
	}

I agree that sequenceIndex should logically be symbolIndex but that breaks up the namespace too much as you suggest.
My main objection is to symbolId and its similarity to symbologyIdentifier, given that that will be introduced by https://github.com/nu-book/zxing-cpp/issues/214. But I don't want to bikeshed this to death, so whatever you decide is fine by me...
(Yes the lastECI business has yet to be proven...)


PepBB model unzip

Manual ms word file says

--
However, my
unzip '*.zip' at centos
shows
Archive:  PepBB.zip
warning [PepBB.zip]:  zipfile claims to be last disk of a multi-part archive;
  attempting to process anyway, assuming all parts have been concatenated
  together in order.  Expect "errors" and warnings...true multi-part support
  doesn't exist yet (coming soon).
file #1:  bad zipfile offset (local header sig):  4

1 archive had fatal errors.

Double-clicking PepBB.zip, PepBB.z01, PepBB.z02 on my macOS led me one file only (e.g. PepBB.hdf5 that is ~220 MB). Is this PepBB.hdf5 the only one that is required?

Yes, it is correct. The result of the unzipping should be that one file


Likely race condition in autoincrement test

This failed twice then finally passed over in PR https://github.com/balderdashy/sails-postgresql/pull/215 for sails-postgresql.  Worth noting that the record that "already exists" was 4 in one failure and 5 in the other.
1) autoIncrement attribute feature should auto generate unique values even when values have been set:
     [Error (E_VALIDATION) 1 attribute is invalid] Invalid attributes sent to undefined:
 • id
   • A record with that `id` already exists (`4`).
  Error (E_VALIDATION) :: 1 attribute is invalid
  Error (E_VALIDATION) :: 1 attribute is invalid
  error: duplicate key value violates unique constraint "autoIncTable_pkey"
      at Socket.<anonymous> (_stream_readable.js:765:14)
      at emitReadable_ (_stream_readable.js:427:10)
      at emitReadable (_stream_readable.js:423:5)
      at readableAddChunk (_stream_readable.js:166:9)
      at Socket.Readable.push (_stream_readable.js:128:10)
      at TCP.onread (net.js:529:21)

Commented in https://github.com/balderdashy/waterline-adapter-tests/pull/99 and added a skip to that test. I can't imagine that test is correct.


Allow for specifying custom meta-data for the cloud-init image.

Works exactly the same way as specifying custom user-data does.

Rebased, and updated as per comments. Sorry for the delays, hopefully this is GTG.

thx for contrib @night199uk !!
i would like to have a testacc for this feature.
Otherwise looks good to me

https://github.com/dmacvicar/terraform-provider-libvirt/issues/384

I close this pr in favor of https://github.com/dmacvicar/terraform-provider-libvirt/pull/410 which will make the metadata field more flexible and stable. It will adress also this pr. Thanks a lot to everyone, have a nice day and journey


Pythran implementation of scipy.signal._spectral

As a follow-up to #13308 convert an extra function to Pythran.
Notable change wrt. Cython version:

Pythran detects that all access are inbound, so no decorator needed
Use np.empty_like instead of np.empty
create a temporary array to hold some computations, instead of doing everything using plain scalar. This as almost no impact on performance (slightly better)

Comparison with cython on the following micro-benchmark:
python -m timeit -s 'from numpy.random import random; n=400; x = random(n); y = random(n); z=random(n); from _spectral import _lombscargle as l' 'l(x, y, z)'

time in ms.
n    | cython | pythran
-----+---------+-----------
100  | 0.230   | 0.227
200  | 0.901   | 0.910
400  | 3.67    | 3.69
800  | 14.4    | 14.5

Note that the compilation flag may slightly differ between cython and pythran, so I wouldn't take the comparison too seriously. Basically they are on par.

Pythran defect spotted, we need t efficiently support divide by zero exception ;-)

Updated version that passes all tests. Updated benchmark, with n=800

Compiled with clang 6.0.1
Cython: 15 ms
Pythran: 14.6 ms

Compiled with gcc 8.2.1
Cython: 15.8 ms
Pythran: 14.4ms

cc @rgommers

Updated version that passes all tests. Updated benchmark, with n=800

Compiled with clang 6.0.1
Cython: 15 ms
Pythran: 14.6 ms

Compiled with gcc 8.2.1
Cython: 15.8 ms
Pythran: 14.4ms

cc @rgommers

I'll leave it open for a day or two again in case anyone else wants to have a look.

I'll leave it open for a day or two again in case anyone else wants to have a look.

LGTM, thanks @serge-sans-paille and @rgommers for moving this forward!

LGTM, thanks @serge-sans-paille and @rgommers for moving this forward!


http://semver.io/node.json claims 0.12.4 to be unstable

Node.js 0.12.4 is the latest patch release for Node.js 0.12, it's not unstable and yet http://semver.io/node.json shows it as such, claiming latest stable version is 0.12.3.
Why is that?

@mzgol unstable will always show the latest release, while stable is limited by the env var MAX_STABLE_NODE. (this is for cases where a nominally stable release ends up breaking major functionality, like 0.10.34).
Since testing stable versions and bumping the env var is a manual process, I usually lag behind the latest patch version.

Thx, good to know.

I'll close this issue since there's nothing to do here.


Prepare release of 1.0.5 version for Azure Monitor Query

API change check for com.azure:azure-monitor-query
API changes are not detected in this pull request for com.azure:azure-monitor-query


WebApplication: Ensure class names match for WebApplicationAuthenticationInformation

Pull Request (PR) description
Prior to this change there as a mismatch between the class name for WebApplicationAuthenticationInformation in the schema and implementation.
The schema referenced the class as DSC_WebApplicationAuthenticationInformation whereas the implementation referenced the class as MSDT_xWebApplicationAuthenticationInformation.
This caused an error when CIM would later try and lookup the class. The underlying error returned was MI RESULT 5.
When consumed by Puppet (via Puppet.Dsc) we see the following:
Error: dsc_webapplication: The specified Class does not exist.
Error: /Stage[main]/Main/Dsc_webapplication[TestApp]: Could not evaluate: undefined method `[]' for nil:NilClass

This commit resolves the issue by updating the class name passed to New-CimInstance so that it matches the value defined in the schema.
This Pull Request (PR) fixes the following issues
None
Task list

[x] Added an entry to the change log under the Unreleased section of the file CHANGELOG.md.
Entry should say what was changed and how that affects users (if applicable), and
reference the issue being resolved (if applicable).
[ ] Resource documentation added/updated in README.md.
[ ] Resource parameter descriptions added/updated in README.md, schema.mof and comment-based
help.
[ ] Comment-based help added/updated.
[ ] Localization strings added/updated in all localization files as appropriate.
[ ] Examples appropriately added/updated.
[ ] Unit tests added/updated. See DSC Community Testing Guidelines.
[ ] Integration tests added/updated (where possible). See DSC Community Testing Guidelines.
[ ] New/changed code adheres to DSC Community Style Guidelines.

This change is

@johlju anything else we need to do to get this reviewed and merged?

@chelnak thank you for this change. Will merge as soon as the tests passes again.

Thank you @johlju 🙏

Thanks so much for merging.
What are you release cycles like for resources? Are we likely to see a patch release before Xmas?

A preview release should have already been released, it is done automatically when merging to main. The community decides when a full release should be done. But since this PR is fixing an error that is affecting existing configuration to be converted from the ‘x’ module the community should probably release it soon.
Ping on the Slack #dsc channel (see dsccommunity.org) in a week or so and suggest for the community to release it.

Perfect thank you!


ill-formed sparse convolution network in Cylinder3D

Hi, I'm developer of spconv.
this cylinder module is definitely ill-formed sparse convolution.
if subm layers share same key, they must have same spatial structure (indices), same kernel size and same dilation.
If two subm layers have different kernel size or dilation or spatial structure, you must assign a different indice key.
In your UpBlock, you use same indice key in three subm layers but the kernel size is different, so in spconv 1.x, the conv2 and conv3 actually run conv1 with different weight. the conv3only use 9 of 27 weight during calculation.
I plan to add some auto-reuse mechanism in future.

Thanks for your reminder. I will check and fix it.


chapter 2 has unknown mistake, please help me

I copyed the code to pycharm, but it can not run, here are the code:
import torch
import torch.nn as nn
import torch.optim as optim
import torch.utils.data
import torch.nn.functional as F
import torchvision
from torchvision import transforms
from PIL import Image, ImageFile
ImageFile.LOAD_TRUNCATED_IMAGES = True
def check_image(path):
try:
im = Image.open(path)
return True
except:
return False
check_image = True
img_transforms = transforms.Compose([
transforms.Resize((64, 64)),
transforms.ToTensor(),
transforms.Normalize(mean=[0.485, 0.456, 0.406],
std=[0.229, 0.224, 0.225])
])
train_data_path = "./train/"
train_data = torchvision.datasets.ImageFolder(root=train_data_path, transform=img_transforms)
val_data_path = "./val/"
val_data = torchvision.datasets.ImageFolder(root=val_data_path, transform=img_transforms)
test_data_path = "./test/"
test_data = torchvision.datasets.ImageFolder(root=test_data_path, transform=img_transforms)
batch_size = 64
train_data_loader = torch.utils.data.DataLoader(train_data, batch_size=batch_size)
val_data_loader = torch.utils.data.DataLoader(val_data, batch_size=batch_size)
test_data_loader = torch.utils.data.DataLoader(test_data, batch_size=batch_size)
class SimpleNet(nn.Module):
def __init__(self):
    super(SimpleNet, self).__init__()
    self.fc1 = nn.Linear(12288, 84)
    self.fc2 = nn.Linear(84, 50)
    self.fc3 = nn.Linear(50, 2)

def forward(self, x):
    x = x.view(-1, 12288)
    x = F.relu(self.fc1(x))
    x = F.relu(self.fc2(x))
    x = self.fc3(x)
    return x

simplenet = SimpleNet()
optimizer = optim.Adam(simplenet.parameters(), lr=0.001)
if torch.cuda.is_available():
device = torch.device("cuda")
else:
device = torch.device("cpu")
simplenet.to(device)
def train(model, optimizer, loss_fn, train_loader, val_loader, epochs, device):
for epoch in range(1, epochs + 1):
training_loss = 0.0
valid_loss = 0.0
model.train()
for batch in train_loader:
optimizer.zero_grad()
inputs, targets = batch
inputs = inputs.to(device)
targets = targets.to(device)
output = model(inputs)
loss = loss_fn(output, targets)
loss.backward()
optimizer.step()
training_loss += loss.data.item() * inputs.size(0)
training_loss /= len(train_loader.dataset)
    model.eval()
    num_correct = 0
    num_examples = 0
    for batch in val_loader:
        inputs, targets = batch
        inputs = inputs.to(device)
        output = model(inputs)
        targets = targets.to(device)
        loss = loss_fn(output, targets)
        valid_loss += loss.data.item() * inputs.size(0)
        correct = torch.eq(torch.max(F.softmax(output, dim=1), dim=1)[1], targets)
        num_correct += torch.sum(correct).item()
        num_examples += correct.shape[0]
    valid_loss /= len(val_loader.dataset)

    print(
        'Epoch: {}, Training Loss: {:.2f}, Validation Loss: {:.2f}, accuracy = {:.2f}'.format(epoch, training_loss,
                                                                                valid_loss,
                                                                                num_correct / num_examples))

epoch = 5
train(simplenet, optimizer, torch.nn.CrossEntropyLoss(), train_data_loader, val_data_loader, epoch, device)

mistake information:
Traceback (most recent call last):
File "C:\Users\Administrator\Desktop\disk_file\DL\1\5.py", line 110, in
train(simplenet, optimizer, torch.nn.CrossEntropyLoss(), train_data_loader, val_data_loader, epoch, device)
File "C:\Users\Administrator\Desktop\disk_file\DL\1\5.py", line 75, in train
for batch in train_loader:
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torch\utils\data\dataloader.py", line 521, in next
data = self._next_data()
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torch\utils\data\dataloader.py", line 561, in _next_data
data = self._dataset_fetcher.fetch(index)  # may raise StopIteration
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torch\utils\data_utils\fetch.py", line 49, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torch\utils\data_utils\fetch.py", line 49, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torchvision\datasets\folder.py", line 232, in getitem
sample = self.loader(path)
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torchvision\datasets\folder.py", line 269, in default_loader
return pil_loader(path)
File "C:\Users\Administrator\AppData\Roaming\Python\Python39\site-packages\torchvision\datasets\folder.py", line 250, in pil_loader
img = Image.open(f)
File "C:\Program Files\1\lib\site-packages\PIL\Image.py", line 3030, in open
raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file <_io.BufferedReader name='./train/cat\1004525_cba96ba3c3.jpg'>

Hey, it's an PIL.UnidentifiedImageError – the image cannot be opened and identified.

Are you able to open the image ./train/cat\1004525_cba96ba3c3.jpg on your working station? Is it a real picture/valid file?
How have you aquired the image files? Have you used the download.py file or the gdrive link?

Hey, it's an PIL.UnidentifiedImageError – the image cannot be opened and identified.

Are you able to open the image ./train/cat\1004525_cba96ba3c3.jpg on your working station? Is it a real picture/valid file? Edit: The backslash after cat seems a bit weird to me: the images with the cats should be in an own directory called cat, I think it needs to be a slash instead of the backslash.
How have you acquired the image files? Have you used the download.py file or the gdrive link?

_
thanks for your help!
I download this image package through G Drive, after your reminder, i check the package on my PC and found '1004525_cba96ba3c3.jpg' has broken, does it means i must use check_image()?

Yes, please adjust your code for the three respective lines and add , is_valid_file=check_image. The check_image() function is included to avoid these kind of error messages and the broken images not being considered.
For example for the training data use the ImageFolder class as follows (see https://github.com/falloutdurham/beginners-pytorch-deep-learning/blob/master/chapter2/Chapter 2.ipynb):
train_data = torchvision.datasets.ImageFolder(root=train_data_path,
                                              transform=img_transforms,
                                              is_valid_file=check_image)

The same for val_data and test_data.
Is there any reason you deleted it in the code you forked from the gihub repo?

If you got an FileNotFoundError with the check_image() function please check out https://github.com/falloutdurham/beginners-pytorch-deep-learning/issues/71.

Yes, please adjust your code for the three respective lines and add , is_valid_file=check_image. The check_image() function is included to avoid these kind of error messages and the broken images not being considered.
For example for the training data use the ImageFolder class as follows (see https://github.com/falloutdurham/beginners-pytorch-deep-learning/blob/master/chapter2/Chapter 2.ipynb):
train_data = torchvision.datasets.ImageFolder(root=train_data_path,
                                              transform=img_transforms,
                                              is_valid_file=check_image)

The same for val_data and test_data.
Is there any reason you deleted it in the code you forked from the gihub repo?

Thanks for your patient!
The reason I delete  'img_check()'  is I noticed the bug in torchvision you mentioned in another issue,  it seems that the function is important for both download by Url and GDrive. Or we can update a new image package to GDrive.

Yes, unfortunately also some GDrive images seem to be affected, but there is no issue at all as long it's possible to include the check_image() function.
I think it's best to downgrade torchvision to 0.10.1 as mentionend in #71 - or you can upgrade to 0.12.0 (released 2 days ago; the bug mentioned in #71 has been fixed in the release - but be aware that the new release has not been tested for this book repo yet).


Audio output Shortcut

Description of the new feature / enhancement
Essentially I use SwitchSound to do this but its just a hotkey programed that will allow you to swap between two different audio outputs. Like for example my headset and my soundbar.
Scenario when this would be used?
Whenever you want to swap from one audio output to the other
Supporting information
No response

/dup https://github.com/microsoft/PowerToys/issues/4964


Product advertising

Let's update setup.sh, start.sh and stop.sh. Big name of "zebrunner standalone" should appears when user will run this scripts.

https://github.com/qaprosoft/qps-infra/pull/198

Verified


the value range of lab space

I want to know the value range of lab space.
when I use the 'colors.lab_to_rgb' , I got a UserWarning: Color data out of range: Z < 0 in 42194 pixels.

Hello,
I apologize for the delay in answering. The underlying implementation by scikit-image uses the following value ranges for LAB:
L (0-100), a (-128-127), b (-128-127). For a proper conversion you will need to scale your image for these ranges.


Restrict Agent Profile To Environment

Hi there,
Is it possible to create an Elastic Agent profile that is tied to a specific environment, and doesn't allow pipelines in other environments to use that profile?
Scenario being we have some pipelines that require certain elevated privileges. We currently put these in a separate environment that also has dedicated agents in.
Moving to Elastic agents we'd want to have a separate EA profile that uses a different image/podspec for these elevated privilege agents, however these agents should only be available to pipelines in a given environment.
As I understand it currently any pipeline can use any elastic profile, regardless of its environment
Cheers,
Mike

@sheroy Regarding this question: I know that we can specify a pod yaml instead of the settings in the EA profile. Does that allow changing environment? Maybe it's a question to @Evesy as well.

Can't GO_EA_AUTO_REGISTER_ENVIRONMENT be used? Currently, this env var is set to the environment that the pipeline belongs to at the time of agent creation. What if GO_EA_AUTO_REGISTER_ENVIRONMENT is set to one specific environment in the profile setting? Then, at the time of agent creation, the environment the agent belongs to is fixed. Instead of GO_EA_AUTO_REGISTER_ENVIRONMENT being set to different environments every time a new agent is created with the profile. Is that a possible workaround until authorization on elastic profiles is implemented? Unless used properly, this could mean that the plugin brings up a new agent not in the same env as the pipeline and so, jobs might not get assigned but agents created. I haven't tried it though. So, not sure if it will even work, just a suggestion.

By parameterized, I meant "provide the ability to set it".

If you look at the elastic profile edit page for the k8s elastic agent - https://build.gocd.org/go/admin/elastic_profiles, there's a section called Environment Variables. Set GO_EA_AUTO_REGISTER_ENVIRONMENT=a fixed environment name (since @Evesy knows which environment the profile should be used in)

That depends on the order of the environment variables set, I guess. Also, since an agent will be brought up in the other environment, some other job in a pipeline in that environment can be picked up by the agent, etc. It might work as a workaround, but as a very hacky one. :) It's clever, though. But, I don't know if it will work.
It'll also not be clear why the jobs are not being picked up. I wouldn't recommend doing that.


Persistence Module

Short Summary
As Developer/Contributor I would like to have a possibility to just add objects to a save/load routine, so I don't have to implement an own one in each module which works with objects.
Description
This module should handle all the saving/loading of objects in the campaign. In the old framework we had routines where one takes care of vehicles/units, one takes care of resource crates and storage contents, etc.
To eliminate this cluttering, we decided to implement a module which takes care of all this at one place and provides a kind of function/event handler framework to register objects to be handled via this module with specific and individual conditions (like in FOB area or similar).
This will also ensure that if there may be issues with placements after loading or something like that, that it's only one place to adjust it and not have the odd situation to adjust something in X amount of modules, as there is not only one module which spawns objects. Also tweaks concerning performance will be possible at one place.
This module will make it necessary to adjust some other modules (like the build menu which already save/load the FOB stuff) to use this module instead of own implementations. As this is kind of a "core functionality" for the mission, it'll be created on place 03 in the module hirarchy, so the current 03 and 04 modules needs to be incremented by one order number and therefore also the include references etc.
Sub-Tasks

[x] Implement a general object saving and loading functionality
[x] Implement a functions or event handlers framework which can be utilized by every other module

[x] Move the current implementations of object save/load (like in the build module) to the persistence module handling

[x] Rearrange the module order accordingly

will vehicles be saved anywhere around the map?

Yes, that's the aim.

Other than that will it be roughly the same as 0.963a? like fob area etc
Sorry just clarifying 🥇

The aim is to make persistent not depending on fixed positions and ranges like FOB area etc.


Can't load on android 9 device.

I put my .glb files on http server, and download on android's Application.persistentPath. the file can download and store successfully, but when l use GLTFComponent.load to load the glb file, but it doesn't show anything. I have testted it successfully in unity editor.
I also switch to other plugins, GLTFUtility and glFast, it occur the same proplem. So, if any one can help me, I'll be very appreciae.

Seems the Application.persistentPath in Android is not pointing to the file, please check it in development apk with console log

@wangyanmeego I have the same problem, is these a way to processing? Please share with me, thanks.

Do you have some code samples?


Update channels.csv

Tried to fix the issue, but I had no write access on this repo, sorry.

@LaneSh4d0w Please try again. The admin panel states that you have write access to all repositories in the organization.

@LaneSh4d0w Please try again. The admin panel states that you have write access to all repositories in the organization.

I do have access to all the projects, but the users when forking the repository can refuse collaborators to access it.
Please try to make the changes using the fork and github.dev, it gives me an error.

Now I see.


Office hour teaser for April

Towards giantswarm/giantswarm#15720
This replaces the textual office hours link with a graphical banner.
The block only renders until April 7, 2021, to avoid us forgetting about outdated content.
Please remember to

[x] Give the PR a meaningful title -- it will be shown in the release notes
[ ] Add (or remove) user questions associated with any updated docs

Delete the April file 2021-04-office-hours.jpg or the March one?

Sorry for the confusion. I meant to delete the old one, as it is no longer needed.

Done


upgrade dependencies

internal issue id: DDS-2943

Codecov Report
Base: 81.52% // Head: 81.52% // No change to project coverage :thumbsup:

Coverage data is based on head (c5ad6be) compared to base (6fa2f90).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff            @@
##             master      #51   +/-   ##
=========================================
  Coverage     81.52%   81.52%
  Complexity      347      347
=========================================
  Files            53       53
  Lines          1034     1034
  Branches         52       52
=========================================
  Hits            843      843
  Misses          172      172
  Partials         19       19

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Added background ANSI colour codes

Discussed in #47457.
Due to the fact that the previous changes are not yet on master, I couldn't figure out a way to isolate the relevant changes in this pull request. Focus on the changes in commit a253dae, as the other commit is captured in pull request #49763.

@danielfrankcom thanks a lot for this PR, let's first merge in the previous one and then we can add this one easily.

@danielfrankcom since we have merged the other PR we could look into this one now.
Though I guess it needs to be updated to be on top of the latest changes we just merged in.
Pushing this to june since there is no rush for this

Yeah I'll need to rebase it, but everything should still work. I'll add the background colour codes to the unit tests too, since it should be relatively easy.

Sounds good, thanks a lot!

This looks good, let's merge it in.
Thanks a lot!


Vim9: help example about closures sharing same context could be improved

This is a follow-up to https://github.com/vim/vim/issues/8614
Now that the patches 8.2.3209, 8.2.3216, and 8.2.3222 have been merged, the code given in the help finally works:
vim9script
var flist: list<func>
for i in range(10)
  var inloop = i
  flist[i] = () => inloop
endfor

However, it could be still improved for the reasons given here, and here.
That is, neither of the 2 snippets output anything.  So, it's not easy for the reader to observe the difference which is explained in this section of the help.
Besides, the variable/function names are not accurate enough.  I think closures would be better than flist.  After all, that's the whole point of the section: how closures are handled in a block; not regular functions.  Similarly, GetClosure() would be better than GetFunc(); for the same reasons.
As a suggestion, here is a patch:
diff --git a/runtime/doc/vim9.txt b/runtime/doc/vim9.txt
index a0681d287..e7bf27ad4 100644
--- a/runtime/doc/vim9.txt
+++ b/runtime/doc/vim9.txt
@@ -1046,25 +1046,39 @@ For these the backtick expansion can be used.  Example: >
 	enddef

 Closures defined in a loop will share the same context.  For example: >
-	var flist: list<func>
+	var closures: list<func>
 	for i in range(10)
 	  var inloop = i
-	  flist[i] = () => inloop
+	  closures[i] = () => inloop
 	endfor
+	echo closures
+	  ->len()
+	  ->range()
+	  ->map((i, _) => closures[i]())
+
+This outputs: >
+	[9, 9, 9, 9, 9, 9, 9, 9, 9, 9]

 The "inloop" variable will exist only once, all closures put in the list refer
 to the same instance, which in the end will have the value 9.  This is
 efficient.  If you do want a separate context for each closure call a function
 to define it: >
-	def GetFunc(i: number): func
+	def GetClosure(i: number): func
 	  var inloop = i
 	  return () => inloop
 	enddef

-	var flist: list<func>
+	var closures: list<func>
 	for i in range(10)
-	  flist[i] = GetFunc(i)
+	  closures[i] = GetClosure(i)
 	endfor
+	echo closures
+	  ->len()
+	  ->range()
+	  ->map((i, _) => closures[i]())
+
+This outputs: >
+	[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]

 ==============================================================================

Unrelated, but I think there is a trailing semicolon which should be removed in the example about the future implementation of classes:
diff --git a/runtime/doc/vim9.txt b/runtime/doc/vim9.txt
index a0681d287..79f48a67a 100644
--- a/runtime/doc/vim9.txt
+++ b/runtime/doc/vim9.txt
@@ -1457,7 +1457,7 @@ Some examples: >
 	    var name: string

 	    def constructor(name: string)
-		this.name = name;
+		this.name = name
 	    enddef

 	    def display(): void

Closing because the help will be updated.  Source


npm run dev failing

Can't seem to get this working.
I've ensured mongodb, mongoose are all installed. What am I missing?
rhysedwards$ npm run dev

><EMAIL_ADDRESS>dev /Users/rhysedwards/Downloads/ideas
> NODE_ENV=development node server/index.js

Environment: development
Error connecting to: mongodb://localhost/ReactWebpackNode. MongoError: connect ECONNREFUSED

/Users/rhysedwards/Downloads/ideas/node_modules/connect-mongo/node_modules/mongodb/lib/server.js:228
        process.nextTick(function() { throw err; })
                                            ^
Error: connect ECONNREFUSED
    at exports._errnoException (util.js:746:11)
    at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1010:19)

npm ERR! Darwin 14.5.0
npm ERR! argv "node" "/usr/local/bin/npm" "run" "dev"
npm ERR! node v0.12.7
npm ERR! npm  v2.13.2
npm ERR! code ELIFECYCLE
npm ERR<EMAIL_ADDRESS>dev: `NODE_ENV=development node server/index.js`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>dev script 'NODE_ENV=development node server/index.js'.
npm ERR! This is most likely a problem with the react-webpack-node package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     NODE_ENV=development node server/index.js
npm ERR! You can get their info via:
npm ERR!     npm owner ls react-webpack-node
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /Users/rhysedwards/Downloads/ideas/npm-debug.log

Had an unrelated mongo installation issue. Closing this.

Having similar issue when deploying to Heroku. Any chance you remember what the issue was


Fix blocking pipeline when running windows exes

Code in the NativeCommandProcessor was guarded under CORECLR when it should have been UNIX.
Fixes #1254.

Hi @lzybkr, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Jason Shirk (POWERSHELL)). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;


[connectivity] Endorse connectivity macos plugin

See https://github.com/flutter/flutter/issues/47851 for a similar discussion.

Connectivity macos has been endorsed


refresh_token is not provided

I'm doing this token request:
URL: https://login.microsoftonline.com/common/oauth2/v2.0/token
HTTPBody: code=M74fae8dc-7c8d-6d2d-8a36-085739a310f3&code_verifier=EvvnJGRZ-TtssDJfECbh6DkFN98Xem6vtz6k3KciJ-U&redirect_uri=dawn://oauth2/callback&client_id=4282106e-a882-4e82-8d98-2f2c3f308a2d&grant_type=authorization_code
However all I got is:
"access_token" = "token goes here...";
"expires_in" = 3600;
"ext_expires_in" = 0;
scope = "https://outlook.office.com/Calendars.Read";
"token_type" = Bearer;
As you can see no refresh_token is provided. Why is that?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fef99ca3-72bb-2c48-a62b-9ff9c314d72b
Version Independent ID: e58fd3a1-0af8-6e16-3d78-3dc748992593
Content: Azure AD v2.0 OAuth Authorization Code Flow
Content Source: articles/active-directory/develop/v2-oauth2-auth-code-flow.md
Service: active-directory
GitHub Login: @CelesteDG
Microsoft Alias: celested

I want to use Outlook API btw as described here: https://docs.microsoft.com/en-us/outlook/rest/get-started
That documentation doesn't even mention refresh_token. How to refresh the token then?

For a very weird reason I only get refresh_token when I specify offline_access scope. Is this documented somewhere?

Thanks for your feedback! We will investigate and update as appropriate.

@agordeev  To receive a refresh token in a token response your application must request the "offline_access" scope.  Refer to Scopes, permissions, and consent in the Azure Active Directory v2.0 endpoint.  Also, the same has been mentioned under the success response section of Refresh the access token document.


Multi-line modes are being ignored.

Regardless of the multi-line setting, either on the command line or in the config file "from x import"
lines always end up formated as mode 7.
from third_party import lib1, lib2, lib3, ...  # NOQA
This is also independent of the current format. I have tried formatting in various multi-line format for the source, and tried with different multi-line modes specified. The end result is always that the "from import" is compressed to a single line.
I am running version 4.3.21 of isort and python 3.7.

Upon further investigation, the cause of the problem is interaction between multi-line and line-width. Mode is ignored unless the line is longer than line-width.
This doesn't seem to make sense, as when a mode is chosen it seems logical to assume that all "from import" would be formatted that way. In my cause I was choosing mode 3 specifically to minimize diffs when committing changes to git.

You can use the following setting, set to a small number, to get the behaviour you want:
  --wl WRAP_LENGTH, --wrap-length WRAP_LENGTH
                        Specifies how long lines that are wrapped should be,
                        if not set line_length is used. NOTE: wrap_length must
                        be LOWER than or equal to line_length.

Most people do not want wrapping, until the line is long, and this is the default of other common tools such as block. If you do isort does allow you to do that as well!
I hope this is helpful,
Thanks!
~Timothy


Can we have a release?

I am after this fix,
https://github.com/telia-oss/concourse-sts-lambda/pull/23

Done in the following release: https://github.com/telia-oss/concourse-sts-lambda/releases/tag/v1.1.0

PS: I had to move the v1.1.0 tag after merging #28

Seems the credentials for doing releases had expired, v1.1.0 was moved again and now includes bumped dependencies and its now building with Go 1.14. Just FYI.


How can I access the props of a svg component?

I am using  to load remote SVG files which are in different sizes. I wonder if there is a way to access the SVG props. I have tried to create a ref but it doesn't work.
Or if there is a way to keep the original ratio of the SVG view area would be great.
I appreciate your kind help.

Hello @namti,
If the issue still persists, could you share an example?
Thank you.


Update MD file on new branch 2017-11-08_06-22-00

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Expose LB costs to applications

@nicolasnoble

Holding off on merging this one: the build failure it caused was on a binary that's EOL'd, and so it's likely it'll just get deleted instead. Keeping it around in case we need it elsewhere though.


MAINT More fixes to include test/ folder in sdist

Followup on https://github.com/rtavenar/tslearn/pull/154
Related to https://github.com/rtavenar/tslearn/issues/150
Sorry, it looks like previous PR was not enough. Some changes to setup.py were also necessary.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@39ad33b). Click here to learn what that means.
The diff coverage is 50%.

@@            Coverage Diff            @@
##             master     #159   +/-   ##
=========================================
  Coverage          ?   93.69%
=========================================
  Files             ?       22
  Lines             ?     2585
  Branches          ?        0
=========================================
  Hits              ?     2422
  Misses            ?      163
  Partials          ?        0

Impacted Files
Coverage Δ

tslearn/tests/test_estimators.py
89.28% <50%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 39ad33b...86f297f. Read the comment docs.


DownloadPipelineArtifactsV2 preferTriggeringPipeline not working as expected

Required Information
Entering this information will route you directly to the right team and expedite traction.
Question, Bug, or Feature?
Type: Bug
Enter Task Name: DownloadPipelineArtifacts
list here (V# not needed):
https://github.com/Microsoft/azure-pipelines-tasks/tree/master/Tasks
Environment

Server - Azure Pipelines or TFS on-premises?

If using Azure Pipelines, provide the account name, team project name, build definition name/build number: Contact me for private details

Agent - Hosted or Private: Private

If using private agent, provide the OS of the machine running the agent and the agent version: Ubuntu 20.04, Agent 2.193.1

Issue Description
I have a task configuration that looks like this.
                - task: DownloadPipelineArtifact@2
                  displayName: Download Deployment Artifact
                  inputs:
                    source: specific
                    project: $(System.TeamProject)
                    pipeline: $(app.ciPipeline)
                    runVersion: latestFromBranch
                    preferTriggeringPipeline: true
                    runBranch: ${{ parameters.runBranch }}
                    artifact: $(app.artifactName)
                    path: $(Pipeline.Workspace)/${{ stageParameters.functionapp }}-pipeline

Even though the pipeline was automatically triggered by a CI pipeline that ran on branch foobar, the preferTriggeringPIpeline: true doesn't seem to override any of the options. An older artifact is downloaded from the configured variables.
Task logs
I can privately share pipeline logs with Microsoft.
Starting: Download Deployment Artifact foobar project
==============================================================================
Task         : Download Pipeline Artifacts
Description  : Download build and pipeline artifacts
Version      : 2.178.0
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/download-pipeline-artifact
==============================================================================
Download from the specified build: #14395
Download artifact to: /agent/_work/1/foobar....
Minimatch patterns: [**]
Start downloading FCS artifact- blah blah
Downloading: /agent/_work/1/blah / blah .zip
Downloading artifact finished.
Finishing: Download Deployment Artifact blah

Troubleshooting
Checkout how to troubleshoot failures and collect debug logs: https://docs.microsoft.com/en-us/vsts/build-release/actions/troubleshooting
Error logs
[Insert error from the logs here for a quick overview]

This seems related to this issue https://github.com/MicrosoftDocs/azure-devops-docs/issues/8277


Add Bootstrap 4 support?

Considering adding Bootstrap 4 to make it easier for folks to actually build on top of. It's still alpha, but it has been for the longest time so version 3 seems a bit backwards at this point.
Feedback is welcome, let me know if you think this would be helpful - and I could extend it with a few pages, maybe even a secure, universal account management page  - or if you think it would complicate the example.
Note: Currently it doesn't use any CSS frameworks, just a 'main.scss' file with about 125 lines for minimal formatting.

I'm currently doing this. I'll may refactor how CSS works and update the in app documentation to better explain how it works.

I've created a branch that uses reactstrap, as this is a pretty great way to do it with Bootstrap 4. Comments and suggestions welcome.

This is now live.
The only snag is that Reactstrap 4.x uses React 15 and Next.js 4.x has jumped to React 16, so the project is still using the latest release in the Next.js 3.x branch for now.
If Reactstrap updates to React 16 the project will be easy to bump to Next.js 4, but if Reactstrap doesn't then we may refactor to remove it (but will keep Boostrap 4) just so we can stay current with the latest release of Next.js.


rootless podman + ignore_chown_errors = setgroups() fails causing cli to fail

Related: https://github.com/NVIDIA/nvidia-container-runtime/issues/85
My libnvidia-container version is 1.2.0.
I am using rootless podman on RHEL (CentOS) 7.8, trying out the new-ish ignore_chown_errors option. This mode maps all users inside the container to my own user id, avoiding the nuisances of UID maps (newuidmap, /etc/subuid, etc.)
I followed all of the recommendations at the "related" link above; specifically, I edited config.toml to set no-cgroups to true and the debug path to something in my home directory.
But I get the following error:
$ podman  run -it --rm nvidia/cuda nvidia-smi
Error: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"process_linux.go:432: running prestart hook 0 caused \\\"error running hook: exit status 1, stdout: , stderr: nvidia-container-cli: initialization error: driver error: failed to process request\\\\n\\\"\"": OCI runtime error

Running under strace -f is informative:
$ grep 3747 strace.out
3742  clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7f00d8218a10) = 3747
3747  prctl(PR_SET_NAME, "nvc:[driver]" <unfinished ...>
...
3747  setgroups(1, [65534] <unfinished ...>
3747  <... setgroups resumed>)          = -1 EPERM (Operation not permitted)
3747  exit_group(1 <unfinished ...>
3747  <... exit_group resumed>)         = ?
3747  +++ exited with 1 +++
3742  --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=3747, si_uid=0, si_status=1, si_utime=0, si_stime=0} ---
3742  wait4(3747, [{WIFEXITED(s) && WEXITSTATUS(s) == 1}], WNOHANG, NULL) = 3747

Note that PID 3742 is the main nvidia-container-cli process and PID 3747 is the "driver" sub-process. The driver sub-process is trying to call setgroups(), which is failing with EPERM, causing the sub-process to exit and the main process to exit with an error.
The only call to setgroups() in the source code is here:
https://github.com/NVIDIA/libnvidia-container/blob/e6e1c4860d9694608217737c31fc844ef8b9dfd7/src/utils.c#L918
...which is in perm_drop_privileges().
So I commented out the body of perm_drop_privileges(), replaced it with "return 0", recompiled, and installed the hacked libnvidia-container.so.1. And now it works!
$ podman run --rm nvidia/cuda nvidia-smi
Wed Aug 26 22:11:35 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 450.51.06    Driver Version: 450.51.06    CUDA Version: 11.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Tesla V100S-PCI...  Off  | 00000000:5E:00.0 Off |                    0 |
| N/A   38C    P0    38W / 250W |      0MiB / 32510MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   1  Tesla V100S-PCI...  Off  | 00000000:D8:00.0 Off |                    0 |
| N/A   39C    P0    36W / 250W |      0MiB / 32510MiB |      6%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Obviously this is not the right fix, and I do not know enough to say what the right fix is. But when I am running rootless podman with all container UIDs mapped to myself, I actually want the container's processes to retain all of my privileges on the host. Perhaps an option in config.toml to skip perm_drop_privileges (?)

Thanks for taking the time to thoroughly debug the issue.
I will need to think about the proper fix for this, but your description makes it clear what the issue is at least.

@klueska Any thoughts on this? I can take a crack at a fix if you can describe what the proper fix is...

Sorry for the delayed response. And thanks for the detailed description / debugging of the issue.
I'll need to dig into this a bit to see what the right fix is. In the meantime, are you OK running on your hacked version, or do you need something more stable / official?

I wound up using Singularity instead, since it already solves all of the problems I was trying to solve with rootless Podman.
Thanks!

For future reference, it looks like a workaround for podman is described here:
https://github.com/containers/podman/issues/3659

Yeah, I saw that. But this problem is specific to rootless podman with the "ignore_chown_errors" option enabled (which maps everything to UID 0 inside the container).

Got it. Thanks for clarifying.


Room - Invited user don't receive invite email

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 9.0.12-0
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: N/A
Email or phone of affected tester (no customers):
Issue reported by: Applause - Internal Team
Action Performed:
Precondition: use private domain account to reproduce

Create a new room
Invite a new user to the room through the room member list

Expected Result:
The invited user should receive an email shortly after for the invitation
Actual Result:
The invited user don't receive an email after invitation
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/user-attachments/assets/f8738e14-630d-49c5-81f7-1d97bffec6be
View all open jobs on GitHub

@twisterdotcom  FYI I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

We think that this bug might be related to #vip-vsp

I'm closing this because #vip-vsb is on pause and we're closing any issue that isn't external, as explained here


Get vocabulary from data

Instead of specifying the vocabulary size and creating an Embedder from that, do a pass over the training data and build and embedder that has precisely all the words in that vocabulary.
Actually, the interesting experimental question is: does this help, or is it just insignificant fine tuning?

Issue moved to wpm/nlp-experiments #2 via ZenHub


fix(README): fix links to examples in Custom Query section

Thanks for the fix!

:tada: This PR is included in version 1.44.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Error in the example

I'm getting this error when trying to run the example.
Traceback (most recent call last):
  File "example.py", line 1, in <module>
    from SnapWrap import Snapchat
  File "SnapWrap/SnapWrap/__init__.py", line 2, in <module>
    from snapchat import Snapchat
  File "SnapWrap/SnapWrap/snapchat.py", line 2, in <module>
    from SnapWrap import Client, Snap
ImportError: cannot import name Client

(I'm running python 2.7.6)

This is a simple fix, sorry for the trouble. You could try cloning the library and try and solve it yourself. I'll investigate when I get home from school.

Thanks, no worries. I'm very new at Python so I have no idea how to do that sorry :-/

On Mar 11, 2015, at 04:22, Robert<EMAIL_ADDRESS>wrote:
This is a simple fix, sorry for the trouble. You could try cloning the library and try and solve it yourself. I'll investigate when I get home from school.
—
Reply to this email directly or view it on GitHub.

It should work - try downloading the repo as a .zip file and then running python setup.py install. If you're still having trouble then post a comment, if it's fixed also either tell me so I can close the issue or close it yourself.
May I ask why you're using Python 2.7.6? I haven't tested it on this version, the lowest I've tested is 2.7.9.

I presume you've sorted everything out.

2.7.6 is the one that came with my Mac. I downloaded the zip and now it's working, thanks a lot and sorry for not responding earlier!


NPM releases improvements

Currently NPM version contains everything from this repository as is, however examples, tests and utility scripts are not necessary in production (this would greatly decrease download size). Also there is no production builds in NPM version.
So this is an issue with 2 parts:

[ ] add production builds to NPM release
[ ] remove everything except production files from NPM release

If you think both features are something you'd like to see I think I can tackle them both and send you a PR. Thoughts?

@nazar-pc This is something I've noticed too over the past few days of use. This is definitely an interesting path, and anything to improve the NPM release to at least parity with that of the bower release would be great.

@nazar-pc If you check out #512 We're moving towards npm only. It'll be ready soon!

Better late than never, good to know there is some development in this repository.
Feel free to close this issue if it is obsolete now.


Add requirements for Cordova mobile applications

In mobile applications that uses Cordova, the authentication will need the inAppBrowser plugin in order to retrieve the code. Well, this is a note as requirement for setting up to use with Satellizer.

:+1:


Device tracker (Luci) showing devices on WAN

Home Assistant release (hass --version): 0.20.2
Python release (python3 --version): 3.4.2
Component/platform: device_tracker.luci
Description of problem:
OpenWRT arp table learns about devices on the WAN side. So when device_tracker.luci or ubus go ahead and grabs its ARP table, it also shows the devices "outside" the LAN.
root@firewall:~# arp
IP address       HW type     Flags       HW address            Mask     Device
68.198.x.x       0x1         0x0         00:00:00:00:00:00     *        eth0
<IP_ADDRESS>    0x1         0x2         24:77:XX:XX:XX:84     *        br-lan
68.198.x.x       0x1         0x0         04:a1:XX:XX:XX:58     *        eth0
<IP_ADDRESS>    0x1         0x2         d0:53:XX:XX:XX:18     *        br-lan
<IP_ADDRESS>    0x1         0x0         c8:3f:XX:XX:XX:14     *        eth0
68.198.x.x       0x1         0x0         f8:e9:XX:XX:XX:a0     *        eth0
<IP_ADDRESS>    0x1         0x2         6c:ec:XX:XX:XX:5a     *        br-lan
68.198.x.x       0x1         0x0         00:00:00:00:00:00     *        eth0
<IP_ADDRESS>    0x1         0x2         00:0c:XX:XX:XX:07     *        br-lan
...

Expected:
Only LAN devices (br-lan).
Problem-relevant configuration.yaml entries and steps to reproduce:
device_tracker:
  - platform: luci
    host: <snip>
    username: root
    password: <snip>
    track_new_devices: yes

I also noticed that setting track_new_devices to no doesn't work. It will track new WAN devices from OpenWRT.

Is this still broken?


🚀 The feature, motivation and pitch
Is Qwen2-VL supported for running on AWS Inf2?
Alternatives
No response
Additional context
No response
Before submitting a new issue...

[X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

vLLM does support Qwen2-VL. As for specific machines, it depends on their hardware (e.g. whether they have enough memory to load the model).


Test fail on the latest version

Running the citgm on gulp in node 22 fail

verbose: gulp npm-test:      |
verbose: gulp npm-test:      | 41 passing (9s)
verbose:                     | 1 failing
verbose: gulp npm-test:      | 1) gulp
verbose:                     | can run against gulpfile.mjs:
verbose:                     | Uncaught Error: expect(received).toEqual(expected) // deep equality
verbose:                     |
verbose:                     | Expected: ""
verbose:                     | Received: "(node:2245619) Warning: To load an ES module, set \"type\": \"module\" in the package.json or use the .mjs extension.
verbose:                     | (Use `node --trace-warnings ...` to show where the warning was created)
verbose:                     | "
verbose:                     | at /home/iojs/tmp/citgm_tmp/4e153d52-d0e6-4ff1-8743-1304b717ff4a/gulp/test/index.test.js:90:22
verbose:                     | at ChildProcess.exithandler (node:child_process:413:7)
verbose:                     | at FastEventEmitter.emit (node:internal/events/fast_event_emitter:47:26)
verbose:                     | at ChildProcess.emit (node:internal/events/event_emitter:448:41)
verbose:                     | at ChildProcess.emit (node:domain:488:12)
verbose:                     | at maybeClose (node:internal/child_process:1105:16)
verbose:                     | at ChildProcess._handle.onexit (node:internal/child_process:305:5)

@yocontra can you please take a look

What version of node was this run on specifically?

Gulp tests are mostly smoke tests. Node has removed the vinyl-fs test suite from citgm (and probably other of our projects) and broke it completely with node 22.

master version of node, can probably reproduce with node 22


poet init does not work

Installed latest from pip just now.
pascal@MBP:~/egoroot/newnew $ poet init

  Welcome to the Poet config generator

This command will guide you through creating your poetry.toml config.

  [FileNotFoundError]
  [Errno 2] No such file or directory: '/Users/pascal/newnew/poetry.toml'

init [-i|--index INDEX] [--name NAME] [--description DESCRIPTION] [--author AUTHOR] [--dependency DEPENDENCY] [--dev-dependency DEV-DEPENDENCY] [-l|--license LICENSE]

Thanks for reporting this. I will look into it.

python 3.5.0 in case you're wondering.
As an aside, I was expecting this to work:
import poet
poet.__version__

but that just might be a personal preference.

Can you launch the command with the -v option to get the full stack trace?

pascal@MBP:~/egoroot/newnew $ poet init -v

  Welcome to the Poet config generator

This command will guide you through creating your poetry.toml config.

  [FileNotFoundError]
  [Errno 2] No such file or directory: '/Users/pascal/newnew/poetry.toml'

Exception trace:
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cleo/application.py in run() at line 96
   status_code = self.do_run(input_, output_)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cleo/application.py in do_run() at line 188
   status_code = command.run(input_, output_)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cleo/commands/command.py in run() at line 90
   return super(Command, self).run(i, o)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cleo/commands/base_command.py in run() at line 144
   status_code = self.execute(input_, output_)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/poet/console/commands/command.py in execute() at line 74
   return super(Command, self).execute(i, o)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/cleo/commands/command.py in execute() at line 99
   return self.handle()
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/poet/console/commands/init.py in handle() at line 59
   git_config = self.git_config()
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/poet/console/commands/init.py in git_config() at line 317
   return self.poet.git_config
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/poet/console/commands/command.py in poet() at line 35
   self._poet = Poet(self.poet_file)
 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/poet/poet.py in __init__() at line 51
   with open(self._path) as f:

init [-i|--index INDEX] [--name NAME] [--description DESCRIPTION] [--author AUTHOR] [--dependency DEPENDENCY] [--dev-dependency DEV-DEPENDENCY] [-l|--license LICENSE]

I just released the 0.3.2 version which fixes the init command.

Thanks, that solved it.


Can u please fix this problem in coding of pulse sensorr

When i am running the code iam getting  no output in processing visualizer it showing a single wave continusely going but giving pulse 0 and bpm 0
And i tried serial plotter too by changing the output type in main but it showing the waves going on even i removed my finger
Plz  anyone help me..

Thank you for the reply.I am using arduino uno.and the interrupt code is not working

Thank you for the reply.I am using arduino uno.and the interrupt code is not working

Thank you for the reply.I am using arduino uno.and the interrup

I am getting output what i initialized in the code

This is the output I am getting in the serial plotter continuously even without my finger in the sensor i guess codes are correct. Do i have to change anything in the IDE to enable interrupt programming. I checked the interrupt code too for the timer2. Plz help me

I think i have a problem with interrupt code.
The codes inside the interrupt setup() is not getting compiled and running. But it showing no errors when compiling.

Thank you for the prompt reply. I tried the code in this website. But not
working for me. Do I have to update  any thing in the arduino ide ?.i am
using arduino  uno.bellow I have attached the plotter visuals.It
continuously giving same without my fimgers in sensor
Thanks inadvance
On 01-Mar-2017 9:09 PM, "Joel Murphy"<EMAIL_ADDRESS>wrote:

Please give me more information.
What Arduino board are you using?
Verify that you have uploaded the code to your board.
Can you share a screen shot of what the Visualizer or Plotter look like?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/WorldFamousElectronics/PulseSensor_Amped_Arduino/issues/43#issuecomment-283375271,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AS_HKoSCVSbkzhY03SEs6TO_8mBXgdaQks5rhZFDgaJpZM4MPoVa
.

Hi,
I am pretty sure that the interrupt code is being compiled. If it was not, you would get an error.
Please do a couple of things:
First, verify that you are connecting the Pulse Sensor purple wire to the A0 pin on the arduino Uno.
Also, please send a picture of the Pulse Sensor when it is plugged in.

Thank you for the reply
Here is my attachment of sensor
Thank you so much for your great help.
On 03-Mar-2017 10:02 PM, "Joel Murphy"<EMAIL_ADDRESS>wrote:

Hi,
I am pretty sure that the interrupt code is being compiled. If it was not,
you would get an error.
Please do a couple of things:
First, verify that you are connecting the Pulse Sensor purple wire to the
A0 pin on the arduino Uno.
Also, please send a picture of the Pulse Sensor when it is plugged in.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/WorldFamousElectronics/PulseSensor_Amped_Arduino/issues/43#issuecomment-284001748,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AS_HKkQVWOCPzsaKBVDbo-zM836ZXXmEks5riECRgaJpZM4MPoVa
.

Thank you so much .... I got the output.
There was a problem with my sensor only. When i tried with another one i got the result .
Once again thank you for your great and timely help

I never saw the picture that you send of the Pulse Sensor.
You say that there was a problem with it? I would like to figure out what the problem was.

Thank you so much. I connected wrongly and also there was a problem  with
my sensor. I found out what the problem was. I got the output.
On 04-Mar-2017 8:04 PM, "Joel Murphy"<EMAIL_ADDRESS>wrote:

I never saw the picture that you send of the Pulse Sensor.
You say that there was a problem with it? I would like to figure out what
the problem was.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/WorldFamousElectronics/PulseSensor_Amped_Arduino/issues/43#issuecomment-284155085,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AS_HKqetveoMRN2gxKiu7xO_FXiIoadhks5riXaNgaJpZM4MPoVa
.

Great!


Push to hub/commit with branches

Completes the revision-based API by adding branches management to push_to_hub and the commit context manager.
Examples of usage:
Using revision from Repository.__init__
project_name = 'org/project'

# Checkout revision
hf_repo = Repository(project_name, clone_from=project_name, revision='test-1')

model = GPT2LMHeadModel.from_pretrained(project_name)
model.save_pretrained(project_name)

hf_repo.push_to_hub(commit_message=f'step {step}')

Using git_checkout from Repository
project_name = 'org/project'

# Checkout revision
hf_repo = Repository(project_name, clone_from=project_name)
hf_repo.git_checkout("branch")

model = GPT2LMHeadModel.from_pretrained(project_name)
model.save_pretrained(project_name)

hf_repo.push_to_hub(commit_message=f'step {step}')

Note that the push_to_hub method interacts in a complex manner:

The branch must first be checked out
The files are saved
Push to hub should be called

Using the Repository.commit context manager
Therefore, I would instead recommend using the Repository.commit context manager as I find it has a better API, as can be seen below. I think the two could eventually be merged into a single with Repository.push_to_hub. See details of the API with usage below:
repo = Repository("local_directory", clone_from="Jikiwa/with-commit-1")

with repo.commit("Add files"):
    with open("file.txt", "w+") as f:
        f.write("Nice")

with repo.commit("Add files to brand-new-branch", branch="brand-new-branch"):
    with open("brand-new-file.txt", "w+") as f:
        f.write("Nice Nice")

repo.git_checkout("nice-branch", create_branch_ok=True)

# Will use lastly checked-out branch
with repo.commit("Add files in nice-branch"):
    with open("file.txt", "w+") as f:
        f.write("Nice")

A caveat with git_checkout is that it may result in a fatal error if some files are added/modified as the changes would be overridden by the checkout.

LGTM, thanks for improving the API!

LGTM, thank you for adding this!


Performance issues with new blocks

Performance issues
Description
There seems to be some significant performance issues that cause nodes to fall behind. This started with the 1.1.3 release, and is present in 1.1.3, 1.1.4 and builds from the current dev or hardfork/pos branches.
With blocks being created approximately every 2 seconds, a performant node should be receiving and writing a new block every 2 seconds. Instead, nodes running 1.1.3 or later frequently get stuck, and can go multiple minutes without writing out any blocks.

Your environment

Ubuntu
1.1.2, 1.1.3, 1.1.4, dev, hardfork/pos

Steps to reproduce

Run dogechain on a standard cloud instance, with resources greater than those recommend in the docs.
Wait for the node to sync
Watch the logs and notice that there are frequent large gaps where no blocks are written

Expected behaviour
New blocks are written out approximately every seconds.
Actual behaviour
Block writing regularly gets stuck, with large gaps where no new blocks are written. Some nodes never catch up.
Proposed solution
Many node operators have reverted to using the 1.1.2 release. The Detroit PoS hardfork should NOT be activated until this issue is resolved.

Thanks for the head up.
We did notice the bug due to adding leveldb compression.
The feat-leveldb-tuning branch is working on bug fixes, and we're seeing a lot of progress with it, including memory, CPU, and I/O.
The latter version v1.2.0 would be released in a week, so we won't release another patch version right now.
You can test sync in the  feat-leveldb-tuning branch (set detroit hard fork to a very large block height).
Any suggestions would be helpful.

The problem is serious. It needs to be resolved quickly...

Looks like from today this issue is actually causing block production issues for periods of 15-30 mins and it is becoming clearer that it is caused by the individual transactions which use tens of millions of gas and consume most of the block.
If your timeline on the fix still holds, I would suggest to seek some hotfix that will bring the stability of the chain.

Thanks for your advices.
We do facing a real hard time in the past few days, since the XEN project send transactions that consume most of the block.
A hotfix is done, and will be merged to repo ASAP.

The block catching up issues are caused by several reasons:

Large gas consuming transactions who executed very slow especially in slow I/O speed hard drive.
P2P network connecting with non-dogechain peer, which brings a high package loss rate.
Syncing peer are a bit of slower than it estimates.

wouldn't it be possible and (a good idea) to simply reduce the block gas limit until this is all resolved? This should reduce the workload of the validators and all others in the network. You can then take your time and make sure you get the right fixes out on your own schedule.

wouldn't it be possible and (a good idea) to simply reduce the block gas limit until this is all resolved? This should reduce the workload of the validators and all others in the network. You can then take your time and make sure you get the right fixes out on your own schedule.

Gas limit would be an macro-control means, which might break normal dAPP transactions.
Some contract creation consumes a lot of gas, and that should be reasonable.

totally your call. But having some things not working rather than none of the things working sounds like a win to me. Again it would just be a band-aid. to buy you some time.

I agree with you on the last point.
As you could imagine, you can't distinguish "bad guys" from "good guys" by simple rules. But time consuming transactions are really annoying for most of the normal users.
For now, the I/O consuming transactions are tolerate but somewhat "rate limited" by validators.
And the PR #238  is merged and deployed.
Any suggestions are helpful.

@TovarishFin @0x3Cycle
Thanks for all the amazing advices.
We now try to treat those "DDOS" transactions with a new policy: #254
Any suggestions are welcome.

still not fix?
i was still stuck when i synced to 410w block, after that the syncing speed was super slow, the cpu and mermory usage soared all of a sudden
and i checked the block which was xen block,  is it possible to keep up with the latest syncing speed after synchronizing all the xen blocks during this period?

Sorry about that, but not yet.
We had provided v1.2.0, the new PoS hard fork detroit, and a new snapshot of about 4.3 million blocks.
The upcoming new version v1.2.1 improves the sync speed.
The planned v1.2.2 will focus on database, cache issues.
In fact, Ethereum encountered the same problem around the end of 2019. So we'll try to implement a relevant solution.


[WIP][SPARK-39168] Use all values in a python list when inferring ArrayType schema

What changes were proposed in this pull request?
This PR modifies type inference for python lists to consider all values in the list, not just the first value.
Why are the changes needed?
This enables convenient type inference in the two following cases:

previous
current

[None, 1]
array<void> (raises ValueError)
array<bigint>

[{"b": 1}, {"c": 2}]
array<struct<b:bigint>>
array<struct<b:bigint,c:bigint>>

Does this PR introduce any user-facing change?
Possible user-facing changes:

attempting to infer the schema of an array with mixed types (e.g. ["a", 1]) may result in a TypeError

previously, this was inferred as an array<string> and produced a value ["a", "1"]

fields of inferred struct types will differ if dictionaries in an array have different keys

How was this patch tested?
Added unit tests for various cases.

[ Add a unit test for ["a", 1] producing a TypeError ]
[ Consider making this behavior configurable ]

[ ] Add a unit test for ["a", 1] producing a TypeError
[ ] Consider making this behavior configurable

Nice PR description. Yeah, we should probably add a configuration then, please also refer to https://github.com/apache/spark/commit/2537fe8cbaf49070137d4b5bc39af078b306c4c8 for adding a SQL config

We should probably add a configuration like spark.sql.pyspark.legacy.inferFirstElementInArray.enabled (feel free to pick other names if you have other ideas).

Can one of the admins verify this patch?

We should probably add a configuration like spark.sql.pyspark.legacy.inferFirstElementInArray.enabled (feel free to pick other names if you have other ideas). Would also have to create a new page like https://github.com/apache/spark/blob/master/python/docs/source/migration_guide/pyspark_3.2_to_3.3.rst and describe this behavior change.

Added this configuration (slightly changed the name) and created a new migration guide page.

cc @BryanCutler @viirya @ueshin FYI

Thanks for working on this @physinet, and congrats for being a Apache Spark contributor :-).


APT whitelist request for rc

The "setuid" strings found by travisbot are located in a C comments and in the man page.
Thus they should not count as security flaws... :-)

Any news here?


create a conda environment error[BUG]

Description
(base) ➜  Recommenders git:(main) conda env create -f reco_base.yaml
Collecting package metadata (repodata.json): failed
Traceback (most recent call last):
    raise Response304ContentUnchanged()
conda.core.subdir_data.Response304ContentUnchanged

During handling of the above exception, another exception occurred:

An unexpected error has occurred. Conda has prepared the above report.
If submitted, this report will be used by core maintainers to improve
future releases of conda.
Would you like conda to send this report to the core maintainers?
Upload successful.
Thank you for helping to improve conda.
Opt-in to always sending reports (and not see this message again)
by running
$ conda config --set report_errors true

This looks like a problem with conda specifically, please see related issue here for possible remedies or further support: https://github.com/conda/conda/issues/8051

This looks like a problem with conda specifically, please see related issue here for possible remedies or further support: conda/conda#8051

thanks


Pbs to install on Debian 12

1) pre-recquis
On Debian 12 "libreadline-gplv2-dev" doesn't exist. I have install "libreadline-dev"
2) bundle install --frozen
Said "deprecated". I must do this before
bundle config set --local frozen 'true'
and
bundle config set --local path 'vendor/bundle'
and just:
bundle install
3) bin/ots init crash!
I have this:
bin/ots init
/home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/storable-0.8.9/lib/proc_source.rb:41:in `<top (required)>': uninitialized constant RubyToken (NameError)

class RubyToken::Token
      ^^^^^^^^^
Did you mean?  RubyLex
	from /home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/storable-0.8.9/lib/storable.rb:35:in `require'
	from /home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/storable-0.8.9/lib/storable.rb:35:in `<class:Storable>'
	from /home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/storable-0.8.9/lib/storable.rb:33:in `<top (required)>'
	from /home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/sysinfo-0.8.1/lib/sysinfo.rb:2:in `require'
	from /home/ots/onetimesecret/vendor/bundle/ruby/3.1.0/gems/sysinfo-0.8.1/lib/sysinfo.rb:2:in `<top (required)>'
	from /home/ots/onetimesecret/lib/onetime.rb:15:in `require'
	from /home/ots/onetimesecret/lib/onetime.rb:15:in `<top (required)>'
	from <internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb>:85:in `require'
	from <internal:/usr/lib/ruby/vendor_ruby/rubygems/core_ext/kernel_require.rb>:85:in `require'
	from bin/ots:9:in `<main>'

After research on Web I found https://github.com/onetimesecret/onetimesecret/pull/279 but no real answers…
My configuration:
Debian 12
ruby --version
ruby 3.1.2p20 (2022-04-12 revision 4491bb740a) [x86_64-linux-gnu]

Thanks for any help

Got the same Issue here and tried to downgrade to Ruby 2.5 or Ruby 2.6 to use the deprecated RubyToken. But now i'am have a hassle with the bundler version. However, a downgrade should not be an option. I hope this get fixed in any way.

Yeah Ruby 3 support has been a long time coming. I have a couple branches with some progress. What slows in down is updating individual dependencies to support it as well. Here’s one which I hope to get back to sooner than later:
https://github.com/onetimesecret/onetimesecret/pull/288/files

Quick update. We made our last release on the current codebase (0.12.0) and have switched develop over to work on Ruby 3 support.

This issue should be resolved on develop branch now. I'll leave this open though in case not.

Here's the link to the latest recent for Ruby 3: https://github.com/onetimesecret/onetimesecret/releases/tag/v0.13.0-RC6
I'll close this ticket but feel free to re-open if it's still giving you probs.


fix: Refactor dynamic bindings in widgets during building block paste.

Description

This pull request refactors the function handleButtonDynamicTriggerPathList to handleWidgetDynamicTriggerPathList in order to make it more generic and handle dynamic trigger paths for all types of widgets.
Additionally, the pull request moves the function handleIfParentIsListWidgetWhilePasting out of handleSpecificCasesWhilePasting to handle compound cases where the parent of the current widget needs to be checked.
Improves the nested object value replacement logic in PasteWidgetUtils.

Fixes #Issue Number
or
Fixes Issue URL

[!WARNING]
If no issue exists, please create an issue first, and check with the maintainers if the issue is valid.

Automation
/ok-to-test<EMAIL_ADDRESS>@tag.Widget, @tag.Sanity"
:mag: Cypress test results

[!CAUTION]
🔴 🔴 🔴 Some tests have failed.
Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/9639410033
Commit: bbb01932a50cec8576627cbcdc220fda8a412d53
Cypress dashboard.
Tags: @tag.Templates, @tag.Widget, @tag.Sanity
The following are new failures, please fix them before merging the PR:
cypress/e2e/Regression/ClientSide/Widgets/RTE/RichTextEditor3_spec.ts
cypress/e2e/Regression/ClientSide/Widgets/RTE/RichTextEditor_1_spec.js
cypress/e2e/Regression/ClientSide/Widgets/RTE/RichTextEditor_2_spec.js
List of identified flaky tests.

Communication
Should the DevRel and Marketing teams inform users about this change?

[ ] Yes
[ ] No

Summary by CodeRabbit

Refactor

Simplified handling of pasting widgets by consolidating functions.
Improved logic for handling widget pasting scenarios.
Reorganized function names for better clarity and consistency.

Bug Fixes

Enhanced the handling of widgets when their parent is a list widget during pasting.

Tests

Updated test cases to reflect changes in widget pasting logic and function names.

/build-deploy-preview skip-tests=true

@coderabbitai review

@rahulbarwal I'm lacking enough context to review this PR. I'm not sure what handleButtonDynamicTriggerPathList does.
In any case, this PR seems to be a refactor for generalisation of this function and doesn't effect the overall system design of the feature.
Such being the case, I'm removing myself as a review from this PR. Please feel free to add me again, if my review is needed.


User hint about missing certificates

Currently, if you intended a service to be available for some name, but you forgot to put a cert for it into the store, the client will just get an inscrutable TLS failure, and nothing much useful will happen on the server end.
Is there something better we can do to clue the server admin in that they might be missing a cert?

I think this needs to be fixed in txsni since SNIMap would be the place to emit this warning. Filed glyph/txsni#11 to cover that.


Build errors in .net 5 after migration to 3.0.14

Describe the bug
In my solution I've a netstandard2.1 class library that references MQTTnet and then a couple of net5 test projects that reference that class library.
As soon as I upgrade MQTTnet from v3.0.13 to v3.0.14 I start getting some weird build errors like the following one:
MqttProducerEndpointBuilderTests.cs(20, 59): [CS0012] The type 'MqttClientOptions' is defined in an assembly that is not referenced. You must add a reference to assembly 'MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b69712f52770c0a7'.

Directly referencing the MQTTnet nuget package in the test projects doesn't help.
No problem with v3.0.13 and v3.0.14 also seems to work if the test projects are targeting netcore3.1 instead of net5.
Which project is your bug related to?

Client

Code example
See the broken branch https://github.com/BEagle1984/silverback/tree/feature/update-mqttnet-net5 (MQTTnet 3.0.14 with net5 test projects).
Here is a working branch with MQTTnet 3.0.14 and netcore3.1: https://github.com/BEagle1984/silverback/tree/feature/update-mqttnet-netcore31
And here is a working branch with MQTTnet 3.0.13 and net5: https://github.com/BEagle1984/silverback/tree/feature/net5

Can confirm that with netstandard2.0 and net5.0 interop.
Workaround: moving both back to 3.13.
Analysis:
There seems so be a inconsistency with the resolved/referenced assembly between netstandard and net5.
net5 resolves to PublicKeyToken=null
netstandard resolves to PublicKeyToken=b69712f52770c0a7
Both Project use 'MqttApplicationMessageReceivedEventArgs'.
At interop between both projects i get the error.
CS0012	The type 'MqttApplicationMessageReceivedEventArgs' is defined in an assembly that is not referenced. You must add a reference to assembly 'MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b69712f52770c0a7'.
Net5.0 resolves to assembly with: PublicKeyToken=null
#region Assembly MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null
// C:\Users\jjaehrig\.nuget\packages\mqttnet\3.0.14\lib\net5.0\MQTTnet.dll
// Decompiled with ICSharpCode.Decompiler <IP_ADDRESS>02
#endregion

Netstandard2.0 lib resolves to assembly with: PublicKeyToken=b69712f52770c0a7
#region Assembly MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b69712f52770c0a7
// C:\Users\jjaehrig\.nuget\packages\mqttnet\3.0.14\lib\netstandard2.0\MQTTnet.dll
// Decompiled with ICSharpCode.Decompiler <IP_ADDRESS>02
#endregion

csproj contains just a plain
    <PackageReference Include="MQTTnet" Version="3.0.14" />

Moving back to 3.0.13
Both (netstandrad2.0 and net5.0) use PublicKeyToken=b69712f52770c0a7
net5
#region Assembly MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b69712f52770c0a7
// C:\Users\jjaehrig\.nuget\packages\mqttnet\3.0.13\lib\netcoreapp3.1\MQTTnet.dll
// Decompiled with ICSharpCode.Decompiler <IP_ADDRESS>02
#endregion

netstandard2
#region Assembly MQTTnet, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b69712f52770c0a7
// C:\Users\jjaehrig\.nuget\packages\mqttnet\3.0.13\lib\netstandard2.0\MQTTnet.dll
// Decompiled with ICSharpCode.Decompiler <IP_ADDRESS>02
#endregion

This is most probably related to https://github.com/chkr1011/MQTTnet/issues/1080.
From @chkr1011: https://github.com/chkr1011/MQTTnet/issues/1080#issuecomment-774471154

It turns out that the build script was not properly updated for .net 5.0. I changed this. Please test RC1 of 3.0.15. @JanEggers Please let me know if the settings are fine for the ASP.NET parts.

I can confirm that. It also seems that there is no RC1 of 3.0.15 out yet from the library.

Please try with RC1 of 3.0.15. It is out now.

It seems to work correctly with the 3.0.15-rc1. Well done.

Closing because the issue is fixed.


[Feat]: Make methods async

Version
1.4.0
Environment that reproduces the issue
You are using openapi-geneartor to generate this project
https://github.com/OpenAPITools/openapi-generator
For the c# version, there is a parameter named operationIsAsync & operationResultTask
https://openapi-generator.tech/docs/generators/aspnetcore/
It's a good practise to use async Task for scalability prupose
https://medium.com/@frederikbanke/improving-scalability-in-c-using-async-and-await-f97af1466922
But maybe it's not possible by the tool you are using ?
https://github.com/OpenAPITools/openapi-generator/blob/master/modules/openapi-generator/src/main/java/org/openapitools/codegen/languages/CSharpFunctionsServerCodegen.java#L611
It's looking like async is forced to false if target is a lib :/ don't know why....
Please, can you try this approche and generate a new nuget package ?
Thanks
Use case description
Look at reproduce
Proposed solution
Look at reproduce
Alternative solutions
Look at reproduce

Hi @ChoOo7 ,
Thanks for your feedback. We'll try to implement this as soon as possible (probably next week).
Regards

Hi @ChoOo7 ,
We've just released v1.5.0 with the addition of *Async() methods.
You can now write things like that:
var cancellationToken = new System.Threading.CancellationToken(); // cancellationToken is optionnal
var task = apiVideoClient.Videos().createAsync(new VideoCreationPayload { title = "My video" }, cancellationToken).ContinueWith(task =>
{
    if (task.IsFaulted)
    {
        Console.WriteLine("An error occured: " + task.Exception.Message);
    }
    else
    {
        var video = task.Result;
        Console.WriteLine("Video successfully created: " + video);
    }
});

or:
var video = await apiVideoClient.Videos().createAsync(new VideoCreationPayload { title = "My video" });

Please let us know if this meets your needs. If so, I will close this issue.
Regards

Thanks, i'll test it and give you a feedback

I see async methods, but some are not valid, the live delete one for example should return a Task, not void

If you generate a new nuget package, can you implement the new live complete method please ?
"Pour ce faire vous devez appeler PUT /live-streams/{liveStreamId}/complete sans body. Cela répondra un 202 et le live s'arrêtera peu de temps après"

Hi @ChoOo7 ,
We'll release a new version early next week, which will include the livestreams.complete method, as well as a fix for the bug you point out here.

Hi @ChoOo7
We've released v1.6.0 with the following changes:

Add new analytics methods
Add livestream complete() method

Regards