SentenceTransformersTokenTextSplitter Doesn't Preserve Text

System Info
from langchain.text_splitter import SentenceTransformersTokenTextSplitter
splitter = SentenceTransformersTokenTextSplitter(
    tokens_per_chunk=64,
    chunk_overlap=0,
    model_name='intfloat/e5-base-v2',
    add_start_index=True,
)
text = "- afrikaans\n- العربية\n- azərbaycanca\n- বাংলা\n- беларуская\n- bosanski\n- čeština\n- deutsch\n- eesti\n- ελληνικά\n- español\n- فارسی\n- français\n- gaeilge\n- 한국어\n- հայերեն\n- bahasa indonesia\n- עברית\n- jawa\n- kurdî\n- latviešu\n- lietuvių\n- македонски\n- malti\n- मराठी\n- مصرى\n- bahasa melayu\n- nederlands\n- 日本語\n- oʻzbekcha / ўзбекча\n- ਪੰਜਾਬੀ\n- پنجابی\n- پښتو\n- português\n- română\n- русский\n- simple english\n- کوردی\n- suomi\n- తెలుగు\n- ไทย\n- türkçe\n- українська\n- اردو\n- tiếng việt\n- 粵語\n- 中文\nedit links\ncoordinates: 41°43′32″n 49°56′49″w / 41.72556°n 49.94694°w / 41.72556; -49.94694\nfrom wikipedia, the free encyclopedia\n2023 submersible implosion in the atlantic\n|date||18 june 2023|\n|location||north atlantic ocean, near the wreck of the titanic|\n|coordinates||41°43′32″n 49°56′49″w / 41.72556°n 49.94694°w / 41.72556; -49.94694|\n|type||maritime disaster|\n|cause||failure of the pressure hull|\n|participants||5 passengers|\n|outcome||submersible destroyed by implosion|\n|deaths||5 (see fatalities)|\non 18 june 2023, titan, a submersible operated by american tourism and expeditions company oceangate, imploded during an expedition to view the wreck of the titanic in the north atlantic ocean off the coast of newfoundland, canada.on board titan, a submersible operated by american tourism and expeditions company oceangate, were stockton rush, the ceo of american tourism and expeditions company oceangate; paul-henri nargeolet, a french deep sea explorer and the titanic| expert; hamish harding, a british billionaire businessman; shahzada dawood, a pakistani-british billionaire businessman; and dawood's son suleman.communication with titan, a submersible operated by american tourism and expeditions company oceangate, was lost 1 hour and 45 minutes into imploded submersible operated by american tourism and expeditions company oceangate, dive.authorities were alerted when titan, a submersible operated by american tourism and expeditions company oceangate, failed to resurface at the scheduled time later that day.after titan, a submersible operated by american tourism and expeditions company oceangate, had been missing for four days, a remotely operated underwater vehicle (rov) discovered a debris field containing parts of titan, a submersible operated by american tourism and expeditions company oceangate,, about 500 metres (1,600 ft) from the bow of the titanic|.the search area was informed by the united states navy's (usn)"

"".join(splitter.split_text(text)) == text
    False

Additional characters are added
len("".join(splitter.split_text(text)))
    2534
len(text)
    2426

Newlines are stripped
text[:50]
    '- afrikaans\n- العربية\n- azərbaycanca\n- বাংলা\n- бел'
splitter.split_text(text)[0][:50]
    '- afrikaans - العربية - azərbaycanca - বাংলা - бел'

Special tokens are added
text[193:293]
    'awa\n- kurdî\n- latviešu\n- lietuvių\n- македонски\n- malti\n- मराठी\n- مصرى\n- bahasa melayu\n- nederlands\n-'
"".join(splitter.split_text(text))[200:300]
    'awa - kurdi - latviesu - lietuviu - македонски -malti - [UNK] - مصرى - bahasa melayu - nederlands - '

Recommended improvement: call
tokenizer(text, return_offsets_mapping=True)
This will allow selection of N tokens and allow reconstruction without the need for and allow reconstruction without the use of tokenizer.decode (which is not perfectly invertible).
Who can help?
No response
Information

[ ] The official example notebooks/scripts
[X] My own modified scripts

Related Components

[ ] LLMs/Chat Models
[X] Embedding Models
[ ] Prompts / Prompt Templates / Prompt Selectors
[ ] Output Parsers
[X] Document Loaders
[ ] Vector Stores / Retrievers
[ ] Memory
[ ] Agents / Agent Executors
[ ] Tools / Toolkits
[ ] Chains
[ ] Callbacks/Tracing
[ ] Async

Reproduction
Please see my code above
Expected behavior
Please see my code above

Here is how I fixed it

Interesting implementation.
This is how I tried to approach it by natively using the APIs of SentenceTransformer.

Special tokens got removed (fixed)
Newline characters also removed (as is behaviour)
The decoder introduced noise (as is behaviour)

from typing import Callable, List, Optional, Any
from dataclasses import dataclass
from sentence_transformers import SentenceTransformer

@dataclass(frozen=True)
class Tokenizer:
    chunk_overlap: int
    tokens_per_chunk: int
    decode: Callable[[list[int]], str]
    encode: Callable[[str], List[int]]

def split_text_on_tokens(*, text: str, tokenizer: Tokenizer) -> List[str]:
    """Split incoming text and return chunks."""
    splits: List[str] = []
    input_ids = tokenizer.encode(text)
    start_idx = 0
    cur_idx = min(start_idx + tokenizer.tokens_per_chunk, len(input_ids))
    chunk_ids = input_ids[start_idx:cur_idx]
    while start_idx < len(input_ids):
        splits.append(tokenizer.decode(chunk_ids,skip_special_tokens=True))
        start_idx += tokenizer.tokens_per_chunk - tokenizer.chunk_overlap
        cur_idx = min(start_idx + tokenizer.tokens_per_chunk, len(input_ids))
        chunk_ids = input_ids[start_idx:cur_idx]
    return splits

class SentenceTransformersTokenTextSplitter:
    """Implementation of splitting text that looks at tokens."""

    def __init__(
        self,
        chunk_overlap: int = 50,
        model_name: str = "sentence-transformers/all-mpnet-base-v2",
        tokens_per_chunk: Optional[int] = None,
        **kwargs: Any,
    ) -> None:
        """Create a new TextSplitter."""
        self._chunk_overlap = chunk_overlap
        self.model_name = model_name
        self._model = SentenceTransformer(self.model_name)
        self.tokenizer = self._model.tokenizer
        self._initialize_chunk_configuration(tokens_per_chunk=tokens_per_chunk)

    def _initialize_chunk_configuration(
        self, *, tokens_per_chunk: Optional[int]
    ) -> None:
        self.maximum_tokens_per_chunk = self._model.max_seq_length

        if tokens_per_chunk is None:
            self.tokens_per_chunk = self.maximum_tokens_per_chunk
        else:
            self.tokens_per_chunk = tokens_per_chunk

        if self.tokens_per_chunk > self.maximum_tokens_per_chunk:
            raise ValueError(
                f"The token limit of the models '{self.model_name}'"
                f" is: {self.maximum_tokens_per_chunk}."
                f" Argument tokens_per_chunk={self.tokens_per_chunk}"
                f" > maximum token limit."
            )

    def split_text(self, text: str) -> List[str]:
        # def encode_without_stripping(text: str) -> List[int]:
        #     return self._encode(text)[1:-1]

        # def decode_tokens(token_ids: List[int]) -> str:
        #     return self.tokenizer.decode(token_ids, skip_special_tokens=True)

        tokenizer = Tokenizer(
            chunk_overlap=self._chunk_overlap,
            tokens_per_chunk=self.tokens_per_chunk,
            decode=self.tokenizer.decode,
            encode=self.tokenizer.encode,
        )

        return split_text_on_tokens(text=text, tokenizer=tokenizer)

    def count_tokens(self, *, text: str) -> int:
        return len(self._encode(text))

    _max_length_equal_32_bit_integer = 2**32

    def _encode(self, text: str) -> List[int]:
        token_ids_with_start_and_end_token_ids = self.tokenizer.encode(
            text,
            max_length=self._max_length_equal_32_bit_integer,
            truncation="do_not_truncate",
            stride=self._chunk_overlap,
        )
        return token_ids_with_start_and_end_token_ids

splitter = SentenceTransformersTokenTextSplitter(
    tokens_per_chunk=64,
    chunk_overlap=0,
    model_name='intfloat/e5-base-v2',
    add_start_index=True,
)

Output
- afrikaans - العربية - azərbaycanca - বাংলা - беларуская - bosanski - cestina - deutsch - eesti - ελληνικα - espanol - ف##ارسی - francais - gaeilge - 한국어 - հայերեն - bahasa indonesia - עברית - jawa - kurdi - latviesu - lietuviu - македонски- malti - - مصرى - bahasa melayu - nederlands - 日 本 語 - oʻzbekcha / узбекча - - پنجابی - - portugues - romana - русскии - simpleenglish - کوردی - suomi - - - turkce - украінська - اردو - tieng viet - 語 - 中 文 edit links coordinates : 41°43 ′ 32 ″ n 49°56 ′ 49 ″ w / 41. 72##556°n 49. 94694°w / 41. 72556 ; - 49. 94694 from wikipedia, the free encyclopedia 2023 submersible implosion in the atlantic | date | | 18 june 2023 | | location | | north atlantic ocean, near the wreck ofthe titanic | | coordinates | | 41°43 ′ 32 ″ n 49°56 ′ 49 ″ w / 41. 72556°n 49. 94694°w / 41. 72556 ; - 49. 94694 | | type | | maritime disaster | | cause | | failureof the pressure hull | | participants | | 5 passengers | | outcome | | submersible destroyed by implosion | | deaths | | 5 ( see fatalities ) | on 18 june 2023, titan, a submersible operated by american tourism and expeditions company oceangate, imploded during an expedition toview the wreck of the titanic in the north atlantic ocean off the coast of newfoundland, canada. on board titan, a submersible operated by american tourism and expeditions company oceangate, were stockton rush, the ceo of american tourism and expeditions company oceangate ; paul - henri nargeolet, a french deep seaexplorer and the titanic | expert ; hamish harding, a british billionaire businessman ; shahzada dawood, a pakistani - british billionaire businessman ; and dawood's son suleman. communication with titan, a submersible operated by american tourism and expeditions company oceangate, was lost 1 hour and 45 minutes into imp##loded submersible operated by american tourism and expeditions company oceangate, dive. authorities were alerted when titan, a submersible operated by american tourism and expeditions company oceangate, failed to resurface at the scheduled time later that day. after titan, a submersible operated by american tourism and expeditions companyoceangate, had been missing for four days, a remotely operated underwater vehicle ( rov ) discovered a debris field containing parts of titan, a submersible operated by american tourism and expeditions company oceangate,, about 500 metres ( 1, 600 ft ) from the bow of the titanic |. the search area wasinformed by the united states navy's ( usn )

I don't understand why this wasn't followed up on.  Similar to @lapp0  I also expect the return from the splitter to be identical to the input. Why would we want it any other way?

@EdwardBurgin really old code, might need some changes to be compatible with current langchain.
def transformer_split_text(self, text: str) -> List[str]:
    # Calculate the step size for the loop
    _step = self.tokens_per_chunk - self._chunk_overlap

    token_offsets = self.tokenizer(text, return_offsets_mapping=True)["offset_mapping"]

    # strip special non-character tokens
    token_offsets = [tof for tof in token_offsets if tof[0] != tof[1]]

    # Creating the chunks
    token_offset_chunks = [
        token_offsets[i: i + self.tokens_per_chunk]
        for i in range(0, len(token_offsets), _step)
    ]

    split_texts = []
    previous_end = token_offset_chunks[0][0][0]
    for token_offset_chunk in token_offset_chunks:
        chunk_start = previous_end
        chunk_end = token_offset_chunk[-1][1]
        split_texts.append(
            text[chunk_start:chunk_end]
        )
        previous_end = chunk_end

    return split_texts

text_splitter_512_token = SentenceTransformersTokenTextSplitter(
    tokens_per_chunk=512,
    chunk_overlap=0,
    model_name='intfloat/e5-base-v2',
    add_start_index=True,
)
text_splitter_512_token.split_text = lambda text: transformer_split_text(text_splitter_512_token, text)


Add a test feature + fix a bug like CWS_Chilled_Water_Systems...

The commit message is self-explanatory for the test feature.
The problem was that Equipment TagSet was added if it is not a part of a Point TagSet even though it "usesEquipment" in the TagSets.csv file. However, in the check, it did not compare synonyms so it didn't notice "CWS" is already there in "Chilled_Water_Systems_Enable_Command". Thus the solution needs to exploit the synonym information.
The current solution is hard-coded because it is difficult to exploit synonyms in the current code structure. I manually created the synonym dictionary inside the code and check. If we want to keep this generation flow, we need to rewrite the code to systematically exploit the CSV file instead of iterating them. If we change our methods to systematic generation, we don't need this fix at that time. Thus, I decided to apply a hot but temporal fix. This does not affect the rest of it, so this should be an okay-solution for now.
This is reported by https://groups.google.com/forum/#!topic/brickschema/vvNw9HgzZh8

Current TagSet changes:
Removed: ['HWS_Enable_Hot_Water_System_Outside_Air_Temperature_Setpoint', 'HWS_Disable_Hot_Water_System_Outside_Air_Temperature_Setpoint', 'DHWS_Domestic_Hot_Water_System_Start_Stop_Command', 'HWS_Hot_Water_System_Enable_Command', 'DHWS_Domestic_Hot_Water_System_Enable_Command', 'CWS_Chilled_Water_System_Enable_Command']
Added: ['HVAC_Mode']

I think HVAC_Mode was added in the previous commit by Gabe, but somehow wasn't included in the ttl file at that time.

@gtfierro any comments?

lgtm!

Okay, I will fix it in the next update (if I don't forget...)
Thanks for the review!


Fixed Dockerfile bugs.

@vaikas-google PTAL

LGTM

LGTM

@jackgr These changes make the dev workflow much smoother. Thanks!

Good to hear. Thanks.
Jack Greenfield | Google
On Mon, Feb 1, 2016 at 4:15 PM, Michelle Noorali<EMAIL_ADDRESS>wrote:

@jackgr https://github.com/jackgr These changes make the dev workflow
much smoother. Thanks!
—
Reply to this email directly or view it on GitHub
https://github.com/kubernetes/deployment-manager/pull/204#issuecomment-178269797
.


NOT TYPING

INSTALLED TERMINAL ANT IS NOT TYPING? ANY IDEAS HOE TO FIX IT??

duplicate of #500
@ivankravets please add a duplicate label, close at your discretion.


Pipe .rrd via stdin/stdout

[ ] Viewer should be capable of streaming rrd data in from standard input
[ ] SDK should be capable of streaming rrd data out to standard output

[ ] Rust
[ ] C++
[ ] Python

Bump'd to high, needed for 0.12.

Implemented in:

#4511
#4512
#4513
#4514


problem with installation pyqt5 version

...
dear all,
first thanks for this tool which will be very helpfull!
I am strugling with the installation
when I use pip install 'squidpy[interactive]'
I got these errors:
ERROR: spyder 4.1.4 has requirement pyqt5<5.13; python_version >= "3", but you'll have pyqt5 5.15.6 which is incompatible.
ERROR: omnipath 1.0.5 has requirement typing-extensions>=<IP_ADDRESS>, but you'll have typing-extensions <IP_ADDRESS> which is incompatible.
ERROR: pydantic 1.9.0 has requirement typing-extensions>=<IP_ADDRESS>, but you'll have typing-extensions <IP_ADDRESS> which is incompatible.
ERROR: superqt 0.3.1 has requirement typing-extensions>=<IP_ADDRESS>, but you'll have typing-extensions <IP_ADDRESS> which is incompatible.
and
ERROR: Cannot uninstall 'llvmlite'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
I use Python 3.8.3
Many thanks !
Sophie

I think I found the solution :
pip install llvmlite --ignore-installed

HI, for me going back to squidpy==1.1.2  vesrion solved all these issues


ImportError: cannot import name 'FlashEraser' from 'pyocd.flash.loader'

After updating from 0.23.0 to 024.1, I get the error below.  I've tried uninstalling, reinstalling, removing files in AppData\Roaming\Python\Python37\site-packages\pyocd, etc.  Still same result.
Version: 0.24.1
Python Version: 3.7.4
Windows 10
Traceback (most recent call last):
  File "prov_helper_tool.py", line 2, in <module>
    from cysecuretools import CySecureTools
  File "C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\cysecuretools\__init__.py", line 16, in <module>
    from cysecuretools.main import CySecureTools
  File "C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\cysecuretools\main.py", line 24, in <module>
    from cysecuretools.execute.programmer.programmer import ProgrammingTool
  File "C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\cysecuretools\execute\programmer\__init__.py", line 17, in <module>
    from . import programmer
  File "C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\cysecuretools\execute\programmer\programmer.py", line 16, in <module>
    from cysecuretools.execute.programmer.pyocd_wrapper import Pyocd
  File "C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\cysecuretools\execute\programmer\pyocd_wrapper.py", line 22, in <module>
    from pyocd.flash.loader import FlashEraser
ImportError: cannot import name 'FlashEraser' from 'pyocd.flash.loader' (C:\Users\user01\AppData\Roaming\Python\Python37\site-packages\pyocd\flash\loader.py)

This is an incompatibility in cysecuretools. The Python API changed in 0.24.0 to refactor classes in pyocd.flash.loader into separate modules. See the release notes for details.
The Python API is considered unstable until version 1.0 is released. So projects using pyOCD's API should pin their dependency on specific versions.
Sorry for the trouble, but this is necessary to prepare for version 1.0. (It's slow in coming, but regular progress is being made.)
cc @Cypress-OpenOCD


Swift compiler error

Hi...
I am trying to run this project however i could not do this because there is message error about swift compiler.
This is screen shot on my xcode

I am using Xcode 9.4 and try to run in IOS 11.4.
Thanks....
I hope i got the right answer to solve my problem.

@microdevil Are you still facing this issue?

@jaimeohm and @saeedbashir it is solved.


Save / Cancel buttons not appearing when creating Custom Actions on Windows 7

On a Windows 7 machines, I get the following in the Custom Actions dialog. Maximising or otherwise expanding the window still doesn't show any buttons. I've tried with both the Aero and Standard windows themes, and that doesn't make a difference. A windows server 2016 machine I alternatively use doesn't show this problem.
I can work around using enter and escape, although that does feel a little odd!

Unfortunately, I don't have access to a Windows 7 machine at the moment. Some things that could help me track down the issue:

Have you encountered the same on any other dialogs within Tabular Editor?
Can you try to change some of the settings in the applications compatibility settings, to see if that changes anything? Specifically, I suspect that the "Disable display settings" option might do the trick:

Thanks for the swift response.
I've tried all combinations of the above (well, not the colour stuff), and it didn't resolve the problem, although it did feel a little like I was going back in time! Also tried running in Windows XP compatibility mode, to no avail.
I've checked the other dialogs too - they are not showing this problem.
Certainly not a big issue, just a bit odd!


task list can not be removed

Please answer these questions before submitting your issue.

Why do you submit this issue?
[ ] Question or discussion
[ ] Bug
[* ] Requirement
[ ] Feature or performance improvement

Question

What do you want to know?
how to delete tasks in task list

Bug

Which version of SkyWalking, OS and JRE?
8.1.0

Which company or project?

What happened?
If possible, provide a way to reproduce the error. e.g. demo application, component version.

Requirement or improvement

Please describe your requirements or improvement suggestions.

What is the task list? Do you mean profiling task?
If so, it will be removed according to record TTL

here is the picture

can not remove tasks in task list

What is the task list? Do you mean profiling task?
If so, it will be removed according to record TTL

I have no idea about how to config record TTL, can I configure it in some config file or some env variable?


WIP* Cut down unnecessary errors from failed inferences

Continuation of the #812 refactor. Specifically builds on the pattern of #820. It also closes #660.
In summary, we now do our best to infer an appropriate type for an expr even if the expr has an error. This is has dramatically cut down the amount of errors being reported.
Before we were exiting the inference process the moment that an error was discovered. This would cause a cascade effect where subsequent errors were generated because we were now analyzing a Type::Error or Type::Unknown. A user would sometimes have to sort through 4+ error messages to understand which was the one they could action on. By assigning an appropriate type, only the actionable root cause error is reported.
It has also had the unintended side effect of surfacing some actionable error messages that were previously not generated because we exited the process early.

As a small example, take issue #660
predicate Test {
    var a: int = 1 + false;
}

Previously produced the 3 errors below. Only the first error is actionable to the user and resolving it would resolve all the other errors.
Error: binary operator type error
   ╭─[foo.pnt:1:18]
   │
 1 │ var a: int = 1 + false;
   │                  ──┬──
   │                    ╰──── operator `+` argument has unexpected type `bool`
───╯
Error: variable initialization type error
   ╭─[foo.pnt:1:14]
   │
 1 │ var a: int = 1 + false;
   │        ─┬─   ────┬────
   │         ╰─────────────── expecting type `int`
   │                  │
   │                  ╰────── variable initializer has unknown type
───╯
Error: constraint expression type error
   ╭─[foo.pnt:1:1]
   │
 1 │ var a: int = 1 + false;
   │ ───────────┬──────────
   │            ╰──────────── constraint expression has unknown type
   │            │
   │            ╰──────────── expecting type `bool`
───╯

Now it produces...
Error: binary operator type error
     ╭─[test.pnt:189:22]
     │
 189 │     var a: int = 1 + false;
     │                      ──┬──
     │                        ╰──── operator `+` argument has unexpected type `bool`
─────╯

Another example from issue #812
storage {
    x: int,
}

predicate Test {
    state x = storage::x;
    var len = __state_len(x, 0);

    constraint len == 0;
}

Previously produced 4 errors. 3 of which were caused by the first error.
Error: this intrinsic takes 1 argument but 2 arguments were supplied
   ╭─[test.pnt:7:15]
   │
 7 │     var len = __state_len(x, 0);
   │               ────────┬────────
   │                       ╰────────── unexpected number of arguments here
───╯
Error: binary operator type error
   ╭─[test.pnt:9:23]
   │
 9 │     constraint len == 0;
   │                ─┬─    ┬
   │                 ╰──────── expecting type `Error`
   │                       │
   │                       ╰── operator `==` argument has unexpected type `int`
───╯
Error: constraint expression type error
   ╭─[test.pnt:7:5]
   │
 7 │     var len = __state_len(x, 0);
   │     ─────────────┬─────────────
   │                  ╰─────────────── constraint expression has unknown type
   │                  │
   │                  ╰─────────────── expecting type `bool`
───╯
Error: constraint expression type error
   ╭─[test.pnt:9:5]
   │
 9 │     constraint len == 0;
   │     ─────────┬─────────
   │              ╰─────────── constraint expression has unknown type
   │              │
   │              ╰─────────── expecting type `bool`
───╯
Error: could not compile `test.pnt` due to 4 previous errors

Now it produces
Error: this intrinsic takes 1 argument but 2 arguments were supplied
     ╭─[test.pnt:198:15]
     │
 198 │     var len = __state_len(x, 0);
     │               ────────┬────────
     │                       ╰────────── unexpected number of arguments here
─────╯
Error: could not compile `test.pnt` due to previous error

This may also even close issue #812
That is up to ya'll to decide as the reviewers.


Add menu or links to countries

Since the countries are not a top menu level, they don't appear on the menu on the right.
If it is not possible to enhance the menu to display the country level, could ypu please at least add links at the beginning of each main section to link all the countries that will follow? That would be very helpful. Currently, it is very difficult to navigate through this page.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 099e4c9c-6893-2d35-6ece-6c056a2c752f
Version Independent ID: 8a51d9d5-605d-d442-337b-ef992d25395d
Content: Fields that are Moved, Removed, or Replaced - Business Central
Content Source: dev-itpro/upgrade/deprecated-fields.md
Service: dynamics365-business-central
GitHub Login: @edupont04
Microsoft Alias: edupont

Hello Natalie,
Than you for your feedback! It fits nicely in with some other work we're planning, so I hope you'll see an improved experience in a few weeks.

This seems to have been fixed. The countries are in the table of contents for a better overview.


Get the speaker id out from wave file

Hi,
Does anyone know how we can use wave-net implementation to actually return the speaker id on giving wave file as input? Instead of generating the wave file for a given speaker.
Thanks,
Arpit

@arpitbaheti In the original paper deepmind mentions using wavenet for speech recognition. Try using that architecture to do any sort of classification tasks on your raw waveforms.  We tried it for F0 estimation and it worked really good

Thanks @belevtsoff  for your answer. In the original paper they said that " adding a mean pooling layer after dilated convolutions that aggregated the activations to coarser frames spanning 10 ms (160x down-sampling). " So what exactly they have done with average pooling (reducing the input dimension to particular value)?
I have tried the same architecture with average pool1d on skip outputs followed by two conv1d layer. After that softmax for target speaker (which is single integer represent the id of the speaker) and predicted output. Problem is size of logit and target is not matching.
you said you have tried F0 estimation, can you please let me know how did you do that?

I have the same question. Does the initiator have solved the problem?

I have tried many things, but as wavenet works on samples and we can't predict speaker per samples, but i have modified https://github.com/buriburisuri/speech-to-text-wavenet to return the speaker ID with MFCC as input feature, Which doesn't work well, Any other network known to work for speaker recognition?? (Any RNN/LSTM)

@arpitbaheti  All right. Actually, I wanna try to classify or identify the audio samples by using time-domain features directly rather than other transferred features such as MFCCs, Spectrogram, etc. Have you ever try some other methods to do it (Just deal with waveform just like wavenet)?

Were you able to find a solution to recognize a speaker using wavelet @arpitbaheti


Enhance Website Design with 3D Elements and Floating Bubbles

What's the style idea?
The current design of the website could benefit from enhancements to create a more engaging and dynamic user experience. I propose two main enhancements:

Add 3D Appearance to Design Elements: Enhance the visual appeal of design elements such as bubbles and the logo "B" by giving them a 3D appearance. This could involve adding shadows, highlights, and gradients to simulate depth and dimensionality, creating a more realistic and visually appealing look.

Introduce Floating Bubbles for Dynamic Visual Effect: Implement floating bubbles that move along the page in a smooth and non-intrusive manner. These bubbles will add a playful touch to the design without interfering with the main content, contributing to a sense of liveliness and engagement for visitors.

Checklist

[X] I have checked the existing issues.
[X] I follow Contributing Guidelines of this project.
[ ] I am a IWOC'24 contributor.
[ ] I am a JWOC'24 contributor.
[ ] I am a SWOC'24 contributor.

Code of Conduct

[X] I agree to follow this project's "Code of Conduct".

Please assign this issue to me i would like to work on it @Rakesh9100  .  Also  label it as GSSoC with the levels mentioned.

please assign me i want to do...beacause i have experience realated to this

Can you provide some supporting screenshots or videos of your idea @Asl2027


Deepseek not working on existing projects

Describe the bug
Thought initially was a problem with the api key, however after running some tests, I can see the issue coming from the existing project I'm working on. So if I'm to start a new project from scratch this I would not encounter this issue.

A bit of background: Started the project initially on Bolt.new, moved to the local version of Bolt.diy, continue the work using Google Gemini API 2.0 - relatively fine, then today I tried to use the newest version of Deepseek v.3 both coder/chat and it doesn't work, getting this error when using the prompt:

``
Link to the Bolt URL that caused the error
localhost app
Steps to reproduce

Load a current project you are working on via Bolt.diy
Change the LLM to DeepSeek API
Type any request, or simple 'test'
Error shown via the toast message (see screenshot)

Expected behavior
to work?
Screen Recording / Screenshot

Platform

OS: [macOS]
Browser: [Chrome]
Version: [latest]

Provider Used
No response
Model Used
No response
Additional context
No response

I have the same problem. It doesn't seem to be a key issue. In my case no prompt works using deepseek.

Same issue here


Use of hotlinking of Go identifiers

GoDoc now supports hot linking to specific Go identifiers. Use that feature to enhance the usability of cmp docs.
Since cmp lacks a direct dependency on cmpopts,
you are forced to use the fully-qualified import path to references identifiers in the cmpopts package.
It can future improvements to the go/doc to handle this case, either by rendering the doc with short form,
or by detecting the use of cmpopts from the unit tests as well (since those can break circular dependencies).

See<EMAIL_ADDRESS>to get a preview of what godoc looks like after this change.


Dependency on lodash

Copied from https://github.com/camwiegert/in-view/issues/11#issuecomment-273293767 :

Hi, thank you for the useful library.
I think, the lodash in package.json should be moved to devDependencies from dependencies.
Some package managers try to install the unneeded lodash when the in-view is installed. We have to remove it every time.
All bundled libraries are typically added to devDependencies.

Or, is there any reason to be in dependencies?

@anseki I think I agree with you and would merge a PR. That said, the rewrite that I'm finishing up removes the lodash dependency altogether. So, this will be a non-issue soon!


🚀 Switching to Poetry for Project Management

Hello team,
This PR revamps project setup with Poetry, bringing in a dedicated environment and enhancing code quality checks:

Transitioned to Poetry.
Introduced pre-commit for standardized code checks.
Integrated pylint for improved linting.
Refactored cleanup with clean_src in the Makefile.
This should address #164, #219, #168. Sets the stage for packaging, integrating .github PR actions, and more.

Why are we changing to use poetry? what specifically does it provide for us? (i'm ok with it being changed over, the poetry stub in there was done for reasons)

I'm currently thinking we aren't gonna use poetry, but a PR that adds quality checks and related tooling sounds great, can you structure it that way in a fresh PR?

(i'm open to being wrong, and either way I do like and support the other improvments)


🦄

@yakov116 We appreciate all the PRs you've done. Would you be interested in joining Refined GitHub as a maintainer?

@sindresorhus it's would be my greatest pleasure.
Thanks for all your awesome work!

🎉

Invite sent. Welcome!


Would it be possible to provide any update about this topic?

Hello,
Would it be possible to provide any update here?
This issue in service is a real blocker for my company.
Many thanks.
Ivan.
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4b51ac2d-86d8-1c65-3fb9-c2e00b465d23
Version Independent ID: 0fa7135a-e7da-a9b4-d238-0e49a4c18a68
Content: Set up multiple administrators on Azure Kubernetes Service (AKS) on Azure Stack HCI - AKS-HCI
Content Source: azure-stack/aks-hci/set-multiple-administrators.md
Service: azure-stack
Sub-service: aks-hci
GitHub Login: @mattbriggs
Microsoft Alias: mabrigg

@IvanNaumeiko Thank you for your feedback!  We're assigning this to the document author for further review.
@mattbriggs I believe the introduction is what is being referenced:

For various reasons, AKS on Azure Stack HCI is currently tightly coupled to the user who installed the service with no awareness of other local users or AD users with administrative rights. We are working on resolving this issue, but you can use the steps in this topic to register additional users with the Microsoft on Cloud (MOC) service under AKS on Azure Stack HCI. This will allow multiple people to perform administrative tasks.

@IvanNaumeiko Thanks for your question. I have forward to your technical staff. In the meantime, you may find the the roadmap for the AKS on HCI here: AKS on Azure Stack HCI roadmap.
#in-progress


Question: Predefined commands?

Is possible to generate buttons to run specific commands like service status, restart?

Yeah you could if you wanted to, you'd just create a button that sends a string to the SSH server
// transport is defined as a global once the SSH connection starts
transport.expect_key('systemctl status')

You could get more advanced if you wanted and start using some custom parsing on the results that come back.

@stuicey  Tky for your help I will se what can i do


Respect XDG Base Directories

For Linux/MacOS, in the global scope can we respect the XDG Base Directory Specification rather than hard-coding against $HOME?
I would expect this would just be an extra check in cmd.go inferWorkDir, checking for the appropriate environment variable and using that instead of $HOME if present.
In the context of ~/.sqlpkg, I believe the correct standard path would be $XDG_DATA_HOME/sqlpkg without the dot, but if it helps consistency with other code (specifically this looks like it would cause some extra work around spec.DirName)  then $XDG_DATA_HOME/.sqlpkg is acceptable.

Sorry, I'm going to pass on this.


Fixing some warnings

About the PR

Replace SS14Window with DefaultWindow
Fix some names
Remove some unused variables
Unhide, or mark hide as intended,
Fixed some fixture warnings


Handle SetModel error, fixes one errcheck report (#257)

I guess it could be also backported to 1.0

I think the admin command is not very necessary? we can do it on the UI.

you mean you would drop the runCreateUser function ?

I agree with @lunny , maybe we should drop the admin command.

But for this one. I will give it LGTM.

I do see uses for the admin command outside of just batch account creation:

reset a user's password from the command line
disable two-factor authentication from an account in the event that the device is stolen and/or missing, they forget their scratch code, and the end user can verify they are the owner

@minecrafter Yes. Command admin is sometimes useful.

LGTM

@strk bug-fix so yes, please backport :)

I'm away from my main development machine, could anyone cherry-pick this to 1.0 and verify ?


Windows builds are saying with a utf encoding error

Our Windows builds are failing with some kind of encoding error. This seems to be related to the sphinx theme builder so we opened an issue to discuss and track there for now:

https://github.com/pradyunsg/sphinx-theme-builder/discussions/38

My feeling is that this should not block a release because I don't believe we introduced it and it likely affects other versions too - but if others disagree please say so!

We hit something like this recently in mne-python and @larsoner fixed it by setting env var PYTHONUTF8=1 on windows (I think). I haven't combed the CI log yet though so I'm not positive this is the same error. I'll check next week if nobody beats me to it

@drammock I remembered this being solved in one of your PR, am I wrong ?

I fixed it for the CIs only.  It is caused by the emoji in our README --- the README gets parsed as metadata during editable pip installs.  The fix is to export the environment variable PYTHONUTF8=1 before doing the pip install but I haven't looked yet into whether this is possible to do automatically for the user. The other, simpler fix is to remove the emoji from our README.


Any plans for local development story

Are there any thoughts regarding inner-loop (local development) support?
Although all containers can easily be hosted in a local Kubernetes environment, it would be awesome to have a first-class local development story.
When thinking about the scenario, I could imagine there are different solutions/ideas like for example

Compiling Azure Container Apps ARM entities (either from Bicep or plain ARM templates) to Kubernetes manifests to run the app with no change in a k8s environment like KIND or minikube -> that could also become the "eject" functionality  to take existing applications from Azure Container Apps and move it seamlessly to AKS if required

This would imply all dependencies being available as helm charts

Another option would be providing a collection of helm charts to take Azure Container Apps and run it in any Kubernetes

Adding a custom CRD that is able to deal with the schema we use to describe Container Apps Microsoft.Web/containerApps@2021-03-01  and Microsoft.Web/kubeEnvironments@2021-02-01

We are working on ways to optimize the developer experience. Thanks for the suggestions

Making Tye a first-class supported (i.e. not an experimental) CLI tool would basically meet this need, I think.. anything other than this would be duplicate effort.

I've found that doing docker-in-docker with VS Code gives a pretty nice local development experience.
You can borrow the example code from here:
https://github.com/johnnyreilly/dapr-devcontainer-debug-and-deploy/releases
It has:

deployment to Azure Container Apps
a devcontainer
running locally with docker compose
debugging locally in VS Code

We're tracking this at #256. Closing this now.


chore: update actions/cache to version 3

What does this do?

What does this do?

This was just trying out whether updating to the latest cache action would improve the performance.


Couldn't build automated binaries for Linux

Travis CI build fails on linux targets with:
error: failed to run custom build command for `xcb v0.8.2`

Caused by:

  process didn't exit successfully: `/target/debug/build/xcb-642392b748273c1b/build-script-build` (exit code: 101)

--- stderr

thread 'main' panicked at 'Unable to find build dependency python3: Os { code: 2, kind: NotFound, message: "No such file or directory" }', /cargo/registry/src/github.com-1ecc6299db9ec823/xcb-0.8.2/build.rs:67:26

note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

But cargo install works on Linux so this should be fixable somehow.

Workaround for now, copy to clipboard uses xclip on linux and pbcopy on OSX, and the copy test (which uses the clipboard crate) is not run on linux. (see #37)


Add a reduced test-case for issue 7696

Issue #7696 was one of the issues fixed by PR #8580. The other ones were all cases of missing glyphs, however in this particular one glyphs did render but every single one was incorrect.
Hence it probably cannot hurt to have a small, reduced, reference test for that PDF file as well.

/botio test

/botio makeref

Thank you!


Fail to gather Extensions - Extensions not showing ( error in both anime and manga )

Source information and language
Every extension
Steps to reproduce
In browser > in anime Extensions/ manga Extensions > fail to gather Extensions
Blank black screen
no Extensions to install
Expected behavior
In browser > in anime Extensions/ manga Extensions > list of Extensions to install
Actual behavior
In browser > in anime Extensions/ manga Extensions > blank black page ( in both anime / manga Extensions)
Aniyomi version
<IP_ADDRESS>
Android version
Android 12
Other details
I download aniyomi from different 2nd phone and share to this main phone
i don't even able to see extension if i download aniyomi by this main phone now i can see extension but its just stuck at downloading
Same thing happen with me when i download aniyomi with this main phone
I change settings in
Setting > advanced > network > dnh : google, adgaurd, cloudflare
( i tried all three of them dnh)
After changing dnh i was able to see extension list but when i try to install
It just stucks at downloading s
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open issue.
[X] I have written a short but informative title.
[X] I have updated the app to version 0.13.5.
[ ] I have updated all installed extensions.
[X] I have tried the troubleshooting guide.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

Now I am facing the same issue

Also the extension page of the website is not working for aniyomi extensions

https://aniyomi.jmir.xyz/extensions/
See ☝

Now I am facing the same issue

They should upload extensions on there discord server because after you get the extensions and install it individually ( not in app or by app )
Every works perfectly fine

This issue has been resolved in the preview version of aniyomi. If the problem still persists, please create a new issue on the repo for the main app.


DownloadPipelineArtifacts does nothing for 10+ minutes then times out

Required Information
Entering this information will route you directly to the right team and expedite traction.
Question, Bug, or Feature?
Type: Bug
Enter Task Name: Download Pipeline Artifact (DownloadPipelineArtifact@2)
Environment

Platform
Azure Pipelines

Account Name
<EMAIL_ADDRESS>

Team Project Name
Senso.Client.Mobile

Build Definition
#20201008.4

VM Image
macos-latest

Agent Name
#was unable to find this

Issue Description
I was running the CI for my xamarin forms application, the pipeline has 2 stages:

Stage 1: Run Tests, Build & Sign Apps, Publish Artifacts
Stage 2: Download Artifacts, Publish To App Center For Alpha Release

Stage 1 completed successfully and Stage 2 begun. The iOS release task waited for around 15 minutes on the DownloadPipelineArtifacts task. Eventually the task timed out and it output the following error:
##[error]The HTTP request timed out after 00:00:30.
The pipeline history claimed the task took 1m 1s, but as the people sitting watching the pipeline run whilst eating my lunch I can confirm it took significantly longer.

The task started and displayed the following:
Starting: DownloadPipelineArtifact
==============================================================================
Task         : Download Pipeline Artifacts
Description  : Download build and pipeline artifacts
Version      : 2.3.1
Author       : Microsoft Corporation
Help         : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/download-pipeline-artifact
==============================================================================
Download from the specified build: #2302
Download artifact to: /Users/runner/work/1

It never progressed past this point until displaying the error, below is a screenshot of the full task output:

once the task had timedout the 2nd task ran and released the android app. I simply reran the failed task and it succeeded. The pipeline artifact absolutely exists and I haven't encountered the issue on subsequent runs.
Thought I'd report because something definitely frozen somewhere in the pipeline and the system hasn't correctly reported this.

+1, seen here: https://dev.azure.com/dnceng/public/_build/results?buildId=910780&view=logs&j=05e92ac1-194e-59cf-664a-fa72d1cdd19b
@zachariahcox FYI.


Mysql provider support

I have no interest if this right now, but it should be easy to implement this adapter.

hi, thanks for your work
i wanna ask, i have mysql connection here, so how can i connect with my db?
thanks for your attention and thanks again for your great work

Thanks! You can't connect to mysql server out-of-box, there is no transport implemented for mysql by now. If you need that, you can create a transport that provides sql queues support.

ok thanks
by the way, do you have any recommendation for yii2 async with mysql support?


Add code at bottom of server to stop app on close

Background
As per schools-workforce-benchmarking add code to stop app to bottom of server.R file
Steps to take
Add the following code in server.R file
  #stop app running when closed in browser
  session$onSessionEnded(function() { stopApp() })

sorted


Show sway/window on all bars

Currently the sway/window module only displays the window title in the bar on the same output as the currently focussed window.
As a workaround I am using this script as a custom module, but it would be very nice to be able to just display the built in module on all outputs/bars (as an option)
#! /bin/bash

swaymsg -t subscribe -m '["window"]' | jq -r --unbuffered '.container.name | .[0:30]'

    "custom/window": {
        "exec":"$HOME/.config/waybar/window.sh",
        "exec-on-event": false
    },

You can do this by setting all-outputs in module config to true. Which is not documented for some reason.


Re-Add get-pr-owners.yml

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow


Polymer.updateStyles() doesnt update styles with new styling system.

Use case is an element like highlight-element which dynamically updates its local dom.  <style include="shared-styles"></style> does not pick up new styles if you call Polymer.updateStyles()/this.updateStyles().

See, for example: https://github.com/Polymer/highlightjs-element/pull/3

Note: to repo this in https://github.com/Polymer/highlightjs-element/pull/3, be sure to take out the custom-style in the main doc (https://github.com/Polymer/highlightjs-element/pull/3/files#diff-3e22c50371c76d64ea9738dbc46a6e57R20).

it doesn't look like any custom properties are used. That would be the only reason you'd ever need to call updateStyles

I'm not sure this is the case but it would explain the behavior you're seeing: there's a 3rd party library involved that's adding DOM inside the element's local DOM. DOM in Polymer elements needs to be added via Polymer.dom. One reason is so that it gets the proper scoping classes added such that the styles properly apply. When a library is used that doesn't know about Polymer.dom, you can use an element's scopeSubtree(container, shouldObserve) method. See the api docs for more info.

Yea this works great! https://github.com/Polymer/highlightjs-element/pull/4
Didn't know about scopeSubtree.

Closing


Could not load VALORANT match data

Since 48 hours ago, maybe longer, I was not able to fetch data from 2.9.1 and just tested rebuilding from 2.10.0 with the same issue. May I know if anyone else is facing the same issue?

I have no issues at all, can you show me a screenshot of your Valorant Companion with the developer console open (CTRL + SHIFT + I) and the window stretched to the right?

Thanks for the swift response!
If I can recall correctly the only thing different was I tried to launch the game from this app instead of opening the game as I would usually do, not sure if that broke anything but the new exe is cached with my accounts as well, should I try going somewhere and deleting some files so I can start fresh?

This doesn't seem like one of the rare errors I already know of. Are you willing to provide a screen share via discord? If so, please email me your discord-username (github@rxj.pw). For privacy reasons we should not share this information in this issue.
I won't have time right now but will negotiate a suitable time for us to see further into this issue.

Sure will drop you an email and this is what I got when in game

Thank you for providing me with your discord-username and further logs! Looking into them, this seems to be an issue I already know of. Looks like the assets api I use for receiving Valorant assets returned unexpected data when requesting them on version change. I already attempted to fix this issue in 2.10.0 but as you can see this didn't really work. My previous attempt to fix this issue clearly needs more attention.

Thank you for making time to address this issue in more detail through screen sharing.
Please feel free to report further encounters.
The bug mentioned in this issue was fixed with commit 29dcfae.
Have a nice day!


test: allowing many test filters to be upstream filters

Signed-off-by: Alyssa Wilk<EMAIL_ADDRESS>Risk Level: n/a (test only)
Testing: n/a
Docs Changes: n/a
Release Notes: n/a
part of https://github.com/envoyproxy/envoy/issues/10455

/wait
Seems like this isn't yet ready for next pass


[callofduty1] Server Request

Just wondering if it would be possible to add support for call of duty 1 server? Your scripts work wonders

The best and really only guide I found is this http://forum.fdcservers.net/showthread.php?t=1211 which explains that you have to have files off of the actual discs be transferred over, something I don't know if we'd really want to do because of copyright issues though I'm not exactly sure Activision would care for abandonware
Up to you @dgibbs64

It may be possible however the admin would probably have to provide the files. I dont have a copy of the game and there would not be much demand for it to warrant me spending time on it, However I would be happy to merge it if someone else developed this.

Yes you do require a copy of the game files but I think its only the specific core files. All executables can be stripped out. The game still requires a valid key to install even once ripped off the discs. I would be happy to host a copy of them for users if needs be. I don't think it would be an issue as it is abandonware as you say but you never know.
Perhaps if the user does need to provide the files, with the scripts saying "put CD files here"
Anyway, I understand if you don't think there is much demand to warrant doing this. Would be great to have your script to install / run it though
Currently use screen command
#!/bin/sh
screen -d -m -S cod bash -c 'cd /home/servers/cod1 && ./cod_lnxded +set_dedi$
Can provide a copy of the game if you do decide to
Cheers

@spudy12 it is worth seeing if you can get it working yourself using an existing script. Normally I just adapt an existing one to create a new one. For the basics you can change the relevant variables and set the parms for cod 1. the hard part would probably be getting the details to work. However if you can get this working and send me a merge request or email me your script. Then let me know ports etc and I can tidy it up.


RequestTimeoutException thrown because of wrongly set ExpiresAt (Azure Service Bus)

Is this a bug report?
yes
Can you also reproduce the problem with the latest version?
yes
Environment
Operating system: Windows 10
Visual Studio version: Enterprise 2019 Version 16.8.2
Dotnet version: .NET Core 3.1
Transport: Azure Service Bus (Standard)
Steps to Reproduce
See sample here
Expected Behavior
It should not raise RequestTimeoutException and respect RequestTimeout set for RequestClient during validation.
Actual Behavior
When request client from Project c is sending a request and waiting for response, RequestTimeoutException is thrown (replaced in this demo with console log to show values for the message properties: expire time, enqueue time, ...).

Is your computer time synched to any reliable time source? The TimeToLive value is passed directly to Azure, which calculates the expiration time based upon the EnqueueTimeUtc (assigned by the broker when the message is sent).

Yes, you are right.
My computer was synced but still there was still an offset.
Thanks for the hint.


CoreProtect plugins cannot log trees block that are cut down quickly

CoreProtect: https://dev.bukkit.org/projects/coreprotect
CoreProtect plugins cannot log trees block that are cut down quickly, Blocks that were destroyed by mistake cannot be recovered.
Or is there some other way of logging/rolling back blocks?
example:

This is an Minecraft Acacia tree.

"HT's TreeChop“Mod cause trees to be cut down quickly.

Lookup result is only one block.

Rollback is the same, only one block.

Thanks for reporting this, I’ll see if I can add support for CoreProtect

Thanks for reporting this, I’ll see if I can add support for CoreProtect

Thank you for your maintenance! Treechop is a very nice MOD.
If there is any progress or other solutions, please let me know, it is very important to me.


Race condition in USBMSD/USBMSD.cpp

In
void USBMSD::disconnect() {
//De-allocate MSD page size:
free(page);
page = NULL;
USBDevice::disconnect();
}
the isr which also accesses page is deactivated in USBDevice::disconnect();, however page is freed on the heap before that. If the isr interrupts the disconnect right after free(page) it will write to freed memory which could corrupt the heap.

fixed in merge #1044


the data in PCCI_20082022_IZA seems to be broken

Thanks for great work!
I got an IndexError after I moved PCCI_20082022_IZA to the training split to be same as the paper.
I was wondering the data in PCCI_20082022_IZA whether it is broken. Is that correct or I need to redownload the section of data in PCCI_20082022_IZA ?
(I'm asure this problem is caused by PCCI_20082022_IZA, since I removed it from training split and everything goes fine)
Here is the detail of my configuration in forecast_datamodule.yaml
  stations:     train: ["PCCI_20082022_IZA", "PCCI_20082022_CNR", "PCCI_20082022_PAL"]     val: ["PCCI_20082022_PAY"]     test: ["PCCI_20082022_CAB", "PCCI_20082022_TAM"]

Hi, thanks for your interest!
There shouldn't theoretically be a problem with the PCCI_20082022_IZA data since we also used it for training in the paper results; could you please provide the details of the IndexError error you get (setting HYDRA_FULL_ERROR=1 if not already)? Also, the full configuration could be useful, in case you are not using an experiment we are providing already.

Thanks for reply!
I found it is caused by the cached channel index in TSDataset
the get_channel_ids function in TSDataset just like below:
if self._ts_channel_ids is None:
        if self.ts_channels is not None:
            self._ts_channel_ids = [
                i
                for i, k in enumerate(timeseries_tensor.info["timeseries_channels"])
                for c in self.ts_channels
                if c == k
            ]
        else:
            self._ts_channel_ids = [
                i
                for i, k in enumerate(timeseries_tensor.info["timeseries_channels"])
            ]
        self._ts_channel_ids = sorted(self._ts_channel_ids)

return self._ts_channel_ids

this code seems to cache channal index in previous batch, however, the  indices of  expected self.ts_channels features are varied from different station. So my IndexError always comes when datas from heterogenous are adjacent. Besides, as we specified the interested channel name in self.ts_channels and gather them sequentially, why using sorted to make their indices ordered?
After annotating the outer if and the sorted statement, everything goes well again.

Sorry to trouble you again.
To utilize context image correctly, I have a question about the EUMETSAT scanned data:

Are six stations always kept with absolute pixel position of image in each context frame?
Is it possible there may be some rotation, distortion (due to different view angel) or offset in some context frames? Thank u!

The absolute pixel positions of the stations are fixed and do not change. The context channels are taken within a fixed spatial window that doesn't change either (the satellite would be geostationary, so that it sees the same coordinates all the time, no offset).
To answer your previous question though, we thank you first for pointing out that problem which is a potential bug in the implementation. We're checking if that bug affects the training of the stations we provided in the paper, otherwise, we will fix it and remove the lazy loading.
Thank you again for pointing out the bug!

Hi,
I just checked and I can confirm that this issue didn't affect the training (and paper results), since the stations that we used had the same channels in the same order.

Hi,
I just checked and I can confirm that this issue didn't affect the training (and paper results), since the stations that we used had the same channels in the same order.

Appreciation for your examination and explanation!

The default yamls file in shared code, e.g. forecast_datamodule.yaml, ts_context.yaml, ts_datamodule.yaml, are little different from one in paper.
So if your train split is based on the below pseudo configuration according to your paper and keep the initial code in repo, the cached channel would lead model to crash during training sooner or later as I issued. Was metrics reported based on the shared file of this repo, e.g. forecast_datamodule.yaml for baseline, ts_context.yaml for cross_vivit? Sorry to point out this, as it could make a fair comparison for later studies.

the pseudo configuration below is mainly mentioned in the paper (top of Page 8):
stations:
      train: ["PCCI_20082022_IZA", "PCCI_20082022_CNR", "PCCI_20082022_PAL"]
      val: ["PCCI_20082022_PAY"]
      test: ["PCCI_20082022_CAB", "PCCI_20082022_TAM"]

the train split above(IZA, CNR, PAL) only covers 2008-2016 period, and the observations of station PAY on 2017-2019 period are used for validation.
For testing, station CAB is evaluated on 2020-2022 period, the TAM station is evaluated on 2017-2019 period instead.

Sorry, the config variables for the datamodules are not up to date and are not the one we used in the paper indeed, so I'll push the correct ones ! I just remembered that we override the datamodule config in the command line, so we forgot to update that accordingly.
Strangely though, we didn't get any errors while running the training at all, but I'll remove the caching in any case.


can i initialize the records for the table when creating the database

You can use the initialization callback,


Revealing the file in Source Control

Hi!
How about another command, Reveal in Source Control?
Because the Git stage and unstage does not work on my code-server, variant of https://vscode.dev

Hi,
Sorry, I have somehow missed that. I'm going to update my tiny VS code
extension since the current version has stopped working with the recent
update of VS code. Happy to add a new simple function to it. Could you
explain what the 'Reveal' function exactly does in the files tree as you
see it?
On Thu, 12 Oct 2023 at 06:22, bilogic @.***> wrote:

Hi!
How about another command, Reveal in Source Control?
—
Reply to this email directly, view it on GitHub
https://github.com/awhitenose/vscode-git-tools/issues/1, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AZLYOOHS4KFZY2X47LFQS4LX65O7LANCNFSM6AAAAAA5457674
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Hi,
Thanks for getting back! When editing a file,

Reveal Active File in Explorer will switch to Explorer and select the file in Workspace, allowing us to move/rename it etc
Focus on Source Control View will switch to Source Control and select the file's repository, focusing on Message
Reveal Active File in Source Control View will switch to Source Control and select the file in Source Control
This way, we can stage the current file + see what other related files we also need to stage

Btw, my setup is a multi-root, multi-repo workspaces.
So, if I'm editing composer.json and run Reveal Active File in Source Control View, it should switch and focus on Source Control and select the composer.json file. Make sense?


fix: candlestick red-green bug

Brief Information

[x] bug fixing
[ ] new feature
[ ] others

What does this PR do?
Changes the colour of the candle to the correct colour: rise - green, fall - red (original bug - colours mixed up).
Fixed issues
The colours have been swapped.
Details
Before: What was the problem?
A positive candle (itemStyle: color) was marked in red, a falling candle in green (itemStyle:color0).

After: How does it behave after the fixing?
The right way: up is green, down is red.

Document Info
One of the following should be checked.

[x] This PR doesn't relate to document changes
[ ] The document should be updated later
[ ] The document changes have been made in apache/echarts-doc#xxx

Misc
ZRender Changes

[ ] This PR depends on ZRender changes (ecomfe/zrender#xxx).

Related test cases or examples to use the new APIs
N.A.
Others
Merging options

[ ] Please squash the commits into a single one when merging.

Other information

Thanks for your contribution but this is not a bug.

Different countries or regions have different implications on the color of candle stick chart. It may use red to imply increasing with red and decreasing with blue (in China mainland, Taiwan, Japan, Koera, and so on), or to imply increasing with green and decreasing with red (in Europe, North America, Hong Kong, Singapore, and so on). Besides color, the increase and decrease of stock may also be represented with candle stick with or without filling colors.
We use red to represent increasing and blue decreasing by default. If you want to change the configuration, you may change the following parameters.

series-candlestick.itemStyle.color: fill color for bullish candle stick (namely, increase)
series-candlestick.itemStyle.color0: fill color for bearish candle stick (namely, decrease)
series-candlestick.itemStyle.borderColor: border color for bullish candle stick (namely, increase)
series-candlestick.itemStyle.borderColor0: border color for bearish candle stick (namely, decrease)
series-candlestick.itemStyle.borderColorDoji: border color for doji (when the open price is the same as the close price)

Please checkout the document for more information.


Crash when moving a panel after closing its parent window

To reproduce:

Open the DockablePanels example
Drag one of the panels into its own window
Close the original window
Drag the panel -> Crash

All the child panels should close when the parent window closes anyway so that is probably the right fix.

Fix delivered to master.
I fixed the crash by forcing creation of a floating window to take a parent window. When the parent window is closed, the floating window is also closed.
Commit
commit 8b34a3de8d1171ff3cf4666cca51535443264190
Author: Alex Hunt<EMAIL_ADDRESS>Date:   Fri Mar 25 17:16:24 2022 -0400
Issue2: Fixed crash when moving a panel when its parent window has closed.

Testing

Tested that dragging a docked panel into a floating window and closing the original window doesn't crash.
Tested redocking a floating window into the original parent and closing the window doesn't crash.
Did some regression testing including closing docked panels, then closing the window and reshowing a closed docked panel and closed floating panel and then closing the window.


Crossplatform multiline termplate literals

Replace crlf with lf line endings for crossplatform translation support

Fixed in v0.6.0


Image size error

Dear chronos coders,
We are trying to run your pipeline in our CRISPR screen. The dimensions of our readcounts matrix are 46x37722. When running the reports.qc_initial_data line, we get a ValueError saying that the Image size of 1500x283800 pixels is too large. It must be less than 2^16 in each direction. We have unsuccessfully been looking at the source code to try to understand where this comes from. Could you help us out?
Thanks!

Hi Anna, can you provide the full traceback?


feat(Ng2LocationConfig): use BrowserLocationConfig.

when i first wrote this I couldn't find an abstraction in Angular that exposes the "LocationConfig" stuff.  I take it you came to the same conclusion?
Is your proposal that in universal people simply replace the config with the memory config?.

yep

works for me.


Upscaling without premultiply and alpha channel produces black border

When I do the following (upscaling an image from 300 to 400 px), i get a thin black border on top and right. When I add premultiply and unpremultiply, that border is gone. I though that's only needed when the picture has an alpha channel? Wrong assumption? Should I premultiply always? Or just when upscaling? But always when with alpha channel?
$pixel = \Jcupitt\Vips\Image::black(1, 1)->add([255 , 255, 255])->cast(BandFormat::UCHAR);
$vips = $pixel->embed(0, 0, 300, 300, ['extend' => Extend::COPY]);
$vips = $vips->copy(['interpretation' =>\Jcupitt\Vips\Interpretation::SRGB]);

//$vips = $vips->premultiply();
$vips = $vips->resize(400/$vips->width);
//$vips = $vips->unpremultiply();

$vips->jpegsave("image.jpg");

Oh dear, looks like an unforseen consequence of the switch to centre sampling for upscale. I'll see if I can fix it.

OK, seems to be fixed. Thanks for reporting this! It should be in 8.6 final.

Works for me too now, as well, thanks a lot


Use com.eightbitlab:blurview so viewRef with background view is not required any more

https://github.com/Dimezis/BlurView supports blurring the view tree behind the view, not requiring the current nasty workaround with the viewRef property.
The patch below works fine for me.
diff --git<EMAIL_ADDRESS><EMAIL_ADDRESS>index bc4cebc..7e92b89 100644
---<EMAIL_ADDRESS>+++<EMAIL_ADDRESS>@@ -40,4 +40,6 @@ repositories {
 dependencies {
     //noinspection GradleDynamicVersion
     implementation 'com.facebook.react:react-native:+'
+
+    implementation 'com.eightbitlab:blurview:1.6.3'
 }
diff --git<EMAIL_ADDRESS><EMAIL_ADDRESS>index 2c228af..36de43f 100644
---<EMAIL_ADDRESS>+++<EMAIL_ADDRESS>@@ -1,63 +1,64 @@
 package com.cmcewen.blurview;

+import android.graphics.drawable.Drawable;
 import android.view.View;
+import android.view.ViewGroup;

 import com.facebook.react.uimanager.SimpleViewManager;
 import com.facebook.react.uimanager.ThemedReactContext;
 import com.facebook.react.uimanager.annotations.ReactProp;

+import java.util.Objects;
+
 import javax.annotation.Nonnull;

+import eightbitlab.com.blurview.BlurView;
+import eightbitlab.com.blurview.RenderScriptBlur;
+

 @SuppressWarnings("unused")
-class BlurViewManager extends SimpleViewManager<BlurringView> {
+class BlurViewManager extends SimpleViewManager<BlurView> {
     private static final String REACT_CLASS = "BlurView";

     private static final int defaultRadius = 10;
     private static final int defaultSampling = 10;

-    private static ThemedReactContext context;
-
     @Override
     public @Nonnull String getName() {
         return REACT_CLASS;
     }

     @Override
-    public @Nonnull BlurringView createViewInstance(@Nonnull ThemedReactContext ctx) {
-        context = ctx;
-
-        BlurringView blurringView = new BlurringView(ctx);
-        blurringView.setBlurRadius(defaultRadius);
-        blurringView.setDownsampleFactor(defaultSampling);
-        return blurringView;
+    public @Nonnull BlurView createViewInstance(@Nonnull ThemedReactContext ctx) {
+        BlurView blurView = new BlurView(ctx);
+        View decorView = Objects.requireNonNull(ctx.getCurrentActivity()).getWindow().getDecorView();
+        ViewGroup rootView = decorView.findViewById(android.R.id.content);
+        Drawable windowBackground = decorView.getBackground();
+        blurView.setupWith(rootView)
+            .setFrameClearDrawable(windowBackground)
+            .setBlurAlgorithm(new RenderScriptBlur(ctx))
+            .setBlurRadius(defaultRadius)
+            .setHasFixedTransformationMatrix(true);
+        return blurView;
     }

     @ReactProp(name = "blurRadius", defaultInt = defaultRadius)
-    public void setRadius(BlurringView view, int radius) {
+    public void setRadius(BlurView view, int radius) {
         view.setBlurRadius(radius);
         view.invalidate();
     }

     @ReactProp(name = "overlayColor", customType = "Color")
-    public void setColor(BlurringView view, int color) {
+    public void setColor(BlurView view, int color) {
         view.setOverlayColor(color);
         view.invalidate();
     }

     @ReactProp(name = "downsampleFactor", defaultInt = defaultSampling)
-    public void setDownsampleFactor(BlurringView view, int factor) {
-        view.setDownsampleFactor(factor);
+    public void setDownsampleFactor(BlurView view, int factor) {
     }

     @ReactProp(name = "viewRef")
-    public void setViewRef(BlurringView view, int viewRef) {
-        if (context != null && context.getCurrentActivity() != null) {
-          View viewToBlur = context.getCurrentActivity().findViewById(viewRef);
-
-          if (viewToBlur != null) {
-              view.setBlurredView(viewToBlur);
-          }
-        }
+    public void setViewRef(BlurView view, int viewRef) {
     }
 }

I couldn't get it to work. Are you sure ?

I made a PR if you wanna contribute, I was full of hope, but no success on my side :'(

Did it fail to compile or did it not produce the expected result?

Sorry, I wasn't very clear.
No problem for the compilation, but I don't get any background. Basically, I just get a transparent background.
Were you able to get it to work correctly ? It might come from my side, i'm not sure

Hi, I made a working demo at https://github.com/mo22/blur-test
There looks to be an issue with the exact border of the blurred area (that's the Platform.select part in the blur view with the margins). Not sure where that comes from.

I'm also seeing good results with the diff. I noticed https://github.com/react-native-community/react-native-blur/pull/358, what's holding us back from getting this merged?

should be
setHasFixedTransformationMatrix(false)

in the settings, that fixes some offset errors.

Hi,
This PR is gonna take care of it :
https://github.com/react-native-community/react-native-blur/pull/358 no more need for viewRef on Android AND BlurView can have children now.


replaceState throws away functions in 0.13

I'm still learning React, so it's possible I'm misunderstanding something.
I'm trying to use React with Immutable.js, and hit a stumbling block, by upgrading to React 0.13. There a wiki page on the immutable.js repository, that explains how to use immutable as a react state, and it provides the following example (I transpiled it to ES3):
'use strict';

var React = require('react');
var Immutable = require('immutable');

var Component = React.createClass({

  getInitialState: function() {
    return Immutable.Map({count:0});
  },

  handleClick: function() {
    this.replaceState(this.state.update('count', function(v) { return v + 1 }));
  },

  render: function() {
    return (
      <div onClick={this.handleClick}>
        {this.state.get('count')}
      </div>
    );
  }

});

React.render(<Component />, document.body);

This works great in 0.12, but in 0.13, you will receive the following error when clicking on the div:
TypeError: this.state.get is not a function
this.state.get('count')

Putting a breakpoint on the error, and inspecting this.state with a debugger reveals that all the methods on this.state have disappeared.
Is this the expected behavior in 0.13?

Sorry, I wanted to open this on the react issue list.
https://github.com/facebook/react/issues/3418


Resolve "Rejected valid signal name"

Close #2076: add analog as potential AMS-dialect word in parser according to https://github.com/chipsalliance/verible/issues/2076#issuecomment-1919763868

This creates a shift-reduce conflict, so the grammar probably has to be massaged more.

This is essentially an ambiguity in the grammar where the parser might not be able to decide. One problem is, that now TK_analog is part of multiple rules, and these rules might both be matched. Next step would probably to check the original location of where Tk_analog and see if it can be replaced with KeywordIdentifier and still keep the semantics.
There are probably also a bunch of resources 'on the net' for shift/reduce conflicts resources.

There should be a file generated in bazel-bin/verilog/parser/verilog.output which might be helpful

The verilog.output file is a "human-readable" state machine of the parser, which explains how conflicting states are reached.


Maximum size for channel data (sourceEvent)

Hello. Is there a maximum size for the sourceEvent data. We're looking to send quite a bit of data down with some of the responses through the Directline API. However, I've seen a couple of times, where none of the data comes through. These tend to be slightly larger responses than the others.
Is there a maximum size?
Thanks.

At the moment it's around 64kB, although it may be lower due to encoding. You'll get a synchronous error if you exceed the size (although my guess is that the error is probably a 500 and not a 4xx code). Is this consistent with what you're seeing?

I'm assuming Dan's response resolved your issue.  Closing this due to inactivity.


docs: logo customization

Added documentation on how to customize the logo.

Nice work; thanks a lot!
If you spot other possible improvements from the documentation, I would he happy to merge them!


Room validation failed

Validation Error: rooms validation failed: amdin: Path 'admin' is required
When I join with other account use by share link appear this, How to solve?

Sir when want to peer to peer (use copy link) always error cant join in the same times

https://soumen-video-calling-app.herokuapp.com/6e97047e-3cd3-4fa7-834b-e2041163b0b7

I too got the same error
and if i join with other account the other person's video is not visible...

Just uncomment the line having  port: "3000"

I guess this problem still exists
although no error showing in the terminal but this is what i get
Cannot GET /http://localhost:3000/9b612b4f-8dac-4b08-8b3a-c36e5ea92131

Me too.... I too tried to debug but not able to find...
On Sun, Apr 18, 2021 at 5:24 PM SamTheDemon @.***>
wrote:

I guess this problem still exists
although no error showing in the terminal but this is what i get
Cannot GET /http://localhost:3000/9b612b4f-8dac-4b08-8b3a-c36e5ea92131
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/50UM3N/video-chat/issues/6#issuecomment-821979805,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASEREYUUJGEYEDXIZOH7ZM3TJLCAZANCNFSM4ZVRTNVA
.

I guess this problem still exists
although no error showing in the terminal but this is what I get in the browser
Cannot GET /http://localhost:3000/9b612b4f-8dac-4b08-8b3a-c36e5ea92131

In which browser mobile or desktop?

I guess this problem still exists
although no error showing in the terminal this is what I get in the browser
Cannot GET /http://localhost:3000/9b612b4f-8dac-4b08-8b3a-c36e5ea92131

In which browser mobile or desktop?

I tried it on Microsoft Edge, Google Chrome, and Opera Browser, none worked.

I tried it in Google chrome , Internet Explorer, and even safari using my
friends laptop but it did'nt work...
I guess there is some port issue...
On Mon, Apr 19, 2021 at 2:24 PM SamTheDemon @.***>
wrote:

I guess this problem still exists
although no error showing in the terminal this is what I get in the browser
Cannot GET /http://localhost:3000/9b612b4f-8dac-4b08-8b3a-c36e5ea92131
In which browser mobile or desktop?
I tried it on Microsoft Edge, Google Chrome, and Opera Browser, none
worked.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/50UM3N/video-chat/issues/6#issuecomment-822296407,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASEREYSRZVKYFC2O5SJRXRDTJPVSRANCNFSM4ZVRTNVA
.

Let me add that even the Demo you have in README.md has the same problem

@50UM3N  Is there anything about the error I tried to debug but I keep getting this  UnhandledPromiseRejectionWarning: ValidationError: rooms validation failed: admin: Path "admin" is required.

@50UM3N  On server.js on the socket.on("join-room") callback I saw that you only use socket.join on the else part of code,  and on the if and else if statements don't really have socket.join  i guess they should have  I tried nothing worked but maybe I tried it wrong.


stc("orange") returns #000000

Dependency for hex-rgb has been changed from<EMAIL_ADDRESS>to<EMAIL_ADDRESS>or higher).
In<EMAIL_ADDRESS>hexRgb('#cd2222cc');
//=> {red: 205, green: 34, blue: 34, alpha: 0.8}
hexRgb('#cd2222cc', {format: 'array'});
//=> [205, 34, 34, 0.8]
Stc code assumes the format as array, thus in index.js line 22:
if (color) colors.push(hexRgb(trimStart(color, '#')));
Should be replaced with:
22    if (color) colors.push(hexRgb(trimStart(color, '#'), {format: 'array'}));
as array is no longer the default result format in<EMAIL_ADDRESS>

Fixed by @psigns. Thanks!

Fixed in v2.2.2


Enable funlen linter (part 7)

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Pull request type

Please check the type of change your PR introduces:

[ ] Bugfix
[ ] Feature
[x] Code style update (formatting, renaming)
[x] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] Documentation content changes
[ ] Other (please describe):

What is the current behavior?

Issue Number: 934
What is the new behavior?

Other information

Codecov Report
Attention: Patch coverage is 19.73684% with 61 lines in your changes are missing coverage. Please review.

Project coverage is 40.82%. Comparing base (b7a9b51) to head (8749d66).
Report is 226 commits behind head on master.

Files
Patch %
Lines

internal/xsql/conn.go
0.00%
57 Missing :warning:

...al/topic/topicwriterinternal/writer_reconnector.go
78.94%
4 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1252      +/-   ##
==========================================
+ Coverage   40.80%   40.82%   +0.02%
==========================================
  Files         309      317       +8
  Lines       32747    33568     +821
==========================================
+ Hits        13361    13704     +343
- Misses      18959    19395     +436
- Partials      427      469      +42

Flag
Coverage Δ

go-1.20.x
42.86% <19.73%> (?)

go-1.21.x
42.92% <19.73%> (-0.01%)
:arrow_down:

go-1.22.x
40.75% <19.73%> (-0.04%)
:arrow_down:

macOS
?

ubuntu
?

unit
40.82% <19.73%> (+0.02%)
:arrow_up:

windows
40.82% <19.73%> (+0.03%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[CI] It is not obvious where to find hs_err_pid files in CI

This issue is more of requirement gathering thing. We have seen a few CI failures that ended up being a segfault, but getting the hs_err_pid files is hard somehow, because each CI is writing those files to a specific location.
I think we should use -XX:ErrorFile to point it somewhere easy to find. @NVnavkumar suggested the workskace that jenkins is using and will copy out later, so these files would be carried along.
I am not an expert on all of the CI jobs, but I think we would want to set this per job since each job has its own paths.

Yeah, this could go huge as we have too many different scenarios to run w/ JVM in CIs.
As this is good to have and would not block prod release,
I will update the ticket when I have time, let's split this into multiple items and tackle them one by one later.

removed bug tag as its not a BUG

Nightly updates were applied in internal pipelines


scale to side node

not really an issue but were are you getting the scale to side node?

those are coming from this package: https://github.com/Derfuu/Derfuu_ComfyUI_ModdedNodes
It mostly contains the scaling nodes, I have not personally used any of the other nodes

those are coming from this package: https://github.com/Derfuu/Derfuu_ComfyUI_ModdedNodes
It mostly contains the scaling nodes, I have not personally used any of the other nodes

thanks


VM BOOT VERY SLOW(more than 2000ms)

kernel version: 4.9.48
qemu version: 2.10.0 (with qboot bios)
hyperd version: master
i did as document, but finally:
# hyperctl run -d --name centos7-test-1 --cpu=2 --memory=1024 --restart=always centos:7 sleep 86400
POD id is centos7-test-3
Time to run a POD is 2357 ms

I tried many times, but never below 2000ms
What went wrong?

@haoyixin you can't enable qboot with default kernel/initrd because of the rom size restriction of qboot. The size of kernel/initrd is a trade off between footprint and functionality. However, if you enable the template/cache configuration in the configuration file, it could start in a few hundred milliseconds with the bigger kernel/initrd.

I have the same problem,even worse


The target entry-point "ng-particles" has missing dependencies:  - tsparticles

I have installed ng-particles using npm and importing it in my app.module.ts file. But, angular app is not running and throwing an error:
The target entry-point "ng-particles" has missing dependencies:

tsparticles

I do not know how to use the tsparticles in my angular app as their official documentation refers to ng-particles for angular framework.

Hi @kiyani1995,
You need to install tsparticles as well, the ng-particles is wrapped around the core library.
Once installed tsparticles you don't need to do anything else with that, it's just for being correctly included in the project correctly.


This causes problems with commits in the build directory.

@rstarmer would you approve this PR? Files in the TLD must be approved by leadership.
Thank you,
-steve


fix: Remove wrong calculation for Murmur3Hash for float with null input

Which issue does this PR close?
Closes #.
Rationale for this change
While developing #226, I noticed the rust implementation of Murmur3Hash doesn't handle float with null input correctly.
This PR fixes that correctness issue.
What changes are included in this PR?

remove extra and wrong hash calculation in hash_array_primitive_float macro
update unit test to include null input

How are these changes tested?
Updated test

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 33.58%. Comparing base (a86626a) to head (c9b1194).

Additional details and impacted files
@@            Coverage Diff            @@
##               main     #245   +/-   ##
=========================================
  Coverage     33.58%   33.58%
  Complexity      780      780
=========================================
  Files           107      107
  Lines         37212    37212
  Branches       8161     8161
=========================================
+ Hits          12496    12497    +1
+ Misses        22076    22075    -1
  Partials       2640     2640

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Merged. Thanks.


IN PROGRESS: User Guide update

Coverage remained the same at 86.985% when pulling 88f752140fa50654d8cb359fc2d35d2daa74443c on denzelchung:ug-update into dccabd59c6f981ece9c051184dd374acff55ab39 on CS2103-AY1819S1-W13-1:master.


user term is broken

 ~/miniconda3/bin/python3  -O dig.py  ../benchmark/c/nla/sqrt1.c -nominmax -nocongruences -noeqts -uterms "y**2"

partial fix,  now still have issue with this
~/miniconda3/bin/python3  -O dig.py  ../tests/traces/cohendiv.csv -nominmax -nocongruences -noeqts -uterms "y+4" -log 4


odd behaviour with python3.12

Hello and greetings,
Trying to install imagetext-py in a python3.12 virtual environment results in pip installing old version 1.0.2 and I couldn't quite figure out why it happened (latest version on pypi is v2.1.3) so I decided to open the issue. Screenshot:

i haven't added a build for 3.12 yet, I'll set it up

i haven't added a build for 3.12 yet, I'll set it up

need support for Python12.3, or could you tell me how to use it on 12.3 by my own?

@owocado @Cathgao, support for python3.12 has been added.


Add to Favorites

Hi,
Is it possible to simplify the management of favorites with, for example, the addition of an icon to like and add the album to our favorites.
Ex: I am listening to a Qobuz album, and by clicking on a heart icon, I go directly to the favorites management screen.
Even better, add it to the different contectual menus.
Thank you for your work.

Material already adds an action to add, or remove, a favourite to the context menu (three dots next to each item) where applicable. For this to work the apps needs to provide a favorite_url - which, for example, the YouTube app does.
Sorry, but I do not use Qobuz, or any other streaming service, so cannot comment on how these work. However, if favorite_url is returned by these services then an entry will be in the context menu.

Re-reading this, sorry, I assume you mean to manage your Qobuz favourites - not LMS's favourites. e.g. so that you can favourite an album in Qobuz and have LMS integrate that with its local library. While I can see the use case, its not something I can do - as LMS does not provide the controller with access to enough info to do this. And, as stated, I do not use Qobuz so could not even experiment to see if I could implement a work-around to enable this.

Hello,
I understand that my request is not easy.
In fact, the favorites must be established in the service used (qobuz, spotify, ...) and not in the LMS favorites.
For example, by clicking on a heart on the home screen, the favorites are added to the service used if possible (spotify, qobuz, ...)
In general, perhaps this "heart" could appear if the function is available as for Youtube, like what is done on official applications.
Thank you and happy new year
Sorry for my poor English, I'm French and google translator is my friend ;-)

The heart icon appears in Material if an item defines a 'favorite_url' - but this is only for LMS favourites. If this is not specified, Material has no way of knowing how to favourite.
As to adding to a service's favourites, sorry but (as stated) LMS does not provide the required info.
Also, please do not apologise for your English - its<PHONE_NUMBER>00% better than my French! Bonne année!

Hello,
I have just tested and it is possible to add an album / song favorites in Qobuz or Spotify via the info then the service and then via the management of favorites.
It would be great if we could, depending on the service used, directly land on this menu from the playback interface.
With for example a heart and by clicking on it, we come across the favorites menu of the service and we can thus, very quickly, add in favorites (on the streaming service), an album, an artist or a song.
I made a little GIF to show the process.
In the end, the album ended up in favorites, directly on Qobuz.
I don't know if I am very clear! :-D

Sorry, but no - there is no standard API for this. You would need to create an issue on the LMS github site to create an API to add favourites to a service, detect if item is favourited, remove favourite, etc. Only then could it be used in Material, and other UIs.

Issue open : https://github.com/Logitech/slimserver/issues/744
Let's see !


[MINOR][0.7] Avoid returning null in defaultUserApps when quota file does't config user

What changes were proposed in this pull request?
map.getOrDefault() => map.computeIfAbsent()
Why are the changes needed?
If do not define the user and app num  in the quota configuration file, it will appear that the defaultUserApps does not have the corresponding app number for this user, because we did not include the quotaAppNum in the defaultUserApps.
before :
The log from coordinator is [ERROR] 2023-03-28 19:24:11,18 Grpc-260 AccessAppQuotaChecker check - Denied by AccessAppQuotaChecker => User: xxxx, current app num is: 3, default app num is: null.
after :
The log from coordinator is [ERROR] 2023-03-31 14:32:21,228 Grpc-240 AccessAppQuotaChecker check - Denied by AccessAppQuotaChecker => User: xxxx, current app num is: 3, default app num is: 3.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Origin uts.

PTAL. @jerqi Thanks!

Codecov Report

Merging #822 (48c4246) into branch-0.7 (bcb591e) will increase coverage by 2.26%.
The diff coverage is 100.00%.

@@               Coverage Diff                @@
##             branch-0.7     #822      +/-   ##
================================================
+ Coverage         60.78%   63.04%   +2.26%
- Complexity         1792     1793       +1
================================================
  Files               214      200      -14
  Lines             12374    10403    -1971
  Branches           1045     1045
================================================
- Hits               7521     6559     -962
+ Misses             4449     3500     -949
+ Partials            404      344      -60

Impacted Files
Coverage Δ

...a/org/apache/uniffle/coordinator/QuotaManager.java
85.29% <100.00%> (ø)

... and 14 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


IBMi DB2 / AS400 - Auto Generated / Auto Increment not correctly showing

System information:

Operating system (distribution) and version:
Windows 10 / 64bit
DBeaver version:
21.0.1 and 21.0.2. Also verified issue in 6.0.0
Additional extensions:
None

Connection specification:

Database name and version:
com.ibm.as400.access.AS400JDBCDriver, jt400-10.5.jar (10.5)
Driver name:
JT400 / com.ibm.as400.access.AS400JDBCDriver
Do you use tunnels or proxies (SSH, SOCKS, etc)?
No

Describe the problem you're observing:
When viewing the column properties on the table it is not identifying identity columns on the table properly and showing us they auto-increment.
Example:

You can see the fields are not marked as auto incrementing, even though it is an identity column which if I use the native ACS viewer from IBM I see this:

Steps to reproduce, if exist:
Double click a table with an identity column in DBeaver to bring up that tables property window.
Include any warning/errors/backtraces from the logs

No warnings.

Hello @xantari
Please add table DDL info for tests. I can't reproduce it for now for DB2 LUW.

This is for DB2 for IBMi, which is a different DB2 dialect then LUW and uses a different JDBC driver then the LUW version.
Here is the DDL:
CREATE TABLE ARRTFLIB.CEACTIVITYAPIUSERS FOR SYSTEM NAME CEACTAPIU (
	IDSPROVIDERID FOR COLUMN IDSPROID   INTEGER GENERATED ALWAYS AS IDENTITY (
	START WITH 1 INCREMENT BY 1
	NO MINVALUE NO MAXVALUE
	NO CYCLE NO ORDER
	NO CACHE )
	,
	CLIENTID VARCHAR(200) CCSID 37 NOT NULL ,
	ALLSPONSORACCESS FOR COLUMN ALLSPAXS   SMALLINT NOT NULL DEFAULT 0 ,
	CONSTRAINT ARRTFLIB.Q_ARRTFLIB_CEACTAPIU_IDSPROID_00001 PRIMARY KEY( IDSPROVIDERID ) )

	RCDFMT CEACTAPIU  ;

LABEL ON TABLE ARRTFLIB.CEACTIVITYAPIUSERS
	IS '-CEACTIVITYAPIUSERS' ;

LABEL ON COLUMN ARRTFLIB.CEACTIVITYAPIUSERS
( IDSPROVIDERID TEXT IS 'Identity Server PoviderID' ,
	CLIENTID TEXT IS 'Client ID' ,
	ALLSPONSORACCESS TEXT IS 'All sponsor access flag' ) ;

Ok, thanks for the bug report.
For AS400 DBeaver shows only what the driver gives. So maybe this is a driver issue.
We don't have a DB2 AS400 test environment for testing, unfortunately. Therefore we can't fix it now. Maybe someday.

@xantari This driver can be very sensitive to it's properties and changing their default values can fix some issues for some people, but break something for others. So my advice to you for now is to try carefully tweaking them (or first looking in the documentation for a needed property) to test if it can be changed

@Matvey16 Thanks, I did some experimentation and found a result that does show the auto increment properties properly. But then it messes up the column retrieval information.
Here is what I had:

metadata source: 0
translate binary: true
date format: iso
time format: iso
extended metadata: false

With the above settings you get the column names in addition to the column text underneath the column as follows when you do a select * from table:

To fix the identity column information issue I then changed it to the following:

metadata source: 1
translate binary: true
date format: iso
time format: iso
extended metadata: true

So lines #1 and #5 above were changed. You can not leave metadata source: 0 and just leave "extended metadata" to true. As that still doesn't allow you to view the identity column information, even though the documentation says it should.
The problem now though, is with #1 and #5 above changed I now get this when viewing that same table as above:

As you can see in the above image, though I've fixed the issue with the identity column property info now being displayed in DBeaver, I have completely lost the column names on the result sets.

So a bit more experimentation.
Used the following driver properties:
metadata source: 1
translate binary: true
date format: iso
time format: iso
extended metadata: true
When I have this unmarked:

I get this:

When marking it:

I get the column names back:

Now, I figured how do I get the column headers back. And I noticed this property in DBeavber:

It was already marked. and should show the column description/labels in the header right? Kinda wondering if this is now a DBeaver bug.

Closing this in favor of #13335 since the original issue this report is about is fixed, but a separate issue has now cropped up.

Ok, thanks for the bug report.
For AS400 DBeaver shows only what the driver gives. So maybe this is a driver issue.
We don't have a DB2 AS400 test environment for testing, unfortunately. Therefore we can't fix it now. Maybe someday.

You may be able to get a free IBM i account at https://pub400.com/.


Drag And Drop Not so intutive (enhancement)

when I am exploring concore-editor and didn't know that I can even drap and Drop files
Suggestion :- UI of the left sidebar can be improved , so that users may know that they can also drag and drop
This we can also mention in our docs but I suggest it is more better that if we also we show this option on our UI as it increases User experience

": didn't know that I can even drap and Drop files"
What do you mean by "drag and drop files" from the left sidebar? Can you please elaborate?
I am not aware of that feature (unless one of the developers left an Easter Egg).

I mean that on left sidebar , we should providec an option showing "drag and drop files" to open them
As it is no where seen on the concore-editor that It provide the option of opening the files by dragging and droping

"As it is no where seen on the concore-editor that It provide the option of opening the files by dragging and droping"
Yes, it is not an expected feature. (or am I misreading your report)?
How did you open a program by drag-and-dropping?

Like this type of thing to upload program files

We do not support drag-and-drop in concore editor.
The options to open the files are:

Open the individual studies (graphml).
Open the whole folder with programs (anything textual actually. but mostly .py, .cpp, .m, .v, ...) via "Upload Directory."

Closing for the same reason as #81.
We lack documentation.
Hopefully, as part of the GSoC project idea, the contributor will pay more attention to make a documentation that supports new users to get started.

hey @pradeeban , are you not keeping it as an enhancement feature

No, @parteekcoder.
At this point, I recommend you look at the open bugs and understand concore through the paper. While I appreciate your Q&A effort, we should use the time (both yours as a contributor and ours as a mentor) more effectively.

The concore repository is at https://github.com/ControlCore-Project/concore (which is to be integrated with concore editor).

I understand the pain of using new software without proper user documentation. Being a research organization, we should pay more attention to documentation. We will make that a top priority for the GSoC 2023 projects.
Thanks for your contributions and efforts.

yeah , Along with the interation I can also help in building documentation
Is there any documentation existing now for concore editor?
If not we can create a "docs" project for concore editor along with integration

The only documentation we have for concore editor is the README file. We need documentation with screenshots.
We cannot have "Docs" only projects as part of GSoC (that is against the rules of GSoC. GSoC projects must be primarily development tasks).
The project idea [1] An Integrated CONTROL-CORE experience. should incorporate the documentation. It is not a difficult undertaking. Just documentation was left as a second-throught in some of the past GSoC projects as we paid more attention to developing.